CN111179541A - Safety monitoring method and intelligent sound box - Google Patents

Safety monitoring method and intelligent sound box Download PDF

Info

Publication number
CN111179541A
CN111179541A CN201911039238.4A CN201911039238A CN111179541A CN 111179541 A CN111179541 A CN 111179541A CN 201911039238 A CN201911039238 A CN 201911039238A CN 111179541 A CN111179541 A CN 111179541A
Authority
CN
China
Prior art keywords
sound box
intelligent sound
monitored person
preset time
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911039238.4A
Other languages
Chinese (zh)
Inventor
尚宇翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201911039238.4A priority Critical patent/CN111179541A/en
Publication of CN111179541A publication Critical patent/CN111179541A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0236Threshold setting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0272System arrangements wherein the object is to detect exact location of child or item using triangulation other than GPS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/02Casings; Cabinets ; Supports therefor; Mountings therein

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Alarm Systems (AREA)

Abstract

A safety monitoring method and an intelligent sound box are provided, the method comprises the following steps: the intelligent sound box outputs prompt information at regular time; the prompt information is used for indicating a monitored person to arrive at a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value; the intelligent sound box judges whether the monitored person arrives at the position within a preset time after the prompt message is output; and if not, the intelligent sound box sends alarm information to the terminal equipment bound with the intelligent sound box. By implementing the embodiment of the invention, whether the monitored person is safe or not can be detected, and when the monitored person is detected to be dangerous, the alarm information is sent in time.

Description

Safety monitoring method and intelligent sound box
Technical Field
The invention relates to the technical field of monitoring, in particular to a safety monitoring method and an intelligent sound box.
Background
At present, when a child is left at home, if the child has certain self-care capability, parents generally leave the child at home alone, and other people are not arranged to take care of the child. However, there are various safety hazards in daily life, and various safety problems may occur when a child stays at home alone. Once a safety problem occurs, if parents cannot find the safety problem in time, the treatment opportunity can be delayed, and the personal safety of children is harmed.
Disclosure of Invention
The embodiment of the invention discloses a safety monitoring method and an intelligent sound box, which can send alarm information in time when a monitored person is detected to be dangerous.
The first aspect of the embodiments of the present invention discloses a security monitoring method, which includes:
the intelligent sound box outputs prompt information at regular time; the prompt information is used for indicating a monitored person to arrive at a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value;
the intelligent sound box judges whether the monitored person arrives at the position within a preset time after the prompt message is output;
and if not, the intelligent sound box sends alarm information to the terminal equipment bound with the intelligent sound box.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the determining, by the smart speaker, whether the monitored person arrives at the position within a preset time period after the prompt information is output includes:
the intelligent sound box controls the camera device to shoot images within a preset time after the prompt information is output; if the monitored person is not identified from the image, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length; or,
the intelligent sound box judges whether a human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length; wherein the maximum detection distance of the human body proximity sensor is set as the preset distance threshold.
As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:
if the monitored person does not arrive at the position within the preset time length, the intelligent sound box controls the camera device to rotate and shoot a video;
the intelligent sound box sends the shot video to the terminal equipment, so that a user of the terminal equipment confirms the safety of the monitored person according to the video.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the monitored person arrives at the location within the preset time period and before the smart speaker sends alarm information to the terminal device bound to the smart speaker, the method further includes:
the intelligent sound box acquires verification information sent by wearable equipment worn by the monitored person; the verification information is sent by manual triggering, and the verification information comprises a wireless local area network identifier accessed by the wearable device;
the intelligent sound box judges whether the wireless local area network accessed by the wearable equipment is consistent with the wireless local area network accessed by the intelligent sound box or not according to the verification information;
and if the two signals are inconsistent, the intelligent sound box executes the step of sending alarm information to the terminal equipment bound with the intelligent sound box by the intelligent sound box.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the prompt information is at least one of a game, a video, and music.
A second aspect of the embodiments of the present invention discloses an intelligent speaker, including:
the output unit is used for outputting prompt information at regular time; the prompt information is used for indicating a monitored person to arrive at a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value;
a first judging unit, configured to judge whether it is detected that the monitored person arrives at the position within a preset time period after the prompt information is output;
and the communication unit is used for sending alarm information to the terminal equipment bound with the intelligent sound box when the first judgment unit judges that the monitored person does not arrive at the position within the preset time.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the first determining unit is specifically configured to control the image capturing apparatus to capture an image within a preset time after the prompt information is output; if the monitored person is not identified from the image, determining that the monitored person does not arrive at the position within the preset time length; or,
the intelligent sound box is specifically used for judging whether the human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, determining that the monitored person does not arrive at the position within the preset time length; wherein the maximum detection distance of the human body proximity sensor is set as the preset distance threshold.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the smart sound box further includes:
the control unit is used for controlling the camera device to rotate and shoot a video when the first judging unit judges that the monitored person does not reach the position within the preset time length;
the communication unit is further used for sending the shot video to the terminal equipment, so that a user of the terminal equipment can confirm the safety of the monitored person according to the video.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the method further includes:
the communication unit is further configured to acquire verification information sent by a wearable device worn by the monitored person after the first judging unit judges that the monitored person arrives at the position within the preset time and before sending alarm information to a terminal device bound to the smart sound box; the verification information is sent by manual triggering, and the verification information comprises an identifier of a wireless local area network accessed by the wearable device;
the intelligent sound box further comprises:
the second judging unit is used for judging whether the wireless local area network accessed by the wearable equipment is consistent with the wireless local area network accessed by the intelligent sound box or not according to the verification information; and when the inconsistency is judged, triggering the communication unit to execute the operation of sending alarm information to the terminal equipment bound with the intelligent sound box.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the prompt information is at least one of a game, a video, and music.
A third aspect of the embodiments of the present invention discloses an intelligent speaker, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute any one of the methods disclosed in the first aspect of the embodiments of the present invention.
A fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute any one of the methods disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to execute any one of the methods disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
the intelligent sound box can indicate a monitored person to approach the intelligent sound box regularly by outputting prompt information regularly, and the method is similar to card punching. The intelligent sound box judges whether the monitored person reaches a position close to the intelligent sound box within a preset time, and if not, alarm information is sent to the bound terminal equipment. That is, if the monitored person does not reach the position within the preset time period, it is considered that the monitored person may run a danger, and the indication given by the prompt message cannot be executed, so as to send the alarm message. Therefore, by implementing the embodiment of the invention, the intelligent sound box can give an alarm in time when the monitored person is detected to be dangerous.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is an exemplary diagram of a smart sound box disclosed in an embodiment of the present invention;
FIG. 2 is a flow chart of a security monitoring method according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart diagram of another security monitoring method disclosed in the embodiments of the present invention;
fig. 4 is a schematic structural diagram of an intelligent sound box disclosed in the embodiment of the present invention;
fig. 5 is a schematic structural diagram of another smart sound box disclosed in the embodiment of the present invention;
fig. 6 is a schematic structural diagram of another smart sound box disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a safety monitoring method and an intelligent sound box, which can send alarm information in time when a child is monitored to be dangerous. The following are detailed below.
In order to better introduce the security monitoring method disclosed in the embodiment of the present invention, the following description is first made on an intelligent sound box to which the method is applied. Referring to fig. 1, fig. 1 is an exemplary diagram of an intelligent sound box according to an embodiment of the present invention. As shown in fig. 1, a display screen 11 may be disposed on one side of the smart sound box body 10. The smart sound box may further include a camera device 20, the camera device 20 may be lifted, and after the camera device 20 is lifted, the camera device 20 may further rotate, so as to change a viewing range of the camera device 20. For example, the camera 20 may be disposed on the top of the main body 10, and the camera 20 may be turned around a rotation axis parallel to the top of the main body 10, so that the viewing range of the camera 20 may be changed at least from a placement plane (as shown in fig. 1) facing the smart sound box to a position facing the front of the display screen 11. Alternatively, the camera device 20 can rotate around a rotating shaft perpendicular to the top of the main body 10, so that the view range of the camera device 20 includes a circle with the smart sound box as the center. When the camera device 20 descends, the camera device 20 can be hidden in the groove of the main body 10, so that the intelligent sound box is more attractive in appearance.
In addition, one or more of a human body proximity sensor, a microphone, and a speaker may be provided inside the main body 10. The human body proximity sensor is used for detecting the action of a human body approaching the intelligent sound box. Illustratively, the human proximity sensor may include at least one of a pyroelectric infrared sensor, an ultrasonic sensor, and an infrared sensor. When the pyroelectric element of the pyroelectric infrared sensor detects that the infrared radiation temperature of a human body changes, electric charges are released outwards, so that a signal for indicating that the human body is detected is triggered. The ultrasonic sensor can detect the movement of a human body by using the Doppler effect of ultrasonic waves; the infrared sensor can judge that the human body approaches by detecting the infrared energy reflected after the emitted infrared rays are blocked by the outside.
Example one
Referring to fig. 2, fig. 2 is a schematic flow chart of a security monitoring method according to an embodiment of the present invention. As shown in fig. 2, the security monitoring method may include the steps of:
201. and the intelligent sound box outputs prompt information at regular time.
In the embodiment of the invention, the intelligent sound box can be placed on furniture such as a desk, a cabinet, a storage rack and a chair. Generally speaking, the placement position of the smart speaker is relatively fixed within a period of time, so that the smart speaker can be used as a card-punching point. The intelligent sound box outputs prompt information at regular time, and the prompt information is used for indicating a monitored person to arrive at a position where the distance from the intelligent sound box is smaller than a preset distance threshold value, namely indicating the monitored person to be close to the intelligent sound box so as to punch a card. The frequency of the intelligent sound box for outputting the prompt message at regular time can be preset. For example, the prompt message may be output every 1 hour or 1.5 hours.
Optionally, the prompt message may be at least one of multimedia contents such as games, videos, music, and the like. The intelligent sound box can output text or image content in the prompt message through the display screen 11; and outputting the voice content in the prompt message through a loudspeaker. Through outputting the multimedia content, the interestingness of the prompt message can be improved, and the monitored person is attracted to be close to the intelligent sound box actively.
202. The intelligent sound box judges whether the monitored person arrives at the position within a preset time after the prompt message is output; if yes, ending the process; if not, step 203 is performed.
In the embodiment of the present invention, the preset time duration may be set by referring to an average time taken by a monitored person to travel from any position of a house to a position of the smart speaker. For example, the preset time period may be set to 5 minutes, 8 minutes.
As an alternative implementation, in the embodiment of the present invention, step 202 may include, but is not limited to, the following implementation manners:
(1) the intelligent sound box controls the camera device 20 to shoot images within a preset time after the prompt information is output; if the monitored person is not identified from the image, the intelligent sound box determines that the monitored person is not detected to reach the position within the preset time.
In the embodiment of the invention, the intelligent sound box can continuously shoot within the preset time after the prompt message is output. It will be appreciated that the camera device 20 may be raised from the recess of the body 10 prior to capturing an image, to facilitate the capture by the camera device 20.
Aiming at the shot image, the intelligent sound box can extract the image characteristics of the image and match the extracted image characteristics with the preset human body image characteristics to identify whether a monitored person exists in the image. Or, a large amount of image information of the monitored person can be collected and marked in advance, and the marked image information of the monitored person is utilized to train the image recognition model; the image recognition model can be a deep neural network model, a support vector machine model and the like; the trained image recognition model can be stored at the cloud end of the intelligent sound box or the intelligent sound box locally, after the intelligent sound box shoots an image within a preset time after the prompt information is output, the image recognition model can be called, the shot image is input into the image recognition model, the output result of the image recognition model is obtained, and the output result can indicate whether a monitored person exists in the shot image or not.
In addition, as an optional implementation manner, before controlling the camera device 20 to shoot an image, the smart sound box may further obtain a first audio signal collected by a microphone of the smart sound box;
the intelligent sound box identifies the sound source position in the first audio signal;
the smart speaker controls the camera device 20 to rotate, so that the viewing range of the camera device 20 faces the sound source position.
The rotation mode of the image capturing device 20 may be rotation or inversion. In the embodiment of the invention, when the monitored person approaches the sound box, sounds such as footsteps and the like are generated. By implementing the above embodiment, the smart sound box adjusts the viewing range of the camera device 20 according to the recognized sound source position, so that the camera device 20 can face the walking direction of the monitored person, thereby increasing the possibility that the camera device 20 can shoot the monitored person.
(2) The intelligent sound box judges whether a human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length.
In the embodiment of the present invention, the maximum detection distance of the human body proximity sensor may be set as a preset distance threshold. When the monitored person comes within the detection range of the human body proximity sensor, the human body proximity sensor may trigger a signal indicating that a human body is detected.
Further optionally, in the implementation (2) above, after the human body proximity sensor detects a human body, the following steps may be further performed:
the intelligent sound box acquires a second audio signal acquired by a microphone of the intelligent sound box;
the intelligent sound box verifies the user voiceprint characteristics in the second audio signal by utilizing the legal voiceprint characteristics of the monitored person;
and if the user voiceprint characteristics are not consistent with the legal voiceprint characteristics, determining that the monitored person arrives at the position within the preset time length.
That is to say, by executing the above steps, it can be further determined whether the human body approaching the smart speaker is a specific monitored person or not through the voiceprint feature, so that the monitoring target of the smart speaker can be locked, and the smart speaker can monitor the safety of the specific monitored person.
In the embodiment of the present invention, if it is not detected that the monitored person reaches the above position within the preset time period, it may be considered that the monitored person may encounter a danger, so that the instruction given by the prompt message (i.e. approaching the smart speaker) cannot be executed.
203. And the intelligent sound box sends alarm information to the terminal equipment bound with the intelligent sound box.
In the embodiment of the present invention, the terminal device bound to the smart speaker may be a smart phone, a smart tablet, a smart watch, a bracelet, a personal computer, or the like, and is not limited specifically. The alarm information sent by the smart speaker may be sent to the terminal device in one or more forms of text, voice, and image through communication manners such as mail, short message, instant messaging message, and notification message, which is not limited specifically. The alarm information is used for indicating that a monitored person possibly encounters danger so as to remind a user of the terminal equipment to confirm.
In addition, the intelligent sound box attracts a monitored person to approach the intelligent sound box in a mode of outputting prompt information at regular time, so that the safety of the monitored person can be monitored, and the monitored person can be reminded of pausing in the processes of learning, working and entertainment. For example, when a child learns at home alone, the smart sound box outputs prompt information at regular time, and after seeing or hearing the prompt information, the child needs to put down the content being learned and walk from a study room to a living room where the smart sound box is placed; if intelligent sound box does not detect that child is close to intelligent sound box in predetermineeing the duration, can send alarm information to parent's terminal equipment, this alarm information is used for instructing that child's study time is too long, and the parent can contact with child in due time, reminds child's the combination of working and ease.
It can be seen that in the method described in fig. 2, the smart speaker attracts the monitored person to actively approach the smart speaker for card punching by outputting the prompt message at regular time. If the intelligent sound box does not detect that the monitored person reaches a position close to the intelligent sound box within the preset time length, alarm information is sent to the bound terminal equipment to prompt that the monitored person of a user of the terminal equipment is possibly dangerous, so that the user of the terminal equipment can know the safety condition of the monitored person in time. In addition, the intelligent sound box can remind a monitored person to pause in time in the process of learning, working and entertainment by outputting prompt information at regular time.
Example two
Referring to fig. 3, fig. 3 is a flowchart illustrating another security monitoring method according to an embodiment of the present invention. As shown in fig. 3, the security monitoring method may include the steps of:
301. and the intelligent sound box outputs prompt information at regular time.
In the embodiment of the invention, the prompt message is used for indicating that the monitored person reaches the position where the distance from the intelligent sound box is less than the preset distance threshold value. Optionally, the prompt message may be at least one of multimedia contents such as games, videos, music, and the like.
302. The intelligent sound box judges whether the monitored person arrives at the position within a preset time after the prompt message is output; if yes, ending the process; if not, step 303 is performed.
In the embodiment of the present invention, step 302 may include, but is not limited to, the following implementation manners:
(1) the intelligent sound box controls the camera device 20 to shoot images within a preset time after the prompt information is output; if the monitored person is not identified from the image, the intelligent sound box determines that the monitored person is not detected to reach the position within the preset time.
(2) The intelligent sound box judges whether a human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length; wherein, the maximum detection distance of the human body proximity sensor is set as a preset distance threshold.
303. The intelligent sound box acquires the verification information sent by the wearable device worn by the monitored person.
In the embodiment of the invention, the verification information is sent by manual triggering, and the verification information comprises the identification of the wireless local area network accessed by the wearable device.
For example, the wearable device may be a smart watch or a bluetooth headset, and the monitored person may trigger the verification information by continuously pressing a key on the wearable device; alternatively, the verification message may be triggered by tapping the housing of the wearable device, which is not limited in particular. The wlan id included in the check signal may be a name of the wlan or a media access control address (MAC) of the wlan, which is not limited specifically.
304. The intelligent sound box judges whether the wireless local area network accessed by the wearable equipment is consistent with the wireless local area network accessed by the intelligent sound box or not according to the verification information; if yes, ending the process; if not, step 305 to step 306 are executed.
In the embodiment of the invention, the intelligent sound box can specifically compare whether the identifier of the wireless local area network accessed by the wearable device is consistent with the identifier of the wireless local area network accessed by the intelligent sound box; if the intelligent sound box and the wearable device are consistent, the intelligent sound box and the wearable device can be considered to be connected to the same wireless local area network, the monitored person is located in a house where the intelligent sound box is located, and the monitored person is safe; if the two are not consistent, the monitored person may have left the house where the smart sound box is located, and the abnormal situation is considered, so that the steps 305 to 306 are triggered to be executed to perform alarm prompting.
By implementing the steps 303 to 304, the monitored person can punch a card by using the wearable device when the monitored person is inconvenient to walk near the smart sound box. For example, when the smart speaker outputs a prompt, the monitored person may be in a washroom and may not be able to leave for a short period of time. At this moment, the person being monitored can send check-up information through the wearable equipment manual trigger of wearing, and intelligent sound box does not send alarm information when verifying out the person being monitored in the house at intelligent sound box place according to this check-up information to can reduce the wrong report.
305. And the intelligent sound box sends alarm information to the terminal equipment bound with the intelligent sound box.
306. The intelligent sound box controls the camera device to rotate and shoot videos, and the shot videos are sent to the terminal equipment, so that a user of the terminal equipment confirms the safety of a monitored person according to the videos.
In the embodiment of the present invention, the smart speaker can also control the camera device 20 to rotate, and a video is shot in the rotation process of the camera device 20, and the video can include the environment around the smart speaker, so that a user of the terminal device can conveniently confirm the safety of a monitored person.
It can be seen that, in the method described in fig. 3, the smart speaker may output the prompt message at regular time to attract the monitored person to actively approach the smart speaker, and if it is not detected that the monitored person approaches the smart speaker within the preset time period, send the alarm message to the terminal device to remind the user of the terminal device to confirm the security of the monitored person. In addition, the smart sound box can also acquire the verification information sent by the wearable device worn by the monitored person, and the safety of the monitored person is verified by utilizing the verification information, so that the monitored person can conveniently punch a card by utilizing the wearable device when the monitored person does not conveniently reach the position close to the smart sound box. Furthermore, when the intelligent sound box does not detect that the monitored person is close to the intelligent sound box within the preset time, the intelligent sound box can also send videos to the terminal equipment, so that a user of the terminal equipment can confirm the safety of the monitored person according to the videos.
EXAMPLE III
Referring to fig. 4, fig. 4 is a schematic structural diagram of an intelligent sound box according to an embodiment of the present invention. As shown in fig. 4, the smart speaker may include:
an output unit 401, configured to output prompt information at regular time; the prompt message is used for indicating the monitored person to reach a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value; the frequency of the prompt message output by the intelligent sound box at regular time can be preset. Optionally, the prompt information may be at least one of multimedia contents such as games, videos, music, and the like; through outputting the multimedia content, the interestingness of the prompt message can be improved, and the monitored person is attracted to be close to the intelligent sound box actively.
A first determining unit 402, configured to determine whether the monitored person arrives at the position within a preset time period after the prompt information is output. The preset duration can be set by referring to the average time of the monitored person walking from any position of the house to the position of the intelligent sound box.
And a communication unit 403, configured to send alarm information to the terminal device bound to the smart sound box when the first determining unit 402 determines that the monitored person arrives at the position within the preset time period.
As an optional implementation manner, the first determining unit 402 may be specifically configured to control the image capturing apparatus 20 to capture an image within a preset time period after the prompt information is output; if the monitored person is not identified from the image, determining that the monitored person is not detected to reach the position within the preset time length;
the first determining unit 402 may perform continuous shooting within a preset time after the prompt information is output. For the captured image, the first determining unit 402 may extract image features of the image, and match the extracted image features with preset human body image features to identify whether a monitored person exists in the image; alternatively, the first determination unit 402 may call an image recognition model, and input the captured image into the image recognition model to obtain an output result of the image recognition model, where the output result may indicate whether a monitored person exists in the captured image. The image recognition model can be a model such as a deep neural network and a support vector machine, and is obtained by training image information of a marked monitored person in advance, and the trained image recognition model can be stored in the cloud end of the intelligent sound box or the local intelligent sound box.
Optionally, before controlling the camera device 20 to shoot an image, the first determining unit 402 may further obtain a first audio signal collected by a microphone of the smart speaker; and identifying a sound source location in the first audio signal; the imaging device 20 is controlled to rotate so that the viewing range of the imaging device 20 is directed to the sound source position.
In the embodiment of the invention, when the monitored person approaches the sound box, sounds such as footsteps and the like are generated. By implementing the above embodiment, the smart sound box adjusts the viewing range of the camera device 20 according to the recognized sound source position, so that the camera device 20 can face the walking direction of the monitored person, thereby increasing the possibility that the camera device 20 can shoot the monitored person.
As another optional implementation manner, the first determining unit 402 is specifically configured to determine whether the human proximity sensor of the smart sound box detects a human body within a preset time period after the prompt information is output; if not, determining that the monitored person does not arrive at the position within the preset time length; wherein, the maximum detection distance of the human body proximity sensor is set as a preset distance threshold.
Optionally, after the first determining unit 402 detects a human body, a second audio signal collected by a microphone of the smart speaker may also be obtained; verifying the user voiceprint characteristics in the second audio signal by utilizing the legal voiceprint characteristics of the monitored person; and if the user voiceprint characteristics are not consistent with the legal voiceprint characteristics, the operation that the monitored person arrives at the position is determined not to be detected within the preset time length is executed.
That is to say, by executing the above steps, it can be further determined whether the human body approaching the smart speaker is a specific monitored person or not through the voiceprint feature, so that the monitoring target of the smart speaker can be locked, and the smart speaker can monitor the safety of the specific monitored person.
Therefore, when the intelligent sound box shown in fig. 4 is implemented, the intelligent sound box can attract the monitored person to actively approach the intelligent sound box by outputting prompt information at regular time so as to punch the card. If the intelligent sound box does not detect that the monitored person reaches a position close to the intelligent sound box within the preset time length, alarm information is sent to the bound terminal equipment to prompt that the monitored person of a user of the terminal equipment is possibly dangerous, so that the user of the terminal equipment can know the safety condition of the monitored person in time.
Example four
Referring to fig. 5, fig. 5 is a schematic structural diagram of another intelligent sound box disclosed in the embodiment of the present invention. The smart sound box shown in fig. 5 is obtained by optimizing the smart sound box shown in fig. 4. As shown in fig. 5, the smart speaker may include:
a control unit 404, configured to control the image capturing device 20 to rotate and capture a video when the first determining unit 402 determines that the monitored person has not reached the position within the preset time period;
the communication unit 403 is further configured to send the captured video to the terminal device, so that the user of the terminal device can confirm the security of the monitored person according to the video.
In addition, as an optional implementation manner, the communication unit 403 may be further configured to acquire verification information sent by a wearable device worn by the monitored person after the first determining unit 402 determines that the monitored person arrives at the location within the preset time period and before sending the alarm information to the terminal device bound to the smart speaker; the verification information is sent by manual triggering and comprises an identifier of a wireless local area network accessed by the wearable device.
The smart speaker shown in fig. 5 may further include:
a second judging unit 405, configured to judge, according to the verification information, whether the wireless local area network to which the wearable device is connected is consistent with the wireless local area network to which the smart speaker is connected; and when the inconsistency is determined, triggering the communication unit 403 to execute an operation of sending alarm information to the terminal device bound with the smart sound box.
According to the implementation of the implementation method, the monitored person can manually trigger and send the check information through the wearable device, and the intelligent sound box does not send alarm information when verifying that the monitored person is in the house where the intelligent sound box is located according to the check information, so that the misinformation can be reduced.
It can be seen that, when the intelligent sound box shown in fig. 5 is implemented, prompt information can be output at regular time to attract the monitored person to approach the intelligent sound box actively, and if the monitored person is not detected to approach the intelligent sound box within the preset time, alarm information is sent to the terminal device to remind the user of the terminal device to confirm the safety of the monitored person. In addition, the smart sound box can also acquire the verification information sent by the wearable device worn by the monitored person, and the safety of the monitored person is verified by utilizing the verification information, so that the monitored person can conveniently punch a card by utilizing the wearable device when the monitored person does not conveniently reach the position close to the smart sound box. Furthermore, when the intelligent sound box does not detect that the monitored person is close to the intelligent sound box within the preset time, the intelligent sound box can also send videos to the terminal equipment, so that a user of the terminal equipment can confirm the safety of the monitored person according to the videos.
EXAMPLE five
Referring to fig. 6, fig. 6 is a schematic structural diagram of another intelligent sound box disclosed in the embodiment of the present invention. As shown in fig. 6, the smart speaker may include:
a Radio Frequency (RF) circuit 601, a memory 602, a display screen 604, a human body proximity sensor 605, an audio circuit 606, a wireless fidelity (WiFi) module 607, a processor 608, a power supply 609, a camera 610, and the like. Those skilled in the art will appreciate that the smart speaker configuration shown in FIG. 6 does not constitute a limitation of smart speakers, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
The following specifically introduces each component of the smart speaker with reference to fig. 6:
the RF circuit 601 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information of a base station and then processes the received downlink information to the processor 608; in addition, the data for designing uplink is transmitted to the base station. Typically, the RF circuit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 601 may also communicate with networks and other devices via wireless communications. In the embodiment of the present invention, the RF circuit 601 may be used for communicating with a terminal device bound to the smart speaker; and may also be used to communicate with a wearable device worn by the monitored person. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), etc.
The memory 602 may be used for storing software programs and modules, and the processor 608 executes various functional applications and data processing of the smart speaker by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, image data, etc.) created according to the use of the smart speaker, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
Display screen 604 may be used to display information entered by or provided to a user. Alternatively, the display panel of the display screen 604 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like. In an embodiment of the present invention, the display screen 604 may be used to display a prompt message.
The smart speaker may also include at least one sensor, such as a human proximity sensor 605. The human proximity sensor 605 is used to detect the action of the human body approaching the smart speaker, and the maximum detection distance thereof may be set as a preset distance threshold. The human proximity sensor 605 may include, but is not limited to, at least one of a pyroelectric infrared sensor, an ultrasonic sensor, and an infrared sensor.
Audio circuitry 606, speakers 6061, and microphone 6062 may provide an audio interface between the user and the smart speaker. The audio circuit 606 may transmit the electrical signal converted from the received audio data to the speaker 6061, and convert the electrical signal into a sound signal by the speaker 6061 and output the sound signal; on the other hand, the microphone 6062 converts the collected sound signal into an electric signal, which is received by the audio circuit 606 and converted into audio data, and the audio data is output to the memory 602 for further processing after being processed by the audio data output processor 608.
WiFi belongs to short distance wireless transmission technology, and wireless local area network can be accessed to the intelligence audio amplifier through WiFi module 607. And communicating with a wearable device worn by the monitored person through the WiFi module.
The processor 608 is a control center of the smart speaker, and is connected to various parts of the whole smart speaker through various interfaces and lines, and executes various functions and processes data of the smart speaker by running or executing software programs and/or modules stored in the memory 602 and calling data stored in the memory 602, thereby performing overall monitoring of the smart speaker. Optionally, processor 608 may include one or more processing units.
The smart speaker may also include a power supply 609 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 608 via a power management system, such that the power management system may manage charging, discharging, and power consumption.
The camera device 610 can be lifted and rotated for image capturing. And will not be described in detail herein.
In the embodiment of the present invention, the processor 608 included in the terminal further has the following functions:
outputting prompt information at fixed time; the prompt message is used for indicating the monitored person to reach a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value;
judging whether the monitored person arrives at the position within a preset time after the prompt message is output;
and if not, sending alarm information to the terminal equipment bound with the intelligent sound box.
An embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute a security monitoring method shown in fig. 1 or fig. 2.
An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the security monitoring method shown in fig. 1 or fig. 2.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are exemplary and alternative embodiments, and that the acts and modules illustrated are not required in order to practice the invention.
In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The security monitoring method and the smart speaker disclosed in the embodiments of the present invention are described in detail above, and specific examples are applied in the description to explain the principle and the implementation of the present invention. Meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A security monitoring method, the method comprising:
the intelligent sound box outputs prompt information at regular time; the prompt information is used for indicating a monitored person to arrive at a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value;
the intelligent sound box judges whether the monitored person arrives at the position within a preset time after the prompt message is output;
and if not, the intelligent sound box sends alarm information to the terminal equipment bound with the intelligent sound box.
2. The method according to claim 1, wherein the smart speaker determining whether the monitored person arrives at the location within a preset time period after the prompt message is output comprises:
the intelligent sound box controls the camera device to shoot images within a preset time after the prompt information is output; if the monitored person is not identified from the image, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length; or,
the intelligent sound box judges whether a human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, the intelligent sound box determines that the monitored person does not arrive at the position within the preset time length; wherein the maximum detection distance of the human body proximity sensor is set as the preset distance threshold.
3. The method according to claim 1 or 2, characterized in that the method further comprises:
if the monitored person does not arrive at the position within the preset time length, the intelligent sound box controls a camera device to rotate and shoot a video;
the intelligent sound box sends the shot video to the terminal equipment, so that a user of the terminal equipment confirms the safety of the monitored person according to the video.
4. The method according to claim 1 or 2, wherein after determining that the monitored person arrives at the location within the preset time period and before the smart speaker sends alarm information to the terminal device bound to the smart speaker, the method further comprises:
the intelligent sound box acquires verification information sent by wearable equipment worn by the monitored person; the verification information is sent by manual triggering, and the verification information comprises a wireless local area network identifier accessed by the wearable device;
the intelligent sound box judges whether the wireless local area network accessed by the wearable equipment is consistent with the wireless local area network accessed by the intelligent sound box or not according to the verification information;
and if the two signals are inconsistent, the intelligent sound box executes the step of sending alarm information to the terminal equipment bound with the intelligent sound box by the intelligent sound box.
5. The method according to any one of claims 1 to 4, wherein the prompt message is at least one of a game, a video and music.
6. An intelligent sound box, comprising:
the output unit is used for outputting prompt information at regular time; the prompt information is used for indicating a monitored person to arrive at a position where the distance from the monitored person to the intelligent sound box is smaller than a preset distance threshold value;
a first judging unit, configured to judge whether it is detected that the monitored person arrives at the position within a preset time period after the prompt information is output;
and the communication unit is used for sending alarm information to the terminal equipment bound with the intelligent sound box when the first judgment unit judges that the monitored person does not arrive at the position within the preset time.
7. The smart sound box according to claim 6, wherein the first determining unit is specifically configured to control the camera device to capture an image within a preset time period after the prompt information is output; if the monitored person is not identified from the image, determining that the monitored person does not arrive at the position within the preset time length; or,
the intelligent sound box is specifically used for judging whether the human body proximity sensor of the intelligent sound box detects a human body within a preset time after the prompt information is output; if not, determining that the monitored person does not arrive at the position within the preset time length; wherein the maximum detection distance of the human body proximity sensor is set as the preset distance threshold.
8. The smart sound box of claim 6 or 7, further comprising:
the control unit is used for controlling the camera device to rotate and shoot a video when the first judging unit judges that the monitored person does not reach the position within the preset time length;
the communication unit is further used for sending the shot video to the terminal equipment, so that a user of the terminal equipment can confirm the safety of the monitored person according to the video.
9. The smart sound box of claim 6 or 7, wherein:
the communication unit is further configured to acquire verification information sent by a wearable device worn by the monitored person after the first judging unit judges that the monitored person arrives at the position within the preset time and before sending alarm information to a terminal device bound to the smart sound box; the verification information is sent by manual triggering, and the verification information comprises an identifier of a wireless local area network accessed by the wearable device;
the intelligent sound box further comprises:
the second judging unit is used for judging whether the wireless local area network accessed by the wearable equipment is consistent with the wireless local area network accessed by the intelligent sound box or not according to the verification information; and when the inconsistency is judged, triggering the communication unit to execute the operation of sending alarm information to the terminal equipment bound with the intelligent sound box.
10. The smart sound box of any one of claims 6 to 8, wherein the prompt message is at least one of a game, a video and music.
CN201911039238.4A 2019-10-29 2019-10-29 Safety monitoring method and intelligent sound box Pending CN111179541A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911039238.4A CN111179541A (en) 2019-10-29 2019-10-29 Safety monitoring method and intelligent sound box

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911039238.4A CN111179541A (en) 2019-10-29 2019-10-29 Safety monitoring method and intelligent sound box

Publications (1)

Publication Number Publication Date
CN111179541A true CN111179541A (en) 2020-05-19

Family

ID=70653688

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911039238.4A Pending CN111179541A (en) 2019-10-29 2019-10-29 Safety monitoring method and intelligent sound box

Country Status (1)

Country Link
CN (1) CN111179541A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120077441A1 (en) * 2010-02-26 2012-03-29 Thl Holding Company, Llc Method, system and wireless device with power management for monitoring protective headgear
CN103207579A (en) * 2013-03-18 2013-07-17 尹浩越 Autonomous learning assisting, supervising and urging system for primary and secondary school students
CN104869497A (en) * 2015-03-24 2015-08-26 广东欧珀移动通信有限公司 Wireless network setting method and apparatus of WIFI sound box
CN106887122A (en) * 2015-12-15 2017-06-23 美的集团股份有限公司 Method, device and the audio amplifier alarmed by audio amplifier
CN107683501A (en) * 2015-05-15 2018-02-09 J·布拉施有限公司 System and method for carrying out active monitoring to people
CN107825428A (en) * 2017-12-08 2018-03-23 子歌教育机器人(深圳)有限公司 Operating system of intelligent robot and intelligent robot
CN207150800U (en) * 2017-07-03 2018-03-27 上海博润天电脑科技有限公司 A kind of intelligent sound box for having monitoring function

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120077441A1 (en) * 2010-02-26 2012-03-29 Thl Holding Company, Llc Method, system and wireless device with power management for monitoring protective headgear
CN103207579A (en) * 2013-03-18 2013-07-17 尹浩越 Autonomous learning assisting, supervising and urging system for primary and secondary school students
CN104869497A (en) * 2015-03-24 2015-08-26 广东欧珀移动通信有限公司 Wireless network setting method and apparatus of WIFI sound box
CN107683501A (en) * 2015-05-15 2018-02-09 J·布拉施有限公司 System and method for carrying out active monitoring to people
CN106887122A (en) * 2015-12-15 2017-06-23 美的集团股份有限公司 Method, device and the audio amplifier alarmed by audio amplifier
CN207150800U (en) * 2017-07-03 2018-03-27 上海博润天电脑科技有限公司 A kind of intelligent sound box for having monitoring function
CN107825428A (en) * 2017-12-08 2018-03-23 子歌教育机器人(深圳)有限公司 Operating system of intelligent robot and intelligent robot

Similar Documents

Publication Publication Date Title
US20210056981A1 (en) Systems and methods for managing an emergency situation
US20210287522A1 (en) Systems and methods for managing an emergency situation
EP3649795B1 (en) Intelligent alerts in multi-user environment
KR102549689B1 (en) Electronic device and method for controlling an operation thereof
US20170126192A1 (en) Method, device, and computer-readable medium for adjusting volume
CN105117211B (en) The method and device of prompting message
JP2007135008A (en) Mobile terminal
CN106503666A (en) Safety monitoring method and device and electronic equipment
CN107920231B (en) Video call system and control method thereof
US20170154521A1 (en) Methods and systems for providing personal emergency alerts and context aware activity notifications
CN105281993B (en) Play the method and device of multimedia file
CN111357006A (en) Fatigue prompting method and terminal
JP2017538238A (en) Method and apparatus for transmitting an alert notification message
CN107767839A (en) Brightness adjusting method and related product
CN104916090A (en) Prompt information sending method and device
CN106134092A (en) The record of potentially harmful radiation
CN110177239B (en) Video call method based on remote control and wearable device
CN105049599A (en) Intelligent conversation method and device
CN107659718B (en) Method and device for controlling mobile terminal, mobile terminal and storage medium
CN101960830A (en) Device and method
CN111179541A (en) Safety monitoring method and intelligent sound box
CN110139064B (en) Video call method of wearable device and wearable device
CN110290270B (en) Anti-theft method and mobile terminal
CN108063869A (en) A kind of safe early warning method, mobile terminal
CN106303211B (en) Method, device and system for controlling shooting

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200519

RJ01 Rejection of invention patent application after publication