CN112995763A - Control method of intelligent monitoring system, 5G television, system and storage medium - Google Patents
Control method of intelligent monitoring system, 5G television, system and storage medium Download PDFInfo
- Publication number
- CN112995763A CN112995763A CN201911295681.8A CN201911295681A CN112995763A CN 112995763 A CN112995763 A CN 112995763A CN 201911295681 A CN201911295681 A CN 201911295681A CN 112995763 A CN112995763 A CN 112995763A
- Authority
- CN
- China
- Prior art keywords
- information
- feedback
- face image
- television
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application discloses a control method of an intelligent monitoring system based on a 5G television, which comprises the following steps: acquiring image information acquired by the television and state information of intelligent household equipment networked with the television; determining whether information feedback is needed or not according to the image information and the state information; and if the information feedback is determined to be needed, acquiring corresponding feedback information to send to the associated terminal. The application also provides a 5G television, an intelligent monitoring system and a computer readable storage medium. The method and the system realize real-time monitoring of the family scene and timely and accurate feedback of the abnormal conditions.
Description
Technical Field
The application relates to the technical field of intelligent monitoring, in particular to a control method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a computer readable storage medium.
Background
With the continuous development of the technology, more and more household devices appear in families of people, and meanwhile, the household devices are more and more intelligent. With the continuous increase of the intelligent home devices, certain problems are inevitably brought, for example, how to monitor each intelligent home device well and monitor the safety of family members under the condition that the number of the intelligent home devices is more and more.
At present, when monitoring the intelligent household equipment, monitoring equipment arranged at each position of a family is generally adopted to complete monitoring of the family, and the monitoring equipment comprises the intelligent household equipment and members, so that the monitoring of the intelligent household equipment is realized, corresponding monitoring equipment needs to be additionally configured, the input cost is increased, and meanwhile, corresponding feedback cannot be timely and effectively carried out on the state condition of corresponding family members.
Disclosure of Invention
The application provides a control method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a storage medium, so that a family scene is monitored in real time under the condition of reducing cost, and abnormal conditions are fed back timely and accurately.
In a first aspect, the present application provides a control method for an intelligent monitoring system based on a 5G television, where the method includes:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed or not according to the image information and the state information;
and if the information feedback is determined to be needed, acquiring corresponding feedback information to send to the associated terminal.
In a second aspect, the present application further provides a 5G television, where the 5G television includes an image pickup device, a processor, and a memory;
the camera device is used for collecting image information;
the memory is used for storing a computer program;
the processor is used for executing the computer program and realizing the control method of the intelligent monitoring system based on the 5G television when the computer program is executed.
In a third aspect, the present application further provides an intelligent monitoring system, which includes a plurality of intelligent home devices and the above-mentioned 5G television.
In a fourth aspect, the present application further provides a storage medium storing computer-readable instructions, which when executed by one or more processors, cause the one or more processors to perform the steps of the above-mentioned control method for the intelligent monitoring system based on the 5G television.
According to the control method of the intelligent monitoring system based on the 5G television, the television is used for acquiring and obtaining image information in real time, meanwhile, the intelligent monitoring system can monitor the state information of each intelligent household device, the state information comprises a normal state and an abnormal state, then whether information feedback is needed or not is determined according to the acquired image information and the state information, and finally when the information feedback is needed, the acquired corresponding feedback information is sent to the corresponding associated terminal. Through the networking of the intelligent household devices, the monitoring of the state of the intelligent household devices in a family by the television is realized, meanwhile, the monitoring of the state information of the family by the television is realized, and then, when abnormal conditions exist, corresponding feedback alarm is carried out. The abnormal condition of the intelligent household equipment or the family state information can be fed back timely and effectively, and the abnormal event can be avoided more effectively.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a block diagram of an intelligent monitoring system in accordance with an embodiment of the present application;
fig. 2 is a schematic flowchart of a monitoring method of a smart home system based on a 5G television in an embodiment of the present application;
fig. 3 is a flowchart illustrating a step of determining whether to perform information feedback according to an embodiment of the present application;
FIG. 4 is a schematic view of a sensing region arrangement according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a step of inputting a face image in an embodiment of the present application;
fig. 6 is a schematic block diagram of a 5G television provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
The embodiment of the application provides a monitoring method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a storage medium.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a block diagram illustrating an intelligent monitoring system according to an embodiment of the present application.
Specifically, this intelligent monitoring system 10 includes 5G television 11 and intelligent home devices 12, wherein, 5G television 11 and intelligent home devices 12 communication connection, 5G television 11 is used for carrying out real-time monitoring and carrying out timely transmission of data information to the state of intelligent home devices, and when there is the anomaly in intelligent home devices 12, utilize self information feedback system to carry out the feedback of information, send the anomaly information to relevant terminal equipment (not marked in the figure), so that the user can know the state of intelligent home devices in real time, and can in time handle the anomaly state.
In some embodiments, the smart home devices 12 include, but are not limited to, smart refrigerators, smart door locks, smart speakers, smart fans, and the like.
In addition, the 5G power supply 11 is provided with a corresponding image acquisition device, such as a camera, and is used for monitoring indoor states in real time, such as who is watching a movie, and whether the old people fall down abnormally or not, and whether the old people invade strangers or not. By collecting and judging the images, the abnormal events can be processed in time.
It should be noted that, for the use of the 5G television 11, the timeliness of data or information transmission can be effectively ensured, so that the user can know the abnormality at the first time to perform corresponding handling operation on the abnormal event.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a monitoring method of an intelligent monitoring system based on a 5G television according to an embodiment of the present application.
Specifically, the monitoring method of the intelligent monitoring system based on the 5G television comprises the following steps:
step S201, acquiring image information acquired by the television and state information of intelligent household equipment networked with the television.
In the monitoring process, the indoor state of the intelligent monitoring system is monitored, and the states of all the associated intelligent household devices are monitored, so that the image information acquired by the television and the state information of the intelligent household devices networked with the television are acquired.
When acquiring image information, an image acquisition device provided on a television is used to acquire the image information, for example, a camera is used to acquire the image. When image acquisition is performed, if image acquisition exists in real time, operation load can be increased, and the useless performance of image acquisition can exist, for example, a large number of identical or similar images exist in continuous image acquisition, and the judgment process cannot be influenced when the device is used, so that a certain image acquisition period can be set, for example, image acquisition is performed every ten minutes, or image acquisition is performed every thirty minutes, and the like, and the device can be specifically set according to actual requirements.
For the intelligent household equipment which is networked with the television, namely the related intelligent household equipment in the intelligent monitoring system, the state information can be obtained in real time, so that the corresponding operation can be carried out in more timely abnormal operation.
Similarly, the corresponding information acquisition mode may be set according to the time. Because the use state of different intelligent household equipment is different when daytime and evening, for example, the electric rice cooker may be used in daytime, but not used at night or late night, therefore, different state information acquisition rules can be set for different intelligent household equipment.
In addition, a certain information acquisition period can be directly set, for example, the state information of the smart home device is acquired every other hour.
Step S202, determining whether information feedback is needed according to the image information and the state information.
After the acquired image information and the state information of the intelligent household equipment are acquired, whether corresponding information feedback is needed or not is judged and determined, corresponding feedback information is sent out when the information feedback is needed, and corresponding monitoring judgment is carried out when the information feedback is not needed.
In some embodiments, if information feedback is needed, corresponding prompt feedback is performed in time, so in order to determine timeliness of information feedback, in practical application, when determining whether information feedback is needed, the method includes: if the state information is in a normal state, determining whether information feedback is needed or not according to the image information; and if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state so as to send corresponding equipment abnormal information to the associated terminal.
When the intelligent household equipment is monitored, information feedback is required as long as the condition that the condition for information feedback is met, so that a user can timely perform corresponding processing. The condition for satisfying information feedback includes that the intelligent household equipment is abnormal, namely when the use state of the intelligent household equipment is in a problem, dangerous things are avoided, and corresponding checking is needed in time. It should be noted that, regardless of the number of the smart home devices, as long as there is one smart home device in an abnormal condition, the state information of the smart home device obtained at this time is in an abnormal state, and only when all the smart home devices are in a normal state, the state information of the smart home device is in a normal state.
In addition, in some embodiments, determining whether information feedback is required according to the image information includes: analyzing and processing the image information to determine whether to feed back the information according to whether behavior abnormity exists; if the condition of abnormal behaviors is determined, determining that information feedback is needed; and if the condition of abnormal behaviors does not exist, determining that information feedback is not needed.
When the intelligent household equipment is in a normal state, the actually collected image information is analyzed and judged to determine whether other conditions for information feedback are met. For example, when analyzing and processing the image information, it is determined that a person falls, and at this time, corresponding information feedback needs to be performed. Specifically, the information feedback mode may be that the television sends a corresponding voice prompt, or sends corresponding prompt information to the associated terminal.
In addition, when determining whether to perform information feedback according to the image information, in addition to performing information feedback when determining that behavior abnormality exists, for example, performing intelligent analysis processing to determine that an outsider invades, feedback needs to be performed, and obtaining a viewing time process determined according to the image information and the running state of the television, and the like, also needs to perform corresponding information feedback.
In some embodiments, when it is determined that no smart home device is in an abnormal state or no outsider intrudes, determining whether to perform information feedback according to the face image by using a corresponding feedback rule, including: if the television is in a film watching state, acquiring the current corresponding film watching duration; acquiring a time threshold corresponding to the feedback rule to determine whether to perform information feedback according to the film watching duration and the event threshold; if the film watching duration is less than or equal to the time threshold, feeding back information according to the feedback rule; and if the film watching duration is greater than the time threshold, determining that information feedback is required.
In practical application, when the television is in a film watching state, in order to ensure the health of people, a user is reminded to rest when a certain condition is reached, namely, the film watching is stopped. When the television is in a film watching state, the film watching duration corresponding to the current moment is obtained without obtaining image information once, meanwhile, the corresponding time threshold is obtained according to the obtained feedback rule, and whether information feedback is carried out or not is further determined according to the film watching duration and the time threshold.
Specifically, if the film watching duration is less than or equal to the time threshold, it is determined that information feedback is not required; and if the film watching duration is greater than the time threshold, determining that information feedback is required. The time thresholds corresponding to different people may be different, for example, the film watching time threshold of a child is smaller than the film watching time threshold of a parent, so that when film watching judgment is performed, the corresponding time threshold is obtained according to the identification information corresponding to the face image, and then the actually obtained film watching duration is compared with the corresponding time threshold, and it is determined that information feedback is not required.
Further, if the number of the face images included in the acquired image information is greater than one, whether information feedback is performed is determined based on a small time threshold when the film watching judgment is performed. For example, when the child and the parent watch television at the same time, the parent watching time threshold is not reached when the child watching time threshold is reached, but corresponding information feedback is carried out at the moment, so that the child is prevented from influencing the body health of the child due to long-time watching.
Step S203, if it is determined that information feedback is required, acquiring corresponding feedback information to send to the associated terminal.
When the information feedback is determined to be needed according to the acquired image information and the acquired state information, corresponding feedback information is obtained according to an event or situation needing to be fed back actually, and then the feedback information is sent to a related terminal related to the intelligent monitoring system, wherein the feedback information is obtained according to an actual abnormal state or abnormal information.
When it is determined that information feedback is required, the current corresponding abnormal situation is determined, and then corresponding feedback information including the abnormal situation is generated and obtained, for example, when it is determined that the intelligent household equipment A is abnormal in operation, the generated feedback information may be that the intelligent household equipment A is abnormal in operation, and for example, when it is determined that the intelligent household equipment is normal in operation, but it is determined that a stranger enters a house at present according to the image information, at this time, the obtained feedback information may be that the stranger invades the house.
After feedback information for feedback is obtained, the feedback information is sent to an associated terminal associated with the intelligent monitoring system, where the associated terminal may be a mobile device such as a smart phone, a tablet computer, and a smart watch, and the information feedback mode may be a short message, or may be prompt information using a corresponding application APP, which is not limited specifically.
In the control method of the intelligent monitoring system based on the 5G television, the television can acquire and acquire image information in real time, meanwhile, the intelligent monitoring system can monitor the state information of each intelligent household device, the state information comprises a normal state and an abnormal state, then whether information feedback is needed or not is determined according to the acquired image information and the state information, and finally when the information feedback is needed, the acquired corresponding feedback information is sent to the corresponding associated terminal. Through the networking of the intelligent household devices, the monitoring of the state of the intelligent household devices in a family by the television is realized, meanwhile, the monitoring of the state information of the family by the television is realized, and then, when abnormal conditions exist, corresponding feedback alarm is carried out. The abnormal condition of the intelligent household equipment or the family state information can be fed back timely and effectively, and the abnormal event can be avoided more effectively.
Further, referring to fig. 3, fig. 3 is a schematic flowchart illustrating a step of determining whether to perform information feedback according to an embodiment of the present application.
Specifically, if the state information is in a normal state, determining whether information feedback is required according to the image information, including:
step S301, if the state information is in a normal state, carrying out face recognition processing on the image information to obtain a face image contained in the image information;
step S302, determining a current corresponding monitoring mode according to the face image;
step S303, determining whether to perform information feedback according to the information feedback rule corresponding to the monitoring mode and the face image.
In practical application, when it is determined that the intelligent home devices in the abnormal state exist in the intelligent home devices, it is determined that information feedback needs to be performed, and meanwhile, the generated feedback information is sent to the associated terminal, so that the abnormal state can be fed back in time.
When the state information of the intelligent home equipment is determined to be in a normal state, namely when no equipment in an abnormal state exists in the intelligent home equipment, face recognition processing is carried out on the acquired image information to obtain a face image contained in the image information, then a current corresponding monitoring mode is obtained according to the obtained face image, and whether information feedback is needed or not is determined according to an information feedback rule corresponding to the obtained monitoring mode and the face image.
When monitoring the state information of the smart home device, if it is determined that the obtained state information is a normal state, that is, it is determined that there is no smart home device in an abnormal condition, the state of the current environment is determined, and a face image included in the image information is determined by performing face recognition on the obtained image information.
When it is determined that the obtained image information does not include the face image, at this time, since the smart home device itself is also in a normal state and it is not detected that a person is in the current corresponding environment, under a general condition, it is determined that the device and the environment monitored by the whole monitoring system are in a normal state, that is, at this time, corresponding information feedback is not required.
When the obtained image information is determined to contain the face image, different people have different behavior habits, so that the corresponding basis for determining whether to perform information feedback is different for different people. For example, for children, the elderly, and young people, there may be some limitation on the viewing time for children, but there may be no such limitation, or different conditions or manners for young people or elderly people. For the elderly, the health state of the elderly is more concerned, and obviously, the corresponding information feedback modes are different.
When the image information contains a face image and the face image contained in the image information is recognized, firstly, who the user or person corresponding to the face image is, such as whether the user or person is one of the family members, or which one or more of the family members, etc., is recognized. And then determining a corresponding monitoring mode and a corresponding information feedback rule according to the obtained face image.
In some embodiments, determining the current corresponding monitoring mode according to the obtained face image includes: acquiring a preset face image library to perform matching in the preset face image library to determine whether the face image exists in the face image library; if the face image does not exist in the preset face image library, determining that the monitoring mode is an intrusion mode; and if the face image exists in the preset face image library, determining that the monitoring mode is a safe mode.
The method comprises the steps of recording and storing face images corresponding to all members of family members in a corresponding face image library in advance, comparing the obtained face images with face images marked with user information stored in advance when the face images are identified, for example, calculating similarity, determining identification information of the identified face images, wherein different identification information represents different users, and further determining corresponding information feedback rules.
When the face image obtained through recognition is determined not to exist in the preset face image library, the fact that a stranger enters is determined to exist, and then the corresponding monitoring mode is the intrusion mode. When the face images obtained by multiple recognition are determined to be stored in the face image library, the corresponding monitoring mode is determined to belong to the safety mode, and then whether information feedback is required or not is determined according to the corresponding related information and rules in the mode.
Specifically, in some embodiments, determining whether to perform information feedback according to the information feedback rule corresponding to the monitoring mode and the face image includes: if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal; if the monitoring mode is a safe mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, and determining whether to perform information feedback according to the face image by using the feedback rule.
And when the current monitoring mode is determined to be the intrusion mode, determining that corresponding information feedback is required. In order to timely and accurately record the relevant information of the intruder so as to better feed the information back to the home owner, corresponding feedback information is generated according to the obtained face image, wherein the feedback information comprises the face image of the intruder, and then the feedback information is sent to the associated terminal, namely the terminal of the home owner.
When the monitoring mode at the moment is determined to be an intrusion mode, the television is used for collecting and storing images and/or videos, then when corresponding feedback information is generated, corresponding feedback information is generated according to the face image to feed back information, and the collected image information is stored, so that a home owner can conveniently use the image information and/or the video information to perform corresponding operation, such as case reporting, corresponding evidence can be provided more effectively, and the safety is improved more effectively.
In addition, when the current monitoring mode is determined to be a safe mode, corresponding information feedback rules are obtained according to the actually acquired face images, wherein the safe mode comprises a child mode, an idle mode, a learning mode, an entertainment mode and the like. And when the mobile terminal is in different modes, corresponding information feedback is carried out according to respective corresponding rules.
For example, when it is determined that the identification information corresponding to the face image is a child and the television is in the film watching state at this time, it is obvious that the child cannot be in the film watching state for a long time, that is, a certain film watching time threshold value is set, and a corresponding prompt is given after a certain time. When determining whether the child exceeds the viewing time threshold, determining the viewing duration of the child according to the acquired related information, including the state of the television (viewing state and non-viewing state) and the time information of each acquired face image of the child, and comparing the actual viewing duration with the viewing time threshold to determine whether information feedback is required.
For another example, when it is determined that the identification information corresponding to the face image is child and the film watching duration is less than the film watching time threshold, information prompt may be performed on the film watching state of the child. Specifically, when the specific television distance of the child is relatively close, corresponding prompt is given, so that the child can guarantee a proper viewing distance. When determining the distance between the child and the television, a corresponding positioning means can be used for determining, such as an infrared detection device, a sensor, etc. The infrared detection equipment can accurately position the position; the sensor may be set with a sensing range, and when the sensor is within the sensing range, the sensing range is determined to be too close, and the irregular distance is normal, specifically, as shown in fig. 4, a semicircular area with the television as the center is used as the sensing range, specifically, an area a in fig. 4, that is, the sensor can be sensed in the area a, and then the sensor can be determined to be the proper viewing distance outside the area a. The setting mode and the specific range of the sensing area are limited in fig. 4, but the setting is not limited in practical application, and the sensing area may be set to be customized according to practical requirements, for example, the sensing area may be set to be a regular polygonal area, or may be set to be an irregular area.
Further, referring to fig. 5, fig. 5 is a schematic flowchart of a step of entering a face image in an embodiment of the present application.
Specifically, in some embodiments, the method further comprises:
step S501, when an image input instruction is received, receiving an input face image to be input and a selected input rule;
and S502, storing the face image according to the entry rule.
The face image library stores face image information which is input in advance, and simultaneously, the face image information can be input at any time. And when an image input instruction is received, receiving an input face image to be input, receiving the selected input rule, and storing the face image to be input according to the selected input rule.
In practical application, the face images recorded are face images of people who are in close relationship with the home owner, such as parents, spouses and children, and if only the face images of the home owner and the people in close relationship are recorded, then friends of the home owner can be judged to be invaded if the people enter the photographing range, which is not an accurate judgment at present, so that the inaccurate condition can be avoided by recording corresponding face image information.
Specifically, when an image entry instruction is received, an input face image is received, and an entry rule selected by a user is also received, wherein the input face image can be acquired by using a 5G television, or acquired by using a related terminal, for example, a smart phone, and the face image is stored in different ways by selecting different entry rules.
For example, for parents of the owner, the intimacy rule may be selected, that is, the face images of the parents are permanently recorded and stored, so that when the face images included in the image information collected again are the face images of the parents, the parents cannot be judged as the intrusion mode.
For another example, for a friend a of an owner, a visitor mode may be selected, wherein the valid time for storing the face image may be set in the visitor mode, and when the face image of the friend a is stored, feedback information that there is an intrusion situation may not be sent out due to the entry of the friend a within a certain period of time. The storage effective time can be set in a self-defined manner, specifically, the storage effective time is set according to the needs of an owner, for example, the set time is 18:00 at 8/2008, and the time to be set is 3 hours, so that when the image information collected between 18:00 at 8/2008 and 21:00 at 8/2008 contains the face image of friend a, it is not determined that intrusion exists, but if the face image contained in the image information collected at 22:00 at 8/2008, intrusion is the face image of friend a, it is determined that intrusion exists.
Further, when a visitor exists, the owner can perform corresponding setting in advance except for entering a face image of the visitor, for example, perform corresponding setting on the 5G television or the associated terminal, so that the 5G television is in the visitor mode, and when the owner is in the visitor mode, the acquisition of the image information will not be performed, but the monitoring of the state of the smart home device will not be stopped, and when the owner is not in the visitor mode, the acquisition of the image information will be restarted.
When the guest mode is set, the active time of the guest mode may be selected, so that the guest mode is canceled when the active time elapses. The visitor mode can be closed actively by the owner without setting the effective time of the visitor mode, and meanwhile, when the visitor mode is not closed by the owner for a long time, corresponding prompt information can be sent out, so that the owner closes the visitor mode, and the inconvenience brought by long-term visitor mode is avoided.
As shown in fig. 6, fig. 6 is a schematic block diagram of a structure of a 5G television provided in an embodiment of the present application. The smart home device 10 includes a camera 11, a memory 12, and a processor 13, where the processor 12 and the memory 13 are connected by a system bus 14, and the memory 12 may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program includes program instructions that, when executed, cause the processor 12 to perform any one of the control methods for a 5G television-based intelligent monitoring system.
The processor 12 is used for providing calculation and control capability and supporting the operation of the whole intelligent household equipment.
The internal memory provides an environment for running a computer program in the nonvolatile storage medium, and the computer program can enable the processor to execute any control method of the intelligent monitoring system based on the 5G television when being executed by the processor.
Those skilled in the art will appreciate that the configuration shown in fig. 6 is a block diagram of only a portion of the configuration associated with the present application and does not constitute a limitation on the terminal to which the present application is applied, and that a particular terminal may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be understood that the Processor 12 may be a Central Processing Unit (CPU), and the Processor 11 may be other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general purpose processor 12 may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in an embodiment, the memory has stored therein a computer program which, when executed by the processor 12, causes the processor to carry out the steps of:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed or not according to the image information and the state information;
if the information feedback is determined to be needed, corresponding feedback information is obtained to be sent to the associated terminal
In one embodiment, the processor, when executing the computer program, further performs the steps of:
if the state information is in a normal state, determining whether information feedback is needed or not according to the image information;
and if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state so as to send corresponding equipment abnormal information to the associated terminal.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
analyzing and processing the image information to determine whether to feed back the information according to whether behavior abnormity exists;
if the condition of abnormal behaviors is determined, determining that information feedback is needed;
and if the condition of abnormal behaviors does not exist, determining that information feedback is not needed.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
if the state information is in a normal state, carrying out face recognition processing on the image information to obtain a face image contained in the image information;
determining a current corresponding monitoring mode according to the face image;
and determining whether to perform information feedback according to an information feedback rule corresponding to the monitoring mode and the face image.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring a preset face image library to perform matching in the preset face image library to determine whether the face image exists in the face image library;
if the face image does not exist in the preset face image library, determining that the monitoring mode is an intrusion mode;
and if the face image exists in the preset face image library, determining that the monitoring mode is a safe mode.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal;
if the monitoring mode is a safe mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, and determining whether to perform information feedback according to the face image by using the feedback rule.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
if the television is in a film watching state, acquiring the current corresponding film watching duration;
acquiring a time threshold corresponding to the feedback rule to determine whether to perform information feedback according to the film watching duration and the event threshold;
if the film watching duration is less than or equal to the time threshold, determining that information feedback is not needed;
and if the film watching duration is greater than the time threshold, determining that information feedback is required.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
when an image entry instruction is received, receiving an input face image and a selected entry rule;
storing the face image according to the input rule; wherein
If the input rule is a visitor rule, storing the face image and setting the storage effective time corresponding to the face image;
and if the input rule is an intimacy rule, marking the face image and storing the face image.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
when a selection instruction of a visitor mode is received, controlling the television to stop acquiring the image information;
and when receiving an ending instruction of the visitor mode, controlling the television to start the acquisition of the image information.
It should be noted that, as will be clearly understood by those skilled in the art, for convenience and brevity of description, the specific working process of the smart home device described above may refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
The embodiment of the application further provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, the computer program comprises program instructions, and the processor executes the program instructions to realize the control method of any intelligent monitoring system based on the 5G television provided by the embodiment of the application.
The computer-readable storage medium may be an internal storage unit of the 5G television described in the foregoing embodiment, for example, a hard disk or a memory of the 5G television. The computer readable storage medium may also be an external storage device of the 5G television, such as a plug-in hard disk provided on the 5G television, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like.
While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (12)
1. A control method of an intelligent monitoring system based on a 5G television is characterized by comprising the following steps:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed or not according to the image information and the state information;
and if the information feedback is determined to be needed, acquiring corresponding feedback information to send to the associated terminal.
2. The method of claim 1, wherein the determining whether information feedback is required according to the image information and the mode information comprises:
if the state information is in a normal state, determining whether information feedback is needed or not according to the image information;
and if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state so as to send corresponding equipment abnormal information to the associated terminal.
3. The method of claim 2, wherein the determining whether information feedback is required according to the image information comprises:
analyzing and processing the image information to determine whether to feed back the information according to whether behavior abnormity exists;
if the condition of abnormal behaviors is determined, determining that information feedback is needed;
and if the condition of abnormal behaviors does not exist, determining that information feedback is not needed.
4. The method of claim 2, wherein the determining whether information feedback is required according to the image information comprises:
carrying out face recognition processing on the image information to obtain a face image contained in the image information;
determining a current corresponding monitoring mode according to the face image;
and determining whether to perform information feedback according to an information feedback rule corresponding to the monitoring mode and the face image.
5. The method of claim 4, wherein determining the current corresponding monitoring mode from the face image comprises:
acquiring a preset face image library to be matched in the preset face image library so as to determine whether the face image exists in the face image library or not;
if the face image does not exist in the preset face image library, determining that the monitoring mode is an intrusion mode;
and if the face image exists in the preset face image library, determining that the monitoring mode is a safe mode.
6. The method according to claim 5, wherein the determining whether to perform information feedback according to the information feedback rule corresponding to the monitoring mode and the face image comprises:
if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal;
if the monitoring mode is a safe mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, and determining whether to perform information feedback according to the face image by using the feedback rule.
7. The method according to claim 6, wherein the determining whether to perform information feedback according to the face image by using the feedback rule comprises:
if the television is in a film watching state, acquiring the current corresponding film watching duration;
acquiring a time threshold corresponding to the feedback rule, and determining whether to perform information feedback according to the film watching duration and the event threshold;
if the film watching duration is less than or equal to the time threshold, determining that information feedback is not needed;
and if the film watching duration is greater than the time threshold, determining that information feedback is required.
8. The method according to any one of claims 1 to 7, further comprising:
when an image entry instruction is received, receiving an input face image and a selected entry rule;
storing the face image according to the input rule; wherein
If the input rule is a visitor rule, storing the face image and setting the storage effective time corresponding to the face image;
and if the input rule is an intimacy rule, marking the face image and storing the face image.
9. The method of claim 8, further comprising:
when a selection instruction of a visitor mode is received, controlling the television to stop collecting image information;
and when receiving an ending instruction of the visitor mode, controlling the television to start collecting image information.
10. A5G television is characterized by comprising a camera device, a processor and a memory;
the camera device is used for collecting image information;
the memory is used for storing a computer program;
the processor is used for executing the computer program and implementing the control method of the intelligent monitoring system based on the 5G television as claimed in any one of claims 1 to 9 when the computer program is executed.
11. An intelligent monitoring system, characterized in that the intelligent monitoring system comprises a plurality of intelligent household devices and the 5G television set according to claim 10.
12. A computer-readable storage medium, which when executed by one or more processors, causes the one or more processors to perform the steps of the method for controlling a 5G television-based intelligent monitoring system according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295681.8A CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295681.8A CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112995763A true CN112995763A (en) | 2021-06-18 |
| CN112995763B CN112995763B (en) | 2023-04-25 |
Family
ID=76343428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911295681.8A Active CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112995763B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117057720A (en) * | 2023-10-12 | 2023-11-14 | 米烁网络科技(广州)有限公司 | Commodity storage management system based on Internet |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093615A (en) * | 2006-06-23 | 2007-12-26 | 乐金电子（沈阳）有限公司 | Device of controlling domestic electrical appliance of using TV set |
| CN103631205A (en) * | 2012-08-21 | 2014-03-12 | 江苏怡海科技发展有限公司 | An intelligent household electrical appliance network interconnection and integration remote control system |
| CN104135642A (en) * | 2014-07-31 | 2014-11-05 | 青岛歌尔声学科技有限公司 | Intelligent monitoring method and relevant equipment |
| WO2018090465A1 (en) * | 2016-11-18 | 2018-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Video monitoring method and system, and monitoring device |
-
2019
- 2019-12-16 CN CN201911295681.8A patent/CN112995763B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093615A (en) * | 2006-06-23 | 2007-12-26 | 乐金电子（沈阳）有限公司 | Device of controlling domestic electrical appliance of using TV set |
| CN103631205A (en) * | 2012-08-21 | 2014-03-12 | 江苏怡海科技发展有限公司 | An intelligent household electrical appliance network interconnection and integration remote control system |
| CN104135642A (en) * | 2014-07-31 | 2014-11-05 | 青岛歌尔声学科技有限公司 | Intelligent monitoring method and relevant equipment |
| WO2018090465A1 (en) * | 2016-11-18 | 2018-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Video monitoring method and system, and monitoring device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117057720A (en) * | 2023-10-12 | 2023-11-14 | 米烁网络科技(广州)有限公司 | Commodity storage management system based on Internet |
| CN117057720B (en) * | 2023-10-12 | 2024-02-02 | 米烁网络科技(广州)有限公司 | Commodity storage management system based on Internet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112995763B (en) | 2023-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10424175B2 (en) | Motion detection system based on user feedback | |
| US11308777B2 (en) | Image capturing apparatus with variable event detecting condition | |
| US9497425B2 (en) | Motion detection method and device using the same | |
| CN102004923A (en) | Method and apparatus for detecting behavior in a monitoring system | |
| US10217350B2 (en) | Adaptive exception handling in security system | |
| US11461441B2 (en) | Machine learning-based anomaly detection for human presence verification | |
| US10750076B2 (en) | Network device, image processing method, and computer readable medium | |
| US20140211003A1 (en) | Safety monitoring device and method | |
| CN107122743A (en) | Security-protecting and monitoring method, device and electronic equipment | |
| JP6872963B2 (en) | Surveillance camera system | |
| EP3188147A1 (en) | Adaptive exit arm times based on real time events and historical data in a home security system | |
| CN112995763B (en) | Control method of intelligent monitoring system, 5G television, system and storage medium | |
| CN112535459B (en) | Sleep abnormality detection method, sleep abnormality detection device, electronic equipment and readable storage medium | |
| JP6663703B2 (en) | Watching system | |
| US10255775B2 (en) | Intelligent motion detection | |
| WO2023279716A1 (en) | Device linkage method and apparatus, and device, storage medium, program product and computer program | |
| WO2021218681A1 (en) | Action association method based on internet of things, and electronic device and storage medium | |
| WO2022009356A1 (en) | Monitoring system | |
| US11676439B2 (en) | Face authentication system and face authentication method | |
| CN110134444B (en) | Method and device for controlling multimedia equipment and multimedia equipment | |
| CN112949502B (en) | Method, system and electronic device for detecting swimming pool safety officer looking around | |
| JP6380794B2 (en) | Security management device | |
| US11756217B2 (en) | Multi-camera system to perform movement pattern anomaly detection | |
| CN107026971A (en) | Control device and control method | |
| CN114091957A (en) | Method, device, server and storage medium for detecting intrusion of Internet of things equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |