CN112995763B - Control method of intelligent monitoring system, 5G television, system and storage medium - Google Patents
Control method of intelligent monitoring system, 5G television, system and storage medium Download PDFInfo
- Publication number
- CN112995763B CN112995763B CN201911295681.8A CN201911295681A CN112995763B CN 112995763 B CN112995763 B CN 112995763B CN 201911295681 A CN201911295681 A CN 201911295681A CN 112995763 B CN112995763 B CN 112995763B
- Authority
- CN
- China
- Prior art keywords
- information
- feedback
- face image
- television
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Alarm Systems (AREA)
Abstract
The application discloses a control method of an intelligent monitoring system based on a 5G television, which comprises the following steps: acquiring image information acquired by the television and state information of intelligent household equipment networked with the television; determining whether information feedback is needed according to the image information and the state information; if the information feedback is determined to be needed, corresponding feedback information is acquired and sent to the associated terminal. The application also provides a 5G television, an intelligent monitoring system and a computer readable storage medium. The method and the device realize the real-time monitoring of the home scene and timely and accurately feed back the abnormal situation.
Description
Technical Field
The application relates to the technical field of intelligent monitoring, in particular to a control method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a computer readable storage medium.
Background
With the continuous development of technology, more and more household devices are in families of people, and meanwhile, the household devices are more and more intelligent. With the increasing number of smart home devices, certain problems are necessarily brought, such as how to monitor each smart home device well and monitor the safety of family members under the condition that the number of smart home devices is increased.
When intelligent household equipment is monitored, monitoring equipment arranged at each position of a household is generally adopted to complete monitoring of the household, and the intelligent household equipment comprises intelligent household equipment and members, so that although the monitoring of the intelligent household equipment is realized, corresponding monitoring equipment is required to be additionally configured, the input cost is increased, and corresponding feedback is not necessarily and timely effectively performed on the state conditions of the corresponding household members.
Disclosure of Invention
The application provides a control method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a storage medium, so that a household scene is monitored in real time under the condition of reducing cost, and abnormal conditions are fed back timely and accurately.
In a first aspect, the present application provides a control method of an intelligent monitoring system based on a 5G television, where the method includes:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed according to the image information and the state information;
if the information feedback is determined to be needed, corresponding feedback information is acquired and sent to the associated terminal.
In a second aspect, the present application further provides a 5G television, where the 5G television includes an image capturing device, a processor, and a memory;
the camera device is used for collecting image information;
the memory is used for storing a computer program;
the processor is used for executing the computer program and realizing the control method of the intelligent monitoring system based on the 5G television when executing the computer program.
In a third aspect, the application further provides an intelligent monitoring system, which comprises a plurality of intelligent home devices and the 5G television.
In a fourth aspect, the present application further provides a storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of the control method of the intelligent monitoring system based on 5G television.
According to the control method of the intelligent monitoring system based on the 5G television, the television is utilized to acquire image information in real time, meanwhile, the intelligent monitoring system monitors state information of all intelligent home equipment, the state information comprises a normal state and an abnormal state, whether information feedback is needed or not is determined according to the acquired image information and the state information, and finally, when the information feedback is needed, the obtained corresponding feedback information is sent to a corresponding associated terminal. Through the networking of each intelligent household device, the state of each intelligent household device in the household is monitored by utilizing the television, and meanwhile, the household state information is monitored by utilizing the television, so that corresponding feedback alarm is carried out when abnormal conditions exist. The abnormal condition of the intelligent household equipment or the household state information can be fed back timely and effectively, and abnormal events are avoided more effectively.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a block diagram of a smart monitoring system in one embodiment of the present application;
fig. 2 is a flow chart of a monitoring method of a smart home system based on a 5G television according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating steps for determining whether to perform information feedback according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an arrangement of sensing regions according to one embodiment of the present application;
FIG. 5 is a flowchart illustrating steps for face image entry in an embodiment of the present application;
fig. 6 is a schematic block diagram of a 5G television provided in one embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The flow diagrams depicted in the figures are merely illustrative and not necessarily all of the elements and operations/steps are included or performed in the order described. For example, some operations/steps may be further divided, combined, or partially combined, so that the order of actual execution may be changed according to actual situations.
It is to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
The embodiment of the application provides a monitoring method of an intelligent monitoring system based on a 5G television, the intelligent monitoring system and a storage medium.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic block diagram of a smart monitoring system according to an embodiment of the present application.
Specifically, the intelligent monitoring system 10 includes a 5G television 11 and an intelligent home device 12, where the 5G television 11 is in communication connection with the intelligent home device 12, and the 5G television 11 is configured to monitor a state of the intelligent home device in real time and perform timely transmission of data information, and when an abnormality exists in the intelligent home device 12, perform feedback of information by using an own information feedback system, and send the abnormal information to an associated terminal device (not shown in the figure), so that a user can know the state of the intelligent home device in real time and process the abnormal state in time.
In some embodiments, the smart home devices 12 include, but are not limited to, smart refrigerators, smart door locks, smart speakers, smart fans, and the like.
In addition, the 5G power supply 11 is provided with a corresponding image acquisition device, such as a camera, for real-time monitoring of indoor status, such as who is watching, for example, whether the old people fall down abnormally, or whether the old people invade strangers. The abnormal event can be processed in time by collecting and judging the image.
It should be noted that, for the use of the 5G television 11, timeliness of data or information transmission can be effectively ensured, so that when an abnormality occurs, a user can know at the first time so as to perform corresponding coping operations on the abnormal event.
Referring to fig. 2, fig. 2 is a flow chart of a monitoring method of the intelligent monitoring system based on the 5G television according to an embodiment of the present application.
Specifically, the monitoring method of the intelligent monitoring system based on the 5G television comprises the following steps:
step S201, acquiring image information acquired by the television and state information of intelligent household equipment networked with the television.
In the process of monitoring, the indoor state of the intelligent monitoring system is monitored, and the states of all the related intelligent household devices are monitored, so that the image information acquired by the television and the state information of the intelligent household devices networked with the television are acquired.
When the image information is acquired, the image information is acquired by using an image acquisition device arranged on the television, for example, a camera is used for image acquisition. When the image is acquired, if the image is acquired in real time, the running load is increased, and the useless performance of the image acquisition can be also possibly existed, for example, a large number of identical or similar images exist in continuous image acquisition, but the judgment process is not affected in use, so that a certain image acquisition period can be set, for example, the image acquisition is carried out once every ten minutes or once every thirty minutes, and the like, and the image acquisition can be specifically set according to actual requirements.
For intelligent home equipment which is networked with a television, namely related intelligent home equipment in an intelligent monitoring system, the acquisition of the state information of the intelligent home equipment can be real-time, so that corresponding operation can be carried out more timely when abnormal operation occurs.
Similarly, the corresponding information acquisition mode can be set according to the time. Because the use states of different intelligent home devices are different in daytime and evening, for example, the electric rice cooker can be used in daytime, but can not be used in evening or late night, the acquisition rules of different state information can be set for different intelligent home devices.
In addition, a certain information acquisition period can be directly set, for example, the state information of the intelligent home equipment can be acquired once every one hour.
Step S202, determining whether information feedback is needed according to the image information and the state information.
After acquiring the acquired image information and the state information of the intelligent home equipment, judging whether to perform corresponding information feedback or not, sending corresponding feedback information when the information feedback is needed, and performing corresponding monitoring judgment when the information feedback is not needed.
In some embodiments, if information feedback is needed, corresponding prompt feedback is performed in time, so in order to determine the timeliness of the information feedback, in practical application, determining whether the information feedback is needed includes: if the state information is in a normal state, determining whether information feedback is needed according to the image information; if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state, and sending corresponding equipment abnormal information to the associated terminal.
When intelligent home equipment is monitored, information feedback is needed only when conditions for information feedback are met, so that a user can timely perform corresponding processing. Meeting the conditions for information feedback comprises abnormal situations of the intelligent household equipment, namely when the use state of the intelligent household equipment is problematic, dangerous things are avoided, and corresponding checking is needed in time. It should be noted that, no matter how many intelligent home devices are, only one intelligent home device in an abnormal condition exists, the obtained state information of the intelligent home device is in an abnormal state, and only when all intelligent home devices are in a normal condition, the state information of the intelligent home device is described as a normal state.
Additionally, in some embodiments, determining whether information feedback is needed based on the image information includes: analyzing and processing the image information to determine whether to feed back information according to whether the behavior abnormality exists; if the abnormal behavior condition is determined, determining that information feedback is needed; if the condition that the behavior abnormality does not exist is determined, the information feedback is not required.
When the intelligent home equipment is in a normal state, the image information acquired in practice is analyzed, judged and determined to meet other information feedback conditions. For example, when the image information is analyzed, it is determined that a person falls down, and at this time, corresponding information feedback is required. Specifically, the information feedback mode may be that the television sends out a corresponding voice prompt, or that the television sends out a corresponding prompt message to the associated terminal.
In addition, when determining whether to perform information feedback according to the image information, in addition to performing information feedback when determining that there is a behavioral abnormality, for example, performing intelligent analysis processing to determine that there is an intrusion of a foreign person, feedback is required to be performed to obtain a process of determining a viewing time according to the image information and an operation state of a television, and corresponding information feedback is also required.
In some embodiments, when it is determined that no smart home device is in an abnormal state and no foreign person invades, determining whether to perform information feedback according to the face image by using a corresponding feedback rule includes: if the television is in a video watching state, acquiring the current corresponding video watching time length; acquiring a time threshold corresponding to the feedback rule, and determining whether to perform information feedback according to the film watching duration and the time threshold; if the film watching duration is smaller than or equal to a time threshold, information feedback is carried out according to the feedback rule; and if the viewing time is longer than the time threshold, determining that information feedback is needed.
In practical application, when the television is in a video watching state, in order to ensure the health of people, a user is reminded to rest when a certain condition is reached, namely, video watching is stopped. When the television is in a video watching state, the video watching time length corresponding to the current time is acquired without acquiring the image information once, and meanwhile, a corresponding time threshold value is obtained according to the obtained feedback rule, so that whether information feedback is performed or not is determined according to the video watching time length and the time threshold value.
Specifically, if the film watching duration is less than or equal to the time threshold, determining that information feedback is not needed; if the viewing time is longer than the time threshold, determining that information feedback is needed. The time thresholds corresponding to different persons can be different, for example, the viewing time threshold of a child is smaller than that of a parent, so that when the viewing judgment is carried out, the corresponding time threshold is obtained according to the identification information corresponding to the face image, and then the actually obtained viewing time length is compared with the corresponding time threshold, so that the information feedback is not required.
Further, if the number of face images included in the acquired image information is greater than one, determining whether to perform information feedback based on the fact that the time threshold is small when performing film viewing judgment. For example, when a child and a parent watch television at the same time and the viewing time threshold of the child is reached, the viewing time threshold of the parent is not reached, but corresponding information feedback is performed at the moment, so that the child is prevented from influencing the body health of the child due to long-time viewing.
Step 203, if it is determined that information feedback is needed, corresponding feedback information is obtained and sent to the associated terminal.
When the information feedback is determined to be needed according to the acquired image information and the acquired state information, corresponding feedback information is obtained according to the event or condition of the actual feedback, and then the feedback information is sent to an associated terminal related to the intelligent monitoring system, wherein the feedback information is obtained according to the actual abnormal state or abnormal information.
When it is determined that information feedback is required, the current corresponding abnormal situation is determined, and then corresponding feedback information containing the abnormal situation is generated and obtained, for example, when it is determined that the intelligent home equipment A is abnormal in operation, the generated feedback information can be "the intelligent home equipment A is abnormal in operation", for example, when it is determined that the intelligent home equipment is normal in operation, but it is determined that a stranger currently exists to enter a house according to image information, and at the moment, the obtained feedback information can be "the stranger is invaded".
After feedback information is obtained, the feedback information is sent to an associated terminal associated with the intelligent monitoring system, wherein the associated terminal can be mobile equipment such as a smart phone, a tablet personal computer and a smart watch, and the information feedback mode can be a short message or prompt information by using a corresponding application program APP, and the method is not particularly limited.
According to the control method of the intelligent monitoring system based on the 5G television, the television can acquire and acquire image information in real time, meanwhile, the intelligent monitoring system can monitor the state information of each intelligent household device, the state information comprises a normal state and an abnormal state, then whether information feedback is needed or not is determined according to the acquired image information and the state information, and finally, when the information feedback is needed, the acquired corresponding feedback information is sent to the corresponding associated terminal. Through the networking of each intelligent household device, the state of each intelligent household device in the household is monitored by utilizing the television, and meanwhile, the household state information is monitored by utilizing the television, so that corresponding feedback alarm is carried out when abnormal conditions exist. The abnormal condition of the intelligent household equipment or the household state information can be fed back timely and effectively, and abnormal events are avoided more effectively.
Further, referring to fig. 3, fig. 3 is a flowchart illustrating a step of determining whether to perform information feedback according to an embodiment of the present application.
Specifically, if the state information is in a normal state, determining whether information feedback is needed according to the image information includes:
step 301, if the state information is in a normal state, performing face recognition processing on the image information to obtain a face image contained in the image information;
step S302, determining a current corresponding monitoring mode according to the face image;
step S303, determining whether to feed back information according to the information feedback rule corresponding to the monitoring mode and the face image.
In practical application, when it is determined that the intelligent home equipment in an abnormal state exists in the intelligent home equipment, it is determined that information feedback is needed, and meanwhile, generated feedback information is sent to an associated terminal, so that timely feedback of the abnormal state is achieved.
When the state information of the intelligent household equipment is determined to be in a normal state, namely, when the intelligent household equipment is not in an abnormal state, the acquired image information is subjected to face recognition processing to obtain a face image contained in the image information, then a current corresponding monitoring mode is obtained according to the obtained face image, and further whether information feedback is needed or not is determined according to an information feedback rule corresponding to the obtained monitoring mode and the face image.
When monitoring the state information of the intelligent home equipment, if the obtained state information is determined to be in a normal state, that is, the intelligent home equipment which is not in an abnormal condition is described, the state of the current environment is determined, the face image contained in the image information is determined by carrying out face recognition on the obtained image information, and in the actual application process, the acquired image information can include the face image or not.
When the obtained image information does not contain the face image, the intelligent home equipment is in a normal state at the moment, and no personnel are detected to be in the environment corresponding to the current state, and in general, the equipment and the environment monitored by the whole monitoring system are determined to be in the normal state at the moment, namely, corresponding information feedback is not needed at the moment.
When the obtained image information is determined to contain the face image, different people have different behavior habits, so that the corresponding basis for determining whether to feed back the information is different for different people. For example, for children, the elderly and young people, the viewing time corresponding to the children has a certain limit, but for young people or the elderly, the limitations may not exist, or the limitation conditions or modes are different. For the elderly, the health status of the elderly should be more concerned, and obviously, the corresponding information feedback modes also can be different.
When the face image is included in the image information and the face image included in the image information is identified, first, a user or person corresponding to the face image is identified, for example, whether the user or person is a member of a family, which position or positions of the family, and the like. And then determining a corresponding monitoring mode and a corresponding information feedback rule through the obtained face image.
In some embodiments, determining the current corresponding monitoring mode according to the obtained face image includes: acquiring a preset face image library, and carrying out matching in the preset face image library to determine whether the face image exists in the face image library; if the fact that the face images do not exist in the preset face image library is determined, determining that the monitoring mode is an intrusion mode; and if the face images exist in the preset face image library, determining that the monitoring mode is a safety mode.
The face images corresponding to the members in the family members are recorded and stored in the corresponding face image library in advance, when the face images are identified, the obtained face images are compared with the face images marked with the user information, such as similarity calculation, so that the identification information of the identified face images is determined, different identification information represents different users, and the corresponding information feedback rules can be determined.
When the face image obtained by recognition is determined not to exist in the preset face image library, the fact that a stranger enters is determined to be affirmative, and then the corresponding monitoring mode is an intrusion mode. When the face images obtained through the recognition are determined to be stored in the face image library, the fact that the corresponding monitoring mode belongs to the safety mode is determined, and then whether information feedback is needed or not is determined according to relevant information and rules corresponding to the mode.
Specifically, in some embodiments, determining whether to perform information feedback according to the information feedback rule corresponding to the monitoring mode and the face image includes: if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal; and if the monitoring mode is a safety mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, so as to determine whether to perform information feedback according to the face image by utilizing the feedback rule.
When the current monitoring mode is determined to be an intrusion mode, corresponding information feedback is determined to be needed. In order to timely and accurately record relevant information of the invader so as to be better fed back to a home owner, corresponding feedback information is generated according to the obtained face image, wherein the feedback information comprises the face image of the invader, and then the feedback information is sent to an associated terminal, namely a terminal of the home owner.
When the monitoring mode at the moment is determined to be an intrusion mode, the television is used for collecting and storing images and/or videos, then when corresponding feedback information is generated, corresponding feedback information is generated according to the face image so as to conduct information feedback, and meanwhile, the collected image information is stored, so that a family owner can conveniently conduct corresponding operations, such as reporting a case, by using the image information and/or the video information, corresponding evidence can be provided more effectively, and safety is improved more effectively.
In addition, when the current monitoring mode is determined to be a safety mode, a corresponding information feedback rule is obtained according to the face image acquired in practice, wherein the safety mode comprises a child mode, an idle mode, a learning mode, an entertainment mode and the like. And when the information is in different modes, corresponding information feedback is carried out according to the corresponding rules.
For example, when it is determined that the identification information corresponding to the face image is a child, and the television is in a viewing state at this time, it is obvious that the child cannot be in a state of long-time viewing, that is, a certain viewing time threshold is set, and after a certain time is reached, a corresponding prompt is performed. When determining whether the child exceeds the film watching time threshold, determining the film watching time length of the child according to the acquired related information including the state (film watching state and non-film watching state) of the television, the time information of each acquired face image of the child and the like, and comparing the actual film watching time length with the film watching time threshold to determine whether information feedback is needed.
For another example, when the identification information corresponding to the face image is determined to be a child and the viewing time is less than the viewing time threshold, information prompt can be further performed on the viewing state of the child. Specifically, when a specific television distance of the child is relatively close, a corresponding prompt is performed, so that the child can ensure a proper viewing distance. In determining the distance between the child and the television, a corresponding positioning means, such as an infrared detection device, a sensor, etc., may be utilized for the determination. The infrared detection equipment can accurately position the position; the sensor can set an induction range, when the sensor is in the induction range, the distance is too close, the irregular distance is normal, specifically, as shown in fig. 4, a semicircular area with the television as the center is taken as the induction range, specifically, an area a in fig. 4, namely, the sensor can be sensed in the area a, and then, the proper viewing distance is determined outside the area a. The arrangement mode and the specific range of the sensing area are limited in fig. 4, but the arrangement mode and the specific range are not limited in practical application, and the sensing area can be set in a customized manner according to practical requirements, for example, can be set as a regular polygonal area or an irregular area.
Further, referring to fig. 5, fig. 5 is a flowchart illustrating steps for face image input in an embodiment of the present application.
Specifically, in some embodiments, the method further comprises:
step S501, when an image input order is received, an input face image to be input and a selected input rule are received;
step S502, storing the face image according to the input rule.
The face image library stores face image information which is input in advance, and meanwhile, the face image information can be input at any time. When an image input order is received, an input face image to be input is received, the selected input rule is received, and the face image to be input is stored according to the selected input rule.
In practical application, the face image recorded is generally a face image of a person having a relatively close relationship with a home owner, such as parents, spouse and children, if only the face images of the home owner and the close relationship person are recorded, then the friends of the home owner can be judged to be invaded if entering a photographing range, and the face image is not an accurate judgment, so that the occurrence of such an inaccurate condition can be avoided by recording corresponding face image information.
Specifically, when an image input order is received, an input face image is received, and an input rule selected by a user is received, wherein the input face image can be acquired by using a 5G television or by using an associated terminal, such as a smart phone, and the face image is stored in different modes through different input rules when selected.
For example, for parents of a homeowner, an affinity rule may be selected, that is, a face image of the parent is permanently recorded and stored, so that the face image included in the image information acquired again is not determined as an intrusion pattern when the face image of the parent is the face image of the parent.
For another example, for friend a of the owner, a visitor mode may be selected, where the visitor mode may set a valid storage time of the face image, and when the face image of friend a is stored, feedback information about an intrusion condition is not sent out due to entry of friend a in a certain period of time. The effective storage time can be set in a self-defined manner, specifically, the effective storage time is set according to the requirement of an owner, for example, the setting time is 18:00 of 8 th month of 2008, and the time required to be set is 3 hours, when the image information acquired from 18:00 of 8 th month of 2008 to 21:00 of 8 th month of 2008 contains the face image of the friend A, the situation of invasion is not determined, but if the face image contained in the image information acquired from 22:00 of 8 th month of 2008 is the face image of the friend A, the situation of invasion is determined.
Further, when a visitor exists, the owner can perform corresponding setting in advance except for inputting the face image of the visitor, for example, the corresponding setting is performed on the 5G television or the associated terminal, so that the 5G television is in a visitor mode, when the visitor mode is in, the acquisition of the image information is not performed, but the monitoring of the state of the intelligent home equipment is not stopped, and when the visitor mode is not in, the acquisition of the image information is restarted.
When setting the guest mode, the valid time of the guest mode may be selected so that the guest mode will be canceled when the valid time passes. The visitor mode can be actively closed by the owner without setting the effective time of the visitor mode, and corresponding prompt information can be sent when the visitor mode is not closed for a long time by the owner, so that the visitor mode is closed by the owner, and inconvenience caused by long-term stay in the visitor mode is avoided.
As shown in fig. 6, fig. 6 is a schematic block diagram of a 5G television provided in an embodiment of the present application. The smart home device 10 comprises an image pickup device 11, a memory 12 and a processor 13, wherein the processor 12 and the memory 13 are connected through a system bus 14, and the memory 12 can comprise a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program comprises program instructions that, when executed, cause the processor 12 to perform any of the control methods of the intelligent monitoring system based on 5G television.
The processor 12 is used to provide computing and control capabilities to support the operation of the entire smart home device.
The internal memory provides an environment for the execution of a computer program in the non-volatile storage medium, which when executed by the processor, causes the processor to perform any one of the control methods of the intelligent monitoring system based on the 5G television.
It will be appreciated by those skilled in the art that the structure shown in fig. 6 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the terminal to which the present application is applied, and that a particular terminal may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.
It should be appreciated that the processor 12 may be a central processing unit (Central Processing Unit, CPU), and the processor 11 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein the general purpose processor 12 may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in one embodiment, the memory stores a computer program which, when executed by the processor 12, causes the processor to execute the computer program to perform the steps of:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed according to the image information and the state information;
if it is determined that information feedback is required, corresponding feedback information is acquired and sent to the associated terminal, and in one embodiment, the processor further implements the following steps when executing the computer program:
if the state information is in a normal state, determining whether information feedback is needed according to the image information;
if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state, and sending corresponding equipment abnormal information to the associated terminal.
In one embodiment, the processor when executing the computer program further performs the steps of:
analyzing and processing the image information to determine whether to feed back information according to whether the behavior abnormality exists;
if the abnormal behavior condition is determined, determining that information feedback is needed;
if the condition that the behavior abnormality does not exist is determined, the information feedback is not required.
In one embodiment, the processor when executing the computer program further performs the steps of:
if the state information is in a normal state, performing face recognition processing on the image information to obtain a face image contained in the image information;
determining a current corresponding monitoring mode according to the face image;
and determining whether to feed back the information according to the information feedback rule corresponding to the monitoring mode and the face image.
In one embodiment, the processor when executing the computer program further performs the steps of:
acquiring a preset face image library, and carrying out matching in the preset face image library to determine whether the face image exists in the face image library;
if the fact that the face images do not exist in the preset face image library is determined, determining that the monitoring mode is an intrusion mode;
and if the face images exist in the preset face image library, determining that the monitoring mode is a safety mode.
In one embodiment, the processor when executing the computer program further performs the steps of:
if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal;
and if the monitoring mode is a safety mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, so as to determine whether to perform information feedback according to the face image by utilizing the feedback rule.
In one embodiment, the processor when executing the computer program further performs the steps of:
if the television is in a video watching state, acquiring the current corresponding video watching time length;
acquiring a time threshold corresponding to the feedback rule, and determining whether to perform information feedback according to the film watching duration and the time threshold;
if the film watching duration is smaller than or equal to the time threshold, determining that information feedback is not needed;
and if the viewing time is longer than the time threshold, determining that information feedback is needed.
In one embodiment, the processor when executing the computer program further performs the steps of:
when an image input order is received, receiving an input face image and a selected input rule; storing the face image according to the input rule; wherein the method comprises the steps of
If the input rule is a visitor rule, storing the face image and setting the storage effective time corresponding to the face image;
and if the input rule is an intimate rule, marking and storing the face image.
In one embodiment, the processor when executing the computer program further performs the steps of:
when a selection instruction of a visitor mode is received, controlling the television to stop acquiring image information;
and when receiving an ending instruction of the visitor mode, controlling the television to start the acquisition of the image information.
It should be noted that, for convenience and brevity of description, a person skilled in the art may clearly understand that, for the specific working process of the smart home device described above, reference may be made to a corresponding process in the foregoing method embodiment, which is not described herein again.
The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, the computer program comprises program instructions, and the processor executes the program instructions to realize the control method of any intelligent monitoring system based on the 5G television.
The computer readable storage medium may be an internal storage unit of the 5G television set according to the foregoing embodiment, for example, a hard disk or a memory of the 5G television set. The computer readable storage medium may also be an external storage device of the 5G television, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the 5G television.
While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (11)
1. The control method of the intelligent monitoring system based on the 5G television is characterized by comprising the following steps:
acquiring image information acquired by the television and state information of intelligent household equipment networked with the television;
determining whether information feedback is needed according to the image information and the state information;
if the state information is in a normal state, determining whether information feedback is needed according to the image information, wherein the determining whether information feedback is needed according to the image information includes:
performing face recognition processing on the image information to obtain a face image contained in the image information;
determining a current corresponding monitoring mode according to the face image;
determining whether to feed back information according to the information feedback rule corresponding to the monitoring mode and the face image;
if the information feedback is determined to be needed, corresponding feedback information is acquired and sent to the associated terminal.
2. The method of claim 1, wherein determining whether information feedback is needed based on the image information and the status information comprises:
if the state information is in an abnormal state, determining abnormal intelligent household equipment in the abnormal state, and sending corresponding equipment abnormal information to the associated terminal.
3. The method of claim 2, wherein determining whether information feedback is required based on the image information comprises:
analyzing and processing the image information to determine whether to feed back information according to whether the behavior abnormality exists;
if the abnormal behavior condition is determined, determining that information feedback is needed;
if the condition that the behavior abnormality does not exist is determined, the information feedback is not required.
4. The method of claim 1, wherein the determining the currently corresponding monitoring mode from the face image comprises:
acquiring a preset face image library, and matching in the preset face image library to determine whether the face image exists in the face image library;
if the fact that the face images do not exist in the preset face image library is determined, determining that the monitoring mode is an intrusion mode;
and if the face images exist in the preset face image library, determining that the monitoring mode is a safety mode.
5. The method of claim 4, wherein the determining whether to perform information feedback according to the information feedback rule corresponding to the monitoring mode and the face image includes:
if the monitoring mode is an intrusion mode, acquiring the face image to obtain corresponding feedback information, and sending the feedback information to the associated terminal;
and if the monitoring mode is a safety mode, obtaining a corresponding feedback rule according to the identification information corresponding to the face image, and determining whether to feed back information according to the face image by using the feedback rule.
6. The method of claim 5, wherein determining whether to perform information feedback based on the face image using the feedback rule comprises:
if the television is in a video watching state, acquiring the current corresponding video watching time length;
acquiring a time threshold corresponding to the feedback rule, and determining whether to perform information feedback according to the film watching duration and the time threshold;
if the film watching duration is smaller than or equal to the time threshold, determining that information feedback is not needed;
and if the viewing time is longer than the time threshold, determining that information feedback is needed.
7. The method according to any one of claims 1 to 6, further comprising:
when an image input order is received, receiving an input face image and a selected input rule;
storing the face image according to the input rule; wherein the method comprises the steps of
If the input rule is a visitor rule, storing the face image and setting the storage effective time corresponding to the face image;
and if the input rule is an intimate rule, marking and storing the face image.
8. The method of claim 7, wherein the method further comprises:
when a selection instruction of a visitor mode is received, controlling the television to stop collecting image information;
and when receiving an ending instruction of the visitor mode, controlling the television to start to collect image information.
9. A 5G television, wherein the 5G television comprises a camera device, a processor and a memory;
the camera device is used for collecting image information;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and to implement the control method of the intelligent monitoring system based on 5G television according to any one of claims 1 to 8 when the computer program is executed.
10. An intelligent monitoring system, characterized in that the intelligent monitoring system comprises a plurality of intelligent home devices and the 5G television according to claim 9.
11. A computer-readable storage medium, wherein the computer-readable storage medium is executed by one or more processors, the one or more processors being caused to perform the steps of the control method of the 5G television-based intelligent monitoring system of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295681.8A CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295681.8A CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112995763A CN112995763A (en) | 2021-06-18 |
| CN112995763B true CN112995763B (en) | 2023-04-25 |
Family
ID=76343428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911295681.8A Active CN112995763B (en) | 2019-12-16 | 2019-12-16 | Control method of intelligent monitoring system, 5G television, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112995763B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114445762A (en) * | 2021-12-20 | 2022-05-06 | 珠海格力电器股份有限公司 | Security monitoring method and device, storage medium and electronic equipment |
| CN117057720B (en) * | 2023-10-12 | 2024-02-02 | 米烁网络科技(广州)有限公司 | Commodity storage management system based on Internet |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101093615A (en) * | 2006-06-23 | 2007-12-26 | 乐金电子（沈阳）有限公司 | Device of controlling domestic electrical appliance of using TV set |
| CN103631205A (en) * | 2012-08-21 | 2014-03-12 | 江苏怡海科技发展有限公司 | An intelligent household electrical appliance network interconnection and integration remote control system |
| CN104135642A (en) * | 2014-07-31 | 2014-11-05 | 青岛歌尔声学科技有限公司 | Intelligent monitoring method and relevant equipment |
| CN106454272A (en) * | 2016-11-18 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Video monitoring method and system, and monitoring device |
-
2019
- 2019-12-16 CN CN201911295681.8A patent/CN112995763B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112995763A (en) | 2021-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10424175B2 (en) | Motion detection system based on user feedback | |
| US9497425B2 (en) | Motion detection method and device using the same | |
| US11308777B2 (en) | Image capturing apparatus with variable event detecting condition | |
| US20210124914A1 (en) | Training method of network, monitoring method, system, storage medium and computer device | |
| EP3026904A1 (en) | System and method of contextual adjustment of video fidelity to protect privacy | |
| CN112995763B (en) | Control method of intelligent monitoring system, 5G television, system and storage medium | |
| KR101990803B1 (en) | PROTECTION SYSTEM FOR VULNERABLE CLASSES USING Internet Of Things AND METHOD THEREFOR | |
| CN102004923A (en) | Method and apparatus for detecting behavior in a monitoring system | |
| US20180299671A1 (en) | Information processing apparatus, fatigue degree evaluating method, and program | |
| CN107122743A (en) | Security-protecting and monitoring method, device and electronic equipment | |
| JP6872963B2 (en) | Surveillance camera system | |
| CN114495270A (en) | Real-time monitoring and early warning method, device and system and storage medium | |
| CN111770309B (en) | Video uploading method and device, electronic equipment and storage medium | |
| CN108881621A (en) | A kind of screen locking method, device, terminal and storage medium | |
| KR20210039663A (en) | Violent behavior management system and method | |
| CN115346060A (en) | Picture abnormity identification method and device, electronic equipment and storage medium | |
| JP6663703B2 (en) | Watching system | |
| CN110895663B (en) | Two-wheel vehicle identification method and device, electronic equipment and monitoring system | |
| WO2022009356A1 (en) | Monitoring system | |
| CN112911154B (en) | Snapshot method, server and computer storage medium | |
| CN112535459B (en) | Sleep abnormality detection method, sleep abnormality detection device, electronic equipment and readable storage medium | |
| CN113361469A (en) | Method, device and equipment for identifying coverage state and storage medium | |
| US10255775B2 (en) | Intelligent motion detection | |
| JP2004310582A (en) | System for controlling person response, and program | |
| CN112949442B (en) | Abnormal event pre-recognition method and device, electronic equipment and monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |