CN106708451B - Method for monitoring state of intelligent device on same screen, projection device and user terminal - Google Patents

Method for monitoring state of intelligent device on same screen, projection device and user terminal Download PDF

Info

Publication number
CN106708451B
CN106708451B CN201510780091.XA CN201510780091A CN106708451B CN 106708451 B CN106708451 B CN 106708451B CN 201510780091 A CN201510780091 A CN 201510780091A CN 106708451 B CN106708451 B CN 106708451B
Authority
CN
China
Prior art keywords
internet
things platform
state information
projection
intelligent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510780091.XA
Other languages
Chinese (zh)
Other versions
CN106708451A (en
Inventor
陈志�
张宝英
李屹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Appotronics Corp Ltd
Original Assignee
Appotronics Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Appotronics Corp Ltd filed Critical Appotronics Corp Ltd
Priority to CN201510780091.XA priority Critical patent/CN106708451B/en
Priority to PCT/CN2016/104633 priority patent/WO2017080402A1/en
Priority to TW105136798A priority patent/TWI628611B/en
Publication of CN106708451A publication Critical patent/CN106708451A/en
Application granted granted Critical
Publication of CN106708451B publication Critical patent/CN106708451B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Abstract

The embodiment of the invention discloses a method for monitoring states of intelligent equipment on the same screen, projection equipment and a user terminal, which can display monitoring results of a plurality of intelligent equipment on the same screen. The method provided by the embodiment of the invention comprises the following steps: the projection equipment is connected with the Internet of things platform through the Internet, and logs in the Internet of things platform through equipment account numbers corresponding to the projection equipment registered in the Internet of things platform in advance, and receives state information transmitted by the intelligent equipment, wherein the state information is forwarded by the Internet of things platform, and the equipment account numbers of the projection equipment and the equipment account numbers corresponding to the intelligent equipment registered in the Internet of things platform in advance have an incidence relation on the Internet of things platform; the projection device projects the received state information of the plurality of intelligent devices to the same screen. According to the embodiment of the invention, the projection equipment receives the state information of the plurality of intelligent equipment through the Internet of things platform and displays the state information on the same screen, so that the state information of each intelligent equipment can be known remotely and simultaneously without space limitation, and the user experience is improved.

Description

Method for monitoring state of intelligent device on same screen, projection device and user terminal
Technical Field
The invention relates to the field of Internet of things, in particular to a method for monitoring the state of intelligent equipment on the same screen, projection equipment and a user terminal.
Background
With the development of the internet, various internet-based applications and service applications have come into play. In the field of internet of things, after data is collected and generated by hardware equipment, a result is generally displayed by intelligent hardware or a mobile terminal (for example, a mobile phone) connected with the intelligent hardware.
However, due to the limitation of the mobile terminal screen, the general screen can only display the result of one monitoring device, and if the monitoring results of other devices are to be known, the monitoring results of other devices need to be switched to other devices to be checked. And the user can only view the monitoring results in close range.
Therefore, when a plurality of devices need to be monitored, the monitoring is troublesome, and meanwhile, the long-time short-distance monitoring is easy to fatigue.
Disclosure of Invention
The embodiment of the invention provides a method for monitoring states of intelligent devices on the same screen, projection equipment and a user terminal, which can display monitoring results of a plurality of intelligent devices on the same screen.
In a first aspect, an embodiment of the present invention provides a method for monitoring a state of an intelligent device on the same screen through a projection device, where the method includes: the projection equipment is connected with the Internet of things platform through the Internet, and logs in the Internet of things platform through an equipment account number corresponding to the projection equipment registered in the Internet of things platform in advance; the projection equipment receives state information of the intelligent equipment forwarded by the internet of things platform, the state information is sent to the internet of things platform by the intelligent equipment, and an equipment account of the projection equipment and equipment accounts corresponding to the intelligent equipment registered in the internet of things platform in advance have an incidence relation in the internet of things platform; the projection device projects the received state information of the plurality of intelligent devices to the same screen.
In the embodiment of the invention, the projection equipment does not need to be connected with the intelligent equipment respectively, but is connected with the Internet of things platform through the projection equipment, the intelligent equipment is also connected with the Internet of things platform respectively, the projection equipment and the intelligent equipment log in the Internet of things platform through respective account numbers registered in the Internet of things platform, the Internet of things platform receives state information of the intelligent equipment which is in association with the projection equipment, the state information is transmitted to the projection equipment, and the projection equipment projects the state information to the same screen. By the method, on one hand, the state information of each intelligent device can be known at the same time; on the other hand, the state information of each intelligent device can be known in a remote or remote way without space limitation; moreover, the state of each intelligent device can be known by starting the projection device and networking, and the method is convenient and quick.
With reference to the first aspect, in a first possible implementation manner of the first aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the projection device and the device accounts of the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the plurality of intelligent devices include a mobile terminal, and the state information of the mobile terminal received by the projection device includes geographical location information of the mobile terminal; the projection device projecting the state information of the plurality of intelligent devices to the same screen includes: when receiving the geographical position information sent by the mobile terminals, the projection equipment marks the geographical position information of the intelligent equipment on the same map and displays the geographical position information in a projection mode in a preset area.
With reference to the first aspect or the first possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the method further includes: the projection equipment detects the state information of the intelligent equipment, and if the state information reaches a preset condition, corresponding early warning prompts are sent out.
With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the step of sending out the corresponding warning prompt by the projection device includes one or two of the following steps: the projection equipment generates a sound alarm indicating that the state information reaches a preset condition and plays the sound alarm; or the projection equipment displays the state information in an identification mode.
With reference to the third possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the intelligent device includes a sphygmomanometer, and the state information sent by the sphygmomanometer and received by the projection device includes blood pressure data; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment judges whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the intelligent device includes a camera, and the state information sent by the camera and received by the projection device includes video information captured by the camera; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment identifies whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
With reference to the third possible implementation manner of the first aspect, in a seventh possible implementation manner of the first aspect, the intelligent device includes a camera, and the state information sent by the camera and received by the projection device includes video information captured by the camera; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment judges whether the video information contains a human face head portrait; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
With reference to the third possible implementation manner of the first aspect, in an eighth possible implementation manner of the first aspect, the intelligent device includes a refrigerator, and the state information sent by the refrigerator and received by the projection device includes food information stored in the refrigerator; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment checks whether one or two of the following conditions are satisfied according to the food information, and generates an early warning prompt corresponding to the satisfied conditions:
the food type represented by the food information is less than the preset type;
or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
In a second aspect, an embodiment of the present invention provides a method for monitoring a state of an intelligent device on the same screen through a projection device, where the method includes: the user terminal logs in the Internet of things platform through a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by at least one intelligent device to the projection device, wherein the device account of the intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and the user terminal sends the instruction to the Internet of things platform, so that the Internet of things platform receives the state information reported by the at least one intelligent device and forwards the state information to the projection device.
With reference to the second aspect, in a first possible implementation manner of the second aspect, the method further includes: the method comprises the steps that a user terminal generates a request for enabling a projection device and at least one intelligent device to correspond to the same group; the user terminal sends the request to the Internet of things platform, so that the Internet of things platform enables the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to correspond to the group identification of the same group; the step of generating an instruction for sending the state information reported by the at least one intelligent device to the projection device by the user terminal comprises the following steps: and the user terminal generates an instruction for sending the state information reported by the intelligent equipment in the same group to the projection equipment in the group.
With reference to the second aspect, in a second possible implementation manner of the second aspect, before the step of generating, by the user terminal, an instruction for sending the state information reported by the at least one smart device to the projection device, the method further includes: the method comprises the steps that a user terminal generates a binding request aiming at the projection equipment, and the binding request is sent to an internet of things platform, so that the internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; the user terminal generates a binding request aiming at least one intelligent device, and sends the binding request to the Internet of things platform, so that the Internet of things platform stores the binding relationship between the user account and the at least one intelligent device.
In a third aspect, an embodiment of the present invention provides a projection apparatus, which includes a memory, a processor, and a projection component, where: the memory is used for storing an application program; the processor is to execute an application to: establishing connection with an Internet of things platform through the Internet, and logging in the Internet of things platform by using a device account number corresponding to a projection device registered in the Internet of things platform in advance; receiving state information of a plurality of intelligent devices forwarded by an internet of things platform, wherein the state information is sent to the internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the internet of things platform in advance have an association relationship on the internet of things platform; and controlling the projection component to project the state information of the plurality of intelligent devices to the same screen.
With reference to the third aspect, in a first possible implementation manner of the third aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the device accounts of the projection device and the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the plurality of intelligent devices include a mobile terminal, and the state information includes geographic location information of the mobile terminal; the processor is specifically configured to perform the steps of: receiving geographical position information of the mobile terminal forwarded by the Internet of things platform; and when receiving the geographical position information sent by the plurality of mobile terminals, controlling the projection component to mark the geographical position information of the plurality of intelligent devices on the same map and perform projection display in a preset area.
With reference to the third aspect or the first possible implementation manner of the third aspect, in a third possible implementation manner of the third aspect, the processor is further configured to perform the following steps: and detecting the state information of the intelligent equipment, and if the state information reaches a preset condition, sending out a corresponding early warning prompt.
With reference to the third possible implementation manner of the third aspect, in a fourth possible implementation manner of the third aspect, the step of issuing the corresponding warning prompt executed by the processor includes one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
With reference to the third possible implementation manner of the third aspect, in a fifth possible implementation manner of the third aspect, the intelligent device includes a sphygmomanometer, and the state information includes blood pressure data measured by the sphygmomanometer; the processor is specifically configured to perform the steps of: judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the third aspect, in a sixth possible implementation manner of the third aspect, the intelligent device includes a camera, and the state information includes video information captured by the camera; the processor is specifically configured to perform the steps of: identifying whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
With reference to the third possible implementation manner of the third aspect, in a seventh possible implementation manner of the third aspect, the intelligent device includes a camera, and the state information includes video information captured by the camera; the processor is specifically configured to perform the steps of: judging whether the video information contains a face head portrait or not; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
With reference to the third possible implementation manner of the third aspect, in an eighth possible implementation manner of the third aspect, the intelligent device includes a refrigerator, the state information includes food information stored in the refrigerator, and the processor is specifically configured to execute the following steps: checking whether one or two of the following conditions are satisfied according to the food information, and generating an early warning prompt corresponding to the satisfied conditions: the food type represented by the food information is less than the preset type; or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
In a fourth aspect, an embodiment of the present invention provides a user terminal, where the user terminal includes a memory and a processor, where: the memory is for storing an application program, and the processor is for executing the application program for: logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by the at least one intelligent device to the projection device, wherein the device account of the at least one intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by at least one intelligent device.
With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the processor is further configured to execute the application program to: generating a request for corresponding the projection device and at least one intelligent device to the same group; sending the request to an Internet of things platform, so that the Internet of things platform corresponds the device account number of the projection device and the device account number of at least one intelligent device to the group identification of the same group; and generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
With reference to the fourth aspect, in a second possible implementation manner of the fourth aspect, before the step of generating the instruction that sends the state information reported by the at least one smart device to the projection device, the processor is further configured to execute the following steps: generating a binding request aiming at the projection equipment, and sending the binding request to an Internet of things platform so that the Internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; generating a binding request aiming at least one intelligent device, and sending the binding request to the IOT platform, so that the IOT platform stores the binding relation between the user account and the at least one intelligent device.
In a fifth aspect, an embodiment of the present invention provides a projection apparatus, including:
the first login module is used for establishing connection with the Internet of things platform through the Internet and logging in the Internet of things platform through a device account number of the projection device registered in the Internet of things platform in advance; the system comprises a state information receiving module, a projection module and a display module, wherein the state information receiving module is used for receiving state information of a plurality of intelligent devices forwarded by an Internet of things platform, the state information is sent to the Internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the Internet of things platform in advance have an incidence relation on the Internet of things platform; and the projection module is used for projecting the state information of the intelligent devices to the same screen.
With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the projection device and the device accounts of the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect, the plurality of intelligent devices include a mobile terminal, and the state information receiving module is specifically configured to receive geographic location information of the plurality of mobile terminals, which is forwarded by the internet of things platform; the projection module is specifically configured to: when the state information receiving module receives the geographical position information sent by the mobile terminals, the geographical position information of the intelligent devices is marked on the same map and is displayed in a projection mode in a preset area.
With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, the projection apparatus further includes: the detection module is used for detecting the state information of the intelligent equipment; and the early warning prompt module is used for sending out corresponding early warning prompts when the state information reaches preset conditions.
With reference to the third possible implementation manner of the fifth aspect, in a fourth possible implementation manner of the fifth aspect, the early warning prompting module is specifically configured to execute one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
With reference to the third possible implementation manner of the fifth aspect, in a fifth possible implementation manner of the fifth aspect, the intelligent device includes a sphygmomanometer, and the state information receiving module is specifically configured to receive blood pressure data of the sphygmomanometer, which is forwarded by the internet of things platform; the detection module is specifically used for judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and the early warning prompt module is specifically used for sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value when the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the fifth aspect, in a sixth possible implementation manner of the fifth aspect, the intelligent device includes a camera, and the state information receiving module is specifically configured to receive video information, which is forwarded by the internet of things platform and captured by the camera; the detection module is specifically used for identifying whether the video information contains image information formed by personnel movement; and the early warning prompt module is specifically used for sending out a preset form of early warning prompt which indicates that people move when the video information contains image information formed by the movement of the people.
With reference to the third possible implementation manner of the fifth aspect, in a seventh possible implementation manner of the fifth aspect, the intelligent device includes a camera; the state information receiving module is specifically used for receiving video information which is transmitted by the Internet of things platform and shot by the camera; the detection module is specifically used for judging whether the video information contains a face portrait or not, extracting the contained face portrait when the video information contains the face portrait, and identifying whether the extracted face portrait and a pre-stored face portrait with a master identity belong to the same person main body or not; and the early warning prompting module is specifically used for sending an early warning prompt in a preset form to indicate that a stranger exists when the detection module detects that the extracted face avatar and the pre-stored face avatar with the master identity do not belong to the same person subject.
With reference to the third possible implementation manner of the fifth aspect, in an eighth possible implementation manner of the fifth aspect, the intelligent device includes a refrigerator, and a state information receiving module, specifically configured to receive food information stored in the refrigerator and forwarded by the internet of things platform; the detection module is specifically configured to check whether one or two of the following conditions are satisfied according to the food information: 1) the food type represented by the food information is less than the preset type; 2) the food amount corresponding to one food in the food information is lower than a preset value; and the early warning prompt module is specifically used for generating an early warning prompt corresponding to the established condition when the one or two conditions detected by the detection module are established.
In a sixth aspect, an embodiment of the present invention provides a user terminal, including:
the second login module is used for logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; the system comprises an instruction generating module, a projection device and a display module, wherein the instruction generating module is used for generating an instruction for sending the state information reported by at least one intelligent device to the projection device, a device account of the at least one intelligent device and a user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and the instruction sending module is used for sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by the at least one intelligent device.
With reference to the sixth aspect, in a first possible implementation manner of the sixth aspect, the user terminal further includes: the group generation request module is used for generating a request for enabling the projection equipment and at least one intelligent device to correspond to the same group; the group generation request sending module is used for sending a request to the Internet of things platform so that the Internet of things platform corresponds the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to the group identification of the same group; and the instruction generating module is specifically used for generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
With reference to the sixth aspect, in a second possible implementation manner of the sixth aspect, the user terminal further includes: the system comprises a first binding request generating module, a first binding request sending module and a second binding request sending module, wherein the first binding request generating module is used for generating a binding request aiming at the projection equipment; the system comprises a first binding request generation module used for generating a binding request aiming at least one intelligent device, and a first binding request sending module used for sending the binding request to an Internet of things platform so as to enable the Internet of things platform to store the binding relationship between a user account and at least one intelligent device.
According to the technical scheme, the projection equipment in the embodiment of the invention is connected with the Internet of things platform through the Internet, receives the state information transmitted by the intelligent equipment and forwarded by the Internet of things platform, and projects the state information of the intelligent equipment to the same screen. Therefore, the state information of the intelligent devices can be conveniently and simultaneously known without space limitation, and the user experience is improved.
In addition, the projection equipment can detect the received state information of each intelligent equipment, and sends out corresponding early warning prompts when the state information reaches preset early warning prompt conditions, so that the effect of monitoring the state information of a plurality of intelligent equipment on the same screen can be achieved.
Drawings
Fig. 1 is a schematic diagram of connections between network elements involved in an embodiment of the present invention;
FIG. 2 is a flowchart of a method for monitoring the state of an intelligent device on the same screen through a projection device according to an embodiment of the present invention;
FIG. 3 is another flowchart of a method for monitoring the status of a smart device via a projection device according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating an interface element of a device list of a user terminal according to an embodiment of the present invention;
FIG. 5 is a schematic interface diagram of a user terminal binding device in an embodiment of the present invention;
FIG. 6 is a block diagram of a hardware configuration of a projection device according to an embodiment of the present invention;
fig. 7 is a block diagram of a hardware structure of a user terminal according to an embodiment of the present invention;
FIG. 8 is a functional block diagram of a projection apparatus according to an embodiment of the present invention;
fig. 9 is a schematic diagram of functional modules of a user terminal in an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the embodiment of the invention, the monitoring results of the plurality of intelligent devices are projected on the screen of the projection device, so that a user can conveniently and simultaneously view the monitoring results of the plurality of intelligent devices. In the embodiment of the invention, the projection equipment is not directly communicated with the plurality of intelligent equipment, but is communicated with the plurality of intelligent equipment through the internet of things platform, the projection equipment is communicated with the internet of things platform, and each equipment accessed to the internet of things platform is controlled and managed through the user terminal.
Fig. 1 is a schematic connection diagram between network elements involved in an embodiment of the present invention, where the network elements involved in the embodiment of the present invention include a projection device 101, an internet of things platform 102, a plurality of intelligent devices 103, and a user terminal 104. The projection device 101 can be a laser micro projector, a home laser cinema, a laser engineering projector and other projection devices 101 with different technologies; the internet of things platform 102 is a cloud platform for realizing interconnection and interaction between users and equipment, and between equipment, and in practical application, the internet of things platform consists of one or more servers, and can exist in a form of a third-party open platform or a form of a system internal platform; the smart device 103 is a smart terminal product with a communication function, and may be a smart phone or a wearable device, and may further include, but is not limited to, the following hardware devices:
1) audio and video types: network cameras (monitoring, nursing), automobile data recorders, visible doorbells, etc.;
2) communication and interaction: a voice intercom watch, a children early education machine, a social television, an electronic photo frame and the like;
3) data collection type: body weight scales, thermometers, air detectors, hand rings, etc.;
4) wireless control type: sound box, air purifier, bulb, socket, door lock, sphygmomanometer, air conditioner, refrigerator, etc.
The user terminal 104 is a terminal device connected to the internet of things platform 102, and may be a terminal device such as a mobile phone, a tablet computer, and a personal computer, and is specifically configured to control and manage devices (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, for example: checking a device list, binding new devices, unbinding devices, checking state information of the devices, receiving messages sent by the devices, establishing a device group and the like.
The plurality of intelligent devices 103 in fig. 1 may be the same device or different devices, and are not limited herein. The projection device 101, the internet of things platform 102, the plurality of intelligent devices 103 and the user terminal 104 are communicated with each other through a wireless or wired network.
The on-screen projection method in the embodiment of the present invention is described in detail below with reference to fig. 2.
201. The projection equipment is connected with the Internet of things platform through the Internet, and logs in the Internet of things platform through an equipment account number corresponding to the projection equipment registered in the Internet of things platform in advance;
the internet of things platform 102 provides a Software Development Kit (SDK) or an integration module to each hardware device, and each hardware device can access the internet of things platform 102 through Development integration, establish connection with the internet of things platform 102, and interconnect with the internet of things platform 102, including: the method comprises the steps of registering in the internet of things platform 102, the internet of things platform 102 distributing equipment accounts for each hardware equipment, managing the state of each hardware equipment through the user terminal 104, and receiving and sending signaling or messages through the internet of things platform 102. Therefore, after the projection device 101 establishes a connection with the internet of things platform 102 through the SDK or the integration module provided by the internet of things platform 102, the projection device logs in the internet of things platform 102 with the device account number registered in the internet of things platform 102 to communicate with the internet of things platform 102.
202. The projection equipment receives state information of a plurality of intelligent equipment forwarded by the Internet of things platform;
not only the projection device 101 but also other intelligent devices 103 are connected to the internet of things platform 102, and similarly, each intelligent device 103 establishes a connection with the internet of things platform 102 through an SDK or an integration module provided by the internet of things platform 102 and registers on the internet of things platform 102, and the internet of things platform 102 allocates a corresponding device account to each intelligent device 103.
The device accounts of the multiple intelligent devices 103 on the internet of things platform 102 have an association relationship with the device account of the projection device 101. Optionally, a specific implementation manner is that the user terminal 104 is respectively bound with the projection device 101 and the plurality of intelligent devices 103, so that an association relationship is established between the projection device 101 and the plurality of intelligent devices 103 on the internet of things platform 102.
The intelligent device 103 reports its own state information to the internet of things platform 102, and the internet of things platform 102 receives the state information of each intelligent device 103.
The status information here differs according to the product form of each smart device 103, for example, if the smart device 103 is a camera, the status information may be video data collected by the camera in real time; if the smart device 103 is a smart band, the state information may be human health state data and exercise data collected by the smart band; when the smart device 103 is a mobile terminal, the state information may be geographical location information of the mobile terminal; when the smart device 103 is a sphygmomanometer, the status information may be blood pressure data measured by the sphygmomanometer.
After receiving the state information of each smart device 103, the internet of things platform 102 forwards the state information to the projection device 101 associated with the smart device 103, and the projection device 101 receives the state information of the plurality of smart devices 103.
Optionally, the projection device 101 and the multiple intelligent devices 103 belong to the same group established by the same user account on the internet of things platform 102, and after receiving the state information of the multiple intelligent devices 103, the internet of things platform 102 forwards the state information to the projection device 101 belonging to the same group as the corresponding intelligent device 103. Optionally, the group establishing method may specifically be: a group is created by the user terminal 104, and one projection device 101 and a plurality of terminal devices 103 are selected from the device list bound to the user terminal 104 to join the group.
Optionally, after each intelligent device 103 sends its own state information to the internet of things platform 102, the internet of things platform 102 needs to detect whether the projection device 101 associated with each intelligent device 103 has logged in the internet of things platform 102, and if the internet of things platform 102 has logged in, the internet of things platform 102 sends the state information to the projection device 101; if the internet of things platform 102 is not logged in, the internet of things platform 102 stores the received state information, and when the projection device 101 establishes connection with the internet of things platform, the state information of each intelligent device 103 is sent.
203. The projection device projects the state information of the plurality of intelligent devices to the same screen.
After receiving the status information of the plurality of intelligent devices 103 forwarded by the internet of things platform 102, the projection device 101 displays the status information of the plurality of intelligent devices 103 on the projection screen at the same time. The specific mode of the on-screen display is not specifically limited here, and the screen can be adaptively displayed according to the resolution of the display screen, the number of the intelligent devices 103, and the size of the default display interface of each intelligent device 103; multiple pieces of status information may be displayed in a scrolling manner cyclically on the screen, etc.
Optionally, after the projection device 101 receives the state information of the smart device 103 forwarded by the internet of things platform 102, the state information of different smart devices 103 may be processed differently and then displayed. For example: when the smart device 103 includes a plurality of mobile terminals (terminals such as a smart phone, a tablet computer, and an intelligent wearable device), and the state information of the plurality of mobile terminals received by the projection device 101 includes geographical location information of the plurality of mobile terminals, the projection device 101 marks the received plurality of geographical location information on the same map at the same time, and displays the map marked with the geographical locations of the plurality of mobile terminals in a preset area of the projection device 101.
Optionally, after the projection device 101 receives the state information of the intelligent device 103 forwarded by the internet of things platform 102, different detections may be performed on the state information of different intelligent devices 103, and when the state information reaches a preset condition, a corresponding warning prompt is sent. The specific manner of prompting can be various, and for example, one or more of the following manners can be included: 1) the projection apparatus 101 generates an audio alarm indicating that the state information reaches a preset condition, and plays the audio alarm; 2) the projection device 101 displays the status information as a logo.
The following description illustrates the projection device 101 detecting and warning the status information of different smart devices 103:
when the intelligent device 103 includes a blood pressure meter, the state information forwarded by the internet of things platform 102 to the projection device 101 is blood pressure data of the user measured by the sphygmomanometer, and when the projection device 101 detects that a blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value (for example, exceeds a normal blood pressure value range), an early warning prompt set by the system and indicating that the blood pressure value reaches the preset blood pressure value is sent, for example: prompting is performed by flashing an interface presentation area of the smart device on the projection screen.
When the intelligent device 103 comprises a camera, the state information forwarded to the projection device 101 by the internet of things platform 102 is video information shot by the camera, and the projection device 101 identifies whether the video information contains image information formed by movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt indicating that the personnel move. For example: marking the frame of the video information display area in red, or performing text prompt on a video information display interface, or shaking a video information display picture, or generating and playing a sound alarm and the like.
The situation that the intelligent device 103 is a camera is suitable for a use scene monitored by the camera, and besides, the camera can be commonly applied to an access control system in an intelligent home, when the intelligent device 103 is the access control camera in the access control system, the internet of things platform 102 forwards the state information of the projection device 101 to video information shot by the camera, the projection device 101 judges whether the video information contains a human face image, if so, the human face image is extracted, and whether the extracted human face image is matched with a pre-stored human face image with a master identity is identified; if the extracted face avatar does not match any pre-stored face avatar with the owner identity, a pre-set form of early warning prompt indicating that a stranger is present is sent, for example: an audible alarm is generated and played.
When the intelligent device 103 includes a refrigerator, the state information forwarded by the internet of things platform 102 to the projection device 101 includes food information stored in the refrigerator, the projection device 101 detects whether the food type represented by the food information in the refrigerator is less than a preset type, and if the food type represented by the food information in the refrigerator is less than the preset type, an early warning prompt that the food type preset by the system is less than the preset type is generated, for example: the display area frame of the state information is marked red, or a text prompt is carried out on the display interface, or the picture area of the state information is displayed in a shaking way, or a sound alarm is generated and played, and the like. The projection device 101 detects whether the amount of food corresponding to one of the food in the food information is lower than a preset value, and if so, generates an early warning prompt that the amount of food preset by the system is lower than the preset value, for example: carrying out corresponding food flickering prompt in the display area of the state information, or generating text information prompt in the display area; for example: when the number of eggs in the refrigerator is less than 3, the projection apparatus 101 flickers the image of the eggs in the status information display area of the refrigerator to prompt.
The above examples are only examples of the projection device 101 detecting and warning the status information of different smart devices 103, and it should be clear to those skilled in the art that the projection device 101 may also detect and warn other smart devices 103, and the description is not repeated here.
Thus, according to the embodiment of the present invention, the projection device 101 does not need to establish a connection with each of the plurality of intelligent devices 103, but establishes a connection with the internet of things platform 102 through the projection device 101 and the intelligent devices 103, and the projection device 101 receives the state information of the intelligent devices 103 associated therewith through the internet of things platform 102, on one hand, the state of each intelligent device 103 can be known at the same time; on the other hand, the state information of each intelligent device can be known remotely or remotely without space limitation; moreover, the state of each intelligent device 103 can be known when the projection device 101 is started and networked, which is convenient and fast.
In addition, the projection device 101 can detect the received state information of each intelligent device 103, and send out a corresponding early warning prompt when the state information reaches a preset early warning prompt condition, so that the state information of a plurality of intelligent devices can be monitored on the same screen.
Both the projection device 101 and the intelligent terminal 103 can be managed by the user terminal 104, and the method for monitoring the state of the intelligent device in the embodiment of the present invention is described below with reference to fig. 3 from the user terminal side.
Specifically, the intelligent terminal 104 is a terminal device connected to the internet of things platform 102, and specifically may be a terminal device such as a mobile phone, a tablet computer, and a personal computer, and is configured to control and manage devices (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, for example: checking a device list, binding new devices, unbinding devices, checking state information of the devices, receiving messages sent by the devices, establishing a device group and the like.
301. The user terminal logs in the Internet of things platform through a user account which is registered in the Internet of things platform in advance;
similar to the projection device 101 and the smart device 103, the user terminal 104 also accesses the internet of things platform 102 through the SDK or the integration module provided by the internet of things platform 102 and the internet of things platform 102, and registers on the internet of things platform 102 to obtain a user account.
The user logs in the internet of things platform 102 through a user account on the user terminal 104, specifically, the user may log in through an application program APP or a webpage, and after logging in, the related information of the projection device 101 and the intelligent device 103 bound to the user account may be displayed on an interface of the user terminal 104. As shown in fig. 4, the device list information bound on the interface of the user terminal 104 includes: the intelligent shoe named as the cloud shoe of the baby, the camera named as the camera of the elisa, the intelligent television 103 named as the television in the living room and the like can be clicked to check the specific information of the corresponding intelligent device 103.
Optionally, in practical application, the user searches for the device through the user terminal 104 first, and then binds the found device, so that the device bound to the user account can be displayed on the interface of the user terminal 104. Specifically, the user terminal 104 may find other intelligent devices (including the projection device 101 and the intelligent device 103) that have been accessed to the internet of things platform 102 by scanning the two-dimensional code or by clicking "search new device" in fig. 4, and after finding a device that needs to be bound, click "binding" on the interface as shown in fig. 5, so that the application terminal 104 generates a binding request for the device, and after receiving the binding request, the internet of things platform 102 stores the binding relationship between the user account and the device account of the device, and returns confirmation information of "binding success" or "binding failure" to the user terminal 104, and the user terminal 104 notifies the user of the binding result through an interface prompt.
For example: as shown in fig. 5, the user terminal 104 finds the projection device: the home projector generates a binding request aiming at the home projector equipment when a user clicks binding on an interface, and the internet of things platform 102 stores the binding relationship between the user account and the equipment account of the home projector equipment after receiving the binding request; likewise, the search and binding of the smart device 103 is the same as the projection device, and will not be described herein.
302. The user terminal generates an instruction for sending the state information reported by the at least one intelligent device to the projection device;
the user sets on the user terminal 104 whether to project the state information of the smart device 103 to the projection device 101, and specific setting manners may include, but are not limited to, the following two types: 1) the user selects which intelligent devices 103 state information are projected on the projection device 101 in the device list of the user terminal 104; 2) whether to project its status information onto the projection device 101 is set for the smart devices 103 in the device list. After the setting is completed, the user terminal 104 generates an instruction for sending the set state information reported by the smart device 103 to the projection device 101.
Optionally, the user may set the associated smart device 103 and the projection device 101 as device members in the same group on the user terminal 104, so that the user terminal may generate, by default, an instruction for sending the state information reported by the smart device 103 in the group to the projection device 101 in the group. Specifically, when a user establishes a group and sets the smart devices 103 and the projection device 101 in the group, the user terminal 104 generates a request for enabling the projection device 101 and at least one smart device 103 to correspond to the same group, and sends the request to the internet of things platform 102, and then the internet of things platform 102 enables the device account number of the projection device 101 and the device account number of the at least one smart device 103 to correspond to the group identifier of the same group. The specific interface and interactive design method for establishing the group are not limited, and are not limited herein.
303. And the user terminal sends the instruction to the Internet of things platform.
After generating an instruction for sending the set state information reported by the intelligent device 103 to the corresponding projection device 101, the user terminal 104 sends the instruction to the internet of things platform 102, and after receiving the instruction, the internet of things platform 102 forwards the state information reported by the intelligent device 103 indicated in the instruction to the projection device 101 indicated in the instruction.
In the embodiment of the invention, the user terminal 104 can perform binding setting and group setting on each device (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, and generate an instruction for sending the set state information reported by the intelligent device 103 to the corresponding projection device 101, so that the state information of the intelligent device 103 displayed on the projection device 101 on the same screen can be controlled, the realizability of the scheme is improved, and the user experience is improved.
The foregoing describes a method for monitoring a state of an intelligent device by using a projection device in an embodiment of the present invention, and the following describes a projection device and a user terminal in an embodiment of the present invention.
With reference to fig. 6, an embodiment of the present invention further provides a projection device 6, where the projection device 6 is a projection device of different technologies, such as the laser pico projector, the home laser cinema, the laser engineering projector, and the like, described in the foregoing embodiment shown in fig. 1.
Specifically, the projection device 6 in the embodiment of the present invention includes: the memory 601, the processor 602 and the projection component 603 further include at least one network interface or other communication interfaces, and the communication connection between the at least one network interface and at least one other network element is realized through the at least one network interface (which may be wired or wireless).
Memory 601 may include both read-only memory and Random-access memory, and may provide instructions and data to processor 602, and portions of memory 601 may include high-speed Random-access memory (RAM) and non-volatile memory (non-volatile memory).
Memory 601 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof:
the application program comprises the following steps: including various operational instructions for performing various operations.
Operating the system: including various system programs for implementing various basic services and for handling hardware-based tasks.
Processor 602 performs some or all of the steps performed by projection device 101 in the method embodiment shown in fig. 2 described above by calling an application program stored in memory 601 (which may be stored in an operating system). The method is mainly used for executing:
establishing connection with an Internet of things platform through the Internet, and logging in the Internet of things platform by using a device account number corresponding to a projection device registered in the Internet of things platform in advance; receiving state information of a plurality of intelligent devices forwarded by an internet of things platform, wherein the state information is sent to the internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the internet of things platform in advance have an association relationship on the internet of things platform; the projection part 603 is controlled to project the status information of the plurality of smart devices to the same screen.
In some specific implementations, the projection device and the plurality of intelligent devices belong to the same group established by the same user account, and the device accounts of the projection device and the plurality of intelligent devices correspond to group identifiers of the same group in the internet of things platform.
In some specific implementations, in a second possible implementation manner of the third aspect, the plurality of intelligent devices include a mobile terminal, and the state information includes geographic location information of the mobile terminal; the processor 602 is specifically configured to perform the following steps: receiving geographical position information of the mobile terminal forwarded by the Internet of things platform; when receiving the geographical location information sent by a plurality of mobile terminals, the projection component 603 is controlled to mark the geographical location information of a plurality of intelligent devices on the same map and to project and display the geographical location information in a preset area.
In some specific implementations, the processor 602 is further configured to perform the following steps: and detecting the state information of the intelligent equipment, and if the state information reaches a preset condition, sending out a corresponding early warning prompt.
In some specific implementations, the step of issuing the corresponding warning prompt executed by the processor 602 includes one or both of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
In some implementations, the smart device includes a blood pressure meter, the status information includes blood pressure data measured by the blood pressure meter; the processor 602 is specifically configured to perform the following steps: judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
In some specific implementations, the smart device includes a camera, and the state information includes video information captured by the camera; the processor 602 is specifically configured to perform the following steps: identifying whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
In some specific implementations, the smart device includes a camera, and the state information includes video information captured by the camera; the processor 602 is specifically configured to perform the following steps: judging whether the video information contains a face head portrait or not; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
In some specific implementations, the smart device includes a refrigerator, the status information includes food information stored within the refrigerator, and the processor 602 is specifically configured to perform the following steps: checking whether one or two of the following conditions are satisfied according to the food information, and generating an early warning prompt corresponding to the satisfied conditions: the food type represented by the food information is less than the preset type; or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
For details of the interaction between the components of the intelligent device 6 and the steps executed by the processor, please refer to the interaction process in the embodiment shown in fig. 2, which is not described herein again.
With reference to fig. 7, an embodiment of the present invention further provides a user terminal 7, where a product form of the user terminal 7 in practical application is the user terminal product exemplified in the embodiment shown in fig. 1.
In particular, the user terminal 7 comprises a memory 701 and a processor 702. Memory 701 may include both read-only Memory and Random-Access Memory, and may provide instructions and data to processor 702, and portions of Memory 701 may include high-speed Random-Access Memory (RAM), and may also include non-volatile Memory.
Memory 701 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof:
the application program comprises the following steps: including various operational instructions for performing various operations.
Operating the system: including various system programs for implementing various basic services and for handling hardware-based tasks.
In this embodiment of the present invention, the processor 702 executes some or all of the steps executed by the user terminal 104 in the embodiment of the method shown in fig. 3 by calling the application program stored in the memory 701, and is mainly configured to execute:
logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by the at least one intelligent device to the projection device, wherein the device account of the at least one intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by at least one intelligent device.
In some implementations, the processor is further configured to execute the application for: generating a request for corresponding the projection device and at least one intelligent device to the same group; sending the request to an Internet of things platform, so that the Internet of things platform corresponds the device account number of the projection device and the device account number of at least one intelligent device to the group identification of the same group; and generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
In some specific implementations, before the step of generating the instruction for sending the state information reported by the at least one smart device to the projection device, the processor is further configured to perform the following steps: generating a binding request aiming at the projection equipment, and sending the binding request to an Internet of things platform so that the Internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; generating a binding request aiming at least one intelligent device, and sending the binding request to the IOT platform, so that the IOT platform stores the binding relation between the user account and the at least one intelligent device.
For details of the interaction between the components of the user terminal 7 and the steps executed by the processor, please refer to the interaction process in the embodiment shown in fig. 3, which is not described herein again.
The projection device 6 and the user terminal 7 in the embodiment of the present invention are described above from the perspective of hardware structures, and the projection device and the user terminal in the embodiment of the present invention are described below from the perspective of functional modules.
With reference to fig. 8, an embodiment of the present invention provides a projection apparatus 8, including:
a first login module 801, configured to establish a connection with an internet of things platform through the internet, and login to the internet of things platform through a device account of the projection device registered in the internet of things platform in advance;
the state information receiving module 802 is configured to receive state information of the multiple intelligent devices forwarded by the internet of things platform, where the state information is sent to the internet of things platform by the intelligent devices, and an association relationship exists between a device account of the projection device and a device account corresponding to each of the multiple intelligent devices registered in advance in the internet of things platform;
and the projection module 803 is used for projecting the state information of the plurality of intelligent devices to the same screen.
In some specific implementations, the projection device 8 and the plurality of smart devices belong to the same group established by the same user account, and the projection device 8 and the device accounts of the plurality of smart devices correspond to group identifiers of the same group in the internet of things platform.
The state information receiving module 802 is specifically configured to receive geographic location information of the plurality of mobile terminals forwarded by the internet of things platform; the projection module 803 is specifically configured to: when the state information receiving module 802 receives geographical location information sent by a plurality of mobile terminals, the geographical location information of a plurality of intelligent devices is marked on the same map and is displayed in a projection manner in a preset area.
Optionally, the projection device 8 further includes: the detection module 804 is used for detecting the state information of the intelligent device; and an early warning prompt module 805, configured to send a corresponding early warning prompt when the state information reaches a preset condition.
The early warning module 805 is specifically configured to perform one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
Optionally, the intelligent device includes a sphygmomanometer, and the state information receiving module 802 is specifically configured to receive blood pressure data of the sphygmomanometer forwarded by the internet of things platform; the detection module 804 is specifically configured to determine whether a blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value; the early warning prompting module 805 is specifically configured to send an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value when the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
Optionally, the intelligent device includes a camera, and the state information receiving module 802 is specifically configured to receive video information, which is forwarded by the internet of things platform and captured by the camera; the detection module 804 is specifically configured to identify whether the video information includes image information formed by movement of a person; the early warning prompting module 805 is specifically configured to send an early warning prompt in a preset form indicating that a person moves when the video information includes image information formed by the movement of the person.
Optionally, the intelligent device includes a camera; the state information receiving module 802 is specifically configured to receive video information captured by a camera forwarded by the internet of things platform; the detection module 804 is specifically configured to determine whether the video information includes a face avatar, extract the included face avatar when the video information includes the face avatar, and identify whether the extracted face avatar and a pre-stored face avatar having a master identity belong to the same person subject; the early warning prompting module 805 is specifically configured to send an early warning prompt in a preset form indicating that a stranger exists when the detection module 804 detects that the extracted face avatar and the pre-stored face avatar with a master identity do not belong to the same person subject.
Optionally, the intelligent device includes a refrigerator, and the state information receiving module 802 is specifically configured to receive food information stored in the refrigerator and forwarded by the internet of things platform; the detecting module 804 is specifically configured to check whether one or two of the following conditions are satisfied according to the food information: 1) the food type represented by the food information is less than the preset type; 2) the food amount corresponding to one food in the food information is lower than a preset value; the early warning module 805 is specifically configured to generate an early warning prompt corresponding to the one or two conditions detected by the detecting module 804 when the one or two conditions are met.
For details of the interaction between the functional modules of the intelligent device 8, please refer to the interaction process in the embodiment shown in fig. 2, which is not described herein again.
With reference to fig. 9, an embodiment of the present invention provides a user terminal 9, including:
a second login module 901, configured to log in the internet of things platform with a user account registered in the internet of things platform in advance;
the instruction generating module 902 is configured to generate an instruction for sending the state information reported by the at least one piece of smart device to the projection device, where a device account and a user account of the at least one piece of smart device have a binding relationship on an internet of things platform, and a device account and a user account of the projection device have a binding relationship on the internet of things platform;
and the instruction sending module 903 is configured to send an instruction to the internet of things platform, so that the internet of things platform forwards the state information to the projection device after receiving the state information reported by the at least one intelligent device.
Optionally, the user terminal further includes: the group generation request module is used for generating a request for enabling the projection equipment and at least one intelligent device to correspond to the same group; the group generation request sending module is used for sending a request to the Internet of things platform so that the Internet of things platform corresponds the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to the group identification of the same group; the instruction generating module 902 is specifically configured to generate an instruction for sending the state information reported by the smart devices in the same group to the projection devices in the group.
Optionally, the user terminal further includes: the system comprises a first binding request generating module, a first binding request sending module and a second binding request sending module, wherein the first binding request generating module is used for generating a binding request aiming at the projection equipment; the system comprises a first binding request generation module used for generating a binding request aiming at least one intelligent device, and a first binding request sending module used for sending the binding request to an Internet of things platform so as to enable the Internet of things platform to store the binding relationship between a user account and at least one intelligent device.
For details of the interaction between the functional modules of the user terminal 9, please refer to the interaction process in the embodiment shown in fig. 3, which is not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (16)

1. A method for monitoring the state of intelligent equipment on the same screen is characterized by comprising the following steps:
the method comprises the steps that a projection device is connected with an internet of things platform through the internet, and logs in the internet of things platform through a device account number corresponding to the projection device registered in the internet of things platform in advance;
the projection equipment receives state information of a plurality of intelligent equipment forwarded by the internet of things platform, the state information is sent to the internet of things platform by the intelligent equipment, and an equipment account number of the projection equipment and an equipment account number corresponding to each of the plurality of intelligent equipment registered in advance in the internet of things platform have an association relationship in the internet of things platform;
and the projection equipment projects the state information of the intelligent equipment to the same screen in a scrolling and circulating display mode.
2. The method of claim 1,
the projection device and the intelligent devices belong to the same group established by the same user account, and the projection device and the intelligent devices have device accounts corresponding to group identifications of the same group in the internet of things platform.
3. The method according to claim 1 or 2, wherein the plurality of intelligent devices comprise mobile terminals, and the state information of the mobile terminals received by the projection device comprises geographical location information of the mobile terminals;
the projection device projecting the state information of the plurality of smart devices to the same screen includes:
when receiving the geographical position information sent by a plurality of mobile terminals, the projection equipment marks the geographical position information of the plurality of mobile terminals on the same map and displays the geographical position information in a projection mode in a preset area.
4. The method according to claim 1 or 2, characterized in that the method further comprises:
and the projection equipment detects the state information, and sends out corresponding early warning prompt if the state information reaches a preset condition.
5. The method of claim 4, wherein the step of the projection device issuing the corresponding warning prompt comprises one or both of:
the projection equipment generates an audio alarm which represents that the state information reaches a preset condition, and plays the audio alarm;
and the projection equipment displays the state information in an identification manner.
6. The method of claim 4, wherein the plurality of smart devices include a blood pressure meter, the status information sent by the blood pressure meter received by the projection device including blood pressure data;
the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps:
the projection equipment judges whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not;
and if the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
7. The method according to claim 4, wherein the plurality of intelligent devices comprise cameras, and the state information sent by the cameras and received by the projection device comprises video information captured by the cameras;
the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps:
the projection equipment identifies whether the video information contains image information formed by personnel movement;
and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt indicating that the personnel move.
8. The method according to claim 4, wherein the plurality of intelligent devices comprise cameras, and the state information sent by the cameras and received by the projection device comprises video information captured by the cameras;
the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps:
the projection equipment judges whether the video information contains a human face head portrait;
if the video information contains a face head portrait, extracting the face head portrait;
identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body;
and if the extracted face portrait and any one of the pre-stored face portraits with owner identities do not belong to the same person main body, sending out an early warning prompt in a preset form to indicate that a stranger exists.
9. The method of claim 4, wherein the plurality of smart devices include a refrigerator, and the status information sent by the refrigerator received by the projection device includes food information stored within the refrigerator;
the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps:
the projection equipment checks whether one or two following conditions are satisfied or not according to the food information, and if so, an early warning prompt corresponding to the satisfied conditions is generated:
the food type represented by the food information is less than a preset type;
the food amount corresponding to one food in the food information is lower than a preset value.
10. A method for monitoring the state of intelligent equipment on the same screen is characterized by comprising the following steps:
a user terminal logs in an internet of things platform through a user account which is registered in the internet of things platform in advance;
the user terminal generates an instruction for sending the state information reported by at least one intelligent device to a projection device, wherein a device account of the at least one intelligent device and the user account have a binding relationship on the internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform;
and the user terminal sends the instruction to the Internet of things platform, so that the Internet of things platform receives the state information reported by the at least one intelligent device and forwards the state information to the projection device.
11. The method of claim 10, further comprising:
the user terminal generates a request for enabling the projection equipment and the at least one intelligent device to correspond to the same group;
the user terminal sends the request to the Internet of things platform, so that the Internet of things platform enables the device account number of the projection device and the device account number of the at least one intelligent device to correspond to the group identification of the same group;
the step of generating, by the user terminal, an instruction for sending the state information reported by the at least one intelligent device to the projection device includes: and the user terminal generates an instruction for sending the state information reported by the intelligent equipment in the same group to the projection equipment in the group.
12. The method according to claim 10, wherein before the step of generating, by the user terminal, an instruction for sending the status information reported by the at least one smart device to the projection device, the method further comprises:
the user terminal generates a binding request aiming at the projection equipment, and sends the binding request to the Internet of things platform, so that the Internet of things platform stores the binding relationship between the user account and the equipment account of the projection equipment;
the user terminal generates a binding request aiming at the at least one intelligent device, and sends the binding request to the Internet of things platform, so that the Internet of things platform stores the binding relationship between the user account and the at least one intelligent device.
13. A projection device comprising a memory, a processor, and a projection component, wherein:
the memory is used for storing an application program;
a processor is for executing the application for:
establishing connection with an internet of things platform through the internet, and logging in the internet of things platform through a device account corresponding to the projection device registered in the internet of things platform in advance;
receiving state information of a plurality of intelligent devices forwarded by the internet of things platform, wherein the state information is sent to the internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the internet of things platform in advance have an association relationship in the internet of things platform;
and controlling the projection component to project the state information of the plurality of intelligent devices to the same screen in a scrolling and circulating display mode.
14. A user terminal comprising a memory and a processor, wherein:
the memory is used for storing an application program;
a processor is for executing the application for:
logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance;
generating an instruction for sending state information reported by at least one intelligent device to a projection device, wherein a device account of the at least one intelligent device and the user account have a binding relationship on the internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform;
and sending the instruction to the Internet of things platform, so that the Internet of things platform receives the state information reported by the at least one intelligent device and forwards the state information to the projection device.
15. A projection device, comprising:
the first login module is used for establishing connection with an internet of things platform through the internet and logging in the internet of things platform through a device account corresponding to the projection device which is registered in the internet of things platform in advance;
the system comprises a state information receiving module, a state information sending module and a state information sending module, wherein the state information is sent to the internet of things platform by the intelligent equipment, and the state information is forwarded by the internet of things platform;
and the projection module is used for projecting the state information of the plurality of intelligent devices to the same screen in a scrolling and circulating display mode.
16. A user terminal, comprising:
the second login module is used for logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance;
the system comprises an instruction generating module, an instruction receiving module and a display module, wherein the instruction generating module is used for generating an instruction for sending state information reported by at least one intelligent device to a projection device, a device account of the at least one intelligent device and a user account have a binding relationship in an internet of things platform, and the device account of the projection device and the user account have a binding relationship in the internet of things platform;
and the instruction sending module is used for sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by the at least one intelligent device.
CN201510780091.XA 2015-11-13 2015-11-13 Method for monitoring state of intelligent device on same screen, projection device and user terminal Active CN106708451B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201510780091.XA CN106708451B (en) 2015-11-13 2015-11-13 Method for monitoring state of intelligent device on same screen, projection device and user terminal
PCT/CN2016/104633 WO2017080402A1 (en) 2015-11-13 2016-11-04 Method for monitoring states of smart devices with same screen, projection equipment, and user terminal
TW105136798A TWI628611B (en) 2015-11-13 2016-11-11 A method for monitoring the state of the intelligent device on the same screen, a projection device and a user terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510780091.XA CN106708451B (en) 2015-11-13 2015-11-13 Method for monitoring state of intelligent device on same screen, projection device and user terminal

Publications (2)

Publication Number Publication Date
CN106708451A CN106708451A (en) 2017-05-24
CN106708451B true CN106708451B (en) 2020-04-28

Family

ID=58694582

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510780091.XA Active CN106708451B (en) 2015-11-13 2015-11-13 Method for monitoring state of intelligent device on same screen, projection device and user terminal

Country Status (3)

Country Link
CN (1) CN106708451B (en)
TW (1) TWI628611B (en)
WO (1) WO2017080402A1 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222536A (en) * 2017-05-31 2017-09-29 济南浪潮高新科技投资发展有限公司 A kind of method of cloud Internet of Things platform adaptive terminal
CN107948765A (en) * 2018-01-11 2018-04-20 重庆和视科技发展有限公司 Window talkback host and system with Multifunctional calling intercommunication
CN109325076B (en) * 2018-06-07 2020-03-27 北京百度网讯科技有限公司 Data management method and device in Internet of things, computer device and readable medium
CN109218144A (en) * 2018-08-18 2019-01-15 佛山市云米电器科技有限公司 The method remotely monitored by refrigerator
CN111083021A (en) * 2018-10-19 2020-04-28 佛山市顺德区美的饮水机制造有限公司 Display terminal and display system
CN109525469B (en) * 2018-12-27 2022-01-11 江苏惠通集团有限责任公司 Networking method of intelligent household equipment and intelligent household equipment
CN109951520A (en) * 2019-01-24 2019-06-28 深圳中兴网信科技有限公司 A kind of data transmission method, air monitering equipment and storage medium
CN110009879A (en) * 2019-04-25 2019-07-12 伟创力电子设备(深圳)有限公司 Reminding method, device and the intelligent terminal of corrective maintenance
CN113395382B (en) * 2020-02-27 2023-08-22 华为技术有限公司 Method for data interaction between devices and related devices
TWI790604B (en) * 2021-04-23 2023-01-21 台灣松下電器股份有限公司 image conversion method
CN115247924B (en) * 2021-04-27 2023-11-03 云米互联科技(广东)有限公司 Screen sharing method and device based on intelligent refrigerator and intelligent refrigerator
CN113729699A (en) * 2021-08-27 2021-12-03 苏州大学附属第一医院 Pulse blood oxygen saturation monitoring method and system based on intelligent wearing

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5740826B2 (en) * 2010-03-29 2015-07-01 セイコーエプソン株式会社 Image display device, image information processing device, and image information processing method
CN102279589B (en) * 2010-06-09 2013-03-13 常州司曼睿信息科技有限公司 Intelligent family service system and working method thereof
US9122444B2 (en) * 2012-02-08 2015-09-01 Ricoh Company, Ltd. Network accessible projectors that display multiple client screens at once
CN103455207A (en) * 2012-06-04 2013-12-18 爱国者数码科技有限公司 Projection system with interaction function
US9413827B2 (en) * 2013-02-25 2016-08-09 Qualcomm Incorporated Context aware actions among heterogeneous internet of things (IOT) devices
US20140241375A1 (en) * 2013-02-27 2014-08-28 Toyota Motor Engineering & Manufacturing North America, Inc Industrial automation control communication method and apparatus
US10628136B2 (en) * 2013-05-24 2020-04-21 Tata Consultancy Services Limited Internet of things (IoT) application development
CN104579857A (en) * 2013-10-16 2015-04-29 中兴通讯股份有限公司 IoT (Internet of Things) communication method, IoT application platform, as well as IoT platform and system
CN104135647A (en) * 2014-08-04 2014-11-05 深圳市劲松安防科技有限公司 Intelligent home control system, control method and control device
CN104363263B (en) * 2014-10-21 2018-03-06 珠海西默电气股份有限公司 Internet of Things general-purpose platform based on cloud service
CN104780045B (en) * 2015-03-11 2018-02-06 小米科技有限责任公司 The management method and device of smart machine
CN104660714B (en) * 2015-03-13 2018-06-26 北京果加智能科技有限公司 Long-range control method, the apparatus and system of terminal device
CN104992106A (en) * 2015-06-30 2015-10-21 小米科技有限责任公司 Information acquisition method and apparatus

Also Published As

Publication number Publication date
TWI628611B (en) 2018-07-01
TW201717142A (en) 2017-05-16
WO2017080402A1 (en) 2017-05-18
CN106708451A (en) 2017-05-24

Similar Documents

Publication Publication Date Title
CN106708451B (en) Method for monitoring state of intelligent device on same screen, projection device and user terminal
US10008092B2 (en) Method, apparatus, and storage medium for alerting cooking state of electric cooker
US10015060B2 (en) Information sharing method that provides a graphical user interface image for sharing information relating to an application within a home among a plurality of users
CN108897468B (en) Method and system for entering into virtual three-dimensional space panorama of house source
CN105472312A (en) Intelligent shooting system alarming method, intelligent shooting system and network camera
US11159260B2 (en) Method, device, system, and storage medium for live broadcast detection and data processing
US11740091B2 (en) Methods and apparatus for distributing and/or receiving locally relevant information in emergencies
CN107302711B (en) Processing system of media resource
CN105827494B (en) Add the methods, devices and systems of equipment
US20140006513A1 (en) Adjacent person specifying apparatus, adjacent person specifying method, adjacent person specifying program, and adjacent person specifying system
KR101584983B1 (en) system, method, computer program and server for finding missing object based on beacon
US20200074839A1 (en) Situational awareness platform, methods, and devices
WO2018133354A1 (en) Information acquisition method and acquisition device
CN105556879A (en) Method for providing a client device with a media asset
CN108534295B (en) Method, device and system for displaying data
JP2017036976A (en) Position management system, position management device, position management method, and program
JP2020119156A (en) Avatar creating system, avatar creating device, server device, avatar creating method and program
CN110875944A (en) Communication connection method, device, terminal equipment and wireless communication system
CN106504103B (en) Method and device for establishing friend relationship
CN110365558B (en) Fault processing method, device and system
KR20160014056A (en) Method, device and system for realizing visual identification
CN109660508A (en) Data visualization method, electronic device, computer equipment and storage medium
CN105074678B (en) Information terminal, access system, information processing method and program
CN112437332B (en) Playing method and device of target multimedia information
CN110047236B (en) High-risk-level area security management method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 518000 20-22, 20-22 headquarters building, 63 high tech Zone, Xuefu Road, Nanshan District, Guangdong Province, Guangdong.

Applicant after: APPOTRONICS Corp.,Ltd.

Address before: 518000 Nanshan District, Shenzhen, Guangdong, Guangdong Province, Guangdong Road, 63 Xuefu Road, high-tech zone, 21 headquarters building, 22 floor.

Applicant before: SHENZHEN GUANGFENG TECHNOLOGY Co.,Ltd.

Address after: 518000 Nanshan District, Shenzhen, Guangdong, Guangdong Province, Guangdong Road, 63 Xuefu Road, high-tech zone, 21 headquarters building, 22 floor.

Applicant after: SHENZHEN GUANGFENG TECHNOLOGY Co.,Ltd.

Address before: 518055 Shenzhen, Shenzhen, Guangdong 1089 Nanshan District road 1089, Shenzhen integrated circuit design application Industrial Park, 4 floor.

Applicant before: APPOTRONICS Corp.,Ltd.

GR01 Patent grant
GR01 Patent grant