Disclosure of Invention
The embodiment of the invention provides a method for monitoring states of intelligent devices on the same screen, projection equipment and a user terminal, which can display monitoring results of a plurality of intelligent devices on the same screen.
In a first aspect, an embodiment of the present invention provides a method for monitoring a state of an intelligent device on the same screen through a projection device, where the method includes: the projection equipment is connected with the Internet of things platform through the Internet, and logs in the Internet of things platform through an equipment account number corresponding to the projection equipment registered in the Internet of things platform in advance; the projection equipment receives state information of the intelligent equipment forwarded by the internet of things platform, the state information is sent to the internet of things platform by the intelligent equipment, and an equipment account of the projection equipment and equipment accounts corresponding to the intelligent equipment registered in the internet of things platform in advance have an incidence relation in the internet of things platform; the projection device projects the received state information of the plurality of intelligent devices to the same screen.
In the embodiment of the invention, the projection equipment does not need to be connected with the intelligent equipment respectively, but is connected with the Internet of things platform through the projection equipment, the intelligent equipment is also connected with the Internet of things platform respectively, the projection equipment and the intelligent equipment log in the Internet of things platform through respective account numbers registered in the Internet of things platform, the Internet of things platform receives state information of the intelligent equipment which is in association with the projection equipment, the state information is transmitted to the projection equipment, and the projection equipment projects the state information to the same screen. By the method, on one hand, the state information of each intelligent device can be known at the same time; on the other hand, the state information of each intelligent device can be known in a remote or remote way without space limitation; moreover, the state of each intelligent device can be known by starting the projection device and networking, and the method is convenient and quick.
With reference to the first aspect, in a first possible implementation manner of the first aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the projection device and the device accounts of the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the plurality of intelligent devices include a mobile terminal, and the state information of the mobile terminal received by the projection device includes geographical location information of the mobile terminal; the projection device projecting the state information of the plurality of intelligent devices to the same screen includes: when receiving the geographical position information sent by the mobile terminals, the projection equipment marks the geographical position information of the intelligent equipment on the same map and displays the geographical position information in a projection mode in a preset area.
With reference to the first aspect or the first possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the method further includes: the projection equipment detects the state information of the intelligent equipment, and if the state information reaches a preset condition, corresponding early warning prompts are sent out.
With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the step of sending out the corresponding warning prompt by the projection device includes one or two of the following steps: the projection equipment generates a sound alarm indicating that the state information reaches a preset condition and plays the sound alarm; or the projection equipment displays the state information in an identification mode.
With reference to the third possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the intelligent device includes a sphygmomanometer, and the state information sent by the sphygmomanometer and received by the projection device includes blood pressure data; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment judges whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the intelligent device includes a camera, and the state information sent by the camera and received by the projection device includes video information captured by the camera; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment identifies whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
With reference to the third possible implementation manner of the first aspect, in a seventh possible implementation manner of the first aspect, the intelligent device includes a camera, and the state information sent by the camera and received by the projection device includes video information captured by the camera; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment judges whether the video information contains a human face head portrait; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
With reference to the third possible implementation manner of the first aspect, in an eighth possible implementation manner of the first aspect, the intelligent device includes a refrigerator, and the state information sent by the refrigerator and received by the projection device includes food information stored in the refrigerator; the projection equipment detects the state information, and if the state information reaches a preset condition, the step of sending out a corresponding early warning prompt comprises the following steps: the projection equipment checks whether one or two of the following conditions are satisfied according to the food information, and generates an early warning prompt corresponding to the satisfied conditions:
the food type represented by the food information is less than the preset type;
or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
In a second aspect, an embodiment of the present invention provides a method for monitoring a state of an intelligent device on the same screen through a projection device, where the method includes: the user terminal logs in the Internet of things platform through a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by at least one intelligent device to the projection device, wherein the device account of the intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and the user terminal sends the instruction to the Internet of things platform, so that the Internet of things platform receives the state information reported by the at least one intelligent device and forwards the state information to the projection device.
With reference to the second aspect, in a first possible implementation manner of the second aspect, the method further includes: the method comprises the steps that a user terminal generates a request for enabling a projection device and at least one intelligent device to correspond to the same group; the user terminal sends the request to the Internet of things platform, so that the Internet of things platform enables the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to correspond to the group identification of the same group; the step of generating an instruction for sending the state information reported by the at least one intelligent device to the projection device by the user terminal comprises the following steps: and the user terminal generates an instruction for sending the state information reported by the intelligent equipment in the same group to the projection equipment in the group.
With reference to the second aspect, in a second possible implementation manner of the second aspect, before the step of generating, by the user terminal, an instruction for sending the state information reported by the at least one smart device to the projection device, the method further includes: the method comprises the steps that a user terminal generates a binding request aiming at the projection equipment, and the binding request is sent to an internet of things platform, so that the internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; the user terminal generates a binding request aiming at least one intelligent device, and sends the binding request to the Internet of things platform, so that the Internet of things platform stores the binding relationship between the user account and the at least one intelligent device.
In a third aspect, an embodiment of the present invention provides a projection apparatus, which includes a memory, a processor, and a projection component, where: the memory is used for storing an application program; the processor is to execute an application to: establishing connection with an Internet of things platform through the Internet, and logging in the Internet of things platform by using a device account number corresponding to a projection device registered in the Internet of things platform in advance; receiving state information of a plurality of intelligent devices forwarded by an internet of things platform, wherein the state information is sent to the internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the internet of things platform in advance have an association relationship on the internet of things platform; and controlling the projection component to project the state information of the plurality of intelligent devices to the same screen.
With reference to the third aspect, in a first possible implementation manner of the third aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the device accounts of the projection device and the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the plurality of intelligent devices include a mobile terminal, and the state information includes geographic location information of the mobile terminal; the processor is specifically configured to perform the steps of: receiving geographical position information of the mobile terminal forwarded by the Internet of things platform; and when receiving the geographical position information sent by the plurality of mobile terminals, controlling the projection component to mark the geographical position information of the plurality of intelligent devices on the same map and perform projection display in a preset area.
With reference to the third aspect or the first possible implementation manner of the third aspect, in a third possible implementation manner of the third aspect, the processor is further configured to perform the following steps: and detecting the state information of the intelligent equipment, and if the state information reaches a preset condition, sending out a corresponding early warning prompt.
With reference to the third possible implementation manner of the third aspect, in a fourth possible implementation manner of the third aspect, the step of issuing the corresponding warning prompt executed by the processor includes one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
With reference to the third possible implementation manner of the third aspect, in a fifth possible implementation manner of the third aspect, the intelligent device includes a sphygmomanometer, and the state information includes blood pressure data measured by the sphygmomanometer; the processor is specifically configured to perform the steps of: judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the third aspect, in a sixth possible implementation manner of the third aspect, the intelligent device includes a camera, and the state information includes video information captured by the camera; the processor is specifically configured to perform the steps of: identifying whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
With reference to the third possible implementation manner of the third aspect, in a seventh possible implementation manner of the third aspect, the intelligent device includes a camera, and the state information includes video information captured by the camera; the processor is specifically configured to perform the steps of: judging whether the video information contains a face head portrait or not; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
With reference to the third possible implementation manner of the third aspect, in an eighth possible implementation manner of the third aspect, the intelligent device includes a refrigerator, the state information includes food information stored in the refrigerator, and the processor is specifically configured to execute the following steps: checking whether one or two of the following conditions are satisfied according to the food information, and generating an early warning prompt corresponding to the satisfied conditions: the food type represented by the food information is less than the preset type; or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
In a fourth aspect, an embodiment of the present invention provides a user terminal, where the user terminal includes a memory and a processor, where: the memory is for storing an application program, and the processor is for executing the application program for: logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by the at least one intelligent device to the projection device, wherein the device account of the at least one intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by at least one intelligent device.
With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the processor is further configured to execute the application program to: generating a request for corresponding the projection device and at least one intelligent device to the same group; sending the request to an Internet of things platform, so that the Internet of things platform corresponds the device account number of the projection device and the device account number of at least one intelligent device to the group identification of the same group; and generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
With reference to the fourth aspect, in a second possible implementation manner of the fourth aspect, before the step of generating the instruction that sends the state information reported by the at least one smart device to the projection device, the processor is further configured to execute the following steps: generating a binding request aiming at the projection equipment, and sending the binding request to an Internet of things platform so that the Internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; generating a binding request aiming at least one intelligent device, and sending the binding request to the IOT platform, so that the IOT platform stores the binding relation between the user account and the at least one intelligent device.
In a fifth aspect, an embodiment of the present invention provides a projection apparatus, including:
the first login module is used for establishing connection with the Internet of things platform through the Internet and logging in the Internet of things platform through a device account number of the projection device registered in the Internet of things platform in advance; the system comprises a state information receiving module, a projection module and a display module, wherein the state information receiving module is used for receiving state information of a plurality of intelligent devices forwarded by an Internet of things platform, the state information is sent to the Internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the Internet of things platform in advance have an incidence relation on the Internet of things platform; and the projection module is used for projecting the state information of the intelligent devices to the same screen.
With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the projection device and the multiple intelligent devices belong to a same group established by a same user account, and the projection device and the device accounts of the multiple intelligent devices correspond to group identifiers of the same group in the internet of things platform.
With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect, the plurality of intelligent devices include a mobile terminal, and the state information receiving module is specifically configured to receive geographic location information of the plurality of mobile terminals, which is forwarded by the internet of things platform; the projection module is specifically configured to: when the state information receiving module receives the geographical position information sent by the mobile terminals, the geographical position information of the intelligent devices is marked on the same map and is displayed in a projection mode in a preset area.
With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, the projection apparatus further includes: the detection module is used for detecting the state information of the intelligent equipment; and the early warning prompt module is used for sending out corresponding early warning prompts when the state information reaches preset conditions.
With reference to the third possible implementation manner of the fifth aspect, in a fourth possible implementation manner of the fifth aspect, the early warning prompting module is specifically configured to execute one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
With reference to the third possible implementation manner of the fifth aspect, in a fifth possible implementation manner of the fifth aspect, the intelligent device includes a sphygmomanometer, and the state information receiving module is specifically configured to receive blood pressure data of the sphygmomanometer, which is forwarded by the internet of things platform; the detection module is specifically used for judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and the early warning prompt module is specifically used for sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value when the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
With reference to the third possible implementation manner of the fifth aspect, in a sixth possible implementation manner of the fifth aspect, the intelligent device includes a camera, and the state information receiving module is specifically configured to receive video information, which is forwarded by the internet of things platform and captured by the camera; the detection module is specifically used for identifying whether the video information contains image information formed by personnel movement; and the early warning prompt module is specifically used for sending out a preset form of early warning prompt which indicates that people move when the video information contains image information formed by the movement of the people.
With reference to the third possible implementation manner of the fifth aspect, in a seventh possible implementation manner of the fifth aspect, the intelligent device includes a camera; the state information receiving module is specifically used for receiving video information which is transmitted by the Internet of things platform and shot by the camera; the detection module is specifically used for judging whether the video information contains a face portrait or not, extracting the contained face portrait when the video information contains the face portrait, and identifying whether the extracted face portrait and a pre-stored face portrait with a master identity belong to the same person main body or not; and the early warning prompting module is specifically used for sending an early warning prompt in a preset form to indicate that a stranger exists when the detection module detects that the extracted face avatar and the pre-stored face avatar with the master identity do not belong to the same person subject.
With reference to the third possible implementation manner of the fifth aspect, in an eighth possible implementation manner of the fifth aspect, the intelligent device includes a refrigerator, and a state information receiving module, specifically configured to receive food information stored in the refrigerator and forwarded by the internet of things platform; the detection module is specifically configured to check whether one or two of the following conditions are satisfied according to the food information: 1) the food type represented by the food information is less than the preset type; 2) the food amount corresponding to one food in the food information is lower than a preset value; and the early warning prompt module is specifically used for generating an early warning prompt corresponding to the established condition when the one or two conditions detected by the detection module are established.
In a sixth aspect, an embodiment of the present invention provides a user terminal, including:
the second login module is used for logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; the system comprises an instruction generating module, a projection device and a display module, wherein the instruction generating module is used for generating an instruction for sending the state information reported by at least one intelligent device to the projection device, a device account of the at least one intelligent device and a user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and the instruction sending module is used for sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by the at least one intelligent device.
With reference to the sixth aspect, in a first possible implementation manner of the sixth aspect, the user terminal further includes: the group generation request module is used for generating a request for enabling the projection equipment and at least one intelligent device to correspond to the same group; the group generation request sending module is used for sending a request to the Internet of things platform so that the Internet of things platform corresponds the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to the group identification of the same group; and the instruction generating module is specifically used for generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
With reference to the sixth aspect, in a second possible implementation manner of the sixth aspect, the user terminal further includes: the system comprises a first binding request generating module, a first binding request sending module and a second binding request sending module, wherein the first binding request generating module is used for generating a binding request aiming at the projection equipment; the system comprises a first binding request generation module used for generating a binding request aiming at least one intelligent device, and a first binding request sending module used for sending the binding request to an Internet of things platform so as to enable the Internet of things platform to store the binding relationship between a user account and at least one intelligent device.
According to the technical scheme, the projection equipment in the embodiment of the invention is connected with the Internet of things platform through the Internet, receives the state information transmitted by the intelligent equipment and forwarded by the Internet of things platform, and projects the state information of the intelligent equipment to the same screen. Therefore, the state information of the intelligent devices can be conveniently and simultaneously known without space limitation, and the user experience is improved.
In addition, the projection equipment can detect the received state information of each intelligent equipment, and sends out corresponding early warning prompts when the state information reaches preset early warning prompt conditions, so that the effect of monitoring the state information of a plurality of intelligent equipment on the same screen can be achieved.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the embodiment of the invention, the monitoring results of the plurality of intelligent devices are projected on the screen of the projection device, so that a user can conveniently and simultaneously view the monitoring results of the plurality of intelligent devices. In the embodiment of the invention, the projection equipment is not directly communicated with the plurality of intelligent equipment, but is communicated with the plurality of intelligent equipment through the internet of things platform, the projection equipment is communicated with the internet of things platform, and each equipment accessed to the internet of things platform is controlled and managed through the user terminal.
Fig. 1 is a schematic connection diagram between network elements involved in an embodiment of the present invention, where the network elements involved in the embodiment of the present invention include a projection device 101, an internet of things platform 102, a plurality of intelligent devices 103, and a user terminal 104. The projection device 101 can be a laser micro projector, a home laser cinema, a laser engineering projector and other projection devices 101 with different technologies; the internet of things platform 102 is a cloud platform for realizing interconnection and interaction between users and equipment, and between equipment, and in practical application, the internet of things platform consists of one or more servers, and can exist in a form of a third-party open platform or a form of a system internal platform; the smart device 103 is a smart terminal product with a communication function, and may be a smart phone or a wearable device, and may further include, but is not limited to, the following hardware devices:
1) audio and video types: network cameras (monitoring, nursing), automobile data recorders, visible doorbells, etc.;
2) communication and interaction: a voice intercom watch, a children early education machine, a social television, an electronic photo frame and the like;
3) data collection type: body weight scales, thermometers, air detectors, hand rings, etc.;
4) wireless control type: sound box, air purifier, bulb, socket, door lock, sphygmomanometer, air conditioner, refrigerator, etc.
The user terminal 104 is a terminal device connected to the internet of things platform 102, and may be a terminal device such as a mobile phone, a tablet computer, and a personal computer, and is specifically configured to control and manage devices (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, for example: checking a device list, binding new devices, unbinding devices, checking state information of the devices, receiving messages sent by the devices, establishing a device group and the like.
The plurality of intelligent devices 103 in fig. 1 may be the same device or different devices, and are not limited herein. The projection device 101, the internet of things platform 102, the plurality of intelligent devices 103 and the user terminal 104 are communicated with each other through a wireless or wired network.
The on-screen projection method in the embodiment of the present invention is described in detail below with reference to fig. 2.
201. The projection equipment is connected with the Internet of things platform through the Internet, and logs in the Internet of things platform through an equipment account number corresponding to the projection equipment registered in the Internet of things platform in advance;
the internet of things platform 102 provides a Software Development Kit (SDK) or an integration module to each hardware device, and each hardware device can access the internet of things platform 102 through Development integration, establish connection with the internet of things platform 102, and interconnect with the internet of things platform 102, including: the method comprises the steps of registering in the internet of things platform 102, the internet of things platform 102 distributing equipment accounts for each hardware equipment, managing the state of each hardware equipment through the user terminal 104, and receiving and sending signaling or messages through the internet of things platform 102. Therefore, after the projection device 101 establishes a connection with the internet of things platform 102 through the SDK or the integration module provided by the internet of things platform 102, the projection device logs in the internet of things platform 102 with the device account number registered in the internet of things platform 102 to communicate with the internet of things platform 102.
202. The projection equipment receives state information of a plurality of intelligent equipment forwarded by the Internet of things platform;
not only the projection device 101 but also other intelligent devices 103 are connected to the internet of things platform 102, and similarly, each intelligent device 103 establishes a connection with the internet of things platform 102 through an SDK or an integration module provided by the internet of things platform 102 and registers on the internet of things platform 102, and the internet of things platform 102 allocates a corresponding device account to each intelligent device 103.
The device accounts of the multiple intelligent devices 103 on the internet of things platform 102 have an association relationship with the device account of the projection device 101. Optionally, a specific implementation manner is that the user terminal 104 is respectively bound with the projection device 101 and the plurality of intelligent devices 103, so that an association relationship is established between the projection device 101 and the plurality of intelligent devices 103 on the internet of things platform 102.
The intelligent device 103 reports its own state information to the internet of things platform 102, and the internet of things platform 102 receives the state information of each intelligent device 103.
The status information here differs according to the product form of each smart device 103, for example, if the smart device 103 is a camera, the status information may be video data collected by the camera in real time; if the smart device 103 is a smart band, the state information may be human health state data and exercise data collected by the smart band; when the smart device 103 is a mobile terminal, the state information may be geographical location information of the mobile terminal; when the smart device 103 is a sphygmomanometer, the status information may be blood pressure data measured by the sphygmomanometer.
After receiving the state information of each smart device 103, the internet of things platform 102 forwards the state information to the projection device 101 associated with the smart device 103, and the projection device 101 receives the state information of the plurality of smart devices 103.
Optionally, the projection device 101 and the multiple intelligent devices 103 belong to the same group established by the same user account on the internet of things platform 102, and after receiving the state information of the multiple intelligent devices 103, the internet of things platform 102 forwards the state information to the projection device 101 belonging to the same group as the corresponding intelligent device 103. Optionally, the group establishing method may specifically be: a group is created by the user terminal 104, and one projection device 101 and a plurality of terminal devices 103 are selected from the device list bound to the user terminal 104 to join the group.
Optionally, after each intelligent device 103 sends its own state information to the internet of things platform 102, the internet of things platform 102 needs to detect whether the projection device 101 associated with each intelligent device 103 has logged in the internet of things platform 102, and if the internet of things platform 102 has logged in, the internet of things platform 102 sends the state information to the projection device 101; if the internet of things platform 102 is not logged in, the internet of things platform 102 stores the received state information, and when the projection device 101 establishes connection with the internet of things platform, the state information of each intelligent device 103 is sent.
203. The projection device projects the state information of the plurality of intelligent devices to the same screen.
After receiving the status information of the plurality of intelligent devices 103 forwarded by the internet of things platform 102, the projection device 101 displays the status information of the plurality of intelligent devices 103 on the projection screen at the same time. The specific mode of the on-screen display is not specifically limited here, and the screen can be adaptively displayed according to the resolution of the display screen, the number of the intelligent devices 103, and the size of the default display interface of each intelligent device 103; multiple pieces of status information may be displayed in a scrolling manner cyclically on the screen, etc.
Optionally, after the projection device 101 receives the state information of the smart device 103 forwarded by the internet of things platform 102, the state information of different smart devices 103 may be processed differently and then displayed. For example: when the smart device 103 includes a plurality of mobile terminals (terminals such as a smart phone, a tablet computer, and an intelligent wearable device), and the state information of the plurality of mobile terminals received by the projection device 101 includes geographical location information of the plurality of mobile terminals, the projection device 101 marks the received plurality of geographical location information on the same map at the same time, and displays the map marked with the geographical locations of the plurality of mobile terminals in a preset area of the projection device 101.
Optionally, after the projection device 101 receives the state information of the intelligent device 103 forwarded by the internet of things platform 102, different detections may be performed on the state information of different intelligent devices 103, and when the state information reaches a preset condition, a corresponding warning prompt is sent. The specific manner of prompting can be various, and for example, one or more of the following manners can be included: 1) the projection apparatus 101 generates an audio alarm indicating that the state information reaches a preset condition, and plays the audio alarm; 2) the projection device 101 displays the status information as a logo.
The following description illustrates the projection device 101 detecting and warning the status information of different smart devices 103:
when the intelligent device 103 includes a blood pressure meter, the state information forwarded by the internet of things platform 102 to the projection device 101 is blood pressure data of the user measured by the sphygmomanometer, and when the projection device 101 detects that a blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value (for example, exceeds a normal blood pressure value range), an early warning prompt set by the system and indicating that the blood pressure value reaches the preset blood pressure value is sent, for example: prompting is performed by flashing an interface presentation area of the smart device on the projection screen.
When the intelligent device 103 comprises a camera, the state information forwarded to the projection device 101 by the internet of things platform 102 is video information shot by the camera, and the projection device 101 identifies whether the video information contains image information formed by movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt indicating that the personnel move. For example: marking the frame of the video information display area in red, or performing text prompt on a video information display interface, or shaking a video information display picture, or generating and playing a sound alarm and the like.
The situation that the intelligent device 103 is a camera is suitable for a use scene monitored by the camera, and besides, the camera can be commonly applied to an access control system in an intelligent home, when the intelligent device 103 is the access control camera in the access control system, the internet of things platform 102 forwards the state information of the projection device 101 to video information shot by the camera, the projection device 101 judges whether the video information contains a human face image, if so, the human face image is extracted, and whether the extracted human face image is matched with a pre-stored human face image with a master identity is identified; if the extracted face avatar does not match any pre-stored face avatar with the owner identity, a pre-set form of early warning prompt indicating that a stranger is present is sent, for example: an audible alarm is generated and played.
When the intelligent device 103 includes a refrigerator, the state information forwarded by the internet of things platform 102 to the projection device 101 includes food information stored in the refrigerator, the projection device 101 detects whether the food type represented by the food information in the refrigerator is less than a preset type, and if the food type represented by the food information in the refrigerator is less than the preset type, an early warning prompt that the food type preset by the system is less than the preset type is generated, for example: the display area frame of the state information is marked red, or a text prompt is carried out on the display interface, or the picture area of the state information is displayed in a shaking way, or a sound alarm is generated and played, and the like. The projection device 101 detects whether the amount of food corresponding to one of the food in the food information is lower than a preset value, and if so, generates an early warning prompt that the amount of food preset by the system is lower than the preset value, for example: carrying out corresponding food flickering prompt in the display area of the state information, or generating text information prompt in the display area; for example: when the number of eggs in the refrigerator is less than 3, the projection apparatus 101 flickers the image of the eggs in the status information display area of the refrigerator to prompt.
The above examples are only examples of the projection device 101 detecting and warning the status information of different smart devices 103, and it should be clear to those skilled in the art that the projection device 101 may also detect and warn other smart devices 103, and the description is not repeated here.
Thus, according to the embodiment of the present invention, the projection device 101 does not need to establish a connection with each of the plurality of intelligent devices 103, but establishes a connection with the internet of things platform 102 through the projection device 101 and the intelligent devices 103, and the projection device 101 receives the state information of the intelligent devices 103 associated therewith through the internet of things platform 102, on one hand, the state of each intelligent device 103 can be known at the same time; on the other hand, the state information of each intelligent device can be known remotely or remotely without space limitation; moreover, the state of each intelligent device 103 can be known when the projection device 101 is started and networked, which is convenient and fast.
In addition, the projection device 101 can detect the received state information of each intelligent device 103, and send out a corresponding early warning prompt when the state information reaches a preset early warning prompt condition, so that the state information of a plurality of intelligent devices can be monitored on the same screen.
Both the projection device 101 and the intelligent terminal 103 can be managed by the user terminal 104, and the method for monitoring the state of the intelligent device in the embodiment of the present invention is described below with reference to fig. 3 from the user terminal side.
Specifically, the intelligent terminal 104 is a terminal device connected to the internet of things platform 102, and specifically may be a terminal device such as a mobile phone, a tablet computer, and a personal computer, and is configured to control and manage devices (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, for example: checking a device list, binding new devices, unbinding devices, checking state information of the devices, receiving messages sent by the devices, establishing a device group and the like.
301. The user terminal logs in the Internet of things platform through a user account which is registered in the Internet of things platform in advance;
similar to the projection device 101 and the smart device 103, the user terminal 104 also accesses the internet of things platform 102 through the SDK or the integration module provided by the internet of things platform 102 and the internet of things platform 102, and registers on the internet of things platform 102 to obtain a user account.
The user logs in the internet of things platform 102 through a user account on the user terminal 104, specifically, the user may log in through an application program APP or a webpage, and after logging in, the related information of the projection device 101 and the intelligent device 103 bound to the user account may be displayed on an interface of the user terminal 104. As shown in fig. 4, the device list information bound on the interface of the user terminal 104 includes: the intelligent shoe named as the cloud shoe of the baby, the camera named as the camera of the elisa, the intelligent television 103 named as the television in the living room and the like can be clicked to check the specific information of the corresponding intelligent device 103.
Optionally, in practical application, the user searches for the device through the user terminal 104 first, and then binds the found device, so that the device bound to the user account can be displayed on the interface of the user terminal 104. Specifically, the user terminal 104 may find other intelligent devices (including the projection device 101 and the intelligent device 103) that have been accessed to the internet of things platform 102 by scanning the two-dimensional code or by clicking "search new device" in fig. 4, and after finding a device that needs to be bound, click "binding" on the interface as shown in fig. 5, so that the application terminal 104 generates a binding request for the device, and after receiving the binding request, the internet of things platform 102 stores the binding relationship between the user account and the device account of the device, and returns confirmation information of "binding success" or "binding failure" to the user terminal 104, and the user terminal 104 notifies the user of the binding result through an interface prompt.
For example: as shown in fig. 5, the user terminal 104 finds the projection device: the home projector generates a binding request aiming at the home projector equipment when a user clicks binding on an interface, and the internet of things platform 102 stores the binding relationship between the user account and the equipment account of the home projector equipment after receiving the binding request; likewise, the search and binding of the smart device 103 is the same as the projection device, and will not be described herein.
302. The user terminal generates an instruction for sending the state information reported by the at least one intelligent device to the projection device;
the user sets on the user terminal 104 whether to project the state information of the smart device 103 to the projection device 101, and specific setting manners may include, but are not limited to, the following two types: 1) the user selects which intelligent devices 103 state information are projected on the projection device 101 in the device list of the user terminal 104; 2) whether to project its status information onto the projection device 101 is set for the smart devices 103 in the device list. After the setting is completed, the user terminal 104 generates an instruction for sending the set state information reported by the smart device 103 to the projection device 101.
Optionally, the user may set the associated smart device 103 and the projection device 101 as device members in the same group on the user terminal 104, so that the user terminal may generate, by default, an instruction for sending the state information reported by the smart device 103 in the group to the projection device 101 in the group. Specifically, when a user establishes a group and sets the smart devices 103 and the projection device 101 in the group, the user terminal 104 generates a request for enabling the projection device 101 and at least one smart device 103 to correspond to the same group, and sends the request to the internet of things platform 102, and then the internet of things platform 102 enables the device account number of the projection device 101 and the device account number of the at least one smart device 103 to correspond to the group identifier of the same group. The specific interface and interactive design method for establishing the group are not limited, and are not limited herein.
303. And the user terminal sends the instruction to the Internet of things platform.
After generating an instruction for sending the set state information reported by the intelligent device 103 to the corresponding projection device 101, the user terminal 104 sends the instruction to the internet of things platform 102, and after receiving the instruction, the internet of things platform 102 forwards the state information reported by the intelligent device 103 indicated in the instruction to the projection device 101 indicated in the instruction.
In the embodiment of the invention, the user terminal 104 can perform binding setting and group setting on each device (the projection device 101 and the intelligent terminal 103) accessing the internet of things platform 102, and generate an instruction for sending the set state information reported by the intelligent device 103 to the corresponding projection device 101, so that the state information of the intelligent device 103 displayed on the projection device 101 on the same screen can be controlled, the realizability of the scheme is improved, and the user experience is improved.
The foregoing describes a method for monitoring a state of an intelligent device by using a projection device in an embodiment of the present invention, and the following describes a projection device and a user terminal in an embodiment of the present invention.
With reference to fig. 6, an embodiment of the present invention further provides a projection device 6, where the projection device 6 is a projection device of different technologies, such as the laser pico projector, the home laser cinema, the laser engineering projector, and the like, described in the foregoing embodiment shown in fig. 1.
Specifically, the projection device 6 in the embodiment of the present invention includes: the memory 601, the processor 602 and the projection component 603 further include at least one network interface or other communication interfaces, and the communication connection between the at least one network interface and at least one other network element is realized through the at least one network interface (which may be wired or wireless).
Memory 601 may include both read-only memory and Random-access memory, and may provide instructions and data to processor 602, and portions of memory 601 may include high-speed Random-access memory (RAM) and non-volatile memory (non-volatile memory).
Memory 601 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof:
the application program comprises the following steps: including various operational instructions for performing various operations.
Operating the system: including various system programs for implementing various basic services and for handling hardware-based tasks.
Processor 602 performs some or all of the steps performed by projection device 101 in the method embodiment shown in fig. 2 described above by calling an application program stored in memory 601 (which may be stored in an operating system). The method is mainly used for executing:
establishing connection with an Internet of things platform through the Internet, and logging in the Internet of things platform by using a device account number corresponding to a projection device registered in the Internet of things platform in advance; receiving state information of a plurality of intelligent devices forwarded by an internet of things platform, wherein the state information is sent to the internet of things platform by the intelligent devices, and the device account number of the projection device and the device account numbers corresponding to the intelligent devices registered in the internet of things platform in advance have an association relationship on the internet of things platform; the projection part 603 is controlled to project the status information of the plurality of smart devices to the same screen.
In some specific implementations, the projection device and the plurality of intelligent devices belong to the same group established by the same user account, and the device accounts of the projection device and the plurality of intelligent devices correspond to group identifiers of the same group in the internet of things platform.
In some specific implementations, in a second possible implementation manner of the third aspect, the plurality of intelligent devices include a mobile terminal, and the state information includes geographic location information of the mobile terminal; the processor 602 is specifically configured to perform the following steps: receiving geographical position information of the mobile terminal forwarded by the Internet of things platform; when receiving the geographical location information sent by a plurality of mobile terminals, the projection component 603 is controlled to mark the geographical location information of a plurality of intelligent devices on the same map and to project and display the geographical location information in a preset area.
In some specific implementations, the processor 602 is further configured to perform the following steps: and detecting the state information of the intelligent equipment, and if the state information reaches a preset condition, sending out a corresponding early warning prompt.
In some specific implementations, the step of issuing the corresponding warning prompt executed by the processor 602 includes one or both of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
In some implementations, the smart device includes a blood pressure meter, the status information includes blood pressure data measured by the blood pressure meter; the processor 602 is specifically configured to perform the following steps: judging whether the blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value or not; and if the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value, sending an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
In some specific implementations, the smart device includes a camera, and the state information includes video information captured by the camera; the processor 602 is specifically configured to perform the following steps: identifying whether the video information contains image information formed by the movement of people; and if the video information contains image information formed by the movement of the personnel, sending out a pre-set form of early warning prompt which indicates that the personnel move.
In some specific implementations, the smart device includes a camera, and the state information includes video information captured by the camera; the processor 602 is specifically configured to perform the following steps: judging whether the video information contains a face head portrait or not; if the video information contains the face head portrait, extracting the contained face head portrait; identifying whether the extracted face head portrait and a pre-stored face head portrait with a master identity belong to the same person main body; if the persons do not belong to the same person subject, an early warning prompt in a preset form is sent out to indicate that a stranger exists.
In some specific implementations, the smart device includes a refrigerator, the status information includes food information stored within the refrigerator, and the processor 602 is specifically configured to perform the following steps: checking whether one or two of the following conditions are satisfied according to the food information, and generating an early warning prompt corresponding to the satisfied conditions: the food type represented by the food information is less than the preset type; or, the food amount corresponding to one of the foods in the food information is lower than a preset value, for example: the number of eggs is less than 3.
For details of the interaction between the components of the intelligent device 6 and the steps executed by the processor, please refer to the interaction process in the embodiment shown in fig. 2, which is not described herein again.
With reference to fig. 7, an embodiment of the present invention further provides a user terminal 7, where a product form of the user terminal 7 in practical application is the user terminal product exemplified in the embodiment shown in fig. 1.
In particular, the user terminal 7 comprises a memory 701 and a processor 702. Memory 701 may include both read-only Memory and Random-Access Memory, and may provide instructions and data to processor 702, and portions of Memory 701 may include high-speed Random-Access Memory (RAM), and may also include non-volatile Memory.
Memory 701 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof:
the application program comprises the following steps: including various operational instructions for performing various operations.
Operating the system: including various system programs for implementing various basic services and for handling hardware-based tasks.
In this embodiment of the present invention, the processor 702 executes some or all of the steps executed by the user terminal 104 in the embodiment of the method shown in fig. 3 by calling the application program stored in the memory 701, and is mainly configured to execute:
logging in the Internet of things platform by using a user account which is registered in the Internet of things platform in advance; generating an instruction for sending the state information reported by the at least one intelligent device to the projection device, wherein the device account of the at least one intelligent device and the user account have a binding relationship on an internet of things platform, and the device account of the projection device and the user account have a binding relationship on the internet of things platform; and sending the instruction to the Internet of things platform so that the Internet of things platform can forward the state information to the projection equipment after receiving the state information reported by at least one intelligent device.
In some implementations, the processor is further configured to execute the application for: generating a request for corresponding the projection device and at least one intelligent device to the same group; sending the request to an Internet of things platform, so that the Internet of things platform corresponds the device account number of the projection device and the device account number of at least one intelligent device to the group identification of the same group; and generating an instruction for sending the state information reported by the intelligent devices in the same group to the projection devices in the group.
In some specific implementations, before the step of generating the instruction for sending the state information reported by the at least one smart device to the projection device, the processor is further configured to perform the following steps: generating a binding request aiming at the projection equipment, and sending the binding request to an Internet of things platform so that the Internet of things platform stores the binding relationship between a user account and an equipment account of the projection equipment; generating a binding request aiming at least one intelligent device, and sending the binding request to the IOT platform, so that the IOT platform stores the binding relation between the user account and the at least one intelligent device.
For details of the interaction between the components of the user terminal 7 and the steps executed by the processor, please refer to the interaction process in the embodiment shown in fig. 3, which is not described herein again.
The projection device 6 and the user terminal 7 in the embodiment of the present invention are described above from the perspective of hardware structures, and the projection device and the user terminal in the embodiment of the present invention are described below from the perspective of functional modules.
With reference to fig. 8, an embodiment of the present invention provides a projection apparatus 8, including:
a first login module 801, configured to establish a connection with an internet of things platform through the internet, and login to the internet of things platform through a device account of the projection device registered in the internet of things platform in advance;
the state information receiving module 802 is configured to receive state information of the multiple intelligent devices forwarded by the internet of things platform, where the state information is sent to the internet of things platform by the intelligent devices, and an association relationship exists between a device account of the projection device and a device account corresponding to each of the multiple intelligent devices registered in advance in the internet of things platform;
and the projection module 803 is used for projecting the state information of the plurality of intelligent devices to the same screen.
In some specific implementations, the projection device 8 and the plurality of smart devices belong to the same group established by the same user account, and the projection device 8 and the device accounts of the plurality of smart devices correspond to group identifiers of the same group in the internet of things platform.
The state information receiving module 802 is specifically configured to receive geographic location information of the plurality of mobile terminals forwarded by the internet of things platform; the projection module 803 is specifically configured to: when the state information receiving module 802 receives geographical location information sent by a plurality of mobile terminals, the geographical location information of a plurality of intelligent devices is marked on the same map and is displayed in a projection manner in a preset area.
Optionally, the projection device 8 further includes: the detection module 804 is used for detecting the state information of the intelligent device; and an early warning prompt module 805, configured to send a corresponding early warning prompt when the state information reaches a preset condition.
The early warning module 805 is specifically configured to perform one or two of the following steps: generating a sound alarm indicating that the state information reaches a preset condition, and playing the sound alarm; or, the status information is displayed in an identifying way.
Optionally, the intelligent device includes a sphygmomanometer, and the state information receiving module 802 is specifically configured to receive blood pressure data of the sphygmomanometer forwarded by the internet of things platform; the detection module 804 is specifically configured to determine whether a blood pressure value corresponding to the blood pressure data reaches a preset blood pressure value; the early warning prompting module 805 is specifically configured to send an early warning prompt indicating that the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value when the blood pressure value corresponding to the blood pressure data reaches the preset blood pressure value.
Optionally, the intelligent device includes a camera, and the state information receiving module 802 is specifically configured to receive video information, which is forwarded by the internet of things platform and captured by the camera; the detection module 804 is specifically configured to identify whether the video information includes image information formed by movement of a person; the early warning prompting module 805 is specifically configured to send an early warning prompt in a preset form indicating that a person moves when the video information includes image information formed by the movement of the person.
Optionally, the intelligent device includes a camera; the state information receiving module 802 is specifically configured to receive video information captured by a camera forwarded by the internet of things platform; the detection module 804 is specifically configured to determine whether the video information includes a face avatar, extract the included face avatar when the video information includes the face avatar, and identify whether the extracted face avatar and a pre-stored face avatar having a master identity belong to the same person subject; the early warning prompting module 805 is specifically configured to send an early warning prompt in a preset form indicating that a stranger exists when the detection module 804 detects that the extracted face avatar and the pre-stored face avatar with a master identity do not belong to the same person subject.
Optionally, the intelligent device includes a refrigerator, and the state information receiving module 802 is specifically configured to receive food information stored in the refrigerator and forwarded by the internet of things platform; the detecting module 804 is specifically configured to check whether one or two of the following conditions are satisfied according to the food information: 1) the food type represented by the food information is less than the preset type; 2) the food amount corresponding to one food in the food information is lower than a preset value; the early warning module 805 is specifically configured to generate an early warning prompt corresponding to the one or two conditions detected by the detecting module 804 when the one or two conditions are met.
For details of the interaction between the functional modules of the intelligent device 8, please refer to the interaction process in the embodiment shown in fig. 2, which is not described herein again.
With reference to fig. 9, an embodiment of the present invention provides a user terminal 9, including:
a second login module 901, configured to log in the internet of things platform with a user account registered in the internet of things platform in advance;
the instruction generating module 902 is configured to generate an instruction for sending the state information reported by the at least one piece of smart device to the projection device, where a device account and a user account of the at least one piece of smart device have a binding relationship on an internet of things platform, and a device account and a user account of the projection device have a binding relationship on the internet of things platform;
and the instruction sending module 903 is configured to send an instruction to the internet of things platform, so that the internet of things platform forwards the state information to the projection device after receiving the state information reported by the at least one intelligent device.
Optionally, the user terminal further includes: the group generation request module is used for generating a request for enabling the projection equipment and at least one intelligent device to correspond to the same group; the group generation request sending module is used for sending a request to the Internet of things platform so that the Internet of things platform corresponds the equipment account number of the projection equipment and the equipment account number of at least one intelligent equipment to the group identification of the same group; the instruction generating module 902 is specifically configured to generate an instruction for sending the state information reported by the smart devices in the same group to the projection devices in the group.
Optionally, the user terminal further includes: the system comprises a first binding request generating module, a first binding request sending module and a second binding request sending module, wherein the first binding request generating module is used for generating a binding request aiming at the projection equipment; the system comprises a first binding request generation module used for generating a binding request aiming at least one intelligent device, and a first binding request sending module used for sending the binding request to an Internet of things platform so as to enable the Internet of things platform to store the binding relationship between a user account and at least one intelligent device.
For details of the interaction between the functional modules of the user terminal 9, please refer to the interaction process in the embodiment shown in fig. 3, which is not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.