CN107317822B - Intelligent home experience system with virtual-real interaction and use method thereof - Google Patents

Intelligent home experience system with virtual-real interaction and use method thereof Download PDF

Info

Publication number
CN107317822B
CN107317822B CN201710611173.0A CN201710611173A CN107317822B CN 107317822 B CN107317822 B CN 107317822B CN 201710611173 A CN201710611173 A CN 201710611173A CN 107317822 B CN107317822 B CN 107317822B
Authority
CN
China
Prior art keywords
virtual
intelligent
preset program
equipment
intelligent terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710611173.0A
Other languages
Chinese (zh)
Other versions
CN107317822A (en
Inventor
朱俊岗
朱峰
朱俊岭
余建美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing IoT Sensor Technology Co Ltd
Original Assignee
Nanjing IoT Sensor Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing IoT Sensor Technology Co Ltd filed Critical Nanjing IoT Sensor Technology Co Ltd
Priority to CN201710611173.0A priority Critical patent/CN107317822B/en
Publication of CN107317822A publication Critical patent/CN107317822A/en
Application granted granted Critical
Publication of CN107317822B publication Critical patent/CN107317822B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/02Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The invention discloses an intelligent home experience system with virtual-real interaction and a using method thereof. The intelligent home equipment linkage virtual scene system takes a wireless communication technology as a core, sends virtual data to a cloud platform and a mobile phone, efficiently accelerates transmission, saves energy and reduces consumption in a wireless encryption communication mode, and simultaneously integrates various information technologies such as a sensor technology, a digital image processing and multimedia technology, a VR display technology and the like to bring efficient and real virtual scene experience of linkage of a whole set of intelligent home equipment.

Description

Intelligent home experience system with virtual-real interaction and use method thereof
Technical Field
The invention belongs to the technical field of wireless, and relates to an intelligent home experience system with virtual-real interaction and a using method thereof.
Background
With the coming of the national thirteen-five planning aiming at the intelligent home scheme report, people have higher and higher attention to the intelligent home, the intelligent terminal device has begun to permeate into a common home, but at present, the intelligent home software needs the user to have real experience feeling under the condition that hardware already exists, however, in the real life, the user often only purchases individual products, and the systematic advantage of the intelligent home is greatly weakened. How to enable a user to experience the strength and convenience of the whole intelligent home system under the condition that the user only has a few single-product devices is a problem which needs to be considered and solved urgently at present.
The single intelligent terminal equipment is used for triggering the linkage virtual equipment to start, and the intelligent living experience brought by the whole set of intelligent home equipment can be felt by a user under the condition that the user has insufficient equipment through wireless technology transmission and virtual interaction mode display.
At present, an intelligent home experience system with virtual-real interaction and a use method thereof, which can bring virtual experience of linkage of a complete set of intelligent home devices, are lacked.
Disclosure of Invention
The invention aims to solve the technical problems that an intelligent home entity experience venue is high in construction cost and energy consumption and a customer is inconvenient to experience a long way to a store, overcomes the defects of the prior art, and provides an intelligent home experience system which is used for efficiently managing intelligent terminal equipment and achieving low-cost virtual and real experience and a using method thereof.
In order to achieve the purpose, the invention adopts the following technical scheme: the invention provides an intelligent home experience system with virtual-real interaction, which comprises intelligent terminal equipment supporting a data reporting function, an intelligent gateway, a cloud platform and an APP user operation interface, wherein the intelligent terminal equipment is connected with the intelligent gateway in an encrypted communication mode;
the APP user operation interface comprises a control unit, a storage module, a binding module and a virtual preset program, wherein the control unit is respectively connected with the storage module, the binding module and the virtual preset program, and the virtual preset program is associated with the binding module.
Furthermore, the control unit is used for uniformly allocating the storage module, the binding module and the virtual preset program, coordinating and managing, analyzing and judging the information instruction, and simultaneously receiving and sending the information instruction;
the storage module is used for storing the sent information instruction and the bound equipment information;
the binding module is used for adding or deleting intelligent terminal equipment which can be actually operated in reality, dynamically managing the associated equipment, inquiring the state and managing the operation of the intelligent electric appliance;
the virtual preset program is used for realizing the operation of the virtual preset program through simulation according to the functions of the real intelligent terminal equipment;
the APP user operation interface is used for a user to perform system query, equipment management and effect display of a virtual preset program.
Further, the virtual preset program comprises light management, home security management, human comfort management, emergency rescue and scene modes.
Further, the light management is used for managing an intelligent switch and an intelligent curtain controller to adjust the light intensity;
the home safety management is used for monitoring, early warning and safety prompting accidents and requirements which may occur in daily life;
the human body comfort management is used for detecting and monitoring indoor environment and pollution conditions;
the emergency rescue is used for monitoring the body abnormity of the user and the abnormity of the indoor environment and timely pushing a message to inform a guardian, and corresponding measures are taken for corresponding warning conditions;
the scene mode is used for managing the intelligent terminal equipment in a room-dividing and time-sharing mode or displaying a virtual preset program according to the work and rest habits of people and the population conditions of families, the light management, the home safety management, the human body comfort management and the systematic default setting of emergency rescue.
Furthermore, the control unit also comprises a power supply monitoring module with a power supply monitoring and protecting function for the intelligent terminal equipment,
further, the cloud platform is a private cloud platform or a public cloud platform, the APP user operation interface is installed on a bearing terminal, the bearing terminal is a mobile phone, a pad or an intelligent television, and the encryption communication mode is a ZigBee wireless communication protocol, Bluetooth, an MQTT wireless communication protocol, a Z-Wave wireless communication protocol or a WiFi wireless communication protocol.
Furthermore, the intelligent terminal device is one or more of a network intelligent lock, an intelligent switch, an intelligent security device, an intelligent socket, a temperature and humidity sensor, a dazzling color lamp, a camera and an intelligent curtain controller.
The use method of the intelligent home experience system with virtual-real interaction comprises the following steps:
(1) the user sets the real controllable intelligent terminal device on the binding module by the encryption communication mode to match and connect,
the user can operate the opening and closing functions of the equipment in the APP user operation interface or on the actual intelligent terminal equipment;
(2) the intelligent terminal equipment executes and generates data, and reports the data to the intelligent gateway in an encrypted communication mode;
(3) the intelligent gateway processes and converts the reported data into service data, and reports the service data to the cloud platform in an encrypted communication mode;
(4) the virtual preset program is opened in advance to wait for the triggering instruction of the intelligent terminal equipment,
the cloud platform judges whether the trigger condition is a trigger condition of a virtual preset program;
(5) the APP user operation interface runs a virtual preset program after receiving the instruction; the intelligent terminal equipment for triggering the condition needs to have an active reporting and executing action mechanism;
(6) and the virtual preset program restores the functions of the linkage intelligent terminal equipment in a virtual 3D scene and displays the functions on the plurality of bearing terminals.
Further, the process of determining the trigger condition of the virtual preset program is as follows:
if not, normal equipment is taken to report an execution record flow, and the equipment is pushed to execute the record to a user operation interface and is gathered in a message center; if yes, continuing to judge the specific virtual interaction type, and positioning the APP user operation interface and the bearing terminal for specifically demonstrating the virtual interaction according to big data analysis.
Further, the APP user operation interface performs state change and real equipment management on the bound intelligent terminal equipment and performs the virtual scene in linkage with the APP user operation interface.
Has the advantages that: the intelligent household equipment linkage virtual scene system takes a wireless communication technology as a core, effectively accelerates transmission, saves energy, reduces consumption in a wireless encryption communication mode, and combines a sensor technology, a digital image processing and multimedia technology and a VR display technology to provide efficient and real virtual scene experience for linkage of a whole set of intelligent household equipment.
The virtual interactive experience mode is based on the existing display terminal, an entity venue does not need to be built, the operation is simple and convenient, the popularization is good, and the cost is low.
Drawings
FIG. 1 is a flow chart of the structure of the present invention.
Fig. 2 is a schematic diagram of the virtual-real interaction presetting program according to the present invention.
Fig. 3 is a schematic diagram of a business process of the product of the present invention.
Detailed Description
Example 1
As shown in fig. 1-2, the present invention provides an intelligent home experience system with virtual-real interaction, where the intelligent home experience system includes an intelligent terminal device supporting a data reporting function, an intelligent gateway, a cloud platform, and an APP user operation interface, the intelligent terminal device is connected to the intelligent gateway in an encrypted communication manner, the intelligent gateway is connected to the cloud platform in an encrypted communication manner, the APP user operation interface is connected to the cloud platform in an encrypted communication manner, and the APP user operation interface is connected to the intelligent terminal device in an encrypted communication manner;
the APP user operation interface comprises a control unit, a storage module, a binding module and a virtual preset program, wherein the control unit is respectively connected with the storage module, the binding module and the virtual preset program, and the virtual preset program is associated with the binding module.
The control unit is used for uniformly allocating the storage module, the binding module and the virtual preset program, coordinating and managing, analyzing and judging the information instruction, and simultaneously receiving and sending the information instruction;
the storage module is used for storing the sent information instruction and the bound equipment information;
the binding module is used for adding or deleting intelligent terminal equipment which can be actually operated in reality, dynamically managing the associated equipment, inquiring the state and managing the operation of the intelligent electric appliance;
the virtual preset program is used for operating the virtual preset program through simulation according to the functions of the real intelligent terminal equipment;
the APP user operation interface is used for a user to perform system query, equipment management and effect display of a virtual preset program.
The virtual preset program comprises light management, home safety management, human body comfort management, emergency rescue and scene modes.
The light management is used for managing an intelligent switch and an intelligent curtain controller to adjust the light intensity, and the light can be turned on by adjusting the pulling amplitude of the intelligent curtain controller;
the home safety management is used for monitoring, early warning and safely prompting the needs and accidents of daily life, the simulation camera is put in the upper right corner of the television, and adults can observe the sleeping infant state or the old people state when watching the television and can also prevent automatic reminding and alarming due to small door knocking sound according to the observation of the outdoor condition; natural gas or coal gas detection alarm or personal safety monitoring anti-theft, and the window screen is automatically pulled up to prevent peeping when a person is at home.
The human body comfort management is used for detecting and monitoring indoor environment and pollution conditions, detecting the indoor environment through corresponding equipment (such as a temperature and humidity detector, an intelligent air conditioner or a PM2.5 detector), collecting and analyzing according to outdoor temperature and humidity, and simulating an interactive scene of opening an air conditioner for dehumidification or a humidifier;
the emergency rescue is used for monitoring accidents, early warning and safety prompt of daily life of a user, monitoring body abnormity of the user and abnormity of indoor environment (such as fire or gas leakage) through a health monitoring electric appliance (such as an intelligent bracelet or a heart pulse detector) or an intelligent terminal device and timely pushing a message to inform a guardian, and taking corresponding measures for corresponding warning conditions; if the body of the old or the child at home is locked, the guardian is informed, and meanwhile, whether an emergency call is made is pushed;
the scene mode is used for performing room-by-room time-sharing management on intelligent terminal equipment or displaying virtual preset programs according to the work and rest habits of people and the family population conditions for light management, home safety management, human body comfort management and emergency rescue systematic default settings.
The control unit also comprises a power supply monitoring module with a power supply monitoring and protecting function for the intelligent terminal equipment, and the control unit can detect the stability of voltage and the current size through the power supply monitoring function, automatically disconnect the main gate and prevent hardware damage.
The cloud platform is private cloud platform or public cloud platform, APP user operation interface installs on bearing the terminal, it is cell-phone, pad, intelligent TV set, VR glasses or 3D glasses to bear the terminal. The encryption communication mode is a ZigBee wireless communication protocol, Bluetooth, MQTT wireless communication protocol, Z-Wave wireless communication protocol or WiFi wireless communication protocol.
The intelligent terminal device is one or more of a network intelligent lock, an intelligent switch, an intelligent security device, an intelligent socket, a temperature and humidity sensor, a colorful lamp, a camera and an intelligent curtain controller, and the intelligent electric appliance has an intelligent function.
As shown in fig. 3, the use method of the smart home experience system with virtual-real interaction of the present invention includes the following steps:
(1) a user sets an intelligent terminal device (such as a network intelligent lock) which can be actually controlled in reality to be in matched connection on a binding module in an encryption communication mode, the network intelligent lock is associated with a virtual preset program through the binding module in a user operation interface, one-to-one or one-to-many operation for establishing a virtual relationship is realized on the user operation interface, so that the user can operate the operation of the virtual preset program in a virtual 3D scene, meanwhile, enough intelligent terminal devices in reality are allowed to be added and managed, and the user can perform grouping management in a scene mode, such as going home, leaving home, sleeping, living and self-defining modes.
The user can operate the opening and closing functions of the equipment in the APP user operation interface or on the actual intelligent terminal equipment;
(2) the intelligent terminal equipment executes and generates data, and reports the data to the intelligent gateway in an encrypted communication mode;
(3) the intelligent gateway processes and converts the reported data into service data, and reports the service data to the cloud platform in an encrypted communication mode;
(4) the virtual preset program is opened in advance to wait for an intelligent terminal device triggering instruction, and the cloud platform judges whether the virtual preset program is a triggering condition of the virtual preset program;
(5) the APP user operation interface runs a virtual preset program after receiving the instruction; the intelligent terminal equipment for triggering the condition needs to have an active reporting and executing action mechanism;
(6) and the virtual preset program restores the functions of the linkage intelligent terminal equipment in a virtual 3D scene and displays the functions on the plurality of bearing terminals. The virtual preset program restores functions of the linkage intelligent terminal device in a virtual 3D scene and displays on the bearing terminal, after the network intelligent lock is opened, the intelligent lamp is turned on, and the air conditioner adjusts indoor stability according to the preset temperature.
In the method for using the smart home experience system with virtual-real interaction, the judgment process of the trigger condition of the virtual preset program is as follows:
if not, normal equipment is taken to report an execution record flow, and the equipment is pushed to execute the record to a user operation interface and is gathered in a message center;
if yes, continuing to judge the specific virtual interaction type, and positioning the APP user operation interface and the bearing terminal for specifically demonstrating the virtual interaction according to big data analysis.
The APP user operation interface makes state changes and executes real equipment management to the bound intelligent terminal equipment, and the APP user operation interface executes a virtualization scene in a linkage mode.
The APP user operation interface judges the virtual interaction type, at the moment, the scene mode is set as a home mode, the APP user operation interface or the bearing terminal which specifically demonstrates the virtual interaction is positioned according to big data analysis,
the APP user operation interface can make state change and execute real equipment management to the bound network intelligent lock, and the APP user operation interface executes a virtualization scene in a linkage mode.
Particularly, the equipment with the triggering condition is a network intelligent lock, and a user can actually operate and control whether to open or lock the door or not; after the network intelligent lock in reality is verified to open the door through the password, the bearing terminal displays that the room temperature is 34 ℃ and the humidity is large at the moment, the air conditioner is arranged to be opened and cooled by 25 ℃, the fresh air is opened, the window is controlled to be closed through the electric window opener, and the intelligent curtain controller pulls up the window screen to protect privacy. The Internet of things television is controlled through voice, and after the television is turned on, the intelligent curtain controller can adjust the light intensity of the living room according to the visual field adjusting shading cloth. At the moment, the virtual intelligent terminal equipment is executed, the functions of the equipment are restored by the computer technology, if the air conditioner is actually bound, the intelligent terminal equipment is controlled, and if the air conditioner is not bound, the display effect of the virtual preset program is executed.
The visual effect of the virtual preset program of the APP user operation interface is displayed in the 3D scene of the user operation interface, and the virtual preset program is a set of complete, ordered and mutually associated virtual interaction systems.
Example 2
Example 2 differs from example 1 in that: the invention provides an intelligent home experience system with virtual-real interaction, which has the same content steps as those of the system in the embodiment 1 and is not repeated.
It should be noted that the system of the present invention is used in a carrier terminal, and may be used for stereoscopic imaging of terminal devices such as AR, VR or 3D glasses, and is not limited herein.
The real scene of the home and the VR virtual world on the APP user operation interface are interactively displayed through the AR technology, and a better actual experience effect can be achieved.
The use method of the intelligent home experience system with virtual-real interaction comprises the following steps:
the method comprises the steps that a user sets actual controllable intelligent terminal equipment on a binding module in an encrypted communication mode, the intelligent terminal equipment is associated with a virtual preset program through the binding module, one-to-one or one-to-many operation relation is realized on a user operation interface to establish virtual association, so that the user can operate the virtual preset program in a VR scene, meanwhile, enough intelligent terminal equipment in reality is allowed to be added and managed, and the user can perform grouping management in a scene mode, such as going home, leaving home, sleeping, living and self-defining modes.
And equipment management, equipment running state change and dynamic presentation of management contents are performed in the binding module.
The user can operate the opening and closing functions of the equipment in the APP user operation interface or on the actual intelligent terminal equipment;
(2) the intelligent terminal equipment executes and generates data, and reports the data to the intelligent gateway in an encrypted communication mode;
(3) the intelligent gateway processes and converts the reported data into service data, and reports the service data to the cloud platform in an encrypted communication mode;
(4) the virtual preset program is opened in advance to wait for an intelligent terminal device triggering instruction, and the cloud platform judges whether the virtual preset program is a triggering condition of the virtual preset program;
(5) the APP user operation interface runs a virtual preset program after receiving the instruction; the intelligent terminal equipment for triggering the condition needs to have an active reporting and executing action mechanism;
(6) the virtual preset program restores functions of the linkage intelligent terminal equipment in a VR scene or 3D glasses and displays the functions on the bearing terminal.
The judging process of the triggering condition of the virtual preset program is as follows:
if not, normal equipment is taken to report an execution record flow, and the equipment is pushed to execute the record to a user operation interface and is gathered in a message center;
if yes, continuing to judge the specific virtual interaction type, and positioning the APP user operation interface and the bearing terminal for specifically demonstrating the virtual interaction according to big data analysis.
The APP user operation interface makes state changes and executes equipment management in reality for the bound intelligent terminal equipment, and the APP user operation interface is linked with a VR scene or 3D glasses to execute experience effects.
After the VR or 3D glasses equipment is accessed, virtual preset programs are simulated into visual fields formed by the VR or the 3D glasses through scene setting, virtual real object states are presented in the VR visual fields through the virtual preset programs, and after the operation interaction in the VR real scenes or the 3D glasses meets the triggering conditions, the same experience effect of the intelligent terminal equipment in reality can be experienced.
Meanwhile, when the intelligent terminal equipment for imaging in the VR live-action scene or the 3D glasses is grabbed, the price tag is displayed above the intelligent terminal equipment, the intelligent terminal equipment is placed into a shopping cart appearing at the upper right corner of the VR live-action scene or the 3D glasses vision lamp after selection, an instruction is directly sent to a shopping mall online shop, and an order is generated.
Example 3
Example 3 differs from example 1 in that: the invention provides an intelligent home experience system with virtual-real interaction, wherein intelligent terminal equipment is a scene switch, and the scene switch is used for realizing the remote control function of switch equipment, binding among equipment, scene linkage and one-key control; different modes can be customized to realize scene change;
virtual scene switch coordinated control entity switch in the APP user operation interface, the scene switch can control the switch function of the virtual preset program in the virtual scene, both of them can be coordinated control, in the virtual-real interaction, the true and real actual function effect is experienced.
Example 4
Example 4 differs from example 1 in that: the invention provides an intelligent home experience system with virtual-real interaction, wherein a user purchases a single intelligent switch to be connected with an illuminating lamp ceiling lamp or an intelligent lamp to be installed on a balcony, a kitchen or a toilet, and the user uses an APP user operation interface.
The virtual preset program is a door magnetic inductor, and when a user pushes a door or closes the door on an APP user operation interface, the lamp in reality can be turned on or turned off in a linkage manner.
It should be noted that the application of the system in combination with the shopping mall is not limited to the shopping of the intelligent terminal device, and is applicable to the shopping of commodities.
The above embodiments are only for illustrating the technical idea of the present invention, and the protection scope of the present invention is not limited thereby, and any modifications made on the basis of the technical scheme according to the technical idea of the present invention fall within the protection scope of the present invention.

Claims (10)

1. An intelligent home experience system with virtual-real interaction comprises intelligent terminal equipment supporting a data reporting function, an intelligent gateway, a cloud platform and an APP user operation interface, wherein the intelligent terminal equipment is connected with the intelligent gateway in an encryption communication mode, the intelligent gateway is connected with the cloud platform in an encryption communication mode, the APP user operation interface is connected with the cloud platform in an encryption communication mode, and the APP user operation interface is connected with the intelligent terminal equipment in an encryption communication mode; APP user operation interface includes the control unit, storage module, binds the module and virtual preset program, the control unit respectively with storage module, bind the module and virtual preset program is connected, virtual preset program with bind the module and be correlated with, its characterized in that: the virtual preset program is used for correspondingly mapping virtual equipment of the virtual preset program through simulation according to the functions of the real intelligent terminal equipment, so that the functions of the real intelligent terminal equipment linkage virtual equipment in reality are restored in the virtual 3D scene.
2. The intelligent home experience system with virtual-real interaction as claimed in claim 1, wherein the control unit is configured to perform unified allocation, coordination management, analysis and judgment on the information command, and send and receive the information command;
the storage module is used for storing the sent information instruction and the bound equipment information;
the binding module is used for adding or deleting intelligent terminal equipment which can be actually operated in reality, dynamically managing the associated equipment, inquiring the state and managing the operation of the intelligent electric appliance;
the APP user operation interface is used for a user to perform system query, equipment management and effect display of a virtual preset program.
3. The intelligent home experience system with virtuality-reality interaction of claim 1, wherein the virtual preset program comprises light management, home security management, human comfort management, emergency rescue and scene mode.
4. The intelligent home experience system with virtual-real interaction of claim 3, wherein the light management is used to manage intelligent switches and intelligent curtain controllers to adjust light intensity;
the home safety management is used for monitoring, early warning and safety prompting possible accidents and needs in daily life;
the human body comfort management is used for detecting and monitoring indoor environment and pollution conditions;
the emergency rescue is used for monitoring the body abnormity of the user and the abnormity of the indoor environment and timely pushing a message to inform a guardian, and corresponding measures are taken for corresponding warning conditions;
the scene mode is used for managing the intelligent terminal equipment in a room-dividing and time-sharing mode or displaying a virtual preset program according to the work and rest habits of people and the population conditions of families, the light management, the home safety management, the human body comfort management and the systematic default setting of emergency rescue.
5. The intelligent home experience system with virtual-real interaction as claimed in claim 1, wherein the control unit further comprises a power supply monitoring module having a power supply monitoring protection function for the intelligent terminal device.
6. The system of claim 1, wherein the cloud platform is a private cloud platform or a public cloud platform, the APP ui is installed on a bearer terminal, the bearer terminal is a mobile phone, a pad, or a smart tv, and the encryption communication mode is a ZigBee wireless communication protocol, bluetooth, MQTT wireless communication protocol, Z-Wave wireless communication protocol, or WiFi wireless communication protocol.
7. The intelligent home experience system with virtual-real interaction according to claim 1, wherein the intelligent terminal device is one or more of a network intelligent lock, an intelligent switch, an intelligent security device, an intelligent socket, a temperature and humidity sensor, a dazzling color lamp, a camera, and an intelligent curtain controller.
8. The use method of the smart home experience system with the virtual-real interaction according to any one of claims 1 to 7, comprising the steps of:
(1) the user sets the real controllable intelligent terminal device on the binding module by the encryption communication mode to match and connect,
the user can operate the opening and closing functions of the equipment in the APP user operation interface or on the actual intelligent terminal equipment;
(2) the intelligent terminal equipment executes and generates data, and reports the data to the intelligent gateway in an encrypted communication mode;
(3) the intelligent gateway processes and converts the reported data into service data, and reports the service data to the cloud platform in an encrypted communication mode;
(4) the virtual preset program is opened in advance to wait for an intelligent terminal device triggering instruction, and the cloud platform judges whether the virtual preset program is a triggering condition of the virtual preset program;
(5) the APP user operation interface runs a virtual preset program after receiving the instruction; the intelligent terminal equipment for triggering the condition needs to have an active reporting and executing action mechanism;
(6) the virtual preset program restores functions which are actually possessed by the linkage intelligent terminal device in the virtual 3D scene and displays the functions on the plurality of bearing terminals.
9. The use method of the smart home experience system with virtual-real interaction according to claim 8, wherein the trigger condition of the virtual preset program is determined as follows:
if not, normal equipment is taken to report an execution record flow, and the equipment is pushed to execute the record to a user operation interface and is gathered in a message center;
if yes, continuing to judge the specific virtual interaction type, and positioning the APP user operation interface and the bearing terminal for specifically demonstrating the virtual interaction according to big data analysis.
10. The use method of the smart home experience system with virtual-real interaction according to claim 8, wherein the APP user operation interface performs state change, performs real device management, and executes a virtualization scene in linkage with the APP user operation interface for the bound smart terminal device.
CN201710611173.0A 2017-07-25 2017-07-25 Intelligent home experience system with virtual-real interaction and use method thereof Active CN107317822B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710611173.0A CN107317822B (en) 2017-07-25 2017-07-25 Intelligent home experience system with virtual-real interaction and use method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710611173.0A CN107317822B (en) 2017-07-25 2017-07-25 Intelligent home experience system with virtual-real interaction and use method thereof

Publications (2)

Publication Number Publication Date
CN107317822A CN107317822A (en) 2017-11-03
CN107317822B true CN107317822B (en) 2020-03-31

Family

ID=60178898

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710611173.0A Active CN107317822B (en) 2017-07-25 2017-07-25 Intelligent home experience system with virtual-real interaction and use method thereof

Country Status (1)

Country Link
CN (1) CN107317822B (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107728590A (en) * 2017-09-29 2018-02-23 四川长虹电器股份有限公司 ZigBee intelligent domestic systems and its scene inter-linked controlling method
CN107807538A (en) * 2017-11-30 2018-03-16 南京物联传感技术有限公司 The virtual projection switching system and method for work of a kind of smart home
CN108224687B (en) * 2017-12-21 2020-06-09 广东汇泰龙科技有限公司 Humidity regulator linkage method and system based on cloud lock
CN107942708B (en) * 2017-12-21 2021-02-09 广东汇泰龙科技股份有限公司 Air purifier linkage method and system based on cloud lock
CN109067845A (en) * 2018-07-10 2018-12-21 深圳市康拓普信息技术有限公司 A kind of Internet of Things management platform for intelligent socket big data
CN110727200A (en) * 2018-07-17 2020-01-24 珠海格力电器股份有限公司 Control method of intelligent household equipment and terminal equipment
CN110740150B (en) * 2018-07-20 2022-12-23 阿里巴巴集团控股有限公司 Message interaction method and device
CN110824971B (en) * 2018-08-13 2022-05-06 深圳市迈迪加科技发展有限公司 Display system and display method thereof
CN111766787A (en) * 2019-04-02 2020-10-13 上海观创智能科技有限公司 Intelligent household control system and method
CN110209074A (en) * 2019-06-04 2019-09-06 广东科徕尼智能科技有限公司 A kind of intelligent curtain and mobile terminal interactive device and exchange method
CN110381385B (en) * 2019-07-25 2021-04-06 四川长虹电器股份有限公司 Web-based intelligent scene editing method for polymer television internet of things platform
US11308697B2 (en) 2019-09-12 2022-04-19 International Business Machines Corporation Virtual reality based selective automation adoption
CN111158256A (en) * 2019-12-31 2020-05-15 南京创维信息技术研究院有限公司 Intelligent household scene simulation and equipment control method and system based on intelligent television
CN111538252B (en) * 2020-05-25 2021-09-21 厦门大学 Intelligent home demonstration system applying VR technology
CN111625095A (en) * 2020-05-28 2020-09-04 重庆跃途科技有限公司 Training evaluation system and method based on VR and Internet of things fusion technology
CN111739352A (en) * 2020-06-03 2020-10-02 长沙理工大学 Simulation method of central air conditioner virtual maintenance training system
CN111901333B (en) * 2020-07-27 2022-08-02 广州卓远虚拟现实科技有限公司 MQTT protocol-based VR (virtual reality) man-machine interaction method and readable storage medium
CN113360731A (en) * 2021-05-31 2021-09-07 北京智思迪科技有限公司 Household appliance information summarizing method and device
CN114326428A (en) * 2021-12-30 2022-04-12 深圳思悦创新有限公司 Intelligent household equipment display method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104536397A (en) * 2014-12-09 2015-04-22 中国电子科技集团公司第十五研究所 3D virtual smart home interaction method
CN105022281A (en) * 2015-07-29 2015-11-04 中国电子科技集团公司第十五研究所 Intelligent household control system based on virtual reality
CN106249611A (en) * 2016-09-14 2016-12-21 深圳众乐智府科技有限公司 A kind of Smart Home localization method based on virtual reality, device and system
CN106412111A (en) * 2016-11-14 2017-02-15 南京物联传感技术有限公司 Cloud-based whole house intelligent system
CN106713082A (en) * 2016-11-16 2017-05-24 惠州Tcl移动通信有限公司 Virtual reality method for intelligent home management

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9272418B1 (en) * 2014-09-02 2016-03-01 The Johns Hopkins University System and method for flexible human-machine collaboration

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104536397A (en) * 2014-12-09 2015-04-22 中国电子科技集团公司第十五研究所 3D virtual smart home interaction method
CN105022281A (en) * 2015-07-29 2015-11-04 中国电子科技集团公司第十五研究所 Intelligent household control system based on virtual reality
CN106249611A (en) * 2016-09-14 2016-12-21 深圳众乐智府科技有限公司 A kind of Smart Home localization method based on virtual reality, device and system
CN106412111A (en) * 2016-11-14 2017-02-15 南京物联传感技术有限公司 Cloud-based whole house intelligent system
CN106713082A (en) * 2016-11-16 2017-05-24 惠州Tcl移动通信有限公司 Virtual reality method for intelligent home management

Also Published As

Publication number Publication date
CN107317822A (en) 2017-11-03

Similar Documents

Publication Publication Date Title
CN107317822B (en) Intelligent home experience system with virtual-real interaction and use method thereof
CN107678649B (en) Information display method and device of intelligent panel
CN102354194B (en) Smart home control system
CN104618201B (en) A kind of control system and control method of internet of things home appliance
CN104597763A (en) Phone-controlled intelligent household system
CN105182786A (en) Intelligent household management device and system
CN104110787B (en) Method and system for controlling air conditioner
CN203117757U (en) Household monitoring system
CN105072003A (en) Synchronous control system and method of smart home mode
US20160004231A1 (en) Method of managing electrical device, managing system, electrical device, operation terminal, and program
CN205067996U (en) Intelligence house management device
CN104407579A (en) Intelligent household system
CN103676912A (en) Intelligent home system
CN107204902A (en) Intelligent domestic system and its control method, Centralized Controller
CN112506148A (en) Intelligent household system and control method
CN105182775A (en) Internet-of-things-based intelligent household mobile phone APP control system
CN103383562A (en) Intelligent house management system
CN202735782U (en) Comprehensive intelligent home control system
CN110111523A (en) A kind of fire-fighting Internet of Things signal imitation Transmission system
CN107885150A (en) Intelligent switch with warning function
CN207867301U (en) A kind of smart home demo system showcase
CN106843883A (en) Display device, system and method based on widget
CN113452589B (en) Wide area network intelligent home remote control system and working method thereof
CN106843787B (en) Display device, system and method based on widget
CN205301845U (en) Visual scene control system based on camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant