CN105955043A - Augmented-reality type visible controllable intelligent household control system and method - Google Patents
Augmented-reality type visible controllable intelligent household control system and method Download PDFInfo
- Publication number
- CN105955043A CN105955043A CN201610370287.6A CN201610370287A CN105955043A CN 105955043 A CN105955043 A CN 105955043A CN 201610370287 A CN201610370287 A CN 201610370287A CN 105955043 A CN105955043 A CN 105955043A
- Authority
- CN
- China
- Prior art keywords
- module
- user
- control
- home
- command
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000010354 integration Effects 0.000 claims abstract description 28
- 238000004891 communication Methods 0.000 claims abstract description 25
- 230000008569 process Effects 0.000 claims abstract description 14
- 238000009877 rendering Methods 0.000 claims description 38
- 230000003190 augmentative effect Effects 0.000 claims description 37
- 230000000875 corresponding effect Effects 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 10
- 230000001276 controlling effect Effects 0.000 claims description 8
- 238000013459 approach Methods 0.000 claims description 6
- 210000004556 brain Anatomy 0.000 claims description 3
- 230000005611 electricity Effects 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 claims description 2
- 238000012546 transfer Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 4
- 230000002452 interceptive effect Effects 0.000 abstract description 4
- 230000008859 change Effects 0.000 abstract description 3
- 210000003128 head Anatomy 0.000 description 14
- 230000006870 function Effects 0.000 description 9
- 210000005252 bulbus oculi Anatomy 0.000 description 8
- 210000001508 eye Anatomy 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an augmented-reality type visible controllable intelligent household control system and method. A 3D image obtaining module enables a home environment three-dimensional image to be transmitted to a user module, and an augmented-reality display module is used for the display of the three-dimensional image. The user module collects user information, and the system switches to the 3D image display module of a corresponding room according to a room selected by a user, and then command information is generated according to controlled household electric appliances in the room selected by the user and the content of a user command. The user module enables the command information to be transmitted to a household electric appliance control integration module, and the household electric appliance control integration module achieves the forwarding control of controlled equipment according to the content of the command, reads the state information of the equipment in real time, and returns the information to the user through a communication module, thereby forming a closed-loop system. The system employs man-machine interactive control integrating watching and control to change the mode of a menu mode. The process that a user controls intelligent household electric appliances can be completed through watching and thinking like a real control process. The user can control the experience effect very easily in a humanized manner.
Description
Technical field
The invention belongs to Smart Home field, particularly relate to the visible i.e. controlled Smart Home of a kind of augmented reality type
Control system and method
Background technology
Instantly Smart Home is as a heat subject, but due to the many not enough resistance on intelligent home control system
Hinder Smart Home and be popularized in huge numbers of families.Such as, due to the control system degree of intelligence requirement to home appliance
Too high, user needs that existing domestic environment carries out the intellectualized reconstruction of very big engineering or needs are purchased and are replaced by height
Spend intelligentized home appliance, cause improvement cost high；Existing intelligent home control system Consumer's Experience is imitated
Fruit is the best, and controlling home appliance interface is that the menu bar screening interface of form or vision are grasped with control layer by layer
Make separate interface, carry out the interface of human-computer interactive control not over stereoscopic vision, it is impossible to immersively go
Know from experience the impression being in, and cannot old man when remote control domestic electrical equipment equipment and in family, child etc. make very
Good contact is interactive.
Summary of the invention
Present invention aims to that existing intelligent home control system improvement cost is high, Consumer's Experience effect
The technical deficiencies such as difference, it is provided that a kind of visible i.e. controlled intelligent home control system and the method for augmented reality type.
It is an object of the invention to be achieved through the following technical solutions: a kind of augmented reality type is visible the most controlled
Intelligent home control system, this system include some 3D rendering acquisition modules, communication module, line module and
Home wiring control integration module；
Described 3D rendering acquisition module is for obtaining domestic environment, the instant stereo-picture of intelligent appliance and intelligence
The image coordinate scope that energy household electrical appliances are corresponding；
Described communication module is anti-for the transmission of 3D rendering, the transmission of user's control instruction and family's electrical information
Feedback；
Described line module include augmented reality display module, multi-media module, user profile acquisition module and
Control processes nucleus module；Wherein, augmented reality display module is used for showing stereo-picture, playing in multimedia
Hold；User profile acquisition module is for gathering the control signal of user；Control process nucleus module is responsible for analysis and is adopted
The user control signal of collection generates corresponding instruction；
Described home wiring control integration module is used for controlling intelligent appliance and performs corresponding action and obtain intelligence man
The working condition of electricity, and described working condition is sent to line module；
Domestic environment stereo-picture is transferred to line module by communication module by described 3D rendering acquisition module,
Carrying out 3D rendering by augmented reality display module to show, line module gathers user profile, selects according to user
Fixed room is switched to the 3D rendering acquisition module in corresponding room, controlled further according in the room that user selectes
The command context of home appliance and user generates command information, and described command information includes command address prefix
(address, room), object prefix (household electrical appliances title) and command context (concrete operations to household electrical appliances), user
Command information transmission to home wiring control integration module, home wiring control integration module are realized by module according to command context
The forward of controlled device is controlled, and the status information reading equipment in real time returns to user, shape through communication module
Become closed loop system.
Further, described 3D rendering acquisition module is that at least one terminal with 3D rendering capturing function sets
Standby, described home wiring control integration module is that at least one integrated information receives and the terminal unit of distant control function, institute
Stating line module is that at least one integrated image shows, image coordinate positions and the terminal unit of control process function,
Described communication module is at least one equipment with 3D rendering transfer function and communication function.
Further, described line module is at least one Wearable integrated intelligent terminal.
Further, described home wiring control integration module is selected from smart mobile phone, panel computer, home computer, intelligence
Can remote controller.
Further, the control object of described home wiring control integration module include all can be by wireless remote control and energy
Enough home appliances in remote control end display working condition data.
A kind of augmented reality type the most controlled visible intelligent home furnishing control method, the method includes forward controlling party
Method and State Feedback Approach, described forward control method comprises the steps:
(1) 3D rendering obtains: 3D rendering acquisition module obtains the stereo-picture of domestic environment and through communication module
It is sent to line module；
(2) household electrical appliances location is with identification: the 3D rendering that step 1 is gathered by augmented reality display module shows,
User profile acquisition module passes through user operation selected digital image position, mates user by the coordinate information of this position
Predefined content under this coordinate, if this content is a room, the 3D rendering being switched to this room obtains
Delivery block, and carry out under the image in this room image position coordinates select, if this content is home appliance,
The control residing room address information and device name information being sent in line module processes nucleus module；
(3) control command generates: control processes nucleus module according to the room address information received and equipment
Name information generates address prefix and the object prefix of instruction, and the command context sent further according to user is combined into ground
The command information of location prefix-object prefix-command context is sent to home wiring control integration module；
(4) order performs: home wiring control integration module finds controlled household electrical appliances to set according to the command information received
Standby, controlled home appliance is carried out operation corresponding to command context and controls.
Described State Feedback Approach comprises the steps:
(1) working condition obtains: home wiring control integration module obtains intelligent appliance working condition, and by work
Situation is sent to line module by communication module；
(2) working condition shows: the working condition of the intelligent appliance received is supplied to user by line module
Check.
Described forward control method and State Feedback Approach use parallel mode to run, separate, the most not shadow
Ring.
Further, in the step (2) of described forward control method, described household electrical appliances location and identification institute
The method used is Smart Home image space coordinate setting method of identification, is implemented as follows: first predefine room
Between and intelligent appliance equipment space coordinates scope under image save as the form of table, pass through user during use
Behind operation selected digital image position, the space coordinates of this position of line module record, and determine this in the way of tabling look-up
Before room title that coordinate is corresponding and/or intelligent appliance device name are as the address prefix of order and/or object
Sew.
Further, in the step (2) of described forward control method, the method for user operation be eye dynamic,
Manually, gesture identification, Expression Recognition or brain control.
Further, in the step (3) of described forward control method, the side that described control command generates
The command context that method is the information according to fixation and recognition and user sends generates and includes address prefix, object prefix
And the command information of command context；Described command context is sent by user speech, or user selects menu
Content sends；The command context that wherein user sends is the first priority, if the command context that i.e. user sends
Include address prefix and object prefix and then give up address prefix that the information according to fixation and recognition generated with right
As prefix.
The beneficial effects of the present invention is:
Even if 1. user is away from home and also can be felt by the three-dimensional image " in going back home " of domestic environment
By the atmosphere in household.
2. the present invention is with stereoscopic vision as background, " seeing " and " control " human-computer interactive control revolution integrally dish
The control of monotype, when user controls intelligent appliance equipment, by seeing, just expecting as true control
Can accomplish, interface or the vision of comparing the form of menu bar screening layer by layer operate separate interface with control, this
Bright user controls that experience effect is extremely simple, hommization.
3. the order executive mode of household electrical appliances integrated control module (is first analyzed command information and is determined the ground of controlled household electrical appliances
Location recalls corresponding remote control device with title) less demanding to the intelligence degree of home appliance, daily relatively
Having can be able to be controlled by the home appliance of the past remote control end feedback operation status data of wireless remote control energy more
Object, makes the intellectualized reconstruction low cost of household.
4. user can remotely and household carries out interaction, by video game media in family with in line module
The synchronism switching of video game media can share program or jointly play game, be away from home and can also give house
In old man and child's intelligence accompany and look after.
5. domestic environment is presented by 3D rendering vision, beneficially the safety monitoring of household.
6. carry out fixation and recognition intelligent appliance equipment by Smart Home image space coordinate setting method of identification, compare it
The method of its image recognition is the simplest, accurately.
7. the control method of the program is a closed loop control comprising forward and feedback so that user can see in real time
To the control effect of home appliance, whether the working condition that also can understand home appliance at any time there is exception, significantly
Ensure accuracy, the safety controlled.
8. selecting the mode of control object can be the diversification aptitude manners such as eye is dynamic, voice, brain control, makes land used
Location prefix couples controlled device with object prefix so that selected the most accurate.
Accompanying drawing explanation
Fig. 1 is the composition frame chart of the visible i.e. controlled intelligent home control system of augmented reality type；
Fig. 2 is the line module schematic diagram of the visible i.e. controlled intelligent home control system of augmented reality type；
Fig. 3 is the sky of the visible i.e. domestic environment stereo-picture of controlled intelligent home control system of augmented reality type
Between coordinate display schematic diagram.
Detailed description of the invention
With specific embodiment, the present invention is described in further detail below in conjunction with the accompanying drawings.
As it is shown in figure 1, the present invention provide a kind of based on i.e. controlled Intelligent housing system seen from augmented reality
System, this system includes some 3D rendering acquisition modules, communication module, line module and the integrated mould of home wiring control
Block；
Described 3D rendering acquisition module is for obtaining domestic environment, the instant stereo-picture of intelligent appliance and intelligence
The image coordinate scope that energy household electrical appliances are corresponding；
Described communication module is anti-for the transmission of 3D rendering, the transmission of user's control instruction and family's electrical information
Feedback；
Described line module include augmented reality display module, multi-media module, user profile acquisition module and
Control processes nucleus module, as shown in Figure 2；Wherein, augmented reality display module be used for showing stereo-picture,
Play content of multimedia；User profile acquisition module is for gathering the control signal of user；Control processes core mould
Block is responsible for analyzing the user control signal gathered and is generated corresponding instruction；
Described home wiring control integration module is used for controlling intelligent appliance and performs corresponding action and obtain intelligence man
The working condition of electricity, and described working condition is sent to line module；Described home wiring control integration module is
There is information receive and the terminal unit of distant control function, be selected from smart mobile phone, panel computer, home computer,
Intelligent remote controller；The control object of described home wiring control integration module include all can be by wireless remote control and can
Home appliance in remote control end display working condition data.
Domestic environment stereo-picture is transferred to line module by communication module by described 3D rendering acquisition module,
Carrying out 3D rendering by augmented reality display module to show, line module gathers user profile, selects according to user
Fixed room is switched to the 3D rendering acquisition module in corresponding room, controlled further according in the room that user selectes
The command context of home appliance and user generates command information, and described command information includes command address prefix
(address, room), object prefix (household electrical appliances title) and command context (concrete operations to household electrical appliances), user
Command information transmission to home wiring control integration module, home wiring control integration module are realized by module according to command context
The forward of controlled device is controlled, and the status information reading equipment in real time returns to user, shape through communication module
Become closed loop system.
Embodiment one: utilize the augmented reality type intelligent home control system of the present invention to control the intelligent ice in kitchen
Intelligent electric lamp in case and bedroom
Intelligent home control system in the present embodiment by the augmented reality integrated functionality helmet, wireless router,
Two 3D photographic head and a smart mobile phone equipped with reception instruction and control household electrical appliances software form, and undertake respectively
Line module, communication module, 3D rendering acquisition module and the function of home wiring control integration module.Wherein intelligence
Can be positioned in family by mobile phone, the augmented reality integrated functionality helmet (is used for equipped with augmented reality display screen, photographic head
Read eyeball correspondence image coordinate with record user expression), search respective coordinates device name with identify smile
Module, sound collection and the identification module of expression.Control the intelligent refrigerator step in kitchen as follows:
The reading of virtual reality image shows: the augmented reality integrated functionality helmet receives the 3D photographic head of central authorities of family
The 3D stereo-picture obtained, and the display screen that panorama is shown in the helmet.
Selecting of kitchen: user observes surrounding in the picture, and the camera head record eyeball in the helmet is corresponding simultaneously
Image coordinate, user watches kitchen smile (being equivalent to this position selected) attentively, and household image is immediately switched to kitchen
The 3D stereo-picture that 3D photographic head in room obtains, and it is set to " KC " (representing kitchen) in instruction address prefix；
Selecting of controlled intelligent refrigerator: user's eyeball coordinate continues to move in kitchen internal image, when falling at refrigerator
Place when smiling (refrigerator is confirmed to be controlled device), instruction address prefix " KC " is afterwards plus object prefix " fr "
(representing refrigerator)；
The generation of control instruction: after selected controlled refrigerator, after sending the phonetic order of " 5 degree ", control command
The instruction that processing module generates (KC, fr, 5 DEG C) according to positional information before is sent to wireless router.
The execution of instruction: the smart mobile phone being positioned in family receives this instruction, identified, is switched to intelligence ice
Case remote control software, is adjusted to 5 DEG C by the refrigerator temperature in kitchen.After regulating successfully, and by the temperature of refrigerator
Data augmented reality display module in wireless router returns to the augmented reality integrated functionality helmet shows, and
2s updates once, checks the real time temperature of refrigerator inside for user.
The intelligent electric lamp step that user continues to control in bedroom in kitchen is as follows:
The generation of control instruction: after user enters kitchen, sends the phonetic order of " electric light turning in bedroom ",
Speech recognition gives up, after " bedroom ", the instruction address prefix " KC " generated after entering kitchen, and revises ground
Location prefix is " BR " (representing bedroom), after speech recognition to " electric light ", object prefix is set to " lg " (generation
Table electric light), generate (BR, lg, 1) and turn on the instruction of bedroom electric light.
The execution of instruction: smart mobile phone receives this instruction, identified, is switched to intelligent electric lamp remote control software,
Light switch in bedroom is opened.
Embodiment two: remotely and household shares TV to utilize the augmented reality type intelligent home control system of the present invention
Program
Intelligent home control system in the present embodiment is by the augmented reality integrated functionality helmet, a wireless routing
Device, a 3D photographic head and one are equipped with receiving instruction and controlling the smart mobile phone composition of household electrical appliances software, respectively
Carry line module, communication module, 3D rendering acquisition module and the function of home wiring control integration module.Its
Middle smart mobile phone is positioned in family, and the augmented reality integrated functionality helmet shows equipped with multi-media module, augmented reality
Screen, photographic head (being used for reading eyeball correspondence image coordinate and record user's expression), the setting of lookup respective coordinates
Standby title and the module, sound collection and identification module, the earphone that identify that smile is expressed one's feelings.TV Festival is shared with household
Mesh step is as follows:
Selecting of TV: user's eyeball coordinate moves in parlor internal image, when falling at television set and when smiling
(television set is confirmed to be controlled device), generates instruction address prefix " LR " (representing parlor), before object
Sew " TV " (representing TV).
The generation of control instruction: user sends the instruction of " seeing TV together ", after speech recognition to " TV "
Display module opens the multi-media module in the virtual reality integrated functionality helmet, switches to and sees television mode, at language
While sound recognizes " together ", represent and family TV is opened and by channel switch to user is Tong Bu
The intelligence that the instruction of ' xx ' is remotely sent in family through wireless router with (LR, TV, ch ' xx ') form
Mobile phone.
The execution of instruction: the smart mobile phone in family receives this instruction, identified, is switched to Intelligent TV remote control
Software, switchs the TV in parlor and opens and can carry out synchronization channels switching with user.After regulating successfully,
And channel state " xx " is returned to user through wireless router.When same channel is watched, the head portrait of user
Can report on smart mobile phone with voice messaging, convenient and household carries out interaction when watching same program.
Embodiment three: utilize the augmented reality type intelligent home control system of the present invention remotely to teach child to learn
Intelligent home control system in the present embodiment by two 3D photographic head, the augmented reality integrated functionality helmet,
The speech player composition of one wireless router and band microphone, carries 3D rendering acquisition module, use respectively
Family module, communication module and the function of home wiring control integration module.Wherein the speech player of band microphone is contained in child
On the desk of son, the augmented reality integrated functionality helmet (is used equipped with 3D reality household image display panel, photographic head
In read eyeball correspondence image coordinate with record user expression), search respective coordinates device name with identification micro-
Laugh at the module of expression, sound collection and identification module, earphone.The step remotely teaching child's study is as follows:
3D rendering obtains: the stereo-picture of parlor central authorities is transferred to by central authorities of family 3D photographic head by communication module
Augmented reality display module in line module, during user is quickly as gone back home.
Child room selected: eye is dynamic, and module can gather user profile with EEG signals etc., and user's eyeball coordinate falls
Behind the room of child and smile (room confirmation), the 3D rendering being switched to desk side, child room obtains
Module, images, by equipment 3D, the modes such as amplification that further, allows user feel as and gone in face of desk.
Entrance is given guidance in study pattern: after eyeball coordinate selectes the desk of child, immediately enter the pattern of giving guidance in study.
Child is consulted to the user head of a family by the microphone on desk, and the user head of a family passes through 3D camera head through wireless simultaneously
The image that route transmission is returned sees the exercise on desk, utilizes voice sending module that voice is sent to child's book
On the speech player of table, to child's explanation and guidance.
The present invention is not only limited to above-mentioned detailed description of the invention, and persons skilled in the art are open according to the present invention
Content, can use other multiple specific embodiments implement the present invention.Therefore, every employing present invention
Design structure and thinking, do some simply change or designs of change, both fall within scope.
Claims (9)
1. an augmented reality type the most controlled visible intelligent home control system, it is characterised in that this system includes
Some 3D rendering acquisition modules, communication module, line module and home wiring control integration module；
Described 3D rendering acquisition module is for obtaining domestic environment, the instant stereo-picture of intelligent appliance and intelligence
The image coordinate scope that energy household electrical appliances are corresponding；
Described communication module is anti-for the transmission of 3D rendering, the transmission of user's control instruction and family's electrical information
Feedback；
Described line module include augmented reality display module, multi-media module, user profile acquisition module and
Control processes nucleus module；Wherein, augmented reality display module is used for showing stereo-picture, playing in multimedia
Hold；User profile acquisition module is for gathering the control signal of user；Control process nucleus module is responsible for analysis and is adopted
The user control signal of collection generates corresponding instruction；
Described home wiring control integration module is used for controlling intelligent appliance and performs corresponding action and obtain intelligence man
The working condition of electricity, and described working condition is sent to line module；
Domestic environment stereo-picture is transferred to line module by communication module by described 3D rendering acquisition module,
Carrying out 3D rendering by augmented reality display module to show, line module gathers user profile, selects according to user
Fixed room is switched to the 3D rendering acquisition module in corresponding room, controlled further according in the room that user selectes
The command context of home appliance and user generates command information, and described command information includes command address prefix
(address, room), object prefix (household electrical appliances title) and command context (concrete operations to household electrical appliances), user
Command information transmission to home wiring control integration module, home wiring control integration module are realized by module according to command context
The forward of controlled device is controlled, and the status information reading equipment in real time returns to user, shape through communication module
Become closed loop system.
Intelligent home control system the most according to claim 1, it is characterised in that: described 3D rendering obtains
Module is that at least one has the terminal unit of 3D rendering capturing function, described home wiring control integration module be to
A few integrated information receives and the terminal unit of distant control function, and described line module is at least one integrated image
Display, image coordinate location and control process the terminal unit of function, and described communication module is at least one to be had
3D rendering transfer function and the equipment of communication function.
Intelligent home control system the most according to claim 1, it is characterised in that: described line module is for wearing
Wear formula integrated intelligent terminal.
Intelligent home control system the most according to claim 1, it is characterised in that: described home wiring control is integrated
Module is selected from smart mobile phone, panel computer, home computer, intelligent remote controller.
Intelligent home control system the most according to claim 1, it is characterised in that: described home wiring control is integrated
The control object of module include all can be by wireless remote control and can be in remote control end display working condition data
Home appliance.
6. apply an augmented reality type the most controlled visible intelligent home furnishing control method for system described in claim 1,
It is characterized in that: the method includes forward control method and State Feedback Approach, described forward control method bag
Include following steps:
(1) 3D rendering obtains: 3D rendering acquisition module obtains the stereo-picture of domestic environment and through communication module
It is sent to line module；
(2) household electrical appliances location is with identification: the 3D rendering that step 1 is gathered by augmented reality display module shows,
User profile acquisition module passes through user operation selected digital image position, mates user by the coordinate information of this position
Predefined content under this coordinate, if this content is a room, the 3D rendering being switched to this room obtains
Delivery block, and carry out under the image in this room image position coordinates select, if this content is home appliance,
The control residing room address information and device name information being sent in line module processes nucleus module；
(3) control command generates: control processes nucleus module according to the room address information received and equipment
Name information generates address prefix and the object prefix of instruction, and the command context sent further according to user is combined into ground
The command information of location prefix-object prefix-command context is sent to home wiring control integration module；
(4) order performs: home wiring control integration module finds controlled household electrical appliances to set according to the command information received
Standby, controlled home appliance is carried out operation corresponding to command context and controls.
Described State Feedback Approach comprises the steps:
(1) working condition obtains: home wiring control integration module obtains intelligent appliance working condition, and by work
Situation is sent to line module by communication module；
(2) working condition shows: the working condition of the intelligent appliance received is supplied to user by line module
Check.
Described forward control method and State Feedback Approach use parallel mode to run, separate, the most not shadow
Ring.
Intelligent home furnishing control method the most according to claim 6, it is characterised in that: described forward controlling party
In the step (2) of method, the method that described household electrical appliances location and identification are used is that Smart Home image space is sat
Demarcate position method of identification, be implemented as follows: first predefine room and intelligent appliance equipment space under image
Coordinate range also saves as the form of table, and during use, user profile acquisition module is by user operation selected digital image
Position after, the space coordinates of this position of line module record, and determine that in the way of tabling look-up this coordinate is corresponding
Room title and/or intelligent appliance device name are as the address prefix ordered and/or object prefix.
8. according to the intelligent home furnishing control method described in claim 6 or 7, it is characterised in that: described forward control
In the step (2) of method processed, the method for user operation be eye dynamic, manually, gesture identification, Expression Recognition or
Brain control.
Intelligent home furnishing control method the most according to claim 6, it is characterised in that: described forward controlling party
In the step (3) of method, the method that described control command generates is the information according to fixation and recognition and user
The command context sent generates and includes address prefix, object prefix and the command information of command context；Described life
Make content be sent by user speech, or user selects menu content to send；In the order that wherein user sends
Appearance is the first priority, if the command context that i.e. user sends includes address prefix and object prefix, gives up
The address prefix that information according to fixation and recognition is generated and object prefix.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610370287.6A CN105955043B (en) | 2016-05-27 | 2016-05-27 | A kind of visible i.e. controllable intelligent home furnishing control method of augmented reality type |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610370287.6A CN105955043B (en) | 2016-05-27 | 2016-05-27 | A kind of visible i.e. controllable intelligent home furnishing control method of augmented reality type |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105955043A true CN105955043A (en) | 2016-09-21 |
| CN105955043B CN105955043B (en) | 2019-02-01 |
Family
ID=56911069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610370287.6A Active CN105955043B (en) | 2016-05-27 | 2016-05-27 | A kind of visible i.e. controllable intelligent home furnishing control method of augmented reality type |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105955043B (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106502118A (en) * | 2016-12-21 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of intelligent home furnishing control method and system based on AR photographic head |
| CN106896736A (en) * | 2017-03-03 | 2017-06-27 | 京东方科技集团股份有限公司 | Intelligent remote nurses method and device |
| WO2018076577A1 (en) * | 2016-10-31 | 2018-05-03 | 深圳市掌网科技股份有限公司 | Electric appliance remote control system and method based on augmented reality |
| CN108109207A (en) * | 2016-11-24 | 2018-06-01 | 中安消物联传感（深圳）有限公司 | A kind of visualization solid modelling method and system |
| CN108345907A (en) * | 2018-02-09 | 2018-07-31 | 广东美的制冷设备有限公司 | Recognition methods, augmented reality equipment and storage medium |
| CN109189209A (en) * | 2018-07-24 | 2019-01-11 | 中国联合网络通信集团有限公司 | The operating method and device of building services |
| CN109283849A (en) * | 2018-09-10 | 2019-01-29 | 缙云县科耳沃自动化科技有限公司 | A kind of Intelligent house system |
| CN109324693A (en) * | 2018-12-04 | 2019-02-12 | 塔普翊海（上海）智能科技有限公司 | AR searcher, the articles search system and method based on AR searcher |
| CN109727321A (en) * | 2017-10-31 | 2019-05-07 | 中兴通讯股份有限公司 | Settlement method and device |
| CN110109370A (en) * | 2019-06-05 | 2019-08-09 | 重庆邮电大学 | Intelligent appliance control system based on GAN algorithm and MR platform |
| CN110211326A (en) * | 2019-05-29 | 2019-09-06 | 上海萃钛智能科技有限公司 | A kind of intelligence monitoring device, system and method |
| CN110456911A (en) * | 2019-08-09 | 2019-11-15 | Oppo广东移动通信有限公司 | Electronic equipment control method and device, electronic equipment and readable storage medium |
| CN110727200A (en) * | 2018-07-17 | 2020-01-24 | 珠海格力电器股份有限公司 | Control method of intelligent household equipment and terminal equipment |
| CN111212182A (en) * | 2019-12-01 | 2020-05-29 | 深圳市纽瑞芯科技有限公司 | Method and device for directly remotely controlling UWB equipment by using mobile phone embedded with UWB module |
| CN112513538A (en) * | 2018-05-29 | 2021-03-16 | 贝利莫控股公司 | Method for generating augmented reality information related to HVAC components for a user |
| CN113380088A (en) * | 2021-04-07 | 2021-09-10 | 上海中船船舶设计技术国家工程研究中心有限公司 | Interactive simulation training support system |
| US11210932B2 (en) | 2019-05-21 | 2021-12-28 | Apple Inc. | Discovery of and connection to remote devices |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110115816A1 (en) * | 2009-11-16 | 2011-05-19 | Alliance For Sustainable Energy, Llc. | Augmented reality building operations tool |
| CN103777851A (en) * | 2014-02-26 | 2014-05-07 | 朱定局 | Method and system for video interaction of internet of things |
| CN104597759A (en) * | 2014-12-26 | 2015-05-06 | 深圳市兰丁科技有限公司 | Network video based household control method and system and intelligent household management system |
| CN105022281A (en) * | 2015-07-29 | 2015-11-04 | 中国电子科技集团公司第十五研究所 | Intelligent household control system based on virtual reality |
| CN105204347A (en) * | 2015-06-18 | 2015-12-30 | 丰唐物联技术（深圳）有限公司 | Method, device and system for smart home interaction based on augmented reality technologies |
-
2016
- 2016-05-27 CN CN201610370287.6A patent/CN105955043B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110115816A1 (en) * | 2009-11-16 | 2011-05-19 | Alliance For Sustainable Energy, Llc. | Augmented reality building operations tool |
| CN103777851A (en) * | 2014-02-26 | 2014-05-07 | 朱定局 | Method and system for video interaction of internet of things |
| CN104597759A (en) * | 2014-12-26 | 2015-05-06 | 深圳市兰丁科技有限公司 | Network video based household control method and system and intelligent household management system |
| CN105204347A (en) * | 2015-06-18 | 2015-12-30 | 丰唐物联技术（深圳）有限公司 | Method, device and system for smart home interaction based on augmented reality technologies |
| CN105022281A (en) * | 2015-07-29 | 2015-11-04 | 中国电子科技集团公司第十五研究所 | Intelligent household control system based on virtual reality |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018076577A1 (en) * | 2016-10-31 | 2018-05-03 | 深圳市掌网科技股份有限公司 | Electric appliance remote control system and method based on augmented reality |
| CN108010302A (en) * | 2016-10-31 | 2018-05-08 | 深圳市掌网科技股份有限公司 | Remote controlling system for electric appliances and method based on augmented reality |
| CN108109207A (en) * | 2016-11-24 | 2018-06-01 | 中安消物联传感（深圳）有限公司 | A kind of visualization solid modelling method and system |
| CN108109207B (en) * | 2016-11-24 | 2021-11-05 | 深圳市豪恩安全科技有限公司 | Visual three-dimensional modeling method and system |
| CN106502118A (en) * | 2016-12-21 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of intelligent home furnishing control method and system based on AR photographic head |
| CN106896736A (en) * | 2017-03-03 | 2017-06-27 | 京东方科技集团股份有限公司 | Intelligent remote nurses method and device |
| CN109727321A (en) * | 2017-10-31 | 2019-05-07 | 中兴通讯股份有限公司 | Settlement method and device |
| CN108345907B (en) * | 2018-02-09 | 2022-02-11 | 广东美的制冷设备有限公司 | Recognition method, augmented reality device, and storage medium |
| CN108345907A (en) * | 2018-02-09 | 2018-07-31 | 广东美的制冷设备有限公司 | Recognition methods, augmented reality equipment and storage medium |
| CN112513538A (en) * | 2018-05-29 | 2021-03-16 | 贝利莫控股公司 | Method for generating augmented reality information related to HVAC components for a user |
| US11550282B2 (en) | 2018-07-17 | 2023-01-10 | Gree Electric Appliances, Inc. Of Zhuhai | Control method for smart home device and terminal device |
| CN110727200A (en) * | 2018-07-17 | 2020-01-24 | 珠海格力电器股份有限公司 | Control method of intelligent household equipment and terminal equipment |
| CN109189209A (en) * | 2018-07-24 | 2019-01-11 | 中国联合网络通信集团有限公司 | The operating method and device of building services |
| CN109283849A (en) * | 2018-09-10 | 2019-01-29 | 缙云县科耳沃自动化科技有限公司 | A kind of Intelligent house system |
| CN109324693A (en) * | 2018-12-04 | 2019-02-12 | 塔普翊海（上海）智能科技有限公司 | AR searcher, the articles search system and method based on AR searcher |
| US11210932B2 (en) | 2019-05-21 | 2021-12-28 | Apple Inc. | Discovery of and connection to remote devices |
| US11532227B2 (en) | 2019-05-21 | 2022-12-20 | Apple Inc. | Discovery of and connection to remote devices |
| US12039859B2 (en) | 2019-05-21 | 2024-07-16 | Apple Inc. | Discovery of and connection to remote devices |
| CN110211326A (en) * | 2019-05-29 | 2019-09-06 | 上海萃钛智能科技有限公司 | A kind of intelligence monitoring device, system and method |
| CN110211326B (en) * | 2019-05-29 | 2022-05-27 | 上海萃钛智能科技有限公司 | Intelligent nursing device, system and method |
| CN110109370A (en) * | 2019-06-05 | 2019-08-09 | 重庆邮电大学 | Intelligent appliance control system based on GAN algorithm and MR platform |
| CN110456911A (en) * | 2019-08-09 | 2019-11-15 | Oppo广东移动通信有限公司 | Electronic equipment control method and device, electronic equipment and readable storage medium |
| CN110456911B (en) * | 2019-08-09 | 2022-05-13 | Oppo广东移动通信有限公司 | Electronic equipment control method and device, electronic equipment and readable storage medium |
| CN111212182A (en) * | 2019-12-01 | 2020-05-29 | 深圳市纽瑞芯科技有限公司 | Method and device for directly remotely controlling UWB equipment by using mobile phone embedded with UWB module |
| CN113380088A (en) * | 2021-04-07 | 2021-09-10 | 上海中船船舶设计技术国家工程研究中心有限公司 | Interactive simulation training support system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105955043B (en) | 2019-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105955043A (en) | Augmented-reality type visible controllable intelligent household control system and method | |
| CN105955042B (en) | A kind of visible i.e. controllable intelligent home furnishing control method of virtual reality type | |
| US9842433B2 (en) | Method, apparatus, and smart wearable device for fusing augmented reality and virtual reality | |
| CN107506037B (en) | Method and device for controlling equipment based on augmented reality | |
| CN104977904B (en) | A kind of visible i.e. controllable intelligent home control system and control method | |
| CN107340853B (en) | Remote presentation interaction method and system based on virtual reality and gesture recognition | |
| CN104410883B (en) | The mobile wearable contactless interactive system of one kind and method | |
| CN104156064B (en) | Interactive Target Control Method and device | |
| JP6958360B2 (en) | Information processing equipment, information processing methods, and programs | |
| CN109361869A (en) | A kind of image pickup method and terminal | |
| WO2014145166A2 (en) | Autonomous computing and telecommunications head-up displays glasses | |
| CN107193381A (en) | A kind of intelligent glasses and its display methods based on eyeball tracking sensing technology | |
| CN104777991A (en) | Remote interactive projection system based on mobile phone | |
| WO2022001406A1 (en) | Display method and display device | |
| CN111651133A (en) | Intelligent control display system and control method | |
| WO2017193805A1 (en) | Method and apparatus for realizing remote monitoring in conference television system | |
| CN116071471A (en) | Multi-machine-position rendering method and device based on illusion engine | |
| CN105068248A (en) | Head-mounted holographic intelligent glasses | |
| CN114302221B (en) | Virtual reality equipment and screen-throwing media asset playing method | |
| CN113066189B (en) | Augmented reality equipment and virtual and real object shielding display method | |
| CN116260956B (en) | Virtual reality shooting method and system | |
| CN104010207B (en) | A kind of data processing method, controlled device and control device | |
| CN204517985U (en) | A kind of Circuits System of virtual implementing helmet and virtual implementing helmet | |
| CN107765894A (en) | A kind of method and device of dummy object in real-time calibration real world | |
| CN208207368U (en) | Head-mounted display apparatus, aircraft and image delivering system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |