CN106713082A - Virtual reality method for intelligent home management - Google Patents
Virtual reality method for intelligent home management Download PDFInfo
- Publication number
- CN106713082A CN106713082A CN201611033557.0A CN201611033557A CN106713082A CN 106713082 A CN106713082 A CN 106713082A CN 201611033557 A CN201611033557 A CN 201611033557A CN 106713082 A CN106713082 A CN 106713082A
- Authority
- CN
- China
- Prior art keywords
- virtual
- actual
- status information
- user
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
- G05B19/4185—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by the network communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Abstract
The invention discloses a virtual reality method for intelligent home management. The method comprises the steps of: carrying out correlation on actual home electrical equipment with which an intelligent home management center is connected and virtual home electrical equipment presented by virtual reality equipment; generating a three-dimensional interactive scene and presenting the virtual home electrical equipment in the three-dimensional interactive scene; acquiring a virtual operation instruction executed on the virtual home electrical equipment by a user; and mapping the virtual operation instruction into an actual operation instruction of the actual home electrical equipment correlated with the virtual home electrical equipment, and sending the actual operation instruction to the intelligent home management center so as to implement a corresponding operation on the actual home electrical equipment. By the method, when people use the virtual reality equipment, the operation instruction can be sent to the virtual home electrical equipment in the three-dimensional interactive scene generated by the virtual reality equipment so as to control the actual home electrical equipment to execute the operation, thereby implementing linkage of the virtual reality equipment and the actual home electrical equipment, providing three-dimensional perception for the user and facilitating the user controlling intelligent home electrical equipment.
Description
Technical field
The present invention relates to virtual device technology field, more particularly to a kind of virtual reality side for smart home management
Method.
Background technology
With the improvement of people ' s living standards, being used in the life of people more and more occurs in smart home, these
The interactive operation of smart home is also for people are provided convenience using smart home.
At present, the interactive operation of smart home is typically all to be carried out on mobile phone or flat board, but such mode is not
The effect of displaying smart home that can be three-dimensional, Consumer's Experience is poor, and when user cannot use mobile phone or flat board, with regard to nothing
Method interacts operation.
The content of the invention
Present invention mainly solves a kind of virtual reality method for smart home management of offer, it is intended to which how solution uses
Virtual reality device manages the problem of smart home.
In order to solve the above technical problems, one aspect of the present invention is:There is provided a kind of for smart home pipe
The virtual reality method of reason, the method includes:By the smart home actual home appliance that is connected of management maincenter with it is virtual
The virtual appliance equipment that real world devices are presented is associated;Generate a three-dimensional interaction scenarios and in the three-dimensional interaction scenarios
The virtual appliance equipment is presented;User is obtained to the pseudo operation instruction performed by the virtual appliance equipment;By the void
Intend operational order and be mapped to the practical operation instruction of the described actual home appliance associated by the virtual appliance equipment, and send
Maincenter is managed to the smart home, and then realizes the corresponding operating to the actual home appliance.
Wherein, the described actual household electrical appliances by associated by the pseudo operation command mappings into the virtual appliance equipment
The practical operation of equipment is instructed, and the step of transmission to smart home management maincenter includes:By the virtual appliance equipment
Identification mark or related described actual home appliance to the virtual appliance equipment identification mark be added to it is described
In the packet of practical operation instruction, and then the reality is grasped according to the identification mark by smart home management maincenter
The corresponding actual home appliance is assigned to as instruction.
Wherein, it is described to generate a three-dimensional interaction scenarios and the virtual appliance equipment is presented in the three-dimensional interaction scenarios
The step of include:It is presented related to the virtual appliance equipment in the three-dimensional interaction scenarios or in the virtual appliance equipment
The virtual item of connection;The step of pseudo operation that user is obtained to the virtual appliance equipment is instructed includes:Obtain described
User instructs to the pseudo operation performed by the virtual item.
Wherein, methods described is further included:The actual home appliance is obtained from smart home management maincenter
Status information;The status information is presented to user.
Wherein, methods described includes:The shape that the actual home appliance is obtained from smart home management maincenter
The step of state information, includes:Identification mark or the institute of the actual home appliance will be extracted from the packet of the status information
The identification mark of the virtual appliance equipment associated by actual home appliance is stated, and then is marked at according to the identification described vertical
In body interaction scenarios or the status information is associated presentation by the virtual appliance equipment with the virtual appliance equipment.
Wherein, methods described is further included:Entered according to the work to the status information to the actual home appliance
Cheng Jinhang judges, and the actual household electrical appliances are presented with animation mode in the three-dimensional interaction scenarios or the virtual appliance equipment
The progress of work of equipment.
Wherein, it is described from smart home management maincenter obtain the status information of the actual home appliance the step of it
Take a step forward including:Pseudo operation instruction according to user to the virtual appliance equipment generates status query request, and
Be sent to smart home management maincenter, so as described in smart home management central feedback actual home appliance shape
State information, or touched in the state for meeting time triggered condition or the actual home appliance by smart home management maincenter
The status information of the actual home appliance is reported during clockwork spring part.
Wherein, the pseudo operation instruction generation status inquiry according to user to the virtual appliance equipment please
The step of asking, and be sent to the smart home management maincenter includes:By the identification of virtual appliance equipment mark or with
The identification mark of the related described actual home appliance of the virtual appliance equipment is added in status query request, Jin Eryou
The status query request is assigned to the corresponding actual family by the smart home management maincenter according to the identification mark
Electric equipment.
Wherein, methods described is further included:Obtain the status information of the virtual appliance equipment, user and be presently in ring
The status information in border and from the smart home management maincenter obtain described actual home appliance status information in
It is few one;The learning outcome life of the operation history according to acquired status information and default operation rules or to user
Into practical operation instruction.
Wherein, the status information of the virtual appliance equipment including user whether be currently in use the virtual reality device,
The operation content of the virtual reality device, operational mode or operation process, the status information that user is presently in environment include
Time or temperature.
The beneficial effects of the invention are as follows:The situation of prior art is different from, during the present invention is managed by associating smart home
Actual home appliance and virtual reality device that pivot is connected, and the pseudo operation that virtual appliance equipment is performed is referred to according to user
Order, realizes the method to the corresponding operating of actual home appliance so that people, can be directly to void when using virtual reality device
Intend the virtual appliance equipment in the three-dimensional interaction scenarios generated in real world devices and send operational order, and then control actual household electrical appliances to set
It is standby to perform corresponding operation, the linkage of virtual reality device and actual home appliance is realized, and three-dimensional perception is provided the user,
Facilitate manipulation of the user to intelligent appliance equipment.
Brief description of the drawings
Fig. 1 is schematic flow sheet of the present invention for the virtual reality method first embodiment of smart home management;
Fig. 2 is schematic flow sheet of the present invention for the virtual reality method second embodiment of smart home management;
Fig. 3 is signal of the present invention for the virtual reality device and its operation principle first embodiment of smart home management
Block diagram;
Fig. 4 is signal of the present invention for the virtual reality device and its operation principle second embodiment of smart home management
Block diagram;
Fig. 5 is schematic block diagram of the present invention for the virtual reality device 3rd embodiment of smart home management.
Specific embodiment
To make those skilled in the art more fully understand technical scheme, below in conjunction with the accompanying drawings and specific implementation
Mode is described in further detail to a kind of virtual reality method for smart home management provided by the present invention.
Refering to Fig. 1, the present invention includes for the virtual reality method first embodiment of smart home management:
S101:The actual home appliance that smart home management maincenter is connected is virtual with what virtual reality device was presented
Home appliance is associated.
In step S101, virtual appliance equipment and actual home appliance are carried out into one-to-one or one-to-many operation first
Relation carries out Virtual Reconstruction, so that obtaining user can control actual household electrical appliances by operating virtual appliance equipment in virtual reality
Equipment performs corresponding operation, while, it is allowed to user adds and manages enough real home appliances, and user can be right
It carries out marshalling management.
Further, in this step, after actual home appliance is associated with virtual reality device, can also be to the pass
Connection relation predetermined registration operation rule, such as:By wave control electric light switch, by Voice command air-conditioning be turned on and off and
Unlatching, pause or the closing of TV are controlled by operation handle.
S102:The three-dimensional interaction scenarios of generation one are simultaneously presented virtual appliance equipment in the three-dimensional interaction scenarios.
For example:When user uses virtual reality device, the three-dimensional domestic environment of generation one, the domestic environment can be user
Itself residing domestic environment, or user-defined domestic environment, and in self-defined domestic environment, user can be right
Residential construction, living space, style etc. are set.
In one embodiment of the invention, step S102 includes:In the three-dimensional interaction scenarios or virtual appliance equipment
It is upper that the virtual item being associated with virtual appliance equipment is presented, and the position of these virtual items is movable, user can pass through
The mode of dragging carries out locus adjustment to it, facilitates user to be used according to itself custom.
Wherein, virtual item can be the control device that operational order is sent to actual home appliance in three-dimensional interaction scenarios
The virtual controlling equipment of middle presentation, such as:Virtual appliance equipment is television set, then corresponding virtual item is virtual remote control
Device, user can send operational order when virtual appliance equipment is operated by operating corresponding virtual item.
S103:User is obtained to the pseudo operation instruction performed by virtual appliance equipment.
In step s 103, user can be by modes such as gesture, action, voice, manipulation buttons in virtual interior scene
In carry out respective fictional home appliance control operation, and then these operational orders are obtained, optionally, in the association of virtual appliance equipment
In the case of having virtual item, operation can also be controlled to virtual appliance equipment by virtual item, and then obtain user
To the pseudo operation instruction performed by virtual item.
S104:The practical operation of the actual home appliance associated by pseudo operation command mappings into virtual appliance equipment is referred to
Order, and send to smart home management maincenter, and then realize the corresponding operating to actual home appliance.
Specifically, by the identification mark of virtual appliance equipment or related actual home appliance to virtual appliance equipment
Identification mark be added in the packet of practical operation instruction, and then will be real according to identification mark by smart home management maincenter
Border operational order is assigned to corresponding actual home appliance, and then actual home appliance performs corresponding operating.
Wherein, pseudo operation instruction can be the void such as the gesture, action, voice and the push-botton operation that are currently sent by user
Intend operational order, or virtual reality device according to the use habit of user and preference is set, generated after learning outcome
Pseudo operation instruction.
In this step, after actual home appliance performs corresponding operating, the virtual appliance equipment in virtual unit is same
When corresponding operating is performed in three-dimensional interaction scenarios, such as, and after user sends the operational order made coffee, actual home appliance
Coffee machine start to make coffee, while the coffee machine of virtual appliance equipment also begins to make coffee, and presentation is boiled with actual coffee machine
Coffee identical animation effect so that user has a kind of sensation on the spot in person in virtual three-dimensional interaction scenarios, improves
Consumer's Experience.
Additionally, smart home management control also includes:Remote monitoring, alarm and the current Smart of real time inspection
The status information of Home smart homes.In one embodiment, user is showed in use VR virtual display devices by virtual
Real equipment sends a pseudo operation instruction for unlatching air-conditioning, and the pseudo operation command mappings are closed into virtual appliance equipment
The practical operation instruction of the actual home appliance of connection, and send to smart home management maincenter, and then control the air-conditioning in family to open
Open, and select suitable temperature and pattern, while the feedback of status of air-conditioning is returned being shown in virtual reality scenario.
Refering to Fig. 2, the present invention for smart home management virtual reality method second embodiment the step of S201,
S202, S203 are identical with S101, S102, S103 of above-mentioned first embodiment, will not be repeated here, additionally, the present embodiment is also wrapped
Include:
S204:Pseudo operation instruction according to user to virtual appliance equipment generates status query request, and is sent to intelligence
Energy household management maincenter, and then the status information of the actual home appliance of central feedback is managed by smart home, or by intelligent family
Occupy management maincenter and report actual home appliance when the state trigger condition of time triggered condition or actual home appliance is met
Status information;
Specifically, the pseudo operation instruction according to user to virtual appliance equipment, the identification of virtual appliance equipment is marked
Or the identification mark of the related described actual home appliance to virtual appliance equipment is added in status query request, and then
Status query request is assigned to by corresponding actual home appliance according to identification mark by smart home management maincenter, to obtain reality
The status information of border home appliance, or time triggered condition or actual home appliance are being met by smart home management maincenter
The status information of actual home appliance is reported during state trigger condition, and then is sent to smart home management maincenter.
Wherein, the status information of actual home appliance include actual home appliance whether running, actual home appliance
Operation content, operational mode or operation process.
For example:, when opening, the air-conditioning of unlatching is by the feedback of status such as temperature, pattern to intelligence for the air-conditioning of actual home appliance
Household manages maincenter;Or when the gas concentration of domestic environment residing for actual home appliance is excessive, actual home appliance will
The gas concentration for detecting is sent to intelligent appliance in the form of warning notice and manages maincenter.
S205:The status information of actual home appliance is obtained from smart home management maincenter, obtain virtual appliance equipment
Status information and user are presently in the status information of environment.
Specifically, sent from step S205 and extract actual to the packet of the status information of smart home management maincenter
The identification mark of the virtual appliance equipment associated by the identification mark of home appliance or actual home appliance, and believed according to the state
Cease and the progress of work of actual home appliance is judged, and then be marked in three-dimensional interaction scenarios according to the identification or virtual family
Status information and virtual appliance equipment are associated presentation by electric equipment, and according to judged result by the work of actual home appliance
Process is presented in three-dimensional interaction scenarios or in virtual appliance equipment with animation mode.
Further, the state of the pseudo operation instruction generation virtual appliance equipment of virtual appliance equipment is looked into according to user
Request is ask, the status information of virtual appliance equipment is fed back.
Wherein, whether the status information of virtual appliance equipment is currently in use virtual reality device, virtual reality including user
The operation content of equipment, operational mode or operation process.
Additionally, in this step, when acquisition user is currently in use the status information of virtual reality device, smart home pipe
Reason maincenter then automatically selected according to the status information and adjust be adapted to current state actual home appliance operation, such as when with
When using virtual reality device, room light brightness need not be too high at family, then automatically adjust lamplight brightness or close light, to save
Energy consumption is saved, Consumer's Experience is improved.
Wherein, user be presently in environment status information include time or temperature.
Such as, when user uses virtual reality device indoors, current room temperature, if room temperature is too high, smart home are obtained
Management maincenter then controls room conditioning to automatically open up, and adjusts suitable temperature and pattern;Again such as, get active user when
Between be at ten two points at noon, smart home management maincenter then control electric cooker to start to cook, or transmission whether begin to use electric meal
The request that pot is cooked is to virtual reality device so that user selects.
It should be noted that in other embodiments, the status information that step S205 is obtained can be that actual household electrical appliances set
Standby status information, the status information of virtual appliance equipment and user are presently in one or many in the status information of environment
It is individual.
S206:Status information is presented to user;
Specifically, by status information, the virtual family of the above-mentioned actual home appliance obtained from smart home management maincenter
The status information of electric equipment and user are presently at least one of status information of environment and are shown to user.
S207:The study of the operation history according to acquired status information and default operation rules or to user
Result generation practical operation instruction.
Specifically, the status information of the actual home appliance according to acquisition, the status information of virtual appliance equipment and user
It is presently in the study of at least one of status information of environment and default operation rules or the operation history to user
Result generation practical operation instruction, and then practical operation instruction is sent to smart home management maincenter, to control actual family
Electric equipment performs practical operation instruction.
Wherein, default operation rules can be gesture, action to the operational order, or language of virtual appliance equipment
The operational order of sound, button to virtual appliance equipment;The operation history of user can be the habit that user sends pseudo operation instruction
Used, or conventional preset rules preference.
Refering to Fig. 3, a kind of first embodiment bag of virtual reality device 30 for smart home management that the present invention is provided
Include:Relating module 301, generation module 302, acquisition module 303, control module 304.
Relating module 301, for the actual home appliance 31 and virtual reality that are connected smart home management maincenter 32
The virtual appliance equipment that equipment is presented is associated.
Specifically, for virtual appliance equipment and actual home appliance 31 to be carried out into one-to-one or one-to-many operative relationship
Virtual Reconstruction is carried out, so that obtaining user can control actual home appliance by operating virtual appliance equipment in virtual reality
31 perform corresponding operation, while, it is allowed to user adds and manages enough actual home appliances 31, and user can be right
It carries out marshalling management.
Generation module 302, sets for generating a three-dimensional interaction scenarios and virtual appliance being presented in the three-dimensional interaction scenarios
It is standby.
For example:When user uses virtual reality device, the three-dimensional domestic environment of generation one, the domestic environment can be user
Itself residing domestic environment, or user-defined domestic environment, and in self-defined domestic environment, user can be right
Residential construction, living space, style etc. are set, and improve Consumer's Experience.
In one embodiment of the invention, production module 302 is additionally operable in the three-dimensional interaction scenarios or virtual appliance
The virtual item that presentation is associated with virtual appliance equipment in equipment, and the position of these virtual items is movable, Yong Huke
Locus adjustment is carried out to it by way of dragging, facilitates user to be used according to itself custom.
Wherein, virtual item can be the control device that operational order is sent to actual home appliance in three-dimensional interaction scenarios
The virtual controlling equipment of middle presentation, such as:Virtual appliance equipment is television set, then corresponding virtual item is virtual remote control
Device, user can send operational order when virtual appliance equipment is operated by operating corresponding virtual item.
Acquisition module 303, for obtaining user to the pseudo operation instruction performed by the virtual appliance equipment.
Specifically, user can be carried out by modes such as gesture, action, voice, manipulation buttons in virtual interior scene
Respective fictional home appliance control operation, and then these operational orders are obtained, optionally, it is associated with virtually in virtual appliance equipment
In the case of stage property, operation can also be controlled to virtual appliance equipment by virtual item, and then obtain user to virtual
Pseudo operation instruction performed by stage property.
Control module 304, by the actual home appliance 31 associated by pseudo operation command mappings into virtual appliance equipment
Practical operation is instructed, and is sent to smart home management maincenter 32, and then realizes the corresponding operating to actual home appliance 31.
Specifically, by the identification mark of virtual appliance equipment or related actual home appliance to virtual appliance equipment
31 identification mark is added in the packet of practical operation instruction, and then is marked according to identification by smart home management maincenter 32
Practical operation instruction is assigned to corresponding actual home appliance 31, and then actual home appliance 31 performs corresponding operating.
Wherein, pseudo operation instruction can be the void such as the gesture, action, voice and the push-botton operation that are currently sent by user
Intend operational order, or virtual reality device according to the use habit of user and preference is set, generated after learning outcome
Pseudo operation instruction.
Refering to Fig. 4, a kind of second embodiment of virtual reality device 40 for smart home management that the present invention is provided is entered
One step includes:Enquiry module 404, display module 405, study module 406, control module 407.
Enquiry module 404, status query request is generated for the pseudo operation instruction according to user to virtual appliance equipment,
And smart home management maincenter 42 is sent to, and then believed by the state that smart home management maincenter 42 feeds back actual home appliance
Breath, or by smart home management maincenter 42 when the state trigger condition of time triggered condition or actual home appliance 41 is met
Report the status information of actual home appliance 41.
Specifically, the pseudo operation instruction according to user to virtual appliance equipment, the identification of virtual appliance equipment is marked
Or the identification mark of the related described actual home appliance 41 to virtual appliance equipment is added in status query request, enters
And status query request is assigned to by corresponding actual home appliance 41 according to identification mark by smart home management maincenter 42, with
The status information of actual home appliance 41 is obtained, or time triggered condition or reality are being met by smart home management maincenter 42
The status information of actual home appliance 41 is reported during the state trigger condition of home appliance, and then is sent into smart home management
Pivot 42.
Further, enquiry module 404, can be also used for inquiring about status information, the current institute of user of virtual appliance equipment
Locate the status information of environment.
Further, acquisition module 403 can be also used for inquiry request in enquiry module 404 from smart home pipe
Reason maincenter 42 obtains the status information of actual home appliance 41, the status information of virtual appliance equipment and user and is presently in environment
Status information.
Display module 405, for status information to be presented into user.
Specifically, by status information, the void of the above-mentioned actual home appliance 41 obtained from smart home management maincenter 42
The status information and user for intending home appliance are presently at least one of status information of environment and are shown to user.
Study module 406, learns for the operation history to user.
Control module 407, for the status information acquired in basis and default operation rules or the behaviour to user
Make the learning outcome generation practical operation instruction of history.
Specifically, according to status information, the status information and use of virtual appliance equipment of the actual home appliance 41 for obtaining
Family is presently in of at least one of status information of environment and default operation rules or the operation history to user
Result generation practical operation instruction is practised, and then practical operation instruction transmission to smart home is managed into maincenter 42, to control reality
Border home appliance 41 performs practical operation instruction.
Refering to Fig. 5, the virtual reality device 3rd embodiment provided by the present invention for smart home management includes:Treatment
Device 501, memory 502 and transceiver 503, processor 501 connect memory 502 and transceiver 503 respectively by bus.
Processor 501 controls the operation of mobile terminal, and processor 501 can also be referred to as CPU (Central Processing
Unit, CPU).Processor 501 is probably a kind of IC chip, the disposal ability with signal.Processor
501 can also be general processor, digital signal processor (DSP), application specific integrated circuit (ASIC), ready-made programmable gate array
Or other PLDs, discrete gate or transistor logic, discrete hardware components (FPGA).General processor
Can be microprocessor or the processor can also be any conventional processor, but be not limited only to this.
Processor 501, for the actual home appliance for being connected smart home management maincenter and virtual reality device institute
The virtual appliance equipment of presentation is associated, and then generates a three-dimensional interaction scenarios and presented in the three-dimensional interaction scenarios virtual
Home appliance, and the user that will be obtained is to the pseudo operation command mappings performed by virtual appliance equipment into virtual appliance equipment institute
The practical operation instruction of the actual home appliance of association, further, processor 501 is additionally operable to obtain the shape of actual home appliance
The ambient condition that state information, the status information of virtual appliance equipment and user are presently in.
Memory 502, works necessary instruction and data for storing processor 501, storage virtual appliance equipment with
The incidence relation of actual home appliance, the status information of the actual home appliance for obtaining, the status information of virtual appliance equipment and
The environmental state information that user is presently in.
Transceiver 503, for connecting and sending connection request, by according to obtain actual home appliance status information,
In the environmental state information that the status information of virtual appliance equipment and user are presently at least one and it is default operation rule
Then or the practical operation instruction of the learning outcome production of the operation history of user is sent to smart home and manage maincenter, and then
Realize the corresponding operating to actual home appliance.
Prior art is different from, the present invention manages actual home appliance and the void that maincenter is connected by associating smart home
Intend real world devices, and according to the pseudo operation instruction that user performs to virtual appliance equipment, realize the phase to actual home appliance
The method that should be operated so that people when using virtual reality device, hand over by solid that can be directly to being generated in virtual reality device
Virtual appliance equipment in mutual scene sends operational order, and then controls actual home appliance to perform corresponding operation, realizes
The linkage of virtual reality device and actual home appliance, and three-dimensional perception is provided the user, facilitate user to intelligent appliance equipment
Manipulation.
Embodiments of the invention are the foregoing is only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. it is a kind of for smart home management virtual reality method, it is characterised in that methods described includes:
The virtual appliance that the actual home appliance that smart home management maincenter is connected is presented with virtual reality device
Equipment is associated;
The three-dimensional interaction scenarios of generation one are simultaneously presented the virtual appliance equipment in the three-dimensional interaction scenarios;
User is obtained to the pseudo operation instruction performed by the virtual appliance equipment;
By the actual behaviour of the described actual home appliance associated by the pseudo operation command mappings into the virtual appliance equipment
Instruct, and send to smart home management maincenter, and then realize the corresponding operating to the actual home appliance.
2. method according to claim 1, it is characterised in that it is described by the pseudo operation command mappings into described virtual
The practical operation instruction of the described actual home appliance associated by home appliance, and send to smart home management maincenter
Step includes:
The virtual appliance equipment is recognized that the related described actual household electrical appliances marked or to the virtual appliance equipment set
Standby identification mark is added in the packet of the practical operation instruction, and then manages maincenter according to institute by the smart home
State identification mark and practical operation instruction is assigned to the corresponding actual home appliance.
3. method according to claim 1, it is characterised in that the three-dimensional interaction scenarios of the generation one simultaneously three-dimensional are handed over described
The step of virtual appliance equipment is presented in mutual scene includes:
The void being associated with the virtual appliance equipment is presented in the three-dimensional interaction scenarios or in the virtual appliance equipment
Intend stage property;
The step of pseudo operation that user is obtained to the virtual appliance equipment is instructed includes:
The user is obtained to the pseudo operation instruction performed by the virtual item.
4. method according to claim 1, it is characterised in that methods described is further included:
The status information of the actual home appliance is obtained from smart home management maincenter;
The status information is presented to user.
5. method according to claim 4, it is characterised in that described to obtain the reality from smart home management maincenter
The step of status information of border home appliance, includes:
The identification mark or the actual household electrical appliances that the actual home appliance will be extracted from the packet of the status information set
The identification mark of the standby associated virtual appliance equipment, and then be marked in the three-dimensional interaction scenarios according to the identification
Or the status information is associated presentation by the virtual appliance equipment with the virtual appliance equipment.
6. method according to claim 4, it is characterised in that methods described is further included:
The progress of work of the actual home appliance is judged according to the status information, and in the three-dimensional interaction field
The progress of work of the actual home appliance is presented on scape or the virtual appliance equipment with animation mode.
7. method according to claim 4, it is characterised in that described to obtain the reality from smart home management maincenter
Further included before the step of status information of border home appliance:
Pseudo operation instruction according to user to the virtual appliance equipment generates status query request, and is sent to described
Smart home manage maincenter, and then as the smart home management central feedback described in actual home appliance status information, or
Person is by smart home management maincenter when the state trigger condition of time triggered condition or the actual home appliance is met
Report the status information of the actual home appliance.
8. method according to claim 7, it is characterised in that it is described according to user to described in the virtual appliance equipment
Pseudo operation instruction generation status query request, and include the step of be sent to smart home management maincenter:
The virtual appliance equipment is recognized that the related described actual household electrical appliances marked or to the virtual appliance equipment set
Standby identification mark is added in status query request, and then will according to the identification mark by smart home management maincenter
The status query request is assigned to the corresponding actual home appliance.
9. method according to claim 1, it is characterised in that methods described is further included:
Obtain the status information of the virtual appliance equipment, user and be presently in the status information of environment and from the intelligent family
Occupy at least one of status information of described actual home appliance of management maincenter acquisition;
The learning outcome generation of the operation history according to acquired status information and default operation rules or to user
The practical operation instruction.
10. method according to claim 9, it is characterised in that the status information of the virtual appliance equipment includes user
Whether the virtual reality device, the operation content of the virtual reality device, operational mode or operation process are currently in use, are used
The status information that family is presently in environment includes time or temperature.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611033557.0A CN106713082A (en) | 2016-11-16 | 2016-11-16 | Virtual reality method for intelligent home management |
PCT/CN2017/102278 WO2018090713A1 (en) | 2016-11-16 | 2017-09-19 | Virtual reality method and device for intelligent home management |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611033557.0A CN106713082A (en) | 2016-11-16 | 2016-11-16 | Virtual reality method for intelligent home management |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106713082A true CN106713082A (en) | 2017-05-24 |
Family
ID=58940127
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611033557.0A Pending CN106713082A (en) | 2016-11-16 | 2016-11-16 | Virtual reality method for intelligent home management |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106713082A (en) |
WO (1) | WO2018090713A1 (en) |
Cited By (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107105065A (en) * | 2017-06-15 | 2017-08-29 | 闻泰通讯股份有限公司 | VR long-range control methods, apparatus and system |
CN107317822A (en) * | 2017-07-25 | 2017-11-03 | 南京物联传感技术有限公司 | A kind of smart home experiencing system interacted with actual situation and its application method |
CN107495719A (en) * | 2017-09-06 | 2017-12-22 | 王建龙 | The virtual scene collocation method of virtual scene collocation method, system and Electric sofa |
CN107797661A (en) * | 2017-09-14 | 2018-03-13 | 珠海格力电器股份有限公司 | A kind of plant control unit, method and mobile terminal |
CN108037743A (en) * | 2017-12-01 | 2018-05-15 | 王建龙 | Scene sharing method, scenario building method, UE equipment and intelligent housing system |
WO2018090713A1 (en) * | 2016-11-16 | 2018-05-24 | 捷开通讯(深圳)有限公司 | Virtual reality method and device for intelligent home management |
CN108428257A (en) * | 2018-03-12 | 2018-08-21 | 杭州巨骐信息科技股份有限公司 | Electric power sensing equipment Virtual design system and design method based on 3D models |
CN108449241A (en) * | 2018-02-09 | 2018-08-24 | 深圳绿米联创科技有限公司 | Configuration method and device, the terminal of Intelligent household scene |
CN108803529A (en) * | 2018-07-16 | 2018-11-13 | 珠海格力电器股份有限公司 | A kind of device and method switching room environment pattern based on mobile terminal |
CN108919663A (en) * | 2018-07-25 | 2018-11-30 | 珠海格力电器股份有限公司 | A kind of management method and electronic equipment of smart home device |
CN108958057A (en) * | 2018-08-01 | 2018-12-07 | 珠海格力电器股份有限公司 | The control method and device of household appliance, storage medium, electronic device |
CN109088803A (en) * | 2018-09-20 | 2018-12-25 | 塔普翊海(上海)智能科技有限公司 | A kind of AR remote control device, intelligent domestic remote control system and method |
CN109189209A (en) * | 2018-07-24 | 2019-01-11 | 中国联合网络通信集团有限公司 | The operating method and device of building services |
CN109324748A (en) * | 2018-09-05 | 2019-02-12 | 联想(北京)有限公司 | A kind of method, electronic equipment and the storage medium of equipment control |
WO2019047288A1 (en) * | 2017-09-06 | 2019-03-14 | 王建龙 | Scene control method, locking method, user equipment, and sofa control system |
CN109582260A (en) * | 2017-09-29 | 2019-04-05 | 佛山市顺德区美的电热电器制造有限公司 | A kind of display methods of Virtual Reality, equipment and system |
CN110058561A (en) * | 2019-05-22 | 2019-07-26 | 上海复旦上科多媒体股份有限公司 | A kind of smart home life system |
CN110321003A (en) * | 2019-05-30 | 2019-10-11 | 苏宁智能终端有限公司 | Smart home exchange method and device based on MR technology |
CN110727200A (en) * | 2018-07-17 | 2020-01-24 | 珠海格力电器股份有限公司 | Control method of intelligent household equipment and terminal equipment |
CN110764429A (en) * | 2019-11-25 | 2020-02-07 | 广东美的制冷设备有限公司 | Interaction method of household electrical appliance, terminal device and storage medium |
CN110794777A (en) * | 2019-10-25 | 2020-02-14 | 浙江工贸职业技术学院 | Intelligent household control equipment and control method |
CN111131735A (en) * | 2019-12-31 | 2020-05-08 | 歌尔股份有限公司 | Video recording method, video playing method, video recording device, video playing device and computer storage medium |
CN111158256A (en) * | 2019-12-31 | 2020-05-15 | 南京创维信息技术研究院有限公司 | Intelligent household scene simulation and equipment control method and system based on intelligent television |
CN111201764A (en) * | 2017-10-19 | 2020-05-26 | Sk电信有限公司 | Method and server device for providing platform service of internet of things |
CN111367412A (en) * | 2020-02-28 | 2020-07-03 | 歌尔科技有限公司 | Implementation method for controlling household equipment by virtual reality equipment and related equipment |
CN111552193A (en) * | 2017-09-06 | 2020-08-18 | 江苏慕林智能电器有限公司 | UE (user equipment) for controlling smart home scene and virtual scene construction and sharing method |
CN112074056A (en) * | 2020-09-16 | 2020-12-11 | 陈漱文 | Light interaction simulation system |
CN112152894A (en) * | 2020-08-31 | 2020-12-29 | 青岛海尔空调器有限总公司 | Household appliance control method based on virtual reality and virtual reality system |
CN110658728B (en) * | 2019-10-08 | 2021-05-25 | 珠海格力电器股份有限公司 | Method for setting household appliance parameters, mobile device and storage medium |
CN112882574A (en) * | 2021-02-22 | 2021-06-01 | 佛山科学技术学院 | Intelligent home gesture control method and system based on virtual reality |
CN114116090A (en) * | 2021-11-08 | 2022-03-01 | 深圳Tcl新技术有限公司 | Information display method and device, electronic equipment and computer readable storage medium |
CN114898683A (en) * | 2022-05-18 | 2022-08-12 | 咪咕数字传媒有限公司 | Immersive reading implementation method and system, terminal equipment and storage medium |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109605403B (en) * | 2019-01-25 | 2020-12-11 | 北京妙趣伙伴科技有限公司 | Robot, robot operating system, robot control device, robot control method, and storage medium |
CN110398900B (en) * | 2019-07-22 | 2022-07-19 | 密码精灵有限公司 | Remote control method, device, medium and server for intelligent lighting equipment |
US11308697B2 (en) | 2019-09-12 | 2022-04-19 | International Business Machines Corporation | Virtual reality based selective automation adoption |
CN112953776B (en) * | 2021-03-01 | 2023-06-30 | 北京小米松果电子有限公司 | Data verification method, device and storage medium |
CN114040551A (en) * | 2021-11-08 | 2022-02-11 | 深圳市新能力科技有限公司 | Stepless dimming control system for intelligent illumination |
CN115361249B (en) * | 2022-10-19 | 2023-01-24 | 潍坊歌尔电子有限公司 | Intelligent household control method, equipment, system and medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101655689A (en) * | 2008-08-19 | 2010-02-24 | 马海英 | Virtual machine device of intelligent remote controller with remote controllable operation interface |
JP2011039731A (en) * | 2009-08-10 | 2011-02-24 | Takenaka Komuten Co Ltd | Virtual space use type apparatus control system, real space control system and virtual space use type apparatus control program |
KR20120128369A (en) * | 2011-05-17 | 2012-11-27 | 목원대학교 산학협력단 | Matching system, matching method, wearable input device and command signal providing method for incorporating real world into virtual reality for handicapped and elderly |
US20160179070A1 (en) * | 2014-12-19 | 2016-06-23 | Samsung Electronics Co., Ltd. | Electronic device for controlling another electronic device and control method thereof |
CN105827494A (en) * | 2016-05-20 | 2016-08-03 | 珠海格力电器股份有限公司 | Method, device and system for adding equipment |
CN105955042A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Virtuality reality type visible and controllable intelligent household control system and method |
CN106094540A (en) * | 2016-06-14 | 2016-11-09 | 珠海格力电器股份有限公司 | Electrical equipment control method, Apparatus and system |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105302535A (en) * | 2014-07-31 | 2016-02-03 | 青岛海尔智能家电科技有限公司 | Method and apparatus for generating man-machine interaction interface |
CN106445156A (en) * | 2016-09-29 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and terminal for intelligent home device control based on virtual reality |
CN106713082A (en) * | 2016-11-16 | 2017-05-24 | 惠州Tcl移动通信有限公司 | Virtual reality method for intelligent home management |
-
2016
- 2016-11-16 CN CN201611033557.0A patent/CN106713082A/en active Pending
-
2017
- 2017-09-19 WO PCT/CN2017/102278 patent/WO2018090713A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101655689A (en) * | 2008-08-19 | 2010-02-24 | 马海英 | Virtual machine device of intelligent remote controller with remote controllable operation interface |
JP2011039731A (en) * | 2009-08-10 | 2011-02-24 | Takenaka Komuten Co Ltd | Virtual space use type apparatus control system, real space control system and virtual space use type apparatus control program |
KR20120128369A (en) * | 2011-05-17 | 2012-11-27 | 목원대학교 산학협력단 | Matching system, matching method, wearable input device and command signal providing method for incorporating real world into virtual reality for handicapped and elderly |
US20160179070A1 (en) * | 2014-12-19 | 2016-06-23 | Samsung Electronics Co., Ltd. | Electronic device for controlling another electronic device and control method thereof |
CN105827494A (en) * | 2016-05-20 | 2016-08-03 | 珠海格力电器股份有限公司 | Method, device and system for adding equipment |
CN105955042A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Virtuality reality type visible and controllable intelligent household control system and method |
CN106094540A (en) * | 2016-06-14 | 2016-11-09 | 珠海格力电器股份有限公司 | Electrical equipment control method, Apparatus and system |
Cited By (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018090713A1 (en) * | 2016-11-16 | 2018-05-24 | 捷开通讯(深圳)有限公司 | Virtual reality method and device for intelligent home management |
CN107105065A (en) * | 2017-06-15 | 2017-08-29 | 闻泰通讯股份有限公司 | VR long-range control methods, apparatus and system |
CN107317822B (en) * | 2017-07-25 | 2020-03-31 | 南京物联传感技术有限公司 | Intelligent home experience system with virtual-real interaction and use method thereof |
CN107317822A (en) * | 2017-07-25 | 2017-11-03 | 南京物联传感技术有限公司 | A kind of smart home experiencing system interacted with actual situation and its application method |
CN107495719A (en) * | 2017-09-06 | 2017-12-22 | 王建龙 | The virtual scene collocation method of virtual scene collocation method, system and Electric sofa |
WO2019047288A1 (en) * | 2017-09-06 | 2019-03-14 | 王建龙 | Scene control method, locking method, user equipment, and sofa control system |
CN111552193A (en) * | 2017-09-06 | 2020-08-18 | 江苏慕林智能电器有限公司 | UE (user equipment) for controlling smart home scene and virtual scene construction and sharing method |
CN107797661A (en) * | 2017-09-14 | 2018-03-13 | 珠海格力电器股份有限公司 | A kind of plant control unit, method and mobile terminal |
CN109582260A (en) * | 2017-09-29 | 2019-04-05 | 佛山市顺德区美的电热电器制造有限公司 | A kind of display methods of Virtual Reality, equipment and system |
CN111201764A (en) * | 2017-10-19 | 2020-05-26 | Sk电信有限公司 | Method and server device for providing platform service of internet of things |
CN111201764B (en) * | 2017-10-19 | 2022-12-16 | Sk电信有限公司 | Method and server device for providing platform service of Internet of things |
CN108037743A (en) * | 2017-12-01 | 2018-05-15 | 王建龙 | Scene sharing method, scenario building method, UE equipment and intelligent housing system |
CN108449241A (en) * | 2018-02-09 | 2018-08-24 | 深圳绿米联创科技有限公司 | Configuration method and device, the terminal of Intelligent household scene |
CN108449241B (en) * | 2018-02-09 | 2021-10-08 | 深圳绿米联创科技有限公司 | Configuration method and device of smart home scene and terminal |
CN108428257A (en) * | 2018-03-12 | 2018-08-21 | 杭州巨骐信息科技股份有限公司 | Electric power sensing equipment Virtual design system and design method based on 3D models |
CN108803529A (en) * | 2018-07-16 | 2018-11-13 | 珠海格力电器股份有限公司 | A kind of device and method switching room environment pattern based on mobile terminal |
US11550282B2 (en) | 2018-07-17 | 2023-01-10 | Gree Electric Appliances, Inc. Of Zhuhai | Control method for smart home device and terminal device |
CN110727200A (en) * | 2018-07-17 | 2020-01-24 | 珠海格力电器股份有限公司 | Control method of intelligent household equipment and terminal equipment |
CN109189209A (en) * | 2018-07-24 | 2019-01-11 | 中国联合网络通信集团有限公司 | The operating method and device of building services |
CN108919663A (en) * | 2018-07-25 | 2018-11-30 | 珠海格力电器股份有限公司 | A kind of management method and electronic equipment of smart home device |
CN108958057A (en) * | 2018-08-01 | 2018-12-07 | 珠海格力电器股份有限公司 | The control method and device of household appliance, storage medium, electronic device |
CN109324748B (en) * | 2018-09-05 | 2021-12-24 | 联想(北京)有限公司 | Equipment control method, electronic equipment and storage medium |
CN109324748A (en) * | 2018-09-05 | 2019-02-12 | 联想(北京)有限公司 | A kind of method, electronic equipment and the storage medium of equipment control |
CN109088803B (en) * | 2018-09-20 | 2023-11-07 | 塔普翊海(上海)智能科技有限公司 | AR remote control device, intelligent home remote control system and method |
CN109088803A (en) * | 2018-09-20 | 2018-12-25 | 塔普翊海(上海)智能科技有限公司 | A kind of AR remote control device, intelligent domestic remote control system and method |
CN110058561A (en) * | 2019-05-22 | 2019-07-26 | 上海复旦上科多媒体股份有限公司 | A kind of smart home life system |
CN110321003A (en) * | 2019-05-30 | 2019-10-11 | 苏宁智能终端有限公司 | Smart home exchange method and device based on MR technology |
CN110658728B (en) * | 2019-10-08 | 2021-05-25 | 珠海格力电器股份有限公司 | Method for setting household appliance parameters, mobile device and storage medium |
CN110794777A (en) * | 2019-10-25 | 2020-02-14 | 浙江工贸职业技术学院 | Intelligent household control equipment and control method |
CN110764429B (en) * | 2019-11-25 | 2023-10-27 | 广东美的制冷设备有限公司 | Interaction method of household electrical appliance, terminal equipment and storage medium |
CN110764429A (en) * | 2019-11-25 | 2020-02-07 | 广东美的制冷设备有限公司 | Interaction method of household electrical appliance, terminal device and storage medium |
CN111158256A (en) * | 2019-12-31 | 2020-05-15 | 南京创维信息技术研究院有限公司 | Intelligent household scene simulation and equipment control method and system based on intelligent television |
CN111131735A (en) * | 2019-12-31 | 2020-05-08 | 歌尔股份有限公司 | Video recording method, video playing method, video recording device, video playing device and computer storage medium |
CN111367412A (en) * | 2020-02-28 | 2020-07-03 | 歌尔科技有限公司 | Implementation method for controlling household equipment by virtual reality equipment and related equipment |
CN112152894A (en) * | 2020-08-31 | 2020-12-29 | 青岛海尔空调器有限总公司 | Household appliance control method based on virtual reality and virtual reality system |
CN112074056A (en) * | 2020-09-16 | 2020-12-11 | 陈漱文 | Light interaction simulation system |
CN112882574A (en) * | 2021-02-22 | 2021-06-01 | 佛山科学技术学院 | Intelligent home gesture control method and system based on virtual reality |
CN114116090A (en) * | 2021-11-08 | 2022-03-01 | 深圳Tcl新技术有限公司 | Information display method and device, electronic equipment and computer readable storage medium |
CN114898683A (en) * | 2022-05-18 | 2022-08-12 | 咪咕数字传媒有限公司 | Immersive reading implementation method and system, terminal equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2018090713A1 (en) | 2018-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106713082A (en) | Virtual reality method for intelligent home management | |
CN104977904B (en) | A kind of visible i.e. controllable intelligent home control system and control method | |
CN105373020B (en) | Intelligent easy sticker electric switch | |
WO2016065812A1 (en) | Scenario mode setting-based smart device control method and apparatus | |
WO2016065825A1 (en) | Method and apparatus for recommending scenario mode for smart device | |
CN105573135B (en) | A kind of control method and device of intelligent appliance | |
CN105785766A (en) | Intelligent household control system | |
US10295972B2 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
CN108600059A (en) | Apparatus control method and Related product | |
CN104391487A (en) | Intelligent controller and control method thereof | |
CN109884913A (en) | Control method, Intelligent control equipment and the system of split type household appliance | |
CN105739318A (en) | Intelligent socket, intelligent household control system and control method thereof | |
CN104793583A (en) | Interaction system based on intelligent robot and software system thereof | |
CN105915418A (en) | Method and device for controlling household appliance | |
CN108803529A (en) | A kind of device and method switching room environment pattern based on mobile terminal | |
CN205721127U (en) | Smart jack and intelligent home control system | |
CN109976176A (en) | Control method, Intelligent control equipment and the system of split type household appliance | |
CN105137774A (en) | Intelligent household appliance control method, device and mobile terminal | |
CN104349198B (en) | The control method of remote control and remote control | |
CN107203144A (en) | The control method and system of smart home, Centralized Controller | |
CN105785774A (en) | Smart household control system | |
JP2018523430A (en) | Intelligent terminal remote control device functionalized control system and control method | |
CN104935631A (en) | Wi-Fi network mapping remote control technology | |
CN108572555A (en) | Kitchen ventilator and family's intarconnected cotrol method based on kitchen ventilator | |
KR20150005800A (en) | Remote controlled home appliances and mobile communication terminal and system for managing of home appliances therefor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170524 |