CN107358007A - Control the method, apparatus of intelligent domestic system and calculate readable storage medium storing program for executing - Google Patents
Control the method, apparatus of intelligent domestic system and calculate readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN107358007A CN107358007A CN201710692424.2A CN201710692424A CN107358007A CN 107358007 A CN107358007 A CN 107358007A CN 201710692424 A CN201710692424 A CN 201710692424A CN 107358007 A CN107358007 A CN 107358007A
- Authority
- CN
- China
- Prior art keywords
- intelligent domestic
- domestic system
- action
- server
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 95
- 230000009471 action Effects 0.000 claims abstract description 215
- 238000009877 rendering Methods 0.000 claims abstract description 18
- 230000008569 process Effects 0.000 claims description 28
- 230000001960 triggered effect Effects 0.000 claims description 17
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000000977 initiatory effect Effects 0.000 claims description 6
- 230000006399 behavior Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 16
- 238000004891 communication Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 230000000007 visual effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 208000003443 Unconsciousness Diseases 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 238000004378 air conditioning Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000012092 media component Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000032696 parturition Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/13—Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Structural Engineering (AREA)
- Human Computer Interaction (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Manufacturing & Machinery (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Evolutionary Computation (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
Present invention is disclosed a kind of method, apparatus and computer-readable recording medium for controlling intelligent domestic system.Methods described includes：Model data is asked to server；Carry out rendering the virtual scene for obtaining intelligent domestic system and associating by model data；The display of virtual scene is performed by the virtual reality device of access；Control performs action video data acquisition of the user in virtual scene trigger action, and action message is obtained to trigger server；According to the action feedback procedure performed in virtual scene, intelligent domestic system is controlled by the action feedback procedure.The action feedback procedure that user performs into the projection of virtual scene and virtual scene, allow users to by means of virtual reality device know the manipulation of intelligent domestic system be initiated after intelligent domestic system by control situation, and then ensure that intelligent domestic system control security and accuracy.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of method, apparatus and meter for controlling intelligent domestic system
Calculation machine readable storage medium storing program for executing.
Background technology
With the rapid development of the Internet, applications, traditional home equipment is gradually evolved to intelligent home device, enters
And form intelligent domestic system.Intelligent domestic system possesses network access facility, and user can be by self-contained terminal device
With intelligent domestic system network connection, and then thus terminal device control intelligent domestic system.
Specifically, terminal device redirects the manipulation page into intelligent domestic system under the manipulation of user, manipulates page
Face is configured with several buttons for controlling intelligent domestic system, and each button, which can be used in touching, performs intelligent domestic system
Corresponding control process.User clicks on the i.e. controllable intelligent domestic system of specific button in the manipulation page of terminal device and enters phase
The state answered, intelligent domestic system are able to operate under the control of terminal device.
But the clicking operation that user is triggered in the manipulation page to button, it is limited to terminal device and terminal device
Existing many unreliable factors between intelligent domestic system, it is not yet in effect to have hair when clicking the situations such as button, false touch button
It is raw.Now, if user actively checks that the operational situation side of intelligent domestic system can know that the manipulation of intelligent domestic system is held
Row result, it is user's necessarily unaware if not checking the operational situation of intelligent domestic system actively.
Therefore, active of the realization of existing intelligent domestic system control due to being necessarily dependent upon user check, there is
Lack the technological deficiency of control security and accuracy.
The content of the invention
In order to solve the realization that intelligent domestic system controls in correlation technique, there is lack control security and accuracy
Technical problem, the invention provides it is a kind of control intelligent domestic system method, apparatus and computer-readable recording medium.
A kind of method for controlling intelligent domestic system, methods described include：
The model data of intelligent domestic system is manipulated to server request user；
Carry out rendering the virtual scene for obtaining the intelligent domestic system and associating by the model data, show the void
Intend scene；
The display of the virtual scene is performed by the virtual reality device of access；
Control performs action video data acquisition of the user in the virtual scene trigger action, and passes through collection
The action video data-triggered server obtains action message；
The action performed according to associating between the action message and the intelligent domestic system in the virtual scene
Feedback procedure, the intelligent domestic system are controlled by the action feedback procedure.
A kind of device for controlling intelligent domestic system, described device include：
Data demand module, for manipulating the model data of intelligent domestic system to server request user；
Scene rendering display module, the intelligent domestic system association is obtained for by the model data render
Virtual scene；
Projection module, for performing the display of the virtual scene by the virtual reality device of access；
Sensing module is acted, for controlling the action video data for performing the user in the virtual scene trigger action
Collection, and action message is obtained by the action video data-triggered server of collection；
Feedback module is acted, described in being performed according to associating between the action message and the intelligent domestic system
Action feedback procedure in virtual scene, the intelligent domestic system are controlled by the action feedback procedure.
A kind of device for controlling intelligent domestic system, including：
Processor；And
Memory, computer-readable instruction is stored with the memory, the computer-readable instruction is by the processing
The method that control intelligent domestic system as described above is realized when device performs.
A kind of computer-readable recording medium, is stored thereon with computer program, and the computer program is held by processor
The method that control intelligent domestic system as described above is realized during row.
The technical scheme that embodiments of the invention provide comprises at least following beneficial effect：
To carry out the control of intelligent domestic system, the model data of manipulation intelligent domestic system is asked to server first,
Carry out rendering the virtual scene for obtaining intelligent domestic system and associating by model data, then pass through the virtual reality device of access
The display of virtual scene is performed, in order to which so far virtual scene, control execution user are dynamic in virtual scene triggering by user's projection
The action video data acquisition of work, action message is obtained by the action video data-triggered server of collection, it is last according to dynamic
Make to associate the action feedback procedure performed in virtual scene between intelligent domestic system, intelligent domestic system is controlled by this
Feedback procedure is acted, the control of intelligent domestic system is realized with this, in the projection of user to virtual scene and virtual scene
The action feedback procedure for associating and performing between action and intelligent domestic system based on user's triggering so that user can borrow
Help virtual reality device know the manipulation of intelligent domestic system be initiated after intelligent domestic system by control situation, no longer
Need to rely on artificial actively progress checks process, and then ensure that the security and accuracy of intelligent domestic system control,
Avoid that the unstability controlled by control situation and intelligent domestic system that can not perceive intelligent domestic system in time occurs.
It should be appreciated that the general description and following detailed description of the above are only exemplary, this can not be limited
Invention.
Brief description of the drawings
Accompanying drawing herein is merged in specification and forms the part of this specification, shows the implementation for meeting the present invention
Example, and in specification together for explaining principle of the invention.
Fig. 1 is the implementation environment schematic diagram involved in the present invention according to an exemplary embodiment；
Fig. 2 is the application schematic diagram of a set of intelligent domestic system according to an exemplary embodiment
Fig. 3 is a kind of block diagram of device according to an exemplary embodiment；
Fig. 4 is a kind of flow chart of the method for control intelligent domestic system according to an exemplary embodiment；
Fig. 5 is the flow chart that the details of step 310 is described for correspondingly being implemented to exemplify according to Fig. 4；
Fig. 6 is the flow chart that the details of step 370 is described for correspondingly being implemented to exemplify according to Fig. 4；
Fig. 7 is the flow chart that the details of step 390 is described for correspondingly being implemented to exemplify according to Fig. 4；
Fig. 8 is a kind of flow chart of the method for control intelligent domestic system according to another exemplary embodiment；
Fig. 9 is the flow chart of generation model data in real time in server according to an exemplary embodiment；
Figure 10 is a kind of block diagram of the device of control intelligent domestic system according to an exemplary embodiment；
Figure 11 is the block diagram that the details of data demand module is described for correspondingly being implemented to exemplify according to Figure 10；
Figure 12 is according to the corresponding block diagrams that the details for acting sensing module is described for implementing to exemplify of Figure 10；
Figure 13 is according to the corresponding block diagrams that the details for acting feedback module is described for implementing to exemplify of Figure 10；
Figure 14 is a kind of block diagram of the device of control intelligent domestic system according to another exemplary embodiment
Embodiment
Here explanation will be performed to exemplary embodiment in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent and the consistent all embodiments of the present invention.On the contrary, they be only with it is such as appended
The example of the consistent apparatus and method of some aspects being described in detail in claims, of the invention.
Fig. 1 is the implementation environment schematic diagram involved in the present invention according to an exemplary embodiment.In an example
In property embodiment, implementation environment involved in the present invention, as shown in figure 1, including at least intelligent domestic system control terminal 110 with
And control terminal 110 is coordinated to realize the server 130 that intelligent domestic system controls.
The control terminal 110 of intelligent domestic system, including terminal device 111, virtual reality device 113 and IMAQ are set
Standby 115.
The control terminal 110 of intelligent domestic system, provides the user the control entrance of intelligent domestic system, and user will be controlled herein
End 110 processed carries out the related various operations of intelligent domestic system control, and obtains respective feedback therewith.
Server 130 is used to provide computing capability for control terminal 110, and then coordinates control terminal 110 to carry out smart home system
The control of system.
Specifically, implementation environment as illustrated in FIG. 1, in this implementation environment in the control terminal 110 of intelligent domestic system,
Terminal device 111 can be the portable mobile terminals such as smart mobile phone, tablet personal computer.Control of the terminal device 111 as control terminal 110
Center processed, and carry out data interaction with server 130.Virtual reality device 113, then it is used for the control for carrying out intelligent domestic system
Three-dimensional visual effect and three-dimensional feedback effects are realized in the control of the realization of neutral body effect, as intelligent domestic system.
It is appreciated that virtual reality device 113, includes virtual reality display device 113, virtual reality device 113 is used
In establishing network connection with terminal device 111, by itself interacting between terminal device 111, realization accesses intelligent family
Occupy the stereoeffect of system control and the feedback based on stereoeffect.
Therefore, in addition, virtual reality device 113 can also include various for realizing according to the needs in configuration
The controller of various manipulations, thus, the triggering of user's control action will be allowd to be not limited to terminal device 111.
Image capture device 115 carries out IMAQ, and on the one hand the configuration for virtual scene in intelligent domestic system is advance
Image data acquiring is realized, on the other hand, also will provide hardware foundation and guarantee for comprehensive accurate perceive of user's control action.
Fig. 2 is the application schematic diagram of a set of intelligent domestic system according to an exemplary embodiment.As shown in Figure 2
, can intuitively it know, intelligent domestic system includes lamplight curtain, central air-conditioning, video intercom, safety monitoring, center
Heat, realize the sound box system of background music and intelligent video, the equipment for realizing central inletting fresh air and other intelligent appliances.
But according to the demand of user side, equipment that intelligent domestic system is covered is not fixed, but flexible configuration obtains
's.
Fig. 3 is a kind of block diagram of device according to an exemplary embodiment.For example, device 200 is implemented shown in Fig. 1
Terminal device 111 in environment.
Reference picture 2, device 200 include at least one component：Processing component 202, memory 204, power supply module 206 are more
Media component 208, audio-frequency assembly 210, sensor cluster 214 and communication component 216.
The integrated operation of the usual control device 200 of processing component 202, such as communicated with display, call, data, phase
Operation that machine operates and record operation is associated etc..Processing component 202 carrys out execute instruction including at least one processor 218,
To complete all or part of step of following methods.In addition, processing component 202 includes at least one module, it is easy to treatment group
Interaction between part 202 and other assemblies.For example, processing component 202 comprises at least multi-media module, to facilitate multimedia groupware
Interaction between 208 and processing component 202.
Memory 204 is configured as storing various types of data to support the operation in device 200.These data are shown
Example includes the instruction of any application program or method for operating on the device 200.Memory 204 can be by any kind of
Volatibility or non-volatile memory device or combinations thereof are realized, such as static RAM (Static Random
Access Memory, abbreviation SRAM), Electrically Erasable Read Only Memory (Electrically Erasable
Programmable Read-Only Memory, abbreviation EEPROM), Erasable Programmable Read Only Memory EPROM (Erasable
Programmable Read Only Memory, abbreviation EPROM), programmable read only memory (Programmable Red-
Only Memory, abbreviation PROM), read-only storage (Read-Only Memory, abbreviation ROM), magnetic memory, flash
Device, disk or CD.One or more modules are also stored with memory 204, one or more modules are configured to by this
One or more processors 218 perform, to complete the whole in any shown method of following Fig. 3, Fig. 4, Fig. 5 and Fig. 6 or portion
Step by step.
Power supply module 206 provides electric power for the various assemblies of device 200.Power supply module 206 includes power-supply management system, extremely
A few power supply, and other components associated with generating, managing and distributing electric power for device 200.
Multimedia groupware 208 is included in the screen of one output interface of offer between described device 200 and user.One
In a little embodiments, screen can include liquid crystal display (Liquid Crystal Display, abbreviation LCD) and touch panel.
If screen includes touch panel, screen may be implemented as touch-screen, to receive the input signal from user.Touch panel
Including at least one touch sensor with the gesture on sensing touch, slip and touch panel.The touch sensor can not
The only border of sensing touch or sliding action, but also detect the duration related to the touch or slide and pressure
Power.Screen also includes display of organic electroluminescence (Organic Light Emitting Display, abbreviation OLED).
Audio-frequency assembly 210 is configured as output and/or input audio signal.For example, audio-frequency assembly 210 includes a Mike
Wind (Microphone, abbreviation MIC), when device 200 is in operator scheme, such as call model, logging mode and speech recognition mould
During formula etc., microphone is configured as receiving external audio signal.The audio signal received can be further stored in storage
Device 204 is sent via communication component 216.In certain embodiments, audio-frequency assembly 210 also includes a loudspeaker, for defeated
Go out audio signal.
Sensor cluster 214 includes at least one sensor, for providing the state estimation of various aspects for device 200.
For example, sensor cluster 214 can detect opening/closed mode of device 200, the relative positioning of component, sensor cluster
214 can be with the position change of 200 1 components of detection means 200 or device and the temperature change of device 200.In some realities
Apply in example, the sensor cluster 214 also includes Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 216 is configured to facilitate the communication of wired or wireless way between device 200 and other equipment.Device
200 can access the wireless network based on communication standard, such as WiFi (WIreless-Fidelity, Wireless Fidelity).Show at one
In example property embodiment, communication component 216 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 216 also includes near-field communication (Near Field
Communication, abbreviation NFC) module, to promote junction service.For example, radio frequency identification (Radio can be based in NFC module
Frequency Identification, abbreviation RFID) technology, Infrared Data Association (Infrared Data
Association, abbreviation IrDA) technology, ultra wide band (Ultra Wideband, abbreviation UWB) technology, Bluetooth technology and other skills
Art is realized.
In the exemplary embodiment, device 200 is by least one application specific integrated circuit (Application
Specific Integrated Circuit, abbreviation ASIC), it is digital signal processor, digital signal processing appts, programmable
Logical device, field programmable gate array, controller, microcontroller, microprocessor or other electronic components are realized, for performing
Following methods.
Fig. 4 is a kind of flow chart of the method for control intelligent domestic system according to an exemplary embodiment.The control
The method of intelligent domestic system processed is applied to the terminal device of implementation environment shown in Fig. 1, and the terminal device is in an exemplary reality
It can be device shown in Fig. 3 to apply in example.As shown in figure 4, the method for the control intelligent domestic system, is performed by terminal device,
Comprise the following steps.
In the step 310, the model data of intelligent domestic system is manipulated to server request user.
Wherein, intelligent domestic system is deployed in the houses such as house.For example, it is deployed in multiple intelligent families of home dwelling
Occupy equipment and just constitute intelligent domestic system, and many intelligent home devices for being deployed in public place can also form intelligent family
Occupy system.It should be noted that this intelligent domestic system can be deployed in any house, but must be the currently requested control of user
Intelligent domestic system.
Every suit intelligent domestic system has its model data, and this model data is stored in server, when needed,
Terminal device can be to this model data of server acquisition request.Model data is used to provide virtually for the manipulation of intelligent domestic system
Scene, this virtual scene is shown in the form of image frame.In exemplary embodiment in the specific implementation, model
Data are three-dimensional modeling datas, and virtual three dimensional field is configured come the manipulation for being user to intelligent domestic system by three-dimensional modeling data
Scape.
When needing to be controlled intelligent domestic system, user can be asked by self-contained terminal device to server
Seek model data corresponding to this intelligent domestic system, terminal device with server by interacting to obtain asked pattern number
According to.
In a step 330, carry out rendering the virtual scene for obtaining intelligent domestic system and associating by model data.
Wherein, virtual scene is the image frame for realizing intelligent domestic system control.Model data is substantially that image is drawn
The description data in face, therefore, terminal device to server after model data is obtained, you can carries out wash with watercolours via model data
Dye, to obtain the virtual scene of the image frame being consistent with this model data, i.e. intelligent domestic system association, and then institute will be rendered
The virtual scene of acquisition transfers to virtual reality device to be shown..
Terminal device will transfer to virtual reality device after rendering to obtain the virtual scene associated with intelligent domestic system
The display of this virtual scene is carried out, now, the picture of achievable intelligent domestic system control has just been provided the user, for intelligence
For the control of house system, intuitively and interactive performance is enabled to be strengthened.
It should remark additionally herein, associating between intelligent domestic system and virtual scene, on the one hand refer to be based on
On the other hand the association of user, intelligent domestic system also refer to by the virtual scene corresponding to user and render the virtual of display
Scene is the control for realizing the currently used intelligent domestic system of user.
In step 350, the display of virtual scene is performed by the virtual reality device of access.
Wherein, virtual reality device is used to match with terminal device realizes that virtual reality is shown combined into user.It is for example, empty
It is VR glasses to intend real world devices.As previously described, terminal device carries out the display of virtual scene, now, in virtual reality
Under the intervention of equipment, projection of the user to virtual scene is performed, so that user is immersed in virtual scene.
Virtual reality device encapsulates user to the vision in the external world and the sense of hearing, and guiding user produces one kind in virtual scene
Sensation, virtual scene is the three-dimensional image frame presented for a user.
It should be appreciated that the projection of user to virtual scene, which is the user for having dressed virtual reality device, checks the virtual of display
Scene and realize, so as to obtain submergence sense and Multi-Sensory, for example, Auditory Perception, tactilely-perceptible etc..
In step 370, control performs action video data acquisition of the user in virtual scene trigger action, and by adopting
The action video data-triggered server of collection obtains action message.
Wherein, image capture device has been installed in the house for disposing intelligent domestic system, and user is also in this house
In.Terminal device carries out the image capture device for controlling access the collection of action video data, that is to say, that user is occurred
Action change will all be captured by image capture device.
The action video data of collection are uploaded to server, and this action video data is carried out in the presence of server
Generation action message is calculated in real time, and is returned to terminal device, thus may be such that terminal device can perceive the action of user,
And then fed back according to this action to carry out the action in virtual scene, and the control of intelligent domestic system.
Moved by the real-time calculating of server and the action message generated for what instruction user triggered in virtual scene
Make.Further, action message also includes animation information of the description user in virtual scene institute trigger action, and the animation information is used
In the action that tracking presentation user triggers in virtual scene.That is, animation information, which is substantially user action, carries out process
With merging for virtual scene.
Due to the generation of action message, on the one hand need to calculate gathered action video data in real time, the opposing party
Face needs to generate corresponding animation, and is blended with virtual scene, the complexity of time performance and calculating it is all higher, it is necessary to
Very strong real-time computing, therefore will be realized by means of server.
In step 390, according to the action associating in execution virtual scene between action message and intelligent domestic system
Feedback procedure, intelligent domestic system are controlled by action feedback procedure.
Wherein, as previously described, action message indicates the action that user triggers in virtual scene.It is appreciated that thrown
The user of virtual scene is incident upon, that is, the user for being immersed in virtual scene is unlikely to be actionless, and it is conscious to carry out some
Action and unconscious action.For example, conscious action includes the control action to intelligent domestic system, and virtual
Various interactive actions in scene etc..
Associating between action message and intelligent domestic system refers to the action and smart home system indicated by action message
Correlation between system.This correlation is used to reflect whether the action indicated by action message is related to intelligent domestic system.Such as
Action indicated by fruit action message is control action, then is related to intelligent domestic system；If indicated by action message
Action be other actions, then it is uncorrelated to intelligent domestic system.
On the one hand action feedback procedure in virtual scene is by action message and the user action tracking realized was presented
Journey, on the other hand it is then the intelligent family for acting the relevance between intelligent domestic system according to indicated by action message and performing
Occupy system manipulation feedback.
Performed intelligent domestic system manipulation feedback comprises at least the related user of action and performs behaviour in virtual scene
Make correct or wrong picture to show.When action is control action, carries out user and perform operation correctly in virtual scene
Picture shows, conversely, be then other actions in action, for example, with the not related action of intelligent domestic system, it will used
The picture that family performs operating mistake in virtual scene is shown.
Therefore, the action feedback procedure in performed virtual scene is the display process of image frame.As user exists
The triggering acted in virtual scene, the action feedback procedure in virtual scene is accordingly performed under the auxiliary of server.
Intelligent domestic system is controllable by acting feedback procedure, with the execution of action feedback procedure, is carrying out user
When virtual scene performs and operates correct picture display, the action indicated according to action message generates manipulation signal, and transmitting should
Manipulation signal is sent to intelligent domestic system and may be such that intelligent domestic system carries out corresponding operating condition.
So far the control of intelligent domestic system is just realized based on virtual scene, on the one hand, due to real in this virtual scene
Existing action perceives, i.e. the collection of action video data is to be directed to everything of the user in virtual scene to carry out, because
This, no longer many restrictions due to terminal device, for example, screen size, and there is situation about not perceiving, and then ensure that intelligence
The accuracy controlled in energy house system.
On the other hand, it is determined that for user after the action that virtual scene triggers, the action carried out in virtual scene is anti-
Feedback, and intelligent domestic system is controllable by this action feedback procedure, so that user was fed back by this action
Journey and know intelligent domestic system by control situation, be able to ensure the security of intelligent domestic system control.
Fig. 5 is the flow chart that the details of step 310 is described for correspondingly being implemented to exemplify according to Fig. 4.The step
310, as shown in figure 5, comprising at least following steps.
In step 311, intelligent domestic system manipulation request is initiated to server according to the identification information that user logs in.
Wherein, as previously described, the control of intelligent domestic system be by terminal device by access of virtual real world devices and
Image capture device and realize.Corresponding application program is run in terminal device, to perform step of the present invention.With
Family performs login process by its identification information in application program, completes that the control of intelligent domestic system can be carried out after logging in
System.
Identification information is used to uniquely indicate the intelligent domestic system that user is manipulated.The application program that terminal device is run
After login process is completed, you can initiate intelligent domestic system manipulation request by the identification information logged in.Smart home system
System manipulation request carries the identification information of user's login, needs to control intelligent domestic system to enter a certain operating condition in user
When, initiate intelligent domestic system manipulation request from the application program that terminal device is run to server.
By described above it is recognised that the manipulation of intelligent domestic system is carried out in virtual scene, therefore for not
For user in intelligent domestic system manipulation state, the initiation that request is manipulated by intelligent domestic system is used in fact to obtain
The model data of existing virtual scene.
In step 313, the model data that the reception server manipulates request in response to intelligent domestic system and returned, pattern number
According to being to build to obtain beforehand through real scene where intelligent domestic system and corresponding in intelligent domestic system manipulation request
Identification information.
Wherein, server is extracted in intelligent domestic system after the intelligent domestic system for receiving user manipulates request
The identification information of carrying, the lookup of model data is carried out according to identification information, to obtain the model that can be returned to terminal device
Data.
Server carries out the storage of model data using identification information as index.That is, in advance to deploying intelligent family
The house for occupying system carries out image data acquiring, and then this view data is uploaded onto the server, in order to which server can be pre-
It is first intelligent domestic system generation model data, and stores.
Real scene where signified intelligent domestic system, as dispose the house of intelligent domestic system.Based on true field
Scape and the model data structure realized, realize the virtual scene being consistent with real scene for user, and anti-in subsequent action
In the execution of feedback process so that the image frame related to user action shows the virtual field being also consistent at this with real scene
Scape is carried out, and the feeling of immersion and authenticity of intelligent domestic system control is greatly enhanced, so as to improve intelligent domestic system
The ease for use of control, reduce the threshold for freely manipulating intelligent domestic system.
In one exemplary embodiment, step 330, including at least following steps.
Image frame is carried out to model data to render, the scene for building model data is applied to image frame acquisition intelligence
The virtual scene of house system association.
Wherein, as previously described, model data corresponds to intelligent domestic system, and model data is this smart home system
System, which provides, realizes the virtual scene that control can be realized to wherein intelligent home device.This virtual scene is in the form of image frame
It has been shown that, and the content shown, i.e., provided by model data.
Build to obtain because model data is in advance based on a scene, therefore, the image that model data is realized is drawn
Face content is shown then will be related to this scene.In one exemplary embodiment, this scene can be pre-configured with it is general
Scene, you can with a certain default scene controlled suitable for all intelligent domestic systems, taken with reducing to calculate pressure and reduce
Server resource but it is also possible to be the real scene as described in corresponding to embodiment such as Fig. 4, can also be user chooses in advance certain
One scene etc..
Image frame render be one from model of place i.e. model data, to the processing procedure of display image.Pass through image
The execution that picture renders so that be used to building the scene of model data before this and be applied in image frame, obtain by
This scene and other virtual scenes for being used to realize that the element of intelligent domestic system control is formed.
Model data is corresponding intelligent domestic system, and therefore, corresponding intelligent domestic system is with rendering obtained void
Intend scene relating, i.e. this virtual scene is by the control for intelligent domestic system associated by realizing.
In the presence of terminal device, rendering for virtual scene is completed, resulting virtual scene is rendered to enable
Enough virtual reality devices by accessing realize display, and user is projected in virtual scene in the presence of virtual reality device,
For the user for dressing virtual reality device, it can be imitated with obtaining the display of solid under the intervention of virtual reality device
Fruit, reaching itself will be projected to the purpose of virtual scene.
Fig. 6 is the flow chart that the details of step 370 is described for correspondingly being implemented to exemplify according to Fig. 4.The step
370, as shown in fig. 6, comprising at least following steps.
In step 371, the image capture device of access is controlled to carry out action video data acquisition, upload action to user
Video data is to server.
Wherein, user side is to realize the control of intelligent domestic system, has accessed image capture device.Image capture device can
Be image the first-class equipment for capturing outdoor scene.Certain action will be triggered by being projected to the user of virtual scene, be led to
Triggered action is crossed to control intelligent domestic system, therefore, it is necessary to incoming image collecting device and realize the sense of user action
Know.
Image capture device persistently carries out the collection of action video data, and action video data describe user and are projected
The everything occurred after to virtual scene, including foregoing signified various conscious actions and unconscious movement.
With the collection of action video data, identification information that collected action video data will be logged in user
Upload onto the server in the lump, and then trigger the real-time calculating of server user's progress action video data for this, with according to calculating
As a result action message is generated.
After virtual scene is realized, realize user therewith by image capture device and adopted in the action of virtual scene
Collection, because image capture device is to continue to carry out, therefore, it is possible to avoid the inaccuracy that action perceives, ensure follow-up institute
Realize the accuracy of intelligent domestic system control.
In step 373, used by real-time calculating of the server to action video data and the return of result of calculation
Family is in action message caused by virtual scene triggering.
Wherein, the real-time calculating process that server performs to action video data, the action triggered for identifying user,
And then obtain the result of calculation for indicating user institute trigger action.Therefore, user can be generated by result of calculation in virtual field
Action message caused by scape triggering.
In one exemplary embodiment, action message is used for the action that is triggered of instruction user, therefore, can directly by
Result of calculation is set to action message, to be returned to terminal device.
In another exemplary embodiment, action message also includes user and believed in the animation of virtual scene institute trigger action
Breath.Animation information is used to be tracked display in the action that virtual scene triggers to user.For example, it is projected to virtual scene
The action of user's triggering is when capturing the dummy object in virtual environment, by animation information come this process of tracking display, at this moment,
Realized by touch feedback and visual feedback, specifically, be so that user has a sensation for being held by object, and regarding
In open country, i.e. virtual scene, the dummy object being booked can also move with the movement set about at once, and this process will pass through animation
The broadcasting that information provides image frame is realized.
Here, it is recognised that the generation of animation information, on the one hand needs the tracking acted according to the realization of action video data
Identification, on the other hand then need by Tracking Recognition to action change procedure blended with virtual scene, form visual
Image frame feeds back.The generation of animation information needs to obtain very high accuracy that is ageing, and calculating.
Therefore, after this action video data is uploaded onto the server, just by means of the computing resource and reality of server
When computing capability be user side generate action message, export the image frame that can be interacted in real time to terminal device.
By this process, the interactive performance of intelligent domestic system control will be improved, ensured in real time by server
In the case of property so that be projected to virtual scene user possess to the dummy object in virtual scene it is very high operable
Degree, so the manipulation process for the intelligent domestic system that user can be carried out and manipulation after intelligent domestic system quilt
Control situation is timely and effectively fed back, and can ensure the security of intelligent domestic system control.
Fig. 7 is the flow chart that the details of step 390 is described for correspondingly being implemented to exemplify according to Fig. 4.The step
390, as shown in fig. 7, comprising at least following steps.
In step 391, judge whether the action indicated by action message is that the manipulation set in intelligent domestic system is moved
Make, if YES, then perform step 393, if NO, then perform step 395.
Wherein, the realization in advance for various control process in the intelligent domestic system disposed sets control action, often
One control process has the corresponding control action set.For a user, it is only necessary to trigger control action and may be such that intelligence
The control process that energy house system performs.
As previously described, the user for being projected to virtual scene often triggers various actions in virtual scene, for example, respectively
Plant conscious or unconscious action.Action message indicates a series of actions, i.e., is formed according to time order and function order
Action sequence.Corresponding, action message indicates multiple actions, it is necessary to therefrom identify the manipulation of intelligent domestic system
Action.
In step 393, perform the correct picture of operation in virtual scene and show, the action is used to generate smart home system
The manipulation signal of system.
Wherein, if it is determined that being the control action set in intelligent domestic system to the action indicated by action message, then
Illustrate the user for being projected to virtual scene, correct operation is performed in virtual scene, therefore, on the one hand to the correct of operation
Property fed back, on the other hand also will accordingly according to this act and generate manipulation signal, manipulate signal generation after be sent to intelligence
House system.
In step 395, the picture that operating mistake is performed in virtual scene is shown.
Wherein, if it is determined that being not that manipulation indicated by intelligent domestic system is moved to the action indicated by action message
Make, then it is any to manipulate the action of intelligent home device to illustrate that user does not trigger in virtual scene, now only needs
Virtual scene be user perform operating mistake picture show, and and need not respond user action progress smart home
The control of system.
By above-mentioned example embodiment, the feedback that user acts in virtual scene is realized, so as to provide the user
Experience good user's operating process.
In addition, it is whether correctly anti-except being operated in the case where action message further comprises animation information
Outside feedback, for example, before being operated and whether correctly feeding back, perform animation information and describe the display of image frame, with
Tracking display is realized in action to the instant triggering of user, it will be understood that the substantial image capture device of shown image frame
The action video data that gather and transmit in real time and the splicing of original virtual scene corresponding image picture, reach empty with this
Intend the purpose that motion tracking is shown in scene.
Fig. 8 is a kind of flow chart of the method for control intelligent domestic system according to another exemplary embodiment.Should
The method for controlling intelligent domestic system, before step 310, as shown in figure 8, further comprising the steps of.
In step 410, the real scene disposed in intelligent domestic system, obtained by the image capture device of access
Real scene view data.
Wherein, for the intelligent domestic system of deployment, to realize control of the user to this intelligent domestic system, it is necessary to
Image data acquiring is carried out to the house for deploying intelligent domestic system in advance, i.e., execution intelligent domestic system is disposed true
The collection of real scene view data corresponding to scene.It is appreciated that the house for deploying intelligent domestic system can be house,
Hotel etc..
The image capture device of access, the specified location being installed in house, for example, the position in corner, behind the door, on wall
Deng.
Terminal device obtains real scene view data by the image capture device of access, and then according to real scene figure
As data request service device is that this intelligent domestic system performs pre-configured process, to be used by the execution of pre-provisioning procedure
Manipulation of the family to this intelligent domestic system can be carried out.
It should be understood that the pre-provisioning procedure of request server execution according to real image data, is substantially to true
Scene image data carries out the process of model data corresponding to dynamic modeling and final intelligent domestic system.
In one exemplary embodiment, image capture device can carry out the video of outdoor scene to place house or panorama is clapped
Take the photograph, to export the real scene view data corresponding to panoramic video or panorama sketch, and then by the computing capability of server and
The augmented reality content that can be interacted, i.e. model data are exported in real time.
In step 430, real scene view data is uploaded to server according to the identification information that user logs in, by true
The upload triggering server of real scene image data carries out dynamic modeling generation model data, mould according to real scene view data
Type data being serviced device stores by index of identification information.
Wherein, it should be noted that the identification information that user logs in corresponds to intelligent domestic system.Terminal device exists
After obtaining real scene view data by the image capture device accessed, real scene view data is carried out for this identification information
Upload, here, being substantially the upload that real scene view data is performed for corresponding intelligent domestic system, in order to obtain
The model data of intelligent domestic system must be corresponded to.
Server performs dynamic modeling after the real scene view data of upload is received.Real scene view data
It is to be obtained and the intelligent domestic system various three-dimensional informations that to dispose house related by image capture device.
In exemplary embodiment in the specific implementation, performed dynamic modeling process, including at least structure entity
It is geometry, NURBS (Non-Uniform Rational B-Splines, non-uniform rational B-spline) modeling, polygon modeling, thin
Divide the process such as curved surface and implicit surface.When needing, dynamic modeling process also includes editor's body surface or material
Matter is (for example, color, fluorescence, diffusion and specular components-roughness and finish, reflection characteristic, transparency or impermeable
Lightness, or refractive index), the process of increase texture, bump mapping and further feature.
By the execution of dynamic modeling process, modeling, scene layout and drawing image picture three phases are completed, and then
Model data is obtained, is finally stored in by index of identification information in server.
In exemplary embodiment in the specific implementation, the model data store that server is realized, is to pass through to configure
Mysql database realizings.
Further, Fig. 9 is to generate three-dimensional modeling data in the server according to an exemplary embodiment in real time
Flow chart.Server is by being interacted with terminal device to obtain real scene view data.As shown in figure 9, in image
Under the intervention of collecting device, terminal device realizes real scene image data acquiring, will upload this real scene view data
To server, i.e., such as process that step 510 is realized.
After server receives real scene view data, packet process is performed, in this packet process
In execution, first should to corresponding to terminal device user carry out Authority Verification, as described by step 610, server with
Itself data interaction between terminal device, have also obtained the identification information that user in terminal device is logged in, to this mark
Know information and carry out Authority Verification, after by Authority Verification, step 620 is performed, according to different visual angles to true field
Scape image data packets, to obtain the real image data sorted out according to visual angle.
The real image data creation time axle sorted out to each visual angle, such as step 630, this is adapted to acquisition and regarded
Feel the time shaft of angle, thus, the real image data of multiple visual angles and the time shaft being adapted can form pattern number
According to.
This model data is entered into library storage using identification information as index, i.e., as illustrated in step 640.
So far model data prestoring in server corresponding to the intelligent domestic system that user is controlled is realized.
Once user initiates to ask by terminal device to server, terminal device can pass through the model data real-time rendering figure of storage
Shape, and image frame is returned via network transmission and to terminal device, so that it is real in the presence of institute's access of virtual real world devices
The display of existing virtual scene, as described by step 650 to step 670.
It is corresponding, it is that after the action of user is perceived, server is held in the virtual scene constructed by user
Row step 690, computing capability and network transmission performance realization action feedback are realized by itself.
In one exemplary embodiment, between server and terminal device network transmission realization, may rely on and match somebody with somebody
The SiBEAM Snap technologies put, to ensure that the realization of augmented reality in intelligent domestic system will not be due to network transmission speed not
Match and cause the fluency of image quality and picture can not meet the situation that viewing requires.
The exemplary embodiment realized by the present invention so that the realization of intelligent domestic system control is blended in virtually
In reality technology, present situation uninteresting, stiff and passive between user and intelligent domestic system is changed, and by tracking user
Head, hand and body perceive the action of user, and the feedback shown by tactile, audio and image strengthens interactivity
Can, user initiates the accuracy of intelligent domestic system control and security is obtained and improved comprehensively.
The exemplary embodiment realized by the present invention, user are seen by taking virtual reality device, such as VR glasses
To the figure of server transport, and then a virtual scene itself will be placed in, be operated such as in this virtual scene by acting
The content of the switches such as washing machine, air-conditioning, electric cooker, it can so ensure the correctness and security of operation, user is to intelligent family
Occupy the more standby enhancing sense of operation of system.
In the exemplary embodiment that the present invention is realized, pass through the use of virtual reality device so that user is to intelligence
The control of house system can incorporate virtual reality technology, on the one hand realize user and intelligent domestic system is manipulated and obtained instead
The immersion experience of feedback, on the other hand also directly improves validity and accuracy of the intelligent domestic system in control, ensures
User's manipulation timely responds to.
Following is apparatus of the present invention embodiment, and the method that can be used for performing the above-mentioned control intelligent domestic system of the present invention is real
Apply example.For the details not disclosed in apparatus of the present invention embodiment, the method that refer to present invention control intelligent domestic system is real
Apply example.
Figure 10 is a kind of block diagram of the device of control intelligent domestic system according to an exemplary embodiment.The control
The device of intelligent domestic system, as shown in Figure 10, include but is not limited to：Data demand module 810, scene rendering display module
830th, projection module 850, action sensing module 870 and action feedback module 890.
Data demand module 810, for manipulating the model data of intelligent domestic system to server request user.
Scene rendering module 830, for carrying out rendering the virtual field for obtaining intelligent domestic system and associating by model data
Scape.
Display module 850, for performing the display of virtual scene by the virtual reality device of access.
Sensing module 870 is acted, for controlling the action video data acquisition for performing user in virtual scene trigger action,
And action message is obtained by the action video data-triggered server of collection.
Feedback module 890 is acted, for performing virtual scene according to associating between action message and intelligent domestic system
In action feedback procedure, intelligent domestic system is controlled by action feedback procedure.
Figure 11 is the block diagram that the details of data demand module is described for correspondingly being implemented to exemplify according to Figure 10.The number
According to request module 810, as shown in figure 11, include but is not limited to：Request initiating cell 811 and data receipt unit 813.
Request initiating cell 811, for initiating intelligent domestic system behaviour to server according to the identification information that user logs in
Control request.
Data receipt unit 813, the pattern number for manipulating request in response to intelligent domestic system for the reception server and returning
According to model data is to build to obtain beforehand through real scene where intelligent domestic system and manipulated corresponding to intelligent domestic system
Identification information in request.
In one exemplary embodiment, scene rendering module 830 is further used for carrying out image frame by model data
Render, the scene for building model data is applied to the virtual scene that image frame obtains intelligent domestic system association.
Figure 12 is according to the corresponding block diagrams that the details for acting sensing module is described for implementing to exemplify of Figure 10.This is dynamic
Make sensing module 870, as shown in figure 12, include but is not limited to：DCU data control unit 871 and action message receiving unit 873.
DCU data control unit 871, for controlling the image capture device of access to carry out action video data acquisition to user,
Action video data are uploaded to server.
Action message receiving unit 873, for by server to the real-time calculating of action video data and result of calculation
Return obtain user the virtual scene triggering caused by action message.
Figure 13 is according to the corresponding block diagrams that the details for acting feedback module is described for implementing to exemplify of Figure 10.This is dynamic
Make feedback module 890, as shown in figure 13, include but is not limited to：Judging unit 891, correct operational feedback unit 893 and mistake behaviour
Make feedback unit 895.
Judging unit 891, for judging whether the action indicated by action message is the behaviour that is set in intelligent domestic system
Control acts, and if YES, then triggers correct operational feedback unit 893, if NO, then triggers faulty operation feedback unit 895.
Correct operational feedback unit 893, show, acted for giving birth to for performing the correct picture of operation in institute's virtual scene
Into the manipulation signal of intelligent domestic system.
Faulty operation feedback unit 895, if the everything for action message instruction is not intelligent domestic system
The control action of middle setting, the then picture that operating mistake is performed in virtual scene are shown.
Figure 14 is a kind of block diagram of the device of control intelligent domestic system according to another exemplary embodiment.The control
The device of intelligent domestic system processed, as shown in figure 14, also include but is not limited to：Data pre-acquired module 910 and scene request are matched somebody with somebody
Put module 930.
Data pre-acquired module 910, for the real scene disposed in intelligent domestic system, adopted by the image of access
Collect equipment and obtain real scene view data；
Scene request configuration module 930, for uploading real scene figure to server according to the identification information that user logs in
As data, server is triggered by the upload of real scene view data dynamic modeling life is carried out according to real scene view data
Into model data, model data being serviced device stores by index of identification information.
Optionally, the present invention also provides a kind of device for controlling intelligent domestic system, performs Fig. 4, Fig. 5 Fig. 6, Fig. 7 and Fig. 8
The all or part of step of the method for control intelligent domestic system shown in any.Described device includes：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as performing：
The model data of intelligent domestic system is manipulated to server request user；
Carry out rendering the virtual scene for obtaining the intelligent domestic system and associating by the model data；
The display of the virtual scene is performed by the virtual reality device of access；
Control performs action video data acquisition of the user in the virtual scene trigger action, and passes through collection
The action video data-triggered server obtains action message；
The action performed according to associating between the action message and the intelligent domestic system in the virtual scene
Feedback procedure, the intelligent domestic system are controlled by the action feedback procedure.
In the exemplary embodiment, a kind of storage medium is additionally provided, the storage medium is computer-readable recording medium,
Such as can be the provisional and non-transitorycomputer readable storage medium for including instruction.The storage medium is for example including instruction
Memory 204, above-mentioned instruction can performs by the processor 218 of device 200 to complete the side of above-mentioned control intelligent domestic system
Method.
It should be appreciated that the invention is not limited in the precision architecture for being described above and being shown in the drawings, and
And various modifications and changes can be performed interior without departing from the scope.The scope of the present invention is only limited by appended claim
System.
Claims (14)
- A kind of 1. method for controlling intelligent domestic system, it is characterised in that methods described includes：The model data of intelligent domestic system is manipulated to server request user；Carry out rendering the virtual scene for obtaining the intelligent domestic system and associating by the model data；The display of the virtual scene is performed by the virtual reality device of access；Control performs action video data acquisition of the user in the virtual scene trigger action, and by described in collection Action video data-triggered server obtains action message；The action performed according to associating between the action message and the intelligent domestic system in the virtual scene is fed back Process, the intelligent domestic system are controlled by the action feedback procedure.
- 2. according to the method for claim 1, it is characterised in that described to manipulate intelligent domestic system to server request user Model data, including：Intelligent domestic system manipulation request is initiated to the server according to the identification information that the user logs in；The model data that the server responds the intelligent domestic system manipulation request and returned is received, the model data is Build to obtain beforehand through real scene where the intelligent domestic system and corresponding to intelligent domestic system manipulation request In identification information.
- 3. according to the method for claim 1, it is characterised in that described by the model data render described in acquisition The virtual scene of intelligent domestic system association, including：Image frame is carried out to the model data to render, the scene for building the model data is applied to described image picture Obtain the virtual scene associated with the intelligent domestic system.
- 4. according to the method for claim 1, it is characterised in that the control performs the user and touched in the virtual scene Start the action video data acquisition made, and action message obtained by the action video data-triggered server of collection, Including：Control the image capture device of access to carry out action video data acquisition to the user, upload the action video data To the server；The user is obtained by real-time calculating of the server to the action video data and the return of result of calculation to exist Action message caused by the virtual scene triggering.
- 5. according to the method for claim 1, it is characterised in that described according to the action message and the smart home system Association between system performs the action feedback procedure in the virtual scene, and it is anti-that the intelligent domestic system is controlled by the action Feedback process, including：Judge whether the action indicated by the action message is the control action set in intelligent domestic system, if YES, Then perform the correct picture of operation in the virtual scene to show, the manipulation acted for generating intelligent domestic system is believed Number；If the everything of the action message instruction is not the control action set in intelligent domestic system, described The picture that virtual scene performs operating mistake is shown.
- 6. according to the method for claim 1, it is characterised in that described to manipulate intelligent domestic system to server request user Model data before, methods described also includes：In the real scene that the intelligent domestic system is disposed, the real scene is obtained by the image capture device of access View data；The real scene view data is uploaded to the server according to the identification information that user logs in, passes through the true field The upload of scape view data triggers the server and carries out the dynamic modeling generation mould according to the real scene view data Type data, the model data are stored by the server by index of the identification information.
- 7. a kind of device for controlling intelligent domestic system, it is characterised in that described device includes：Data demand module, for manipulating the model data of intelligent domestic system to server request user；Scene rendering module, for carrying out rendering the virtual field for obtaining the intelligent domestic system and associating by the model data Scape；Display module, for performing the display of the virtual scene by the virtual reality device of access；Sensing module is acted, for controlling the execution user to be adopted in the action video data of the virtual scene trigger action Collection, and action message is obtained by the action video data-triggered server of collection；Feedback module is acted, it is described virtual for being performed according to associating between the action message and the intelligent domestic system Action feedback procedure in scene, the intelligent domestic system are controlled by the action feedback procedure.
- 8. device according to claim 7, it is characterised in that the data demand module includes：Request initiating cell, for initiating intelligent domestic system behaviour to the server according to the identification information that the user logs in Control request；Data receipt unit, the pattern number for responding the intelligent domestic system manipulation request for receiving the server and returning According to the model data is to build to obtain beforehand through real scene where the intelligent domestic system and correspond to the intelligence Identification information in house system manipulation request.
- 9. device according to claim 7, it is characterised in that the scene rendering module is further used for the model Data carry out image frame and rendered, and the scene for building the model data is applied to the acquisition of described image picture and the intelligence The virtual scene of house system association.
- 10. device according to claim 7, it is characterised in that the action sensing module includes：DCU data control unit, for controlling the image capture device of access to carry out action video data acquisition to the user, on The action video data are passed to the server；Action message receiving unit, for passing through real-time calculating of the server to the action video data and result of calculation Return obtain the user in action message caused by virtual scene triggering.
- 11. device according to claim 7, it is characterised in that the action feedback module includes：Judging unit, for judging whether the action indicated by the action message is that the manipulation set in intelligent domestic system is moved Make, if YES, then trigger correct operational feedback unit, if NO, then trigger faulty operation feedback unit；The correct operational feedback unit is used to show that described act is used in the correct picture of virtual scene execution operation Generate the manipulation signal of intelligent domestic system；If the everything that the faulty operation feedback unit is used for action message instruction is not intelligent domestic system The control action of middle setting, the then picture that operating mistake is performed in the virtual scene are shown.
- 12. device according to claim 7, it is characterised in that described device also includes：Data pre-acquired module, for the real scene disposed in the intelligent domestic system, pass through the IMAQ of access Equipment obtains the real scene view data；Scene request configuration module, for uploading the real scene figure to the server according to the identification information that user logs in As data, the server is triggered by the upload of the real scene view data and entered according to the real scene view data Mobile state modeling generates the model data, and the model data is stored by the server by index of the identification information.
- A kind of 13. device for controlling intelligent domestic system, it is characterised in that including：Processor；AndMemory, computer-readable instruction is stored with the memory, the computer-readable instruction is held by the processor The method that control intelligent domestic system according to any one of claim 1 to 6 is realized during row.
- 14. a kind of computer-readable recording medium, is stored thereon with computer program, the computer program is executed by processor The method of Shi Shixian control intelligent domestic systems according to any one of claim 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710692424.2A CN107358007B (en) | 2017-08-14 | 2017-08-14 | It controls the method, apparatus of smart home system and calculates readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710692424.2A CN107358007B (en) | 2017-08-14 | 2017-08-14 | It controls the method, apparatus of smart home system and calculates readable storage medium storing program for executing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107358007A true CN107358007A (en) | 2017-11-17 |
| CN107358007B CN107358007B (en) | 2018-11-30 |
Family
ID=60286504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710692424.2A Active CN107358007B (en) | 2017-08-14 | 2017-08-14 | It controls the method, apparatus of smart home system and calculates readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107358007B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108093030A (en) * | 2017-11-29 | 2018-05-29 | 杭州古北电子科技有限公司 | A kind of artificial intelligence model dispositions method based on Cloud Server |
| CN108345907A (en) * | 2018-02-09 | 2018-07-31 | 广东美的制冷设备有限公司 | Recognition methods, augmented reality equipment and storage medium |
| CN108710308A (en) * | 2018-05-29 | 2018-10-26 | 广东汇泰龙科技有限公司 | A kind of method and system of the given pose triggering scene linkage based on intelligent cloud lock |
| CN108919663A (en) * | 2018-07-25 | 2018-11-30 | 珠海格力电器股份有限公司 | Management method of intelligent household equipment and electronic equipment |
| CN108958057A (en) * | 2018-08-01 | 2018-12-07 | 珠海格力电器股份有限公司 | Control method and device of household appliance, storage medium and electronic device |
| CN109660508A (en) * | 2018-10-23 | 2019-04-19 | 平安壹钱包电子商务有限公司 | Data visualization method, electronic device, computer equipment and storage medium |
| CN110276819A (en) * | 2018-03-14 | 2019-09-24 | 佛山市顺德区美的电热电器制造有限公司 | A kind of displaying control method and device and computer readable storage medium |
| CN110426965A (en) * | 2019-09-17 | 2019-11-08 | 苏州百宝箱科技有限公司 | A kind of smart home long-range control method based on cloud platform |
| CN110794777A (en) * | 2019-10-25 | 2020-02-14 | 浙江工贸职业技术学院 | Intelligent household control equipment and control method |
| CN110852770A (en) * | 2018-08-21 | 2020-02-28 | 阿里巴巴集团控股有限公司 | Data processing method and device, computing equipment and display equipment |
| CN110928411A (en) * | 2019-11-18 | 2020-03-27 | 珠海格力电器股份有限公司 | AR-based interaction method and device, storage medium and electronic equipment |
| CN111131735A (en) * | 2019-12-31 | 2020-05-08 | 歌尔股份有限公司 | Video recording method, video playing method, video recording device, video playing device and computer storage medium |
| CN111538252A (en) * | 2020-05-25 | 2020-08-14 | 厦门大学 | Intelligent home demonstration system applying VR technology |
| CN111752443A (en) * | 2019-03-28 | 2020-10-09 | 华为技术有限公司 | Method, related device and system for controlling page by display equipment |
| CN112460743A (en) * | 2020-11-30 | 2021-03-09 | 珠海格力电器股份有限公司 | Scene rendering method, scene rendering device and environment regulator |
| CN113225549A (en) * | 2021-04-19 | 2021-08-06 | 广州朗国电子科技有限公司 | VR intelligence life system |
| CN113808728A (en) * | 2021-09-02 | 2021-12-17 | 武汉联影医疗科技有限公司 | Medical equipment management method and device, computer equipment and storage medium |
| CN113885345A (en) * | 2021-10-29 | 2022-01-04 | 广州市技师学院(广州市高级技工学校、广州市高级职业技术培训学院、广州市农业干部学校) | Interaction method, device and equipment based on intelligent home simulation control system |
| CN114885031A (en) * | 2022-03-21 | 2022-08-09 | 深圳绿米联创科技有限公司 | Interactive processing method and device based on equipment control and electronic equipment |
| WO2024140349A1 (en) * | 2022-12-30 | 2024-07-04 | 华为技术有限公司 | Smart home configuration method and electronic device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102306020A (en) * | 2011-06-27 | 2012-01-04 | 中国科学院深圳先进技术研究院 | Virtual modeling thing internet and cloud computing combining method and system |
| CN105117017A (en) * | 2015-09-07 | 2015-12-02 | 众景视界（北京）科技有限公司 | Gloves used in interaction control of virtual reality and augmented reality |
| CN105376125A (en) * | 2015-12-08 | 2016-03-02 | 深圳众乐智府科技有限公司 | Control method and device for intelligent home system |
| CN105629744A (en) * | 2015-04-30 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Control method of smart home, control system, terminal and smart home system |
| CN106200983A (en) * | 2016-07-25 | 2016-12-07 | 圣域科技（深圳）有限公司 | A kind of combined with virtual reality and BIM realize the system of virtual reality scenario architectural design |
| CN205809568U (en) * | 2016-06-21 | 2016-12-14 | 武汉方格信息技术有限公司 | A kind of combination VR and the intelligent domestic system of robot |
| CN106249607A (en) * | 2016-07-28 | 2016-12-21 | 桂林电子科技大学 | Virtual Intelligent household analogue system and method |
| CN106445156A (en) * | 2016-09-29 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and terminal for intelligent home device control based on virtual reality |
| CN106681479A (en) * | 2015-11-05 | 2017-05-17 | 丰唐物联技术（深圳）有限公司 | User interaction method and system based on virtual reality |
-
2017
- 2017-08-14 CN CN201710692424.2A patent/CN107358007B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102306020A (en) * | 2011-06-27 | 2012-01-04 | 中国科学院深圳先进技术研究院 | Virtual modeling thing internet and cloud computing combining method and system |
| CN105629744A (en) * | 2015-04-30 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Control method of smart home, control system, terminal and smart home system |
| CN105117017A (en) * | 2015-09-07 | 2015-12-02 | 众景视界（北京）科技有限公司 | Gloves used in interaction control of virtual reality and augmented reality |
| CN106681479A (en) * | 2015-11-05 | 2017-05-17 | 丰唐物联技术（深圳）有限公司 | User interaction method and system based on virtual reality |
| CN105376125A (en) * | 2015-12-08 | 2016-03-02 | 深圳众乐智府科技有限公司 | Control method and device for intelligent home system |
| CN205809568U (en) * | 2016-06-21 | 2016-12-14 | 武汉方格信息技术有限公司 | A kind of combination VR and the intelligent domestic system of robot |
| CN106200983A (en) * | 2016-07-25 | 2016-12-07 | 圣域科技（深圳）有限公司 | A kind of combined with virtual reality and BIM realize the system of virtual reality scenario architectural design |
| CN106249607A (en) * | 2016-07-28 | 2016-12-21 | 桂林电子科技大学 | Virtual Intelligent household analogue system and method |
| CN106445156A (en) * | 2016-09-29 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and terminal for intelligent home device control based on virtual reality |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108093030A (en) * | 2017-11-29 | 2018-05-29 | 杭州古北电子科技有限公司 | A kind of artificial intelligence model dispositions method based on Cloud Server |
| CN108345907A (en) * | 2018-02-09 | 2018-07-31 | 广东美的制冷设备有限公司 | Recognition methods, augmented reality equipment and storage medium |
| CN110276819A (en) * | 2018-03-14 | 2019-09-24 | 佛山市顺德区美的电热电器制造有限公司 | A kind of displaying control method and device and computer readable storage medium |
| CN108710308A (en) * | 2018-05-29 | 2018-10-26 | 广东汇泰龙科技有限公司 | A kind of method and system of the given pose triggering scene linkage based on intelligent cloud lock |
| CN108919663A (en) * | 2018-07-25 | 2018-11-30 | 珠海格力电器股份有限公司 | Management method of intelligent household equipment and electronic equipment |
| CN108958057A (en) * | 2018-08-01 | 2018-12-07 | 珠海格力电器股份有限公司 | Control method and device of household appliance, storage medium and electronic device |
| CN110852770A (en) * | 2018-08-21 | 2020-02-28 | 阿里巴巴集团控股有限公司 | Data processing method and device, computing equipment and display equipment |
| CN110852770B (en) * | 2018-08-21 | 2023-05-26 | 阿里巴巴集团控股有限公司 | Data processing method and device, computing device and display device |
| CN109660508A (en) * | 2018-10-23 | 2019-04-19 | 平安壹钱包电子商务有限公司 | Data visualization method, electronic device, computer equipment and storage medium |
| CN111752443A (en) * | 2019-03-28 | 2020-10-09 | 华为技术有限公司 | Method, related device and system for controlling page by display equipment |
| CN110426965A (en) * | 2019-09-17 | 2019-11-08 | 苏州百宝箱科技有限公司 | A kind of smart home long-range control method based on cloud platform |
| CN110794777A (en) * | 2019-10-25 | 2020-02-14 | 浙江工贸职业技术学院 | Intelligent household control equipment and control method |
| CN110928411A (en) * | 2019-11-18 | 2020-03-27 | 珠海格力电器股份有限公司 | AR-based interaction method and device, storage medium and electronic equipment |
| CN111131735A (en) * | 2019-12-31 | 2020-05-08 | 歌尔股份有限公司 | Video recording method, video playing method, video recording device, video playing device and computer storage medium |
| CN111538252A (en) * | 2020-05-25 | 2020-08-14 | 厦门大学 | Intelligent home demonstration system applying VR technology |
| CN111538252B (en) * | 2020-05-25 | 2021-09-21 | 厦门大学 | Intelligent home demonstration system applying VR technology |
| CN112460743A (en) * | 2020-11-30 | 2021-03-09 | 珠海格力电器股份有限公司 | Scene rendering method, scene rendering device and environment regulator |
| CN113225549A (en) * | 2021-04-19 | 2021-08-06 | 广州朗国电子科技有限公司 | VR intelligence life system |
| CN113225549B (en) * | 2021-04-19 | 2022-07-01 | 广州朗国电子科技股份有限公司 | VR intelligence life system |
| CN113808728A (en) * | 2021-09-02 | 2021-12-17 | 武汉联影医疗科技有限公司 | Medical equipment management method and device, computer equipment and storage medium |
| CN113885345A (en) * | 2021-10-29 | 2022-01-04 | 广州市技师学院(广州市高级技工学校、广州市高级职业技术培训学院、广州市农业干部学校) | Interaction method, device and equipment based on intelligent home simulation control system |
| CN113885345B (en) * | 2021-10-29 | 2024-03-19 | 广州市技师学院(广州市高级技工学校、广州市高级职业技术培训学院、广州市农业干部学校) | Interaction method, device and equipment based on intelligent home simulation control system |
| CN114885031A (en) * | 2022-03-21 | 2022-08-09 | 深圳绿米联创科技有限公司 | Interactive processing method and device based on equipment control and electronic equipment |
| WO2024140349A1 (en) * | 2022-12-30 | 2024-07-04 | 华为技术有限公司 | Smart home configuration method and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107358007B (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107358007B (en) | It controls the method, apparatus of smart home system and calculates readable storage medium storing program for executing | |
| CN107703872B (en) | Terminal control method and device of household appliance and terminal | |
| US11206373B2 (en) | Method and system for providing mixed reality service | |
| CN103631768B (en) | Collaboration data editor and processing system | |
| CN103926890B (en) | Intelligent terminal control method and device | |
| CN106791893A (en) | Net cast method and device | |
| CN109920065A (en) | Methods of exhibiting, device, equipment and the storage medium of information | |
| CN107040646A (en) | Mobile terminal and its control method | |
| CN106804000A (en) | Direct playing and playback method and device | |
| CN107113226A (en) | Electronic installation and its method for recognizing peripheral equipment | |
| CN105068467B (en) | Control the method and device of smart machine | |
| CN103345204B (en) | A kind of home control system | |
| CN108037863A (en) | A kind of method and apparatus for showing image | |
| US11195408B1 (en) | Sending signals for help during an emergency event | |
| CN104484858B (en) | Character image processing method and processing device | |
| WO2018022442A1 (en) | Incentivizing activation of audio/video recording and communication devices | |
| CN106488109A (en) | Mobile device and its control method | |
| CN107577352A (en) | Terminal access method, device and the electronic equipment and storage medium of home appliance | |
| WO2020151255A1 (en) | Display control system and method based on mobile terminal | |
| CN106572007A (en) | Intelligent gateway | |
| CN107371052A (en) | Apparatus control method and device | |
| CN107132769A (en) | Smart machine control method and device | |
| CN107679942A (en) | Product introduction method, apparatus and storage medium based on virtual reality | |
| CN107330391A (en) | Product information reminding method and device | |
| CN105843595A (en) | Method, device, and terminal for interface display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |