CN105204347B - Smart home exchange method based on augmented reality, device and system - Google Patents
Smart home exchange method based on augmented reality, device and system Download PDFInfo
- Publication number
- CN105204347B CN105204347B CN201510340763.5A CN201510340763A CN105204347B CN 105204347 B CN105204347 B CN 105204347B CN 201510340763 A CN201510340763 A CN 201510340763A CN 105204347 B CN105204347 B CN 105204347B
- Authority
- CN
- China
- Prior art keywords
- terminal
- intelligent gateway
- smart home
- picture
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The present invention discloses a kind of smart home exchange method based on augmented reality, device and system.The method includes：Intelligent gateway is obtained to monitor the picture of ground smart home real scene in real time and handled；Obtain the location information in the geographical location and terminal of intelligent gateway, the location information include the terminal geographical position coordinates and the terminal towards orientation, the location information is used to indicate the correspondence that the terminal determines the geographical location of the intelligent gateway and the location information of the terminal according to the geographical location of the intelligent gateway；According to the correspondence, the treated intelligent gateway is monitored into the picture of ground smart home real scene in real time and the information of terminal is simultaneously displayed in terminal；It is interacted with the picture for being shown in the terminal.The present invention carries out the purpose of remote interaction by augmented reality realization with smart home, and the application embodiment that a real body faces in family, effect that the user experience is improved are provided to be operated in outer people.
Description
Technical field
The present invention relates to smart home field more particularly to a kind of smart home interaction sides based on augmented reality
Method, device and system.
Background technology
In current environment of internet of things, outer people is operated in usually using the terminals such as smart mobile phone, tablet computer and intelligence
Energy household carries out remote interaction, can be very clear to the operative scenario of smart home device, does not stay the feeling in family but,
Certain puzzlement is brought to the people for being operated in outer, therefore, current this remote interaction mode is not smart enough, user experience effect
It is bad.
Invention content
In view of the foregoing, it is necessary to provide a kind of smart home exchange method based on augmented reality, device and
System, it is intended to which the purpose that remote interaction smart home is realized by augmented reality provides one very to be operated in outer people
The application that identity is faced in family embodies, and promotes user experience effect.
In a first aspect, the embodiment of the present invention provides a kind of smart home exchange method based on augmented reality, it is described
Method includes step：
Intelligent gateway is obtained to monitor the picture of ground smart home real scene in real time and handled；
The location information in the geographical location and terminal of intelligent gateway is obtained, the location information includes the geography of the terminal
Position coordinates and the terminal towards orientation, the location information is used to indicate ground of the terminal according to the intelligent gateway
Manage the correspondence of the location information in the geographical location and terminal of intelligent gateway described in location determination；
According to the correspondence, the treated intelligent gateway is monitored into ground smart home real scene in real time
The information of picture and terminal is simultaneously displayed in terminal；
It is interacted with the picture for being shown in the terminal.
With reference to first aspect, in its first realization method, the intelligent family in ground is monitored in real time in the acquisition intelligent gateway
Before occupying the picture of real scene and carrying out processing step, further include：The communication established between the intelligent gateway and terminal connects
It connects, and protocol information one, the terminal and the intelligence that the intelligent gateway is communicated with terminal is transmitted by the communication connection
The protocol information two that energy gateway is communicated.
With reference to first aspect and its above-mentioned realization method, described according to institute in second of realization method of first aspect
Correspondence is stated, includes in terminal by the picture that the treated intelligent gateway monitors ground smart home real scene in real time
On step, including：
According to the position of terminal and the intelligent gateway described in the positional information calculation of the geographical location of intelligent gateway and terminal
Set correspondence；
The treated intelligent gateway is monitored into ground smart home real scene in real time according to the correspondence
Picture is shown in terminal, while by the presentation of information of terminal on the picture.
With reference to first aspect and its above-mentioned realization method, described according to institute in the third realization method of first aspect
It includes in terminal to state the picture that the treated intelligent gateway is monitored ground smart home real scene by correspondence in real time
On, while by step of the presentation of information of terminal on the picture further including：
The information superposition of the terminal monitors ground smart home real scene in real time in the treated intelligent gateway
Picture on.
Second aspect, the embodiment of the present invention provides a kind of smart home interactive device based on augmented reality, described
Device includes：
Picture acquiring unit, for obtain intelligent gateway monitor in real time ground smart home real scene picture and located
Reason；
Position acquisition unit, the location information in geographical location and terminal for obtaining intelligent gateway, the location information
Geographical position coordinates and the terminal including the terminal towards orientation, the location information is used to indicate the terminal root
Determine that the geographical location of the intelligent gateway is corresponding with the location information of the terminal according to the geographical location of the intelligent gateway
Relationship；
Picture display unit, for according to the correspondence, monitoring ground in real time by the treated intelligent gateway
The picture of smart home real scene and the information of terminal are simultaneously displayed in terminal；
Interactive unit, for being interacted with the picture for being shown in the terminal.
In conjunction with second aspect, in the first realization method of second aspect, described device further includes：
Communication unit is connected for establishing the connection of the communication between the intelligent gateway and terminal, and by the communication
Transmit the agreement letter that the protocol information one, the terminal that the intelligent gateway communicated with terminal are communicated with intelligent gateway
Breath two.
In conjunction with second aspect and its above-mentioned realization method, in second of realization method of second aspect, the picture is aobvious
Show that unit further includes：
Computing unit, for according to terminal described in the geographical location of intelligent gateway and the positional information calculation of terminal with it is described
The position correspondence of intelligent gateway；
Sprite display unit, for monitoring ground in real time by the treated intelligent gateway according to the correspondence
The picture of smart home real scene is shown in terminal, while by the presentation of information of terminal on the picture.
In conjunction with second aspect and its above-mentioned realization method, in the third realization method of second aspect, the sprite
Display unit further includes：
Superpositing unit, the information superposition for the terminal monitor ground intelligence in real time in the treated intelligent gateway
On the picture of household real scene.
The third aspect, the embodiment of the present invention provides a kind of smart home interactive system based on augmented reality, described
System includes：
Intelligent gateway, terminal, the smart home interactive device based on augmented reality, wherein
The smart home interactive device based on augmented reality includes any of second aspect or second aspect
The smart home interactive device based on augmented reality described in possible realization method is integrated with terminal setting,
Alternatively, being set as the part detached with the terminal.
The smart home exchange method that an embodiment of the present invention provides a kind of based on augmented reality, device and system,
By establishing communication connection between intelligent gateway and terminal, obtains intelligent gateway and monitor ground smart home real scene in real time
Picture is simultaneously handled, is obtained the geographical location of intelligent gateway and the location information of terminal, according to the geography of the intelligent gateway
The correspondence of position and the location information of the terminal, the information superposition of terminal is real in the treated intelligent gateway
When monitoring ground smart home real scene picture on, and be shown in terminal, handed over the picture for being shown in the terminal
Mutually, remote interaction is carried out with smart home to achieve the purpose that realize by augmented reality, for the people for being operated in outer
It provides the application that a real body faces in family to embody, promotes user experience effect.
Description of the drawings
Fig. 1 is a kind of smart home exchange method flow based on augmented reality that first embodiment of the invention provides
Figure；
Fig. 2 is a kind of smart home interactive device structure based on augmented reality that second embodiment of the invention provides
Figure；And
Fig. 3 is a kind of smart home interactive system structure based on augmented reality that third embodiment of the invention provides
Figure.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
The (if present)s such as term " one ", " two " in description and claims of this specification and above-mentioned attached drawing are to use
In distinguishing similar object, without being used to describe specific sequence or precedence.It should be appreciated that the data used in this way exist
It can be interchanged in the case of appropriate, so that the embodiments described herein can be with other than the content for illustrating or describing herein
Sequence is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover it is non-exclusive include,
For example, containing that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly to list
A little steps or unit, but may include not listing clearly or for intrinsic its of these processes, method, product or equipment
Its step or unit.
The present invention is based on the smart home exchange method of augmented reality, device and system following embodiments in, institute
The terminal of description can be any intelligent terminals such as intelligent glasses, smartwatch, smart mobile phone；The intelligent gateway, as intelligence
Various smart home devices are converged to home network, are controlled to various smart home devices by the core of energy house system
The hinge of system.As long as it will be understood by those skilled in the art that can realize that the present invention is based on the friendships of the smart home of augmented reality
The thought of mutual method, the embodiment of the present invention do not limit the terminal, the specific manifestation form of the intelligent gateway.It is right
Terminal, the associated description of intelligent gateway are right as described above, in the specific embodiment that corresponding technical solution is described below
The above is no longer repeated.
The specific implementation of the present invention is described in detail below in conjunction with specific embodiment：
Embodiment one：
Fig. 1 shows a kind of smart home exchange method based on augmented reality that first embodiment of the invention provides
Flow, details are as follows：
In step S101, obtains intelligent gateway and monitor the picture of ground smart home real scene in real time and handled.
In specific implementation process, the communication connection between the intelligent gateway and terminal is initially set up, and by described
Communication connects the protocol information one for transmitting the intelligent gateway and being communicated with terminal, the terminal is communicated with intelligent gateway
Protocol information two, wherein the protocol information one that intelligent gateway is communicated with terminal can be that the intelligent gateway that will obtain is real
When monitoring ground information such as smart home real scene picture, into terminal transmission process, be transformed to that terminal can identify with
The intelligent gateway monitors the change scaling method of the corresponding information of information such as ground smart home real scene picture in real time, can also
It is the algorithm that the intelligent gateway of acquisition is monitored to ground smart home real scene picture in real time and is handled, such as：Image procossing is calculated
Treated intelligent gateway is monitored ground smart home real scene picture transmission to terminal by method in real time later, and terminal with
The protocol information two that intelligent gateway is communicated can be will by interactive command information or other information that terminal inputs,
Into intelligent gateway transmission process, be transformed to that intelligent gateway can identify with the interactive command information or other information phase
The change scaling method of corresponding information.
In certain preferred embodiments, the communication connection between the intelligent gateway and terminal can pass through WiFi, indigo plant
Tooth, other wireless modes or wired mode are attached, and to this communication connection type, the present invention is not especially limited.
After establishing communication connection between intelligent gateway and terminal, intelligent gateway automatically turns on included camera, by intelligence
Real scene that can be before the camera of gateway is monitored, and the range that monitors of camera carried according to intelligent gateway determines
The range of the picture of the real scene monitored, when direction, the gradient of camera etc. that are carried to intelligent gateway are adjusted,
The picture of the real scene monitored correspondingly changes, can will be at the picture for the real scene that monitored
Reason, such as：Storage, transmission, is decomposed, is reconfigured at compression of images, correspondingly, when the court of the camera carried to intelligent gateway
It is adjusted to, gradient etc., treated intelligent gateway monitors the picture of ground smart home real scene in terminal in real time
Display also occur correspondingly to change, can also by the picture of the real scene monitored pass through computer processing technology, obtain
Virtual content corresponding with the picture of the real scene monitored after to analog simulation, those skilled in the art can manage
Solution, the processing that the embodiment of the present invention monitors the intelligent gateway of acquisition in the picture of ground smart home real scene in real time are not made specifically
It limits, as long as the thought of smart home exchange method of the embodiment of the present invention based on augmented reality can be realized.
In step s 102, the geographical location of intelligent gateway and the location information of terminal are obtained, the location information includes
The geographical position coordinates of the terminal and the terminal towards orientation, the location information is used to indicate the terminal according to institute
The geographical location for stating intelligent gateway determines the correspondence in the geographical location of the intelligent gateway and the location information of the terminal.
In specific implementation process, after establishing the communication connection of intelligent gateway and terminal, the geographical position of intelligent gateway is obtained
Set the location information with terminal, wherein the geographical location of the intelligent gateway includes at least the geographical of intelligent gateway location and sits
Mark can be positioned by home network and obtain geographical coordinate, can also be obtained geographical coordinate by base station location, can also be passed through
Other modes obtain geographical coordinate, it will be understood by those skilled in the art that geographical location of the embodiment of the present invention to intelligent gateway
Acquisition modes be not especially limited；The location information of the terminal can include at least the terminal geographical position coordinates and
The terminal towards orientation, the geographical position coordinates that positioning obtains terminal can be carried out by the network mode of terminal, also may be used
To obtain the geographical position coordinates of terminal by GPS positioning, the geographical location for obtaining terminal can also be positioned by other means
Coordinate, it will be understood by those skilled in the art that the embodiment of the present invention is not made to have to the acquisition modes of the geographical position coordinates of terminal
Body limits, the terminal towards orientation, refer to the side of the display interface direction of the terminal for opposite user's used terminal
To, can be recognized by the electronic compass of terminal the terminal towards orientation, terminal can be according to the geography of intelligent gateway
Correspondence between the geographical location of location determination intelligent gateway and the location information of terminal, can be by terminal to intelligent network
Direction, the gradient of camera etc. for sending control command adjustment intelligent gateway are closed, so that the intelligent gateway obtained monitors in real time
The picture of ground smart home real scene correspondingly changes with the variation of direction, the gradient of camera of intelligent gateway etc.,
The picture that treated intelligent gateway monitors ground smart home real scene in real time also can be with the court of the camera of intelligent gateway
Correspondingly change to the variation of, gradient etc., wherein the correspondence can be relative position coordinates, the terminal
Location information is used to indicate the geographical location that the terminal determines the intelligent gateway according to the geographical location of the intelligent gateway
With the correspondence of the location information of the terminal, can be located by the display interface and passing through towards orientation for terminal of terminal
The intelligent gateway of reason monitors the picture of ground smart home real scene in real time and the information of terminal is presented on terminal interface jointly,
The information superposition of terminal is namely monitored to the picture of ground smart home real scene in real time in the treated intelligent gateway
Picture on face is presented on terminal interface, to realize the enhancing to smart home real scene picture.
In addition, monitoring ground in real time by treated intelligent gateway towards orientation by the display interface of terminal and terminal
The picture of smart home real scene and the information of terminal are presented on jointly on preterminal viewing surface, that is, by the letter of terminal
Breath is superimposed upon the picture that the treated intelligent gateway is monitored in real time on the picture of ground smart home real scene and is presented on
On preterminal viewing surface, to realize the enhancing to smart home real scene picture, wherein the preterminal observation
Face can be preterminal perspective plane, such as ground, wall plane, that is, by the information superposition of terminal treated
The intelligent gateway monitors the image projection on the picture of ground smart home real scene to preterminal perspective plane in real time.
In step s 103, according to the correspondence, the treated intelligent gateway is monitored into ground intelligence in real time
The picture of household real scene and the information of terminal are simultaneously displayed in terminal.
In specific implementation process, determined according to the correspondence of the geographical location of intelligent gateway and the location information of terminal
The picture that treated intelligent gateway monitors ground smart home real scene in real time corresponds to the position on the display interface of terminal
It sets, while by the presentation of information of terminal on the interface of terminal.
In certain preferred embodiments, the step S103 is specifically included：
According to the position of terminal and the intelligent gateway described in the positional information calculation of the geographical location of intelligent gateway and terminal
Set correspondence；The treated intelligent gateway is monitored into ground smart home real scene in real time according to the correspondence
Picture be shown in terminal, while by the presentation of information of terminal on the picture.
It should be noted that obtaining terminal and intelligence according to the positional information calculation in the geographical location of intelligent gateway and terminal
The position correspondence of gateway determines that treated intelligent gateway monitors the intelligent family in ground in real time according to the position correspondence
Position of the picture of real scene on the display interface of terminal is occupied, while by the presentation of information of terminal treated described
On the picture of smart home real scene, the information of the terminal can be that the intelligent gateway that will be obtained monitors the intelligent family in ground in real time
Virtual content of the picture of real scene after computer treatment technology analog simulation is occupied, the information of the terminal can be according to terminal
It is distributed with the position correspondence of intelligent gateway, control life can be sent by terminal towards orientation, to intelligent gateway
The position correspondence for enabling the adjustment terminal and intelligent gateway such as direction, gradient of camera of adjustment intelligent gateway, to adjust
Distribution of the information of whole terminal on the picture of treated smart home real scene is realized to smart home real scene
The enhancing of picture, that is, augmented reality is applied on the picture of treated smart home real scene.
Wherein, the augmented reality be one kind by means of computer graphics techniques and visualization technique, virtual information is answered
The true world is used, makes that true environment and virtual object are superimposed upon the same picture in real time or space exists simultaneously, it is comprehensive
Dimension display technologies, interaction technique, sensor technology, computer vision technique and multimedia technology etc. are closed.
Further, according to the correspondence by the treated intelligent gateway monitor in real time ground smart home it is true
The picture of real field scape is shown in terminal, while further including by step of the presentation of information of terminal on the picture：
The information superposition of the terminal monitors ground smart home real scene in real time in the treated intelligent gateway
Picture on.
In the embodiment of the present invention, the augmented reality, by treated smart home real scene picture and acquisition
Intelligent gateway monitors virtual content of the picture of ground smart home real scene after computer treatment technology analog simulation in real time
It is carried out at the same time display, that is, the information of treated smart home real scene picture and terminal is carried out at the same time display,
The treated smart home real scene picture is complementary to one another with two kinds of information of information of terminal, is superimposed, can be with layer
Mode by the information superposition of terminal treated intelligent gateway monitor in real time ground smart home real scene picture on, can
The information of terminal is placed on upper layer, the picture that treated intelligent gateway monitors ground smart home real scene in real time is placed on
Lower layer, the picture that treated intelligent gateway can also in real time be monitored to ground smart home real scene are placed on upper layer, terminal
Information be placed on lower layer, it should be understood that the embodiment of the present invention is not especially limited the mode of layer, as long as augmented reality can be highlighted
Effect.
In step S104, interacted with the picture for being shown in the terminal.
In specific implementation process, App is controlled by the smart home operative scenario that terminal is supported, user can be to intelligence
The operative scenario of home equipment is very clear, is shown in the treated smart home real scene picture and terminal of terminal
The overlay drafting of information, enhances the picture of the smart home real scene of acquisition, and user can be with the process that is shown in terminal
The Intelligent household scene that the smart home real scene picture of processing and the overlay drafting of the information of terminal are presented carries out long-range
Interaction can change smart home operative scenario, to realize and intelligence by changing the working condition of smart home device
Interaction between household operative scenario, such as：App is controlled by the smart home operative scenario that terminal is supported to carry out with smart home
Remote interaction.
An embodiment of the present invention provides a kind of smart home exchange method based on augmented reality, by intelligent network
It closes and establishes communication connection between terminal, obtain intelligent gateway and monitor the picture of ground smart home real scene in real time and located
The location information for managing, obtaining the geographical location and terminal of intelligent gateway, according to the geographical location of the intelligent gateway and the end
The correspondence of the location information at end, by the information superposition of terminal on the picture of treated smart home real scene,
And be shown in terminal, it interacts with the picture for being shown in the terminal, is realized by augmented reality to reach
The purpose that remote interaction is carried out with smart home provides the application embodiment that a real body faces in family to be operated in outer people, carries
Rise user experience effect.
Embodiment two：
Fig. 2 shows a kind of smart home interactive devices based on augmented reality that third embodiment of the invention provides
Structure, details are as follows：
Picture acquiring unit 21 monitors picture and the progress of ground smart home real scene for obtaining intelligent gateway in real time
Processing.
In specific implementation process, it is necessary first to the communication connection between the intelligent gateway and terminal is established, therefore：It is described
Smart home interactive device based on augmented reality further includes：
Communication unit 20 connects for establishing the connection of the communication between the intelligent gateway and terminal, and by the communication
Connect the protocol information one for transmitting the intelligent gateway and being communicated with terminal, the agreement that the terminal is communicated with intelligent gateway
Information two.
Communication unit establishes the connection of the communication between the intelligent gateway and terminal, described in communication connection transmission
The protocol information two that protocol information one that intelligent gateway is communicated with terminal, the terminal are communicated with intelligent gateway,
In, the protocol information one that intelligent gateway is communicated with terminal can supervise the intelligent gateway that picture acquiring unit obtains in real time
The information such as geodetic smart home real scene picture, into terminal transmission process, be transformed to that terminal can identify with it is described
Intelligent gateway monitors the change scaling method of the ground corresponding information of information such as smart home real scene picture in real time, can also be by
The intelligent gateway of acquisition monitors the algorithm that ground smart home real scene picture is handled in real time, such as：Image processing algorithm, it
Afterwards, treated intelligent gateway is monitored to ground smart home real scene picture transmission in real time to terminal, and terminal and intelligence
The protocol information two that gateway is communicated can be will be by interactive command information or other information that terminal inputs, to intelligence
Can in gateway transmission process, be transformed to intelligent gateway can identify it is corresponding with the interactive command information or other information
Information change scaling method.
In certain preferred embodiments, the communication connection between the intelligent gateway and terminal can pass through WiFi, indigo plant
Tooth, other wireless modes or wired mode are attached, and to this communication connection type, the present invention is not especially limited.
After establishing communication connection between intelligent gateway and terminal, intelligent gateway automatically turns on included camera, picture
Real scene before the camera of intelligent gateway is monitored by acquiring unit, and the camera carried according to intelligent gateway monitors
Range determine the range of the picture of monitored real scene, when the camera that intelligent gateway is carried direction, tilt
Degree etc. is adjusted, and the picture of the real scene monitored correspondingly changes, the real scene that can will be monitored
Picture handled, such as：Storage, transmission, is decomposed, is reconfigured at compression of images, correspondingly, when included to intelligent gateway
Direction, the gradient of camera etc. be adjusted, treated intelligent gateway monitors ground smart home real scene in real time
Picture also occur correspondingly to change in the display of terminal, can also by the picture of the real scene monitored pass through computer
Treatment technology obtains the virtual content corresponding with the picture of the real scene monitored after analog simulation, this field skill
Art personnel are appreciated that the embodiment of the present invention monitors the intelligent gateway of acquisition in the picture of ground smart home real scene in real time
Processing is not especially limited, as long as the think of of smart home exchange method of the embodiment of the present invention based on augmented reality can be realized
Think.
Position acquisition unit 22, the location information in geographical location and terminal for obtaining intelligent gateway, the position letter
Breath include the terminal geographical position coordinates and the terminal towards orientation, the location information is used to indicate the terminal
Pair in the geographical location of the intelligent gateway and the location information of the terminal is determined according to the geographical location of the intelligent gateway
It should be related to.
In specific implementation process, after establishing the communication connection of intelligent gateway and terminal, position acquisition unit obtains intelligence
The geographical location of gateway and the location information of terminal, wherein the geographical location of the intelligent gateway includes at least intelligent gateway institute
Geographical coordinate on ground can be positioned by home network and obtain geographical coordinate, and geographical sit can also be obtained by base station location
Mark, can also obtain geographical coordinate, it will be understood by those skilled in the art that the embodiment of the present invention is to intelligent network by other means
The acquisition modes in the geographical location of pass are not especially limited；The location information of the terminal can include at least the ground of the terminal
Manage position coordinates and the terminal towards orientation, the geographical position that positioning obtains terminal can be carried out by the network mode of terminal
Coordinate is set, the geographical position coordinates of terminal can also be obtained by GPS positioning, acquisition terminal can also be positioned by other means
Geographical position coordinates, it will be understood by those skilled in the art that acquisition of the embodiment of the present invention to the geographical position coordinates of terminal
Mode is not especially limited, the terminal towards orientation, refer to display circle of the terminal for opposite user's used terminal
Facing towards direction, can be recognized by the electronic compass of terminal the terminal towards orientation, terminal can be according to intelligence
The geographical location of gateway determines the correspondence between the geographical location of intelligent gateway and the location information of terminal, can pass through end
It holds to intelligent gateway and sends direction, the gradient of camera etc. that interactive command adjusts intelligent gateway, so that the intelligent network obtained
The picture of the real-time monitoring ground smart home real scene in pass phase with the variation of direction, the gradient of camera of intelligent gateway etc.
Change with answering, the picture that treated intelligent gateway monitors ground smart home real scene in real time also can taking the photograph with intelligent gateway
The variation of direction, gradient as head etc. and correspondingly change, wherein the correspondence can be relative position coordinates, institute
The location information for stating terminal is used to indicate the terminal and determines the intelligent gateway according to the geographical location of the intelligent gateway
The correspondence of the location information of geographical location and the terminal, can be by the display interface of terminal and terminal towards orientation
The information of picture and terminal that treated intelligent gateway is monitored to ground smart home real scene in real time is presented on end jointly
Hold interface on, that is, by the information superposition of terminal the treated intelligent gateway monitor in real time smart home it is true
Picture on the picture of scene is presented on terminal interface, to realize the enhancing to smart home real scene picture.
In addition, monitoring ground in real time by treated intelligent gateway towards orientation by the display interface of terminal and terminal
The picture of smart home real scene and the information of terminal are presented on jointly on preterminal viewing surface, that is, by the letter of terminal
Breath is superimposed upon the picture that the treated intelligent gateway is monitored in real time on the picture of ground smart home real scene and is presented on
On preterminal viewing surface, to realize the enhancing to smart home real scene picture, wherein the preterminal observation
Face can be preterminal perspective plane, such as ground, wall plane, that is, by the information superposition of terminal treated
The intelligent gateway monitors the image projection on the picture of ground smart home real scene to preterminal perspective plane in real time.
Picture display unit 23, for according to the correspondence, the treated intelligent gateway to be monitored in real time
The picture of ground smart home real scene and the information of terminal are simultaneously displayed in terminal.
In specific implementation process, picture display unit 23 can be according to the geographical location of intelligent gateway and the position of terminal
The correspondence of information determines that treated intelligent gateway monitors the picture correspondence of ground smart home real scene at end in real time
Position on the display interface at end, while by the presentation of information of terminal on the interface of terminal.
In certain preferred embodiments, the picture display unit 23 further includes：
Computing unit 230, for according to terminal described in the geographical location of intelligent gateway and the positional information calculation of terminal with
The position correspondence of the intelligent gateway；
Sprite display unit 231, for being supervised the treated intelligent gateway in real time according to the correspondence
The picture of geodetic smart home real scene is shown in terminal, while by the presentation of information of terminal on the picture.
It should be noted that computing unit obtains end according to the geographical location of intelligent gateway and the positional information calculation of terminal
The position correspondence at end and intelligent gateway, sprite display unit determine treated intelligence according to the position correspondence
Can gateway monitor in real time smart home real scene position of the picture on the display interface of terminal, while by the letter of terminal
Breath is shown on the picture of the treated smart home real scene, and the information of the terminal can be the intelligence that will be obtained
Energy gateway monitors virtual content of the picture of ground smart home real scene after computer treatment technology analog simulation in real time, should
The information of terminal can be distributed according to the position correspondence of terminal and intelligent gateway, can pass through the direction side of terminal
Adjustment terminal and the intelligent networks such as position, direction, the gradient of camera that interactive command adjustment intelligent gateway is sent to intelligent gateway
The position correspondence of pass, so as to adjust terminal information on the picture of treated smart home real scene point
Cloth realizes the enhancing to smart home real scene picture, that is, augmented reality is applied to treated smart home
On the picture of real scene.
Wherein, the augmented reality be one kind by means of computer graphics techniques and visualization technique, virtual information is answered
The true world is used, makes that true environment and virtual object are superimposed upon the same picture in real time or space exists simultaneously, it is comprehensive
Dimension display technologies, interaction technique, sensor technology, computer vision technique and multimedia technology etc. are closed.
Further, the sprite display unit 231 further includes：
Superpositing unit 2310, the information superposition for the terminal monitor ground in real time in the treated intelligent gateway
On the picture of smart home real scene.
In the embodiment of the present invention, the augmented reality, by treated smart home real scene picture and acquisition
Intelligent gateway monitors virtual content of the picture of ground smart home real scene after computer treatment technology analog simulation in real time
It is carried out at the same time display, that is, the information of treated smart home real scene picture and terminal is carried out at the same time display,
The treated smart home real scene picture is complementary to one another with two kinds of information of information of terminal, is superimposed by superpositing unit,
The information superposition of terminal can be monitored into ground smart home real scene in real time in treated intelligent gateway in a manner of layer
Picture on, the information of terminal can be placed on to upper layer, treated intelligent gateway monitors the ground true field of smart home in real time
The picture of scape is placed on lower layer, and the picture that treated intelligent gateway can also in real time be monitored to ground smart home real scene is put
On upper layer, the information of terminal is placed on lower layer, it should be understood that the embodiment of the present invention is not especially limited the mode of layer, as long as energy
Highlight the effect of augmented reality.
Interactive unit 24, for being interacted with the picture for being shown in the terminal.
In specific implementation process, App is interacted by the smart home operative scenario that terminal is supported, user can be to intelligence
The operative scenario of home equipment is very clear, is shown in the treated smart home real scene picture and terminal of terminal
The overlay drafting of information, enhances the picture of the smart home real scene of acquisition, and user can be with display by interactive unit
In the smart home that the overlay drafting of the information of the treated smart home real scene picture and terminal of terminal is presented
Scene carries out remote interaction, can change smart home operative scenario by changing the working condition of smart home device, from
And realize the interaction between smart home operative scenario, such as：By terminal support smart home operative scenario interact App with
Smart home carries out remote interaction.
An embodiment of the present invention provides a kind of smart home interactive device based on augmented reality, passes through communication unit
Communication connection is established between intelligent gateway and terminal, it is true that picture acquiring unit acquisition intelligent gateway monitors ground smart home in real time
The picture of real field scape is simultaneously handled, and position acquisition unit obtains the location information in the geographical location and terminal of intelligent gateway, is drawn
Face display unit is according to the correspondence in the geographical location of the intelligent gateway and the location information of the terminal, by the letter of terminal
Breath is superimposed upon treated intelligent gateway and monitors in real time on the picture of ground smart home real scene, and is shown in terminal,
Interactive unit is interacted according to the picture for being shown in the terminal, and long-range hand over is realized by augmented reality to reach
The purpose of mutual smart home provides the application embodiment that a real body faces in family to be operated in outer people, promotes user experience effect
Fruit.
Embodiment three：
Fig. 3 shows a kind of smart home interactive system based on augmented reality that third embodiment of the invention provides
Structure, details are as follows：
The smart home interactive system based on augmented reality includes：Intelligent gateway 30 is based on augmented reality skill
The smart home interactive device 31 of art, terminal 32, wherein
The smart home interactive device 31 based on augmented reality is as shown in Figure 2 based on augmented reality
Smart home interactive device, can be arranged with the terminal 32 and be integrated, alternatively, can also be set as with the terminal 32 point
From part.
The terminal can be any intelligent terminals such as intelligent glasses, smartwatch, smart mobile phone；The intelligent gateway,
As the core of intelligent domestic system, various smart home devices are converged into home network, are and various smart home devices
The hinge interacted.It will be understood by those skilled in the art that as long as the intelligence the present invention is based on augmented reality can be realized
The thought of household exchange method, the embodiment of the present invention do not do the terminal, the specific manifestation form of the intelligent gateway
It limits.
The smart home interactive system based on augmented reality that an embodiment of the present invention provides a kind of, by intelligent network
It closes and establishes communication connection between terminal, obtain intelligent gateway and monitor the picture of ground smart home real scene in real time and located
The location information for managing, obtaining the geographical location and terminal of intelligent gateway, according to the geographical location of the intelligent gateway and the end
The information superposition of terminal is monitored ground smart home by the correspondence of the location information at end in real time in treated intelligent gateway
It on the picture of real scene, and is shown in terminal, is interacted according to the picture for being shown in the terminal, it is logical to reach
The purpose that augmented reality realizes remote interaction smart home is crossed, the people to be operated in outer provides a real body and faces in family
Using embodiment, user experience effect is promoted.
One of ordinary skill in the art will appreciate that implement the method for the above embodiments be can be with
Relevant hardware is instructed to complete by program, the program can be stored in a computer read/write memory medium,
The storage medium, such as ROM/RAM, disk, CD.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
All any modification, equivalent and improvement etc., should all be included in the protection scope of the present invention made by within refreshing and principle.
Claims (9)
1. a kind of smart home exchange method based on augmented reality, which is characterized in that the method includes the steps：
Intelligent gateway is obtained to monitor the picture of ground smart home real scene in real time and handled；
The location information in the geographical location and terminal of intelligent gateway is obtained, the location information includes the geographical location of the terminal
Coordinate and the terminal towards orientation, the location information is used to indicate geographical position of the terminal according to the intelligent gateway
Set the correspondence in the geographical location and the location information of the terminal that determine the intelligent gateway；Wherein, the court of the terminal
Refer to the direction of the display interface direction of the terminal for opposite user's used terminal to orientation, by terminal to intelligent network
Direction, the gradient for closing the camera for sending control command adjustment intelligent gateway, so that the intelligent gateway obtained monitors ground in real time
The picture of smart home real scene correspondingly changes with the variation of the direction, gradient of the camera of intelligent gateway, passes through
The intelligent gateway of processing monitor in real time ground smart home real scene picture also can with the camera of intelligent gateway direction, incline
The variation of gradient and correspondingly change；
According to the correspondence, the treated intelligent gateway is monitored to the picture of ground smart home real scene in real time
It is simultaneously displayed in terminal with the information of terminal；
It is interacted with the picture for being shown in the terminal.
2. the smart home exchange method based on augmented reality as described in claim 1, which is characterized in that obtained described
Before taking intelligent gateway to monitor the picture of ground smart home real scene in real time and carrying out processing step, further include：Described in foundation
Communication connection between intelligent gateway and terminal, and the intelligent gateway is transmitted by communication connection and is communicated with terminal
Protocol information one, the protocol information two that is communicated with intelligent gateway of the terminal.
3. the smart home exchange method based on augmented reality as described in claim 1, which is characterized in that the basis
The picture that the treated intelligent gateway monitors ground smart home real scene in real time is included at end by the correspondence
Step on end, including：
According to the position pair of terminal and the intelligent gateway described in the positional information calculation of the geographical location of intelligent gateway and terminal
It should be related to；
The treated intelligent gateway is monitored to the picture of ground smart home real scene in real time according to the correspondence
It is shown in terminal, while by the presentation of information of terminal on the picture.
4. the smart home exchange method based on augmented reality as claimed in claim 3, which is characterized in that the basis
The picture that the treated intelligent gateway is monitored ground smart home real scene by the correspondence in real time includes at end
On end, while by step of the presentation of information of terminal on the picture further including：
The information superposition of the terminal monitors the picture of ground smart home real scene in the treated intelligent gateway in real time
On face.
5. a kind of smart home interactive device based on augmented reality, which is characterized in that described device includes：
Picture acquiring unit, for obtain intelligent gateway monitor in real time ground smart home real scene picture and handled；
Position acquisition unit, the location information in geographical location and terminal for obtaining intelligent gateway, the location information include
The geographical position coordinates of the terminal and the terminal towards orientation, the location information is used to indicate the terminal according to institute
The geographical location for stating intelligent gateway determines the correspondence in the geographical location of the intelligent gateway and the location information of the terminal；
Wherein, the terminal towards orientation, refer to the side of the display interface direction of the terminal for opposite user's used terminal
To, direction, the gradient that control command adjusts the camera of intelligent gateway are sent to intelligent gateway by terminal, so as to obtain
Intelligent gateway monitor in real time ground smart home real scene picture with intelligent gateway camera direction, gradient variation
And correspondingly change, the picture that treated intelligent gateway monitors ground smart home real scene in real time also can be with intelligent gateway
Camera direction, gradient variation and correspondingly change；
Picture display unit, for according to the correspondence, the treated intelligent gateway to be monitored ground intelligence in real time
The picture of household real scene and the information of terminal are simultaneously displayed in terminal；
Interactive unit, for being interacted with the picture for being shown in the terminal.
6. the smart home interactive device based on augmented reality as claimed in claim 5, which is characterized in that described device
Further include：
Communication unit for establishing the connection of the communication between the intelligent gateway and terminal, and is connected by the communication and is transmitted
The protocol information that protocol information one that the intelligent gateway is communicated with terminal, the terminal are communicated with intelligent gateway
Two.
7. the smart home interactive device based on augmented reality as claimed in claim 5, which is characterized in that the picture
Display unit further includes：
Computing unit, for according to terminal described in the geographical location of intelligent gateway and the positional information calculation of terminal and the intelligence
The position correspondence of gateway；
Sprite display unit, for the treated intelligent gateway to be monitored ground intelligence in real time according to the correspondence
The picture of household real scene is shown in terminal, while by the presentation of information of terminal on the picture.
8. the smart home interactive device based on augmented reality as claimed in claim 7, which is characterized in that the sub- picture
Face display unit further includes：
Superpositing unit, the information superposition for the terminal monitor ground smart home in real time in the treated intelligent gateway
On the picture of real scene.
9. a kind of smart home interactive system based on augmented reality, which is characterized in that the system comprises：
Intelligent gateway, terminal, the smart home interactive device based on augmented reality, wherein
The smart home interactive device based on augmented reality includes that claim 5-8 any one of them is based on enhancing
The smart home interactive device of reality technology is integrated with terminal setting, alternatively, being set as the portion detached with the terminal
Point.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510340763.5A CN105204347B (en) | 2015-06-18 | 2015-06-18 | Smart home exchange method based on augmented reality, device and system |
| PCT/CN2016/077195 WO2016202034A1 (en) | 2015-06-18 | 2016-03-24 | Reality enhancement-based smart home interaction method, and device and system utilizing same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510340763.5A CN105204347B (en) | 2015-06-18 | 2015-06-18 | Smart home exchange method based on augmented reality, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105204347A CN105204347A (en) | 2015-12-30 |
| CN105204347B true CN105204347B (en) | 2018-11-09 |
Family
ID=54952094
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510340763.5A Active CN105204347B (en) | 2015-06-18 | 2015-06-18 | Smart home exchange method based on augmented reality, device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105204347B (en) |
| WO (1) | WO2016202034A1 (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105204347B (en) * | 2015-06-18 | 2018-11-09 | 丰唐物联技术（深圳）有限公司 | Smart home exchange method based on augmented reality, device and system |
| CN105843054A (en) * | 2016-03-22 | 2016-08-10 | 美的集团股份有限公司 | Method for controlling household devices, intelligent household system and mobile device |
| CN105827494B (en) * | 2016-05-20 | 2018-12-07 | 珠海格力电器股份有限公司 | Add the methods, devices and systems of equipment |
| CN105955043B (en) * | 2016-05-27 | 2019-02-01 | 浙江大学 | A kind of visible i.e. controllable intelligent home furnishing control method of augmented reality type |
| CN107528752B (en) * | 2016-06-22 | 2020-11-20 | 佛山市顺德区美的电热电器制造有限公司 | Control system and virtual reality projection arrangement of intelligence household electrical appliances |
| CN108109207B (en) * | 2016-11-24 | 2021-11-05 | 深圳市豪恩安全科技有限公司 | Visual three-dimensional modeling method and system |
| CN107168091A (en) * | 2017-06-30 | 2017-09-15 | 成都智建新业建筑设计咨询有限公司 | A kind of smart home interactive system based on virtual reality technology |
| CN109979012A (en) * | 2017-12-27 | 2019-07-05 | 北京亮亮视野科技有限公司 | Show the method and device of message informing |
| CN108958057A (en) * | 2018-08-01 | 2018-12-07 | 珠海格力电器股份有限公司 | The control method and device of household appliance, storage medium, electronic device |
| CN108931924B (en) * | 2018-08-06 | 2020-02-28 | 珠海格力电器股份有限公司 | Control method and device of intelligent household system, processor and storage medium |
| US11521384B1 (en) | 2019-07-01 | 2022-12-06 | Alarm.Com Incorporated | Monitoring system integration with augmented reality devices |
| CN114615430B (en) * | 2022-03-07 | 2022-12-23 | 清华大学 | Interaction method and device between mobile terminal and external object and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103971401A (en) * | 2013-02-01 | 2014-08-06 | 索尼公司 | Information Processing Device, Terminal Device, Information Processing Method, And Programme |
| CN104460330A (en) * | 2014-11-04 | 2015-03-25 | 宁波工程学院 | Augmented reality and remote control method based on indoor positioning and electronic compass |
| CN104717190A (en) * | 2013-12-13 | 2015-06-17 | 广州杰赛科技股份有限公司 | Wireless augmented reality transmission method |
| CN104717264A (en) * | 2013-12-13 | 2015-06-17 | 广州杰赛科技股份有限公司 | Cross-platform multi-screen interaction data sharing equipment |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101699858A (en) * | 2009-11-06 | 2010-04-28 | 深圳华为通信技术有限公司 | Control method of camera head, control terminal and camera system |
| JP2012037919A (en) * | 2010-08-03 | 2012-02-23 | Doshisha | Information appliance operating system using augmented reality technology |
| US9342928B2 (en) * | 2011-06-29 | 2016-05-17 | Honeywell International Inc. | Systems and methods for presenting building information |
| AU2013213701A1 (en) * | 2012-07-27 | 2014-02-13 | Cavtec Pty Ltd | Method and system for augmented reality |
| CN103105993B (en) * | 2013-01-25 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Method and system for realizing interaction based on augmented reality technology |
| US9395810B2 (en) * | 2013-05-28 | 2016-07-19 | The Boeing Company | Ubiquitous natural user system |
| CN104301661B (en) * | 2013-07-19 | 2019-08-27 | 南京中兴软件有限责任公司 | A kind of smart home monitoring method, client and related device |
| CN104199304A (en) * | 2014-09-24 | 2014-12-10 | 江苏红叶视听器材股份有限公司 | Home intelligent safety control system |
| CN204086973U (en) * | 2014-09-28 | 2015-01-07 | 季鸿 | A kind of intelligent domestic system |
| CN105204347B (en) * | 2015-06-18 | 2018-11-09 | 丰唐物联技术（深圳）有限公司 | Smart home exchange method based on augmented reality, device and system |
-
2015
- 2015-06-18 CN CN201510340763.5A patent/CN105204347B/en active Active
-
2016
- 2016-03-24 WO PCT/CN2016/077195 patent/WO2016202034A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103971401A (en) * | 2013-02-01 | 2014-08-06 | 索尼公司 | Information Processing Device, Terminal Device, Information Processing Method, And Programme |
| CN104717190A (en) * | 2013-12-13 | 2015-06-17 | 广州杰赛科技股份有限公司 | Wireless augmented reality transmission method |
| CN104717264A (en) * | 2013-12-13 | 2015-06-17 | 广州杰赛科技股份有限公司 | Cross-platform multi-screen interaction data sharing equipment |
| CN104460330A (en) * | 2014-11-04 | 2015-03-25 | 宁波工程学院 | Augmented reality and remote control method based on indoor positioning and electronic compass |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105204347A (en) | 2015-12-30 |
| WO2016202034A1 (en) | 2016-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105204347B (en) | Smart home exchange method based on augmented reality, device and system | |
| JP6771101B2 (en) | HMD transition to focus on specific content in virtual reality environment | |
| CN105814626B (en) | Method and apparatus for providing enhancement information | |
| US8046408B2 (en) | Virtual reality systems and methods | |
| CN106097245B (en) | A kind for the treatment of method and apparatus of panorama 3D video image | |
| CN110999281A (en) | Spatially reliable telepresence supporting varying geometries and mobile users | |
| KR101277906B1 (en) | Method and apparatus for creating virtual graffiti in a mobile virtual and augmented reality system | |
| KR101839122B1 (en) | A multi-access virtual space provisioning system linked with a multi-user real space location system and a method for providing 3D virtual reality images in a multiple access virtual space | |
| CN106165415A (en) | Stereos copic viewing | |
| JP2017511615A (en) | Video interaction between physical locations | |
| CN107426508A (en) | A kind of method that long-range security inspection is realized using AR | |
| CN104881114A (en) | Angle rotation real-time matching method based on try wearing of 3D (three dimensional) glasses | |
| US20220301270A1 (en) | Systems and methods for immersive and collaborative video surveillance | |
| CN105005441B (en) | A kind of display methods and electronic equipment of instant video | |
| US20220407902A1 (en) | Method And Apparatus For Real-time Data Communication in Full-Presence Immersive Platforms | |
| CN107329268A (en) | A kind of utilization AR glasses realize the shared method in sight spot | |
| CN107894842A (en) | Augmented reality scene restored method, terminal and computer-readable recording medium | |
| CN110971678A (en) | Immersive visual campus system based on 5G network | |
| US20220404620A1 (en) | Methods and devices related to extended reality | |
| CN107623812A (en) | A kind of method, relevant apparatus and system for realizing outdoor scene displaying | |
| CN106569044B (en) | Electromagnetic spectrum situation observation method based on immersed system of virtual reality | |
| KR101839118B1 (en) | A multi-access virtual space provisioning system linked with a multi-user real space location system | |
| CN109478342A (en) | Image display device and image display system | |
| CN108366232A (en) | A kind of intelligent video monitoring system based on mobile terminal virtual reality technology | |
| CN104735380A (en) | Multi-projection immersion display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |