CN107783648A - interaction method and system - Google Patents

interaction method and system Download PDF

Info

Publication number
CN107783648A
CN107783648A CN201610809899.0A CN201610809899A CN107783648A CN 107783648 A CN107783648 A CN 107783648A CN 201610809899 A CN201610809899 A CN 201610809899A CN 107783648 A CN107783648 A CN 107783648A
Authority
CN
China
Prior art keywords
image data
user
electronic device
virtual objects
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610809899.0A
Other languages
Chinese (zh)
Other versions
CN107783648B (en
Inventor
李钟彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Home Makeup Co ltd
Original Assignee
Home Makeup Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Home Makeup Co ltd filed Critical Home Makeup Co ltd
Publication of CN107783648A publication Critical patent/CN107783648A/en
Application granted granted Critical
Publication of CN107783648B publication Critical patent/CN107783648B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2016Rotation, translation, scaling

Abstract

The invention provides an interaction method and an interaction system, which are completely different from the application mode of the prior art, and provide the interaction method and the interaction system which can be used for enabling a plurality of users to interact between virtual reality image data and augmented reality image data.

Description

Interactive approach and system
Technical field
It can be used for allowing multiple users in a void the present invention relates to a kind of interactive approach and system, and more particularly to one kind Intend real border (Virtual Reality, VR) image data and an augmented reality (Augmented Reality, AR) image data Between carry out interaction interactive approach and system.
Background technology
In general, designer is often by simple when helping consumer to carry out the furniture installation of indoor decoration Still image or model carry out ornaments suggestion to consumer, or are more directly with physical commodity, to come to personally to room Interior scene is furnished.But for consumers, if designer is to be built by still image or model to carry out ornaments If view, consumer is then often the mode that must pass through the imagination, to decide whether the suitable hobby of oneself, and is easily only set The account given by one party only of teacher is counted, and is had not been able to so that consumer has good experience effect.
However, in other situations, when designer is then directly with physical commodity, to come to personally to indoor scene During being furnished, shortcoming is exactly when physical commodity is reached in family, if feeling improper, including size is not to, actual material It is very big with photo difference, or be ornaments after with family environment space be not suitable for etc., then can run into the return of goods inconvenience, freight charges damage Lose, or the problem of even harmful designer makes a fruitless trip, these factors all possibly slattern designer and consumer when Between and money.In view of this, how to improve the interaction of designer and consumer when carrying out furniture installation, and effectively avoid wave Take time and the money of designer or consumer, be really the problem of art urgent need to resolve.
The content of the invention
In view of this, the embodiment of the present invention provides a kind of interactive approach and system, and can be used for allowing more particularly to one kind Multiple users carry out the interactive approach and system of interaction between a virtual reality image data and an augmented reality image data.
The embodiment of the present invention provides a kind of interactive approach, for allowing multiple users in a virtual reality image data and one Carried out between augmented reality image data interactive.The step of interactive approach, is as follows.First, at least one first user operation the One electronic installation, and cause the first electronic installation to acquire the actual environment where being associated with one second user at present according to this One image data in space.Secondly, according to a merchandising database, the first user to selected in merchandising database since then to Few one first virtual objects, and the loading of this first virtual objects is positioned over to the first default location in image data, with by means of This causes the first electronic installation to generate the first control instruction, wherein the first control instruction is included with this first virtual objects Dimensional parameters, and this first virtual objects are placed on the coordinate parameters in image data.Then, the second user operates One second electronic device, and cause second electronic device to according to the first received control instruction, and second according to this Actual environment space where user is current, to build up with reference to the augmented reality image number containing this first virtual objects According to, and second electronic device then can be further according to the viewing position operated by the second user during second electronic device and viewing angle Degree, and dimensional parameters and coordinate parameters in the first control instruction, to establish out this first virtual objects and augmented reality shadow The relative position relation during display screen being presented on second electronic device is combined as data.
Preferably, the image data obtained acquired in the first electronic installation, that is, it is expressed as being associated with the second user current The virtual reality image data in the actual environment space at place, and first and second electronic installation communicates to pass through at least one Agreement reaches being in communication with each other to each other.
The embodiment of the present invention separately provides a kind of interaction systems, for allowing multiple users in a virtual reality image data and Carried out between one augmented reality image data interactive.The interaction systems include merchandising database, the first electronic installation and second Electronic installation.Wherein, the first electronic installation is supplied to operated by few one first user, and the first electronic installation is acquiring Be associated with one second user at present where actual environment space an image data, and according to this cause the first user to At least one first virtual objects are selected from merchandising database, and the loading of this first virtual objects is positioned in image data The first default location, with whereby cause the first electronic installation generate the first control instruction, wherein the first control instruction includes Dimensional parameters with this first virtual objects, and this first virtual objects are placed on the coordinate ginseng in image data Number.In addition, second electronic device is then supplied operated by the second user, and second electronic device is to according to received first Control instruction, and the actual environment space at the current place of the second user, contain this first virtual objects to build up to combine Augmented reality image data, and second electronic device then can be further according to operated by the second user during second electronic device Dimensional parameters and coordinate parameters in viewing position and viewing angle, and the first control instruction, it is first virtual to establish out this Relative position when object and augmented reality image data are combined the display screen being presented on second electronic device is closed System.
Preferably, the image data obtained acquired in the first electronic installation, that is, it is expressed as being associated with the second user current The virtual reality image data in the actual environment space at place, and first and second electronic installation communicates to pass through at least one Agreement reaches being in communication with each other to each other.
In summary, the interactive approach and system that the embodiment of the present invention is provided, will be totally different from existing prior art Application mode, and there is provided and a kind of can be used for allowing multiple users in a virtual reality image data and an augmented reality shadow Interactive approach and system as carrying out interaction between data, therefore the interactive approach of the embodiment of the present invention and system, can to set Meter teacher can not have to be limited to the regional limitation in use environment, and cause consumer more can intuitively experience virtual business The characteristic of product, whereby and then to provide good interaction effect.
For the enabled feature and technology contents for being further understood that the present invention, refer to below in connection with the present invention specifically Bright and accompanying drawing, but these explanations are intended merely to the explanation present invention, rather than the right model to the present invention with brief description of the drawings book accompanying drawing Enclose and make any limitation.
Brief description of the drawings
Fig. 1 is the application schematic diagram for the interaction systems that the embodiment of the present invention is provided.
Fig. 2 is the schematic flow sheet for the interactive approach that the embodiment of the present invention is provided.
Fig. 3 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided.
Fig. 4 is the application schematic diagram for the interaction systems that another embodiment of the present invention is provided.
Fig. 5 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided.
Fig. 6 is the application schematic diagram for the interaction systems that another embodiment of the present invention is provided.
Fig. 7 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided.
Fig. 8 is the application schematic diagram for the interaction systems that another embodiment of the present invention is provided.
Fig. 9 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided.
Figure 10 is the application schematic diagram for the interaction systems that another embodiment of the present invention is provided.
Embodiment
Hereinafter, the present invention will be described in detail by the various embodiments of the schema explanation present invention.It is however, of the invention Concept may embody in many different forms, and should not be construed as limited by exemplary embodiments set forth herein.In addition, Same reference numbers can be used to represent similar component in the drawings.
First, referring to Fig. 1, the application schematic diagram for the interaction systems that Fig. 1, which is the embodiment of the present invention, to be provided.Interaction systems 10 mainly include merchandising database 101, the first electronic installation 103 and second electronic device 105.Wherein, the first electronic installation 103 can be supplied to operated by few one first user 103a, and second electronic device 105 can be then to supply one second user Operated by 105a.Therefore, in practice, it may be, for example, a designer that the first user 103a, which is, and the second user 105a then may be used A for example, consumer.However, it is noted that in order to facilitate following explanation, the first user of the embodiment of the present invention 103a is illustrated using the example that quantity is only 1, but it is not intended to limiting the invention.
In addition, as described in previous contents, when being then that directly band is really in the first user 103a (that is, designer) Body commodity, to come to personally into the second user 105a (that is, consumer) family come in the case of being furnished, if after ornaments Physical commodity and the second user 105a family in environment when not feeling suitable, be then often that can waste to the first user 103a or the second user 105a time and money.Therefore, compared to prior art, the first user of the embodiment of the present invention 103a is then need not be with physical commodity, to come to personally into the second user 105a family to be furnished.In other words, first User 103a and the second user 105a operates the use ring of the first electronic installation 103 and second electronic device 105 respectively Border, then can be not two places of identical completely.
For example, the first user 103a may be, for example, in a design lawyer's offices, operate the first electronic installation 103 to the second user 105a (that is, consumer) by a virtual reality image data to carry out ornaments suggestion.Similarly, Second user 105a may be, for example, then in the family of its own, operate second electronic device 105 with by an augmented reality Image data watches the ornaments suggestion that the first user 103a (that is, designer) is provided.Therefore, according to the above Teaching, in the art the usually intellectual of having should be appreciated that one of main spirits of the invention are to be, are used for Allow multiple users to carry out interaction between a virtual reality image data and an augmented reality image data, overcome with reaching whereby Regional limitation in use environment.Wherein, it is worth mentioning at this point that, in practice, the first electronic installation 103 may be, for example, a line Dynamic communication device, a desktop computer, a notebook computer, a tablet PC, or even head mounted display etc., and Second electronic device 105 may be, for example, then a head mounted display, but the present invention is all not limited thereto system.
In addition, it is to be understood that the first electronic installation 103 and second electronic device 105 can also be separately by At least communications protocol interface (not illustrating) that is each possessed is online to an internet (not illustrating).Therefore, the first electronics Device 103 can be then to reach being in communication with each other to each other by this at least communications protocol with second electronic device 105. In addition, merchandising database 101 can be simultaneously be built into the first electronic installation 103 and/or second electronic device 105 it In, or be, merchandising database 101 can similarly to by this at least communications protocol come with the first electronic installation 103 And/or second electronic device 105 carries out the transmission of data.Sum it up, the embodiment of the present invention is also unlimited to be formed with underlying commodity data The specific implementation in storehouse 101, the first electronic installation 103 or second electronic device 105.
In more detail, the first electronic installation 103 is associated with the current places of the second user 105a to acquire The one image data 110a in actual environment space 110, and cause the first user 103a to from merchandising database 101 according to this At least one first virtual objects 120 are selected, and the loading of this first virtual objects 120 is positioned in image data 110a One first default location, to cause the first electronic installation 130 to generate one first control instruction TS1 whereby.Wherein first control TS1 is instructed to include the dimensional parameters with this first virtual objects 120, and this first virtual objects 120 is placed on shadow As the coordinate parameters in data 110a.
Then, second electronic device 105 is then to according to the first received control instruction TS1, and the second use Actual environment space 110 where person 105a is current, to build up with reference to the augmented reality image containing the first virtual objects 120 Data 110b.It is to be a virtual goodses (also however, it is noted that due to the main purpose of augmented reality technology That is, the first virtual objects 120) cover in a real world to carry out interaction.Therefore, (that is, the head of second electronic device 105 Head mounted displays) it can not only will be shown in its display screen outside the image frame containing this virtual goods, can be with Further according to user operation and position and the angle of real-time operation second electronic device 105, with this image frame of relative changes Presentation content.
Therefore, teaching according to the above, in the art the usually intellectual of having should be appreciated that, when second In the case that electronic installation 105 has built up the augmented reality image data 110b containing the first virtual objects 120, the second electricity Sub-device 105 then can further according to the viewing position operated by the second user 105a during second electronic device 105 and viewing angle, And the first dimensional parameters and coordinate parameters in control instruction TS1, to establish out this first virtual objects 120 and augmented reality Image data 110b is combined the relative position relation during display screen being presented on second electronic device 105.Citing For, then it is increasingly closer to this first virtual objects 120 in the second user 105a viewing position as shown in figure 1, working as In the case of, second electronic device 105 should be able to be then according to the result after real-time operation, carry out relative changes augmented reality image number According to 110b presentation content (such as so that the shared size of this first virtual objects 120 in the presentation content is also got over It is more).However, due to augmented reality technology and its operation principles of head mounted display (that is, second electronic device 105), all To have in the art known by usually intellectual, therefore it is related to be dissolved in this in its thin portion and just no longer adds to repeat.
Then, it is thus evident that one of main spirits of the invention are also so that designer (that is, the first user It can 103a) come to carry out at least one to consumer (that is, second user 105a) directly with a virtual reality technology The ornaments suggestion of virtual goodses, and consumer then can relatively change using an augmented reality technology to browse to this virtual objects institute The image frame being given in true environment, and sensation is put in the position selected in true environment with angle to watch, So as to so be clearly understood that the whether suitable hobby of oneself of this virtual goods.Consequently, it is possible to will may be such that designer (that is, First user 103a) do not have to be limited to regional limitation in use environment, and make it that (that is, second uses consumer Person 105a) characteristic of this virtual goods more can be intuitively experienced, to provide good interaction effect whereby.
In addition, as described in previous contents, the first electronic installation 103 also may be, for example, a head mounted display.Therefore, exist In the present embodiment, when the loading of this first virtual objects 120 is positioned over image data 110a by the first user 103a, the One electronic installation 103 can also be to provide to be combined containing this first virtual objects 120 with a virtual reality pattern Image data 110a's browses.However, because the technical principle of virtual reality pattern is to have usual knowledge in the art Known by person, therefore it is related to be dissolved in this in its thin portion and just no longer adds to repeat.Then, it should be appreciated that the first electronics fills Put the image data 110a obtained acquired in 103, you can the actual rings where being expressed as being associated with the second user 105a at present The one virtual reality image data in border space 110.It is noted that in practice, the content of this virtual reality image data May be, for example, a 3D virtual interactives scene or one can interactive model etc..Sum it up, also unlimited be formed with closes this to the embodiment of the present invention The specific implementation of virtual reality image data.
Then, below in order to illustrate further the operation workflow on interaction systems 10, the present invention further provides it A kind of embodiment of interactive approach.Referring to Fig. 2, the flow signal for the interactive approach that Fig. 2, which is the embodiment of the present invention, to be provided Figure.Method described in this example can perform in the interaction systems 10 shown in Fig. 1, therefore please be understood in the lump according to Fig. 1 with profit.Separately Outside, detailed step flow as in the foregoing embodiment, therefore is only summarized in this and no longer adds redundant.
First, in step s 201, at least one first user operates the first electronic installation, and causes the first electronics according to this Device acquires an image data in the actual environment space where being associated with the second user at present.Secondly, in step In S203, according to merchandising database, the first user to select at least one first virtual objects from merchandising database, and And the loading of this first virtual objects is positioned over to one first default location in image data, to cause the first electronic installation whereby Generate one first control instruction.Wherein, the first control instruction includes the dimensional parameters with this first virtual objects, and This first virtual objects is placed on the coordinate parameters in image data.
Then, in step S205, the second user operates second electronic device, and according to this second electronic device is used With the actual environment space according to the first received control instruction, and the second user where current, tied to build up Close the augmented reality image data containing this first virtual objects.Finally, in step S207, second electronic device then can root again According to the size in the viewing position operated by the second user during second electronic device and viewing angle, and the first control instruction Parameter and coordinate parameters, it is combined to establish out this first virtual objects and augmented reality image data and is presented in the second electronics A relative position relation during display screen on device.
Still further aspect, it is following with multiple embodiments schema to be coordinated to illustrate to introduce the interaction that the embodiment of the present invention is provided Other several applications of method and system.It is to be understood, however, that concept of the present invention may carry out body in many different forms It is existing, and should not explain and be limited to embodiment set forth herein.
Please refer to Fig. 3 to Fig. 4, Fig. 3 and Fig. 4 will explain since the interactive approach and system of the embodiment of the present invention Other one kind applications.Wherein, Fig. 3 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided, and Fig. 4 is this hair The application schematic diagram for the interaction systems that bright another embodiment is provided.It is worth noting that, the method described in this example can be in Fig. 1 And performed in the interaction systems 10 shown in Fig. 4, therefore please understood in the lump according to Fig. 1 and Fig. 4 with profit.In addition, part and Fig. 2 in Fig. 3 Identical process step is indicated with identical figure number, therefore no longer adds that its details is described in detail in this.
In simple terms, the interactive approach compared to Fig. 2, Fig. 3 interactive approach is even more can be with by the first user 103a Continue and change the original ornaments of the first virtual objects 120 and suggest to taking into account.Therefore, can more be included in Fig. 3 embodiment There is step S301 to step S305.Wherein, in step S301, by the first electronic installation 103, the first user 103a to This first virtual objects 120 is moved or rotated to one second default location in image data 110a, to cause first whereby Electronic installation 130 generates the first control instruction TS1 ' after renewal.Wherein, the first control instruction TS1 ' after renewal is equally wrapped Containing the dimensional parameters with this first virtual objects 120, and this first virtual objects 120 is updated and is positioned over image data One coordinate parameters of the second default location in 110a.
Then, in step S303, second electronic device 105 to according to the first control instruction TS1 ' after renewal, with And second user 105a at present where actual environment space 110, to build up with reference to containing this first virtual objects 120 Augmented reality image data 110b.Finally, in step S305, second electronic device 105 then can be further according to the second user The first control instruction TS1 ' behind viewing position and viewing angle, and renewal operated by 105a during second electronic device 105 In dimensional parameters and coordinate parameters, tied to establish out this first virtual objects 120 and augmented reality image data 110b Close relative position relation when being presented in the display screen on second electronic device 105.
Therefore, teaching according to the above, usually intellectual is had in the art it would be appreciated that arriving, step S205~step S207 and step S303~step S305 should be similar or identical step.For example, when designer (also That is, the first user 103a) think this first virtual objects 120 original ornaments suggestion and it is improper when, designer can be with Directly change the first default location of this first virtual objects 120 from image data 110a, and the first electronic installation 130 then can The first control instruction TS1 ' after renewal is produced according to this, and is caused second electronic device 105 whereby and then built up renewal Augmented reality image data 110b afterwards.
It is to be understood, however, that in another case, it is also possible to be consumer (that is, the second user 105a) the original ornaments suggestion of this dissatisfied the first virtual objects 120.Therefore, then please refer to Fig. 5 to Fig. 6, Fig. 5 and Fig. 6 applies other one kind of the interactive approach that the embodiment of the present invention has been explained since and system.Wherein, Fig. 5 is of the invention another The schematic flow sheet for the interactive approach that one embodiment is provided, Fig. 6 be the interaction systems that are provided of another embodiment of the present invention it Application schematic diagram.Method described in this example can then perform in the interaction systems 10 shown in Fig. 1 and Fig. 6, thus please in the lump according to Fig. 1 and Fig. 6 is understood with profit.In addition, the part process step identical with Fig. 2 is indicated with identical figure number in Fig. 5, therefore in this no longer Add that its details is described in detail.
In simple terms, the interactive approach compared to Fig. 3, Fig. 5 interactive approach is then can also by the second user 105a The original ornaments for changing the first virtual objects 120 are suggested to taking into account.Therefore, step can be more included in Fig. 5 embodiment Rapid S501 to step S503.Wherein, in step S501, by second electronic device 105, the second user 105a to by this First virtual objects 120 are moved or rotated to one second default location in augmented reality image data 110b, to cause whereby Second electronic device 150 generates one second control instruction TS2.Wherein, the second control instruction TS2 includes virtual right with first As 120 dimensional parameters, and the first virtual objects 120 are placed on the coordinate ginseng in augmented reality image data 110b Number.
Then, in step S503, the first user 103a can then operate the first electronic installation 130, and cause the according to this One electronic installation 130 is according to the second received control instruction TS2, updating this first virtual objects 120 and be placed Coordinate parameters in image data 110a.Therefore, teaching according to the above, has usually intellectual in the art It would be appreciated that arrive, Fig. 3 step S301~step S305 and Fig. 5 step S501~step S503 should be parallel perform and not The step of conflict.That is, as the second user 105a it is determined that to change this using second electronic device 150 first virtual When the original ornaments of object 120 are suggested, second electronic device 150 can then produce corresponding second control instruction TS2 according to this, and And cause the first electronic installation 103 then can be first virtual right to change this according to the second received control instruction TS2 whereby The first default location in image data 110a is placed on as 120, as shown in Figure 6.Consequently, it is possible to consumer will be may be such that (that is, second user 105a) go with also having the right carry out virtual goodses ornaments suggestion, and cause designer (that is, First user 103a) can synchronously observe consumer it is desired ornaments suggest, with so efficiently meet consume The expectation of person's active demand, provides the rich of its interaction effect more whereby.
Still further aspect, in the case of other one kind, it is also possible to be designer (that is, first user 103a) or disappear The person of expense (that is, second user 105a) has found in fact and does not like this body style of this first virtual objects 120.Therefore, then Please refer to Fig. 7 to Fig. 8, Fig. 7 and Fig. 8 by explained since the embodiment of the present invention interactive approach and system other are a kind of Using.Wherein, Fig. 7 is the schematic flow sheet for the interactive approach that another embodiment of the present invention is provided, and Fig. 8 is another reality of the present invention Apply the application schematic diagram for the interaction systems that example is provided.Method described in this example then can be in the interaction systems shown in Fig. 1 and Fig. 8 Perform in 10, therefore please understood in the lump according to Fig. 1 and Fig. 8 with profit.In addition, the part process step identical with Fig. 2 is with identical in Fig. 7 Figure number sign, therefore no longer add that its details is described in detail in this.
In simple terms, the interactive approach compared to Fig. 3, Fig. 7 interactive approach is even more can be with by the first user 103a The first virtual objects are removed to taking into account.Therefore, step S701 can be more included in Fig. 7 embodiment to step S705.Wherein, in step s 701, by the first electronic installation 103, the first user 103a is in self imaging data 110a Unloading removes this first virtual objects 120, to cause the first electronic installation 130 to generate one first deletion instruction DS1 whereby. Then, in step S703, second electronic device 105 instructs DS1 to be deleted according to first, and the second user 105a institutes Actual environment space 110, to build up the uncombined augmented reality image data containing this first virtual objects 120 110b.Finally, in step S705, second electronic device 105 then can be further according to the second electronics operated by the second user 105a Viewing position and viewing angle during device 105, the second electronics is presented in establish out augmented reality image data 110b Relative position relation during display screen on device 105.
Therefore, teaching according to the above, usually intellectual is had in the art it would be appreciated that arrive, Fig. 3's The step S501 of step S301~step S305, Fig. 5~step S503 and Fig. 7 step S701~step S705 should be all parallel The step for performing and not conflicting.For example, when designer (that is, first user 103a) thinks this first virtual objects 120 and it is improper furnish when this actual environment space 110, designer can with directly from image data 110a unload move This first virtual objects 120 is removed, and the first electronic installation 130 can then generate the first deletion instruction DS1 according to this, and whereby So that second electronic device 105 and then the augmented reality image data for not including this first virtual objects 120 can be built up 110b, as shown in Figure 8.
Similarly, then please refer to Fig. 9 to Figure 10, Fig. 9 and Figure 10 the interaction side of the embodiment of the present invention will have been explained since A kind of application of other of method and system.Wherein, Fig. 9 is the flow signal for the interactive approach that another embodiment of the present invention is provided Figure, Figure 10 is the application schematic diagram for the interaction systems that another embodiment of the present invention is provided.Method described in this example then can be Perform in interaction systems 10 shown in Fig. 1 and Figure 10, therefore please understood in the lump according to Fig. 1 and Figure 10 with profit.In addition, part in Fig. 9 The process step identical with Fig. 2 is indicated with identical figure number, therefore no longer adds that its details is described in detail in this.
In simple terms, the interactive approach compared to Fig. 7, Fig. 9 interactive approach is even more can also by the second user 105a The first virtual objects are removed to taking into account.Therefore, step S901 can be more included in Fig. 9 embodiment to step S903.Wherein, in step S901, by second electronic device 105, the second user 105a is to from augmented reality image number This first virtual objects 120 is removed according to unloading in 110b, to cause second electronic device 105 to generate one second deletion whereby Instruct DS2.Then, in step S903, the first user 103a operates the first electronic installation 103, and causes the first electricity according to this Sub-device 103 according to received second to delete instruction DS2, the actual rings where updating the second user 105a at present The image data 110a in border space 110, as shown in Figure 10.Consequently, it is possible to compared to prior art, the interaction of the embodiment of the present invention Method and system, can be by by a virtual goodses synchronously by a virtual reality pattern (that is, the first electronic installation 103) and in an augmented reality pattern (that is, second electronic device 105) presented, to reach improvement designer whereby and disappear Interaction effect of the person of expense when carrying out furniture installation.
In summary, the interactive approach and system that the embodiment of the present invention is provided, answering for prior art will be totally different from With mode, and it there is provided and a kind of can be used for allowing multiple users in a virtual reality image data and an augmented reality image number According to carrying out an interactive interactive approach and a system, therefore the interactive approach of the embodiment of the present invention and system, designer can be caused The regional limitation in use environment can not had to be limited to, and cause consumer more can intuitively experience virtual goodses Characteristic, whereby and then to provide good interaction effect.
Described above, only the preferred embodiments of the disclosure, feature of the invention are not limited thereto, this area Technical staff according to the present invention can think easily and change or modification, can all cover the protection domain in the claims in the present invention In.

Claims (10)

  1. A kind of 1. interactive approach, for allowing multiple users between a virtual reality image data and an augmented reality image data Carry out interactive, it is characterised in that the interactive approach includes:
    At least one first user operates one first electronic installation, and causes first electronic installation to acquire association according to this One image data in the actual environment space where one second user is current;
    According to a merchandising database, first user is virtual to select at least one first from the merchandising database Object, and first virtual objects are loaded to one first default location being positioned in the image data, to make whereby Obtain first electronic installation and generate one first control instruction, wherein first control instruction, which includes, has the described first void Intend a dimensional parameters of object, and first virtual objects are placed on the coordinate parameters in the image data; And
    Second user operates a second electronic device, and causes the second electronic device to according to being received according to this First control instruction arrived, and the actual environment space at the current place of second user, to build up knot The augmented reality image data containing first virtual objects is closed, and the second electronic device then can be further according to institute A viewing position and a viewing angle when stating the second electronic device operated by the second user, and first control The dimensional parameters and the coordinate parameters in instruction, to establish out first virtual objects and the augmented reality image Data are combined the relative position relation during display screen being presented on the second electronic device.
  2. 2. interactive approach as claimed in claim 1, it is characterised in that the institute obtained acquired in wherein described first electronic installation Image data is stated, that is, the virtual reality in the actual environment space where being expressed as being associated with second user at present Border image data, and described first with the second electronic device being reached to each other by an at least communications protocol It is in communication with each other.
  3. 3. interactive approach as claimed in claim 2, it is characterised in that the interactive approach further includes:
    By first electronic installation, first user is to by first virtual objects are mobile or rotation is to described One second default location in image data, to cause first electronic installation to generate first control after updating whereby System instruction;And
    The second electronic device is to according to first control instruction after renewal, and the current institute of second user The actual environment space, to build up with reference to the augmented reality image data containing first virtual objects, And the second electronic device then can be further according to the sight operated by second user during second electronic device The dimensional parameters in first control instruction behind shadow position and the viewing angle, and renewal are joined with the coordinate Number, is combined when being presented in the display screen to establish out first virtual objects and the augmented reality image data The relative position relation.
  4. 4. interactive approach as claimed in claim 2, it is characterised in that the interactive approach further includes:
    By first electronic installation, first user removes described first to be unloaded from the image data Virtual objects, to cause first electronic installation generates one first deletion to instruct whereby;And
    The second electronic device instructs to be deleted according to described first, and the reality where second user Environment space, to build up the uncombined augmented reality image data containing first virtual objects, and described the Two electronic installations then can be further according to the viewing position operated by second user during second electronic device and institute Viewing angle is stated, to establish out the relative position when augmented reality image data is presented in the display screen Relation.
  5. 5. interactive approach as claimed in claim 2, it is characterised in that the interactive approach further includes:
    By the second electronic device, second user is to by first virtual objects are mobile or rotation is to described One second default location in augmented reality image data, to cause the second electronic device to generate one second control whereby Instruction, wherein second control instruction includes the dimensional parameters with first virtual objects, and described first Virtual objects are placed on the coordinate parameters in the augmented reality image data;And
    First user operates first electronic installation, and causes first electronic installation to according to being connect according to this Second control instruction received, update the coordinate that first virtual objects are placed in the image data Parameter.
  6. 6. interactive approach as claimed in claim 2, it is characterised in that the interactive approach further includes:
    By the second electronic device, second user removes to be unloaded from the augmented reality image data First virtual objects, to cause the second electronic device generates one second deletion to instruct whereby;And
    First user operates first electronic installation, and causes first electronic installation to according to being connect according to this Described second received deletes instruction, the image in the actual environment space where updating second user at present Data.
  7. 7. interactive approach as claimed in claim 2, it is characterised in that wherein described merchandising database is built into described first And/or among the second electronic device, or the merchandising database to by an at least communications protocol come with Described first and/or the second electronic device carry out data transmission.
  8. A kind of 8. interaction systems, for allowing multiple users between a virtual reality image data and an augmented reality image data Carry out interactive, it is characterised in that the interaction systems include:
    One merchandising database;
    One first electronic installation, it is supplied to operated by few one first user, and one second user is associated with to acquire One image data in the actual environment space where at present, and cause first user to from the commodity number according to this According to selecting at least one first virtual objects in storehouse, and first virtual objects loading is positioned in the image data One first default location, to cause first electronic installation to generate one first control instruction whereby, wherein first control System instruction includes the dimensional parameters with first virtual objects, and described in first virtual objects are placed on A coordinate parameters in image data;And
    One second electronic device, for operated by second user, and to be referred to according to received first control Order, and the actual environment space at the current place of second user, to build up with reference to virtual containing described first The augmented reality image data of object, and the second electronic device then can be further according to operated by second user Join with the size in a viewing angle, and first control instruction viewing position during second electronic device Number and the coordinate parameters, are combined and are presented in establish out first virtual objects and the augmented reality image data A relative position relation during display screen on the second electronic device.
  9. 9. interaction systems as claimed in claim 8, it is characterised in that the institute obtained acquired in wherein described first electronic installation Image data is stated, that is, the virtual reality in the actual environment space where being expressed as being associated with second user at present Border image data, and described first with the second electronic device being reached to each other by an at least communications protocol It is in communication with each other.
  10. 10. interaction systems as claimed in claim 8, it is characterised in that wherein described merchandising database is built into described first And/or among the second electronic device, or the merchandising database to by an at least communications protocol come with Described first and/or the second electronic device carry out data transmission.
CN201610809899.0A 2016-08-31 2016-09-08 Interaction method and system Active CN107783648B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW105128153 2016-08-31
TW105128153A TWI585617B (en) 2016-08-31 2016-08-31 Interaction method and system thereof

Publications (2)

Publication Number Publication Date
CN107783648A true CN107783648A (en) 2018-03-09
CN107783648B CN107783648B (en) 2020-08-18

Family

ID=59688330

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610809899.0A Active CN107783648B (en) 2016-08-31 2016-09-08 Interaction method and system

Country Status (2)

Country Link
CN (1) CN107783648B (en)
TW (1) TWI585617B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111352503A (en) * 2018-12-21 2020-06-30 秀铺菲公司 E-commerce platform with augmented reality application for display of virtual objects
CN113112614A (en) * 2018-08-27 2021-07-13 创新先进技术有限公司 Interaction method and device based on augmented reality
US20220028108A1 (en) 2020-07-27 2022-01-27 Shopify Inc. Systems and methods for representing user interactions in multi-user augmented reality
US11847716B2 (en) 2020-07-27 2023-12-19 Shopify Inc. Systems and methods for generating multi-user augmented reality content

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757941B (en) * 2020-10-30 2022-03-11 幻景啟動股份有限公司 Image processing system and image processing device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011020793A2 (en) * 2009-08-18 2011-02-24 Metaio Gmbh Method for representing virtual information in a real environment
CN103390287A (en) * 2012-05-11 2013-11-13 索尼电脑娱乐欧洲有限公司 Apparatus and method for augmented reality
CN103593876A (en) * 2012-08-17 2014-02-19 北京三星通信技术研究有限公司 Electronic device, and method for controlling object in virtual scene in the electronic device
CN104104862A (en) * 2013-04-04 2014-10-15 索尼公司 Image processing device and image processing method
CN104346081A (en) * 2013-07-25 2015-02-11 邱美虹 Augmented reality learning system and method thereof
CN105225120A (en) * 2014-06-11 2016-01-06 宅妆股份有限公司 Household and display place family ornament arrangement proposal recommendation method and system
CN105786311A (en) * 2016-02-24 2016-07-20 杨晟志 Virtual space application platform

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60222890T2 (en) * 2002-08-12 2008-02-07 Alcatel Lucent Methods and apparatus for implementing highly interactive entertainment services using media streaming technology that enables the provision of virtual reality services
JP4500632B2 (en) * 2004-09-07 2010-07-14 キヤノン株式会社 Virtual reality presentation apparatus and information processing method
TW201503038A (en) * 2013-07-08 2015-01-16 Hwa Hsia Inst Of Technology Interior design simulation system
TWI540525B (en) * 2014-06-11 2016-07-01 宅妝股份有限公司 System and method for providing proposal to furniture and decorations buyer

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011020793A2 (en) * 2009-08-18 2011-02-24 Metaio Gmbh Method for representing virtual information in a real environment
CN103390287A (en) * 2012-05-11 2013-11-13 索尼电脑娱乐欧洲有限公司 Apparatus and method for augmented reality
CN103593876A (en) * 2012-08-17 2014-02-19 北京三星通信技术研究有限公司 Electronic device, and method for controlling object in virtual scene in the electronic device
CN104104862A (en) * 2013-04-04 2014-10-15 索尼公司 Image processing device and image processing method
CN104346081A (en) * 2013-07-25 2015-02-11 邱美虹 Augmented reality learning system and method thereof
CN105225120A (en) * 2014-06-11 2016-01-06 宅妆股份有限公司 Household and display place family ornament arrangement proposal recommendation method and system
CN105786311A (en) * 2016-02-24 2016-07-20 杨晟志 Virtual space application platform

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113112614A (en) * 2018-08-27 2021-07-13 创新先进技术有限公司 Interaction method and device based on augmented reality
CN113112614B (en) * 2018-08-27 2024-03-19 创新先进技术有限公司 Interaction method and device based on augmented reality
CN111352503A (en) * 2018-12-21 2020-06-30 秀铺菲公司 E-commerce platform with augmented reality application for display of virtual objects
US11842385B2 (en) 2018-12-21 2023-12-12 Shopify Inc. Methods, systems, and manufacture for an e-commerce platform with augmented reality application for display of virtual objects
US20220028108A1 (en) 2020-07-27 2022-01-27 Shopify Inc. Systems and methods for representing user interactions in multi-user augmented reality
US11847716B2 (en) 2020-07-27 2023-12-19 Shopify Inc. Systems and methods for generating multi-user augmented reality content
US11908159B2 (en) 2020-07-27 2024-02-20 Shopify Inc. Systems and methods for representing user interactions in multi-user augmented reality

Also Published As

Publication number Publication date
TWI585617B (en) 2017-06-01
CN107783648B (en) 2020-08-18
TW201812530A (en) 2018-04-01

Similar Documents

Publication Publication Date Title
Farshid et al. Go boldly!: Explore augmented reality (AR), virtual reality (VR), and mixed reality (MR) for business
CN107783648A (en) interaction method and system
US20230153475A1 (en) Method for replacing 3d objects in 2d environment
US10325407B2 (en) Attribute detection tools for mixed reality
US20200302693A1 (en) Generating and presenting a 3d virtual shopping environment
CN102263772A (en) Virtual conference system based on three-dimensional technology
WO2017143303A1 (en) Apparatuses, methods and systems for sharing virtual elements
CN106708452B (en) Information sharing method and terminal
WO2015007150A1 (en) Terminal device and method for designing network application product
CN109298777B (en) Virtual reality experience control system
CN104012103A (en) Collaborative entertainment platform
US20150286364A1 (en) Editing method of the three-dimensional shopping platform display interface for users
CN107818490A (en) Equipment choosing guidance method, device, computer-readable recording medium and terminal
CN104504576A (en) Method for achieving three-dimensional display interaction of clothes and platform
CN111243068A (en) Automatic rendering method and device for 3D model scene and storage medium
US20220245888A1 (en) Systems and methods to generate an interactive environment using a 3d model and cube maps
JP2022013801A (en) Spatial design coordinating system, spatial design coordinating method, and program
CN105516823A (en) Intelligent television theme customization method and apparatus
KR20230093643A (en) Method for providing contents displaying service based on metaverse and electronic device thereof
Jackman 3-D cinema: Immersive media technology
Nasir et al. Augmented Reality Application for Architects and interior designers: Interno A cost effective solution
Joshi et al. A Design Framework for Contextual and Embedded Information Visualizations in Spatial Augmented Reality
Wendrich et al. Hybrid design tools in a social virtual reality using networked oculus rift: a feasibility study in remote real-time interaction
Hu et al. Research on 3d interactive model selection and customization of ceramic products based on big data cloud service platform
Papadimitriou et al. Digital Futures: Lumen Big Reveal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant