CN110377147B - Method and system for amplifying reality - Google Patents
Method and system for amplifying reality Download PDFInfo
- Publication number
- CN110377147B CN110377147B CN201810481192.0A CN201810481192A CN110377147B CN 110377147 B CN110377147 B CN 110377147B CN 201810481192 A CN201810481192 A CN 201810481192A CN 110377147 B CN110377147 B CN 110377147B
- Authority
- CN
- China
- Prior art keywords
- wireless signal
- signal transmitter
- augmented reality
- mobile device
- transmitter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000003190 augmentative effect Effects 0.000 claims abstract description 157
- 238000013461 design Methods 0.000 claims abstract description 44
- 230000003993 interaction Effects 0.000 claims abstract description 23
- 230000009471 action Effects 0.000 claims abstract description 11
- 230000003321 amplification Effects 0.000 claims abstract description 11
- 238000003199 nucleic acid amplification method Methods 0.000 claims abstract description 11
- 230000002452 interceptive effect Effects 0.000 claims abstract description 8
- 238000009434 installation Methods 0.000 claims description 18
- 238000004891 communication Methods 0.000 claims description 5
- 239000004984 smart glass Substances 0.000 claims description 3
- 238000010276 construction Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 6
- 230000003416 augmentation Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a method and a system for amplifying a real world, wherein the method comprises the following steps: transmitting wireless signals with identification codes the setting information of the device is placed in a cloud server; setting wireless signal transmitter from cloud server loading information into an amplification real content design tool system; wireless signal transmitter controls are provided by the augmented reality content design tool system, to bind the wireless signal transmitter with the augmented reality interactive content; storing the binding result as augmented reality setting information, placing the augmented reality setting information on a cloud server; receiving augmented reality setting information from a cloud server by a mobile device; and when the mobile device detects the wireless signal transmitter or the real-time live-action image conforming to the picture connected with the wireless signal transmitter, the mobile device executes the augmented reality action according to the augmented reality interaction content of the augmented reality setting information.
Description
Technical Field
The present invention relates to an Augmented Reality (AR) technology, and more particularly, to a method and system for augmented reality.
Background
First, the augmented reality (Augmented Reality; AR) is to amplify some information in the reality, and the way of augmentation or the content of augmentation varies depending on the requirements. Therefore, in order to meet different amplification reality requirements, existing technology has amplification reality content editing and designing tools such as Wikitude Studio of Wikitude GmbH, thingWorx internet of things platform of PTC, camera Effects of Facebook, etc., so that users can design and produce various amplification reality applications by themselves.
Next, there are also some documents concerning augmented reality applications, such as a system and method for creating a visualized augmented reality scene, a terminal for providing an augmented reality, a method for providing an augmented reality, and a system and method for managing an augmented reality plan.
However, the above-mentioned augmented reality related techniques each have their functions, but no description is given of how to incorporate the techniques of wireless signal transmitters into the field of augmented reality. Therefore, how to solve the above-mentioned drawbacks of the known technology has been a big problem for the person skilled in the art.
Disclosure of Invention
The present invention provides a method and system for augmented reality that can quickly and efficiently combine the technology of augmented reality with wireless signal transmitters.
The method for amplifying the reality comprises the following steps: setting information of a wireless signal transmitter with an identification code of at least one wireless signal transmitter is placed in a cloud server; the method comprises the steps that setting information of a wireless signal transmitter is loaded into an amplification real content design tool system from a cloud server; providing at least one wireless signal transmitter control by the augmented reality content design tool system to bind the wireless signal transmitter with the augmented reality interactive content by means of the wireless signal transmitter control; storing the binding result as augmented reality setting information to place the augmented reality setting information in a cloud server; receiving augmented reality setting information from a cloud server by a mobile device capable of shooting live-action images; and when the mobile device detects the wireless signal transmitter or the real-time live-action image conforming to the picture connected with the wireless signal transmitter, the mobile device executes the augmented reality action according to the augmented reality interaction content recorded by the augmented reality setting information.
The system for amplifying the reality in the invention comprises: the mobile device capable of shooting the live-action image receives the augmented reality setting information from the cloud server, and when the mobile device detects the wireless signal transmitter or the live-action image conforming to a picture connected with the wireless signal transmitter, the mobile device executes the augmented reality action according to the augmented reality interaction content recorded by the augmented reality setting information.
In order to make the above features and advantages of the present invention more comprehensible, embodiments accompanied with figures are described in detail below. Additional features and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The features and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the scope of the invention as claimed.
Drawings
FIG. 1 is a flow chart illustrating a method of the present invention for amplifying an actual environment;
FIG. 2 is a schematic diagram showing the implementation of a wireless signal transmitter in the method and system for amplifying an actual situation according to the present invention;
fig. 3A to 3B are schematic diagrams illustrating the operation relationship between the wireless signal transmitter, the cloud server, the augmented reality content design tool system and the mobile device in the method and the system for augmenting reality according to the present invention;
fig. 4A to fig. 4B are schematic diagrams showing the information of the hot and cold areas of the wireless signal transmitter in an augmented reality manner in the method and the system for augmenting an reality according to the present invention;
FIGS. 5A-5B are schematic diagrams showing the method and system for amplifying an actual environment according to the present invention, wherein the actual information represented by the wireless signal transmitter is marked in the manner of the amplified actual environment; and
fig. 6A-6B are schematic diagrams illustrating the method and system for providing information related to sensing of a wireless signal transmitter in an augmented reality manner.
Symbol description:
1. wireless signal transmitter
2. Cloud server
21. Wireless signal transmitter back-end system
22. Database for storing data
23. Wireless signal transmitter setting information
24. Wireless signal transmitter provisioning information
25. Augmented reality backend system
26. Augmenting reality setting information
3. Wireless signal transmitter deployment tool system
31. Program for configuring wireless signal transmitter
32. Position information
33. Electronic map
4. Amplification real-time content design tool system
41. Wireless signal transmitter control
42a, 42b, 42c controls
43. Picture picture
44. Design area
45. Real-time live-action image
46. State information layer
47. Text information block
5. Mobile device
A1 to A4 wireless signal transmitter article
B1 to B2 position
Steps S1 to S6.
Detailed Description
The following embodiments of the present invention will be described in terms of specific embodiments, and those skilled in the art will readily appreciate from the disclosure of the present invention that many other advantages and uses can be made or applied in a variety of other embodiments.
FIG. 1 is a flow chart of a method for amplifying an actual environment of the present invention, and is described with reference to FIGS. 2-3B.
As shown in the fig. 1, in step S1, the wireless signal transmitter setting information 23 having the identification code (ID) of at least one (e.g. one or more) wireless signal transmitters 1 is placed on the cloud server 2, wherein the cloud server 2 may be a centralized or decentralized server, and the invention is not limited thereto. The wireless signal transmitter 1 may be a Beacon (Beacon) transmitter, a Zigbee (Zigbee) transmitter, a radio frequency identification (Radio Frequency Identification; RFID) tag, an ultrasonic transmitter, an infrared transmitter, a near field communication (Near Field Communication; NFC) device, or a wireless network base station such as Wi-Fi AP, etc.
In step S2 of fig. 1, the wireless signal transmitter setting information 23 is loaded from the cloud server 2 to the augmented reality content design tool system 4, and the augmented reality content design tool in the augmented reality content design tool system 4 may be, for example, a web page program or an application program (APP) running in a web browser.
In step S3 of fig. 1, at least one wireless signal transmitter control 41 is provided by the augmented reality content design tool system 4 to bind the wireless signal transmitter 1 with the augmented reality interactive content via the wireless signal transmitter control 41. The binding may refer to rendering augmented reality interaction content corresponding to the wireless signal transmitter 1 on the mobile device 5 after the mobile device 5 detects the wireless signal transmitter 1. The augmented reality interaction content may include, but is not limited to, for example, causing the augmented reality of the mobile device 5 to present hot and cold zone information, location information, people stream information, information cues, or physical object information represented by the wireless signal transmitter 1 obtained using the wireless signal transmitter 1.
In step S4 of fig. 1, the binding result is stored as the augmented reality setting information 26, so that the augmented reality setting information 26 is placed in the cloud server 2. The augmented reality setting information 26 may include an identification code of the wireless signal transmitter 1 and augmented reality interaction content associated with the wireless signal transmitter 1.
In step S5 of fig. 1, the mobile device 5 capable of capturing live-action images receives the augmented reality setting information 26 from the cloud server 2. For example, the augmented reality setting information 26 may be downloaded to the mobile device 5 from the augmented reality backend system 25 of the cloud server 2, and the mobile device 5 may be a smart phone, a tablet computer, a notebook computer, or smart glasses, etc., which is not limited to the present invention.
In step S6 of fig. 1, when the mobile device 5 detects the wireless signal transmitter 1 or the real-time live-action image 45 corresponding to the picture 43 connected to the wireless signal transmitter 1 through the wireless transmission protocol, the mobile device 5 executes the augmented reality action according to the augmented reality interaction content recorded in the augmented reality setting information 26, and the augmented reality action can also be implemented on the mobile device 5 according to the data designed by the augmented reality content design tool system 4. In step S6, the wireless signal transmitter 1 may be connected to the picture 43, the mobile device 5 captures the real-time image 45, and compares whether the real-time image 45 matches with the picture 43, if so, the mobile device 5 detects the wireless signal transmitter 1.
Fig. 2 is a schematic diagram showing a method and a system for implementing the wireless signal transmitter 1 in the amplification method and the system of the invention, wherein the method can be implemented in or before the step S1 of fig. 1.
The wireless signal transmitter 1 may be configured in such a way that the wireless signal transmitter setting information 23 is inputted and stored in the database 22 through the database access interface, and the database 22 may be located in the wireless signal transmitter backend system 21 of the cloud server 2. Alternatively, the wireless signal transmitter 1 may be built by using the wireless signal transmitter building program 31 of the wireless signal transmitter building tool system 3, and the wireless signal transmitter building program 31 may present the location information 32 of the wireless signal transmitter 1 or the electronic map 33 having the location information 32 to set the installation location of the wireless signal transmitter 1 through the wireless signal transmitter building program 31. The wireless signal transmitter configuration tool system 3 may be disposed in a mobile device such as a smart phone, a tablet computer or a notebook computer, but the invention is not limited thereto.
Specifically, the wireless signal transmitter 1 may be configured by the following procedure, but not limited thereto.
The wireless signal transmitter configuration tool system 3 is used for sensing and acquiring information of the wireless signal transmitter 1 to be installed, such as the name and the identification code of different wireless signal transmitters 1.
(II) setting the actual installation position of the wireless signal transmitter 1 by using the position information 32 or the electronic map 33 of the wireless signal transmitter construction tool system 3, for example: a store beverage area, map number, map coordinates (X, Y), etc.
And (III) the wireless signal transmitter configuration information is uploaded to the wireless signal transmitter backend system 21 of the cloud server 2 by the wireless signal transmitter configuration tool system 3, and the wireless signal transmitter configuration information can include, for example, the name, the identification code, or the actual installation position of the wireless signal transmitter 1.
Fig. 3A to 3B are schematic diagrams showing the operation relationship between the wireless signal transmitter 1, the cloud server 2, the amplified content design tool system 4 and the mobile device 5 in the method and the system for amplifying an actual environment according to the present invention, wherein fig. 3A may include the following procedures (one) to (four) to further illustrate the steps S2 to S4 of fig. 1.
One) the user may load a picture 43 (e.g., of the A-vendor) on the augmented reality content design tool of the augmented reality content design tool system 4 through the control 42a representing the picture into the design area 44 of the augmented reality content design tool.
(two) the wireless signal transmitter control 41 is dragged four times, respectively, to place the wireless signal transmitter objects A1-A4 on four different positions of the picture 43, respectively.
And (III) the wireless signal transmitter configuration information 24, such as the names and identification codes of the four wireless signal transmitters 1, is loaded from the wireless signal transmitter backend system 21. The wireless signal transmitter configuration information 24 may or may not be included in the wireless signal transmitter setting information 23.
(IV) different identification codes (names) of the four wireless signal transmitters 1 are selected, respectively, and the identification codes of the four wireless signal transmitters 1 are set to the wireless signal transmitter objects A1 to A4 in the picture 43, respectively. Through this action, the wireless signal transmitter objects A1 to A4 in the representation picture 43 actually represent four wireless signal transmitters 1 having different identification codes.
The augmented reality interaction information is then checked or enabled, such as enabling a location indicator or enabling a people stream indicator (see right side of fig. 3A). The location mark indicates that the mobile device 5 can calculate the location of the mobile device 5 by using the setup locations of the wireless signal transmitters 1, and provide the location of the mobile device 5 on the real-time live-action image 45 (see fig. 3B). The traffic sign indicates that the mobile device 5 can sign traffic information on the instant live-action image 45, and the traffic information is obtained by statistics through the sensing records of the mobile device 5 and the wireless signal transmitter 1.
It is noted that the arrangement positions of the wireless signal transmitter articles A1 to A4 in the picture 43 are not necessarily the actual installation positions of the wireless signal transmitters 1 represented by them. Meanwhile, through the procedure (IV), the set four wireless signal transmitters 1 can be bound with the augmented reality interactive contents.
When the user presses the "store" option or button on the upper right of the augmented reality content design tool, the binding result may be stored as an augmented reality setting information 26 and the augmented reality setting information 26 uploaded to the augmented reality backend system 25 of the cloud server 2, and may include, for example, the picture 43 of the a-vendor, the identification code and placement location of the wireless signal transmitter 1, the augmented reality interaction content, etc.
On the other hand, fig. 3B may include the following procedures (one) to (three) to further illustrate the steps S5 to S6 of fig. 1.
(one) the mobile device 5 downloads the wireless signal transmitter configuration information 24 and the augmented reality setting information 26 from the cloud server 2.
And (II) capturing or capturing a live-action image 45 through the mobile device 5.
(III) if the live-action image 45 matches the data of the picture 43 in the augmented reality setting information 26, the mobile device 5 recognizes that the wireless signal transmitter objects A1 to A4 arranged in the picture 43 have been detected and performs the following augmented reality action (1) or (2) according to the augmented reality interaction content recorded in the augmented reality setting information 26.
(1) And drawing a traffic sign line of the augmented reality. Assuming that the mobile device 5 has collected the sensing record of each wireless signal transmitter 1, the sequence of the four wireless signal transmitters 1, which also represents the information of the tide flow, can be respectively sensed by the mobile device 5 through the sensing record analysis. Furthermore, according to the four arrangement positions of the wireless signal transmitter objects A1 to A4 in the picture 43, the four arrangement positions can be connected, and the three arrows shown in fig. 3B are drawn by lines to indicate the people flow.
(2) The current location of the mobile device 5 is calculated based on the wireless signal transmitter configuration information 24 and an information indication of the current location is provided. The mobile device 5 can obtain the actual installation positions of the four wireless signal transmitters 1 from the cloud server 2, and the actual installation positions can be represented by real geographic position coordinates or map coordinates of a map. If the mobile device 5 has at least three of the four wireless signal transmitters 1 sensed using bluetooth low energy (Bluetooth Low Energy; BLE) technology, the mobile device 5 can calculate the instant position of the mobile device 5 by a three-point positioning method based on the actual installation positions of the three wireless signal transmitters 1.
Fig. 4A to fig. 4B are schematic diagrams showing the information of the hot and cold areas of the wireless signal transmitter 1 in an augmented reality manner in the method and system for augmenting an reality according to the present invention.
As shown in the drawing, the user can load the live-action picture 43 into the augmented reality content design tool system 4, and drag the wireless signal transmitter control 41 representing the wireless signal transmitter 1 to the position B1 and the position B2 of the picture 43 twice, respectively, wherein the position B1 and the position B2 can be the actual installation positions of the two wireless signal transmitters 1 on the scene shown in the picture 43, respectively, and the augmented reality content design tool system 4 can generate two wireless signal transmitter program objects in the memory (not shown in the drawing).
Next, the wireless signal transmitter configuration information 24 is loaded from the cloud server 2 through the augmented reality content design tool system 4, and the identification codes of the two wireless signal transmitters 1 are respectively assigned to the two wireless signal transmitter program objects, so as to select the wireless signal transmitter 1 to be actually bound.
Next, the right side of the amplification real-time content design tool in the amplification real-time content design tool system 4 is checked for "wireless signal transmitter hot zone enabled" indicating that the subsequent mobile device 5 can draw a rendering layer on the real-time live-action image 45, e.g. a bright layer indicates a hot zone, a dark layer indicates a cold zone, to indicate which region in real space is a hot population stay zone or which region is a cold population stay zone.
Meanwhile, the above operation result may be made into the augmented reality setting information 26 to be stored in the cloud server 2, and the augmented reality setting information 26 may include the picture 43 of the scene, the information of the two wireless signal transmitters 1 (such as the wireless signal transmitter setting information 23 or the wireless signal transmitter configuration information 24), the arrangement position of the wireless signal transmitters 1 in the picture 43, and the augmented reality interaction is "the information of the cold and hot areas of the wireless signal transmitters is presented".
The mobile device 5 may then load the augmented reality setting information 26 back from the cloud server 2 and take the live-action image 45 with a camera on the mobile device 5. If the live-action image 45 matches the picture 43 on the scene, the mobile device 5 may render two areas at the positions B1 and B2 of the live-action image 45 according to the indication of the augmented reality setting information 26 to prompt the user or the crowd of the cold and hot area information. For example, the positions B1 and B2 of the live-action image 45 are the hot area and the cold area, respectively, but the hot area and the cold area are not fixed information, and the information of the mobile device stay condition is obtained after statistics by using the wireless signal transmitter to sense the information collected at the positions B1 and B2, and the cold area information of the wireless signal transmitter 1 obtained after statistics can also be obtained from the cloud server 2.
Fig. 5A to 5B are schematic diagrams showing the method and system for amplifying an actual environment according to the present invention, wherein the physical information represented by the wireless signal transmitter 1 is marked in the manner of amplifying the actual environment.
As shown, a user may first load data from an industrial machine into the design area 44 of the augmented reality content design tool system 4 via the controls 42b representing the industrial machine. Next, the user may bind the wireless signal transmitter 1 to the industrial machine via the wireless signal transmitter control 41 on behalf of the wireless signal transmitter 1, e.g., drag a wireless signal transmitter control 41 onto the picture 43, to cause the augmented reality content design tool in the augmented reality content design tool system 4 to generate a wireless signal transmitter program object. Then, the user can select the identification code of the wireless signal transmitter 1 and set the identification code to the wireless signal transmitter program object.
Then, the amplification real-time content design tool can automatically prompt, for example, "the industrial machine is already bound with a wireless signal transmitter" in the screen according to the operation of the user, which means that the subsequent mobile device 5 can draw the status information layer 46 of the industrial machine on the real-time image of the mobile device 5 after detecting the bound wireless signal transmitter 1.
Meanwhile, the above operation result may be made into the augmented reality setting information 26 to be stored in the cloud server 2, and the augmented reality setting information 26 may include information of one wireless signal transmitter 1, a status data acquisition address of an industrial machine to which the wireless signal transmitter 1 is bound, and augmented reality interaction as "information of the entity represented by the augmented reality marking wireless signal transmitter".
Then, the mobile device 5 can load the augmented reality setting information 26 back from the cloud server 2, and when the user holds the mobile device 5 to detect that the wireless signal transmitter 1 is nearby and the identification code of the wireless signal transmitter 1 is matched with the record of the augmented reality setting information 26, the mobile device 5 can capture the real-time status data of the industrial machine from the cloud server 2 according to the status data acquisition address of the industrial machine bound by the wireless signal transmitter 1, and nest the status information layer 46 of the industrial machine on the real-time live-action image in an augmented reality mode. If the real-time live-action image includes the actual body of the industrial machine, the status information layer 46 is also nested on the body of the industrial machine, so that the wireless signal transmitter 1 can be installed beside the industrial machine with skill to obtain better image effect.
Fig. 6A to 6B are schematic diagrams showing the method and system for providing information related to sensing of the wireless signal transmitter 1 in an augmented reality manner in the method and system for augmenting reality according to the present invention.
As shown, the user may first place text information block 47 into the design area 44 of the augmented reality content design tool in the augmented reality content design tool system 4 through the control 42c representing text information, and edit the text information content of the text information block 47, e.g. "I am Wang Xiaoming, i know that you will practice photography …" here. The user may bind a wireless signal transmitter 1 to the text message block 47 via the wireless signal transmitter control 41 representing the wireless signal transmitter 1, for example, drag the wireless signal transmitter control 41 onto the text message block 47, so that the augmented reality content design tool generates a wireless signal transmitter program object. Then, the user can select an identification code of the wireless signal transmitter 1 and set the identification code to the wireless signal transmitter program object.
Then, the augmented reality content design tool can automatically prompt that "the text information is associated with the specified wireless signal transmitter" in the right side screen of the augmented reality content design tool according to the operation of the user, which means that the following mobile device 5 can draw and superimpose the text information block 47 and the text information content thereof on the real-time live-action image 45 of the mobile device 5 after detecting the bound wireless signal transmitter 1.
Meanwhile, the above operation result may be made into the augmented reality setting information 26 to be stored in the cloud server 2, and the augmented reality setting information 26 may include information of one wireless signal transmitter 1, the text information block 47 bound by the wireless signal transmitter 1 and text information content thereof, and the augmented reality interaction is "providing information related to the wireless signal transmitter sensing in an augmented reality manner".
Then, the mobile device 5 can load the augmented reality setting information back from the cloud server 2, and when the user holds the mobile device 5 to detect that the wireless signal transmitter 1 is nearby and the identification code of the wireless signal transmitter 1 is matched with the record of the augmented reality setting information 26, the mobile device 5 can nest the text information block 47 and the text information content thereof on the real-time live-action image 45 of the mobile device 5 in an augmented reality mode according to the text information block 47 and the text information content thereof bound by the wireless signal transmitter 1. The text message content may include a web hyperlink (e.g., http:// aaa.bbb.ccc/10gb/qscg832tybadf 12) and the user may click on the web hyperlink on the mobile device 5 to connect to other external systems via the web hyperlink communication.
In addition, in a variation of the present embodiment, the text information block 47 may be bound to the wireless signal transmitter 1 on the augmented reality content design tool in the augmented reality content design tool system 4, the text information content to be included in the text information block 47 may be set to be the content bound by the wireless signal transmitter 1 through the augmented reality content design tool system 4, and the content bound by the wireless signal transmitter 1 may be stored in the wireless signal transmitter back-end system 21 of the cloud server 2. The obtained address of the content bound by the wireless signal transmitter 1 may be put into the augmented reality setting information 26, and then the mobile device 5 may grab back the corresponding content from the cloud server 2 according to the obtained address, and fill the content (i.e. the text information content) into the text information block 47.
In summary, the features, advantages, or efficacy of the methods and systems for augmenting reality according to the invention are described below:
the present invention enables rapid and efficient introduction or incorporation of wireless signal transmitter technology into the field of augmented reality through an augmented reality content design tool system.
The presentation mode of the augmented reality content according to the present invention can be changed according to the information of the wireless signal transmitter, and the presentation mode can be changed in various ways through the augmented reality content design tool system.
The third aspect of the present invention enables the connection of a wireless signal transmitter to augmented reality content, allowing augmented reality applications on a mobile device to interact with a wireless signal transmitter installed in the field.
The invention can use the information of the wireless signal transmitter installed at one location (such as the A ground) to the augmented reality of the mobile device at another location (such as the B ground).
The above-described embodiments are merely illustrative of the principles, features and advantages of the present invention, and are not intended to limit the scope of the invention, which is susceptible to modification and variation by those skilled in the art without departing from the spirit and scope of the invention. Any equivalent changes and modifications made by the present disclosure are intended to be covered by the scope of the appended claims. Accordingly, the scope of the invention is to be indicated by the appended claims.
Claims (14)
1. A method of augmenting an reality, the method comprising:
setting wireless signal transmitter setting information with an identification code of at least one wireless signal transmitter in a wireless signal transmitter rear end system of a cloud server, and setting an actual installation position of the wireless signal transmitter by using an electronic map by using a wireless signal transmitter building tool system;
the wireless signal transmitter setting information of the wireless signal transmitter after the wireless signal transmitter setting tool system sets the actual installation position by using the electronic map is loaded into an amplification real content design tool system from a wireless signal transmitter rear end system of the cloud server;
providing at least one wireless signal transmitter control by the augmented reality content design tool system, so that the wireless signal transmitter after the wireless signal transmitter construction tool system sets the actual installation position by using the electronic map is bound with the augmented reality interactive content by the wireless signal transmitter control;
storing the binding result as augmented reality setting information including the identification code of the wireless signal transmitter and the augmented reality interaction content associated with the wireless signal transmitter, so as to place the augmented reality setting information including the identification code of the wireless signal transmitter and the augmented reality interaction content associated with the wireless signal transmitter on the cloud server;
receiving the augmented reality setting information including the identification code of the wireless signal transmitter and the augmented reality interaction content associated with the wireless signal transmitter from the cloud server with a mobile device capable of capturing live action images; and
when the mobile device detects the real-time live-action image which is matched with the wireless signal transmitter or the picture connected with the wireless signal transmitter after the actual installation position is set by the wireless signal transmitter setting tool system through the electronic map, the mobile device executes the augmented reality action according to the augmented reality interaction content recorded by the augmented reality setting information comprising the identification code of the wireless signal transmitter and the augmented reality interaction content associated with the wireless signal transmitter.
2. The method of claim 1, wherein the wireless signal transmitter is a Beacon (Beacon) transmitter, a Zigbee (Zigbee) transmitter, a Radio Frequency Identification (RFID) tag, an ultrasonic transmitter, an infrared transmitter, a Near Field Communication (NFC) device, or a wireless network base station, and the mobile device is a smart phone, a tablet, a notebook, or smart glasses.
3. The method of claim 1, wherein the augmented reality interaction content comprises causing an augmented reality of the mobile device to present hot and cold zone information, location information, people stream information, information cues, or physical object information represented by the wireless signal transmitter.
4. The method of claim 1, wherein the binding is to present augmented reality interaction content corresponding to the wireless signal transmitter on the mobile device after the mobile device detects the wireless signal transmitter.
5. The method of claim 1, further comprising downloading the augmented reality setting information from an augmented reality backend system of the cloud server to the mobile device.
6. The method of claim 1 further comprising connecting the wireless signal transmitter to the picture, capturing the live-action image by the mobile device, comparing the live-action image with the picture, and if so, indicating that the mobile device detects the wireless signal transmitter.
7. The method of claim 1, further comprising implementing the augmented reality action on the mobile device according to data designed by the augmented reality content design tool system.
8. The method of claim 1 wherein the wireless signal transmitter is configured to input and store the wireless signal transmitter configuration information into a database through a database access interface, and wherein the database is located in a wireless signal transmitter backend system of the cloud server.
9. The method of claim 1, wherein the wireless signal transmitter is configured by a wireless signal transmitter configuration program of the wireless signal transmitter configuration tool system, and the wireless signal transmitter configuration program presents location information of the wireless signal transmitter and an electronic map having the location information.
10. The method of claim 1 further comprising using the wireless transmitter configuration tool system to sense and obtain an identification code of the wireless transmitter and using the wireless transmitter configuration tool system's electronic map and location information to set an actual installation location of the wireless transmitter.
11. The method of claim 10 further comprising uploading wireless signal transmitter configuration information to a wireless signal transmitter backend system of the cloud server with the wireless signal transmitter configuration tool system, wherein the wireless signal transmitter configuration information includes an identification code and an actual installation location of the wireless signal transmitter.
12. A system for augmenting an reality, the system comprising:
the cloud server is provided with a wireless signal transmitter back-end system for placing wireless signal transmitter setting information with at least one wireless signal transmitter identification code;
a wireless signal transmitter constructing tool system which utilizes an electronic map to set the actual installation position of the wireless signal transmitter;
an augmented reality content design tool system, which loads the wireless signal transmitter setting information of the wireless signal transmitter after the wireless signal transmitter setting tool system uses the electronic map to set the actual installation position from a wireless signal transmitter back end system of the cloud server, and provides at least one wireless signal transmitter control, so that the wireless signal transmitter after the wireless signal transmitter setting tool system uses the electronic map to set the actual installation position is bound with augmented reality interactive content by the wireless signal transmitter control, and the bound result is stored into augmented reality setting information comprising the identification code of the wireless signal transmitter and the augmented reality interactive content associated with the wireless signal transmitter, so that the augmented reality setting information comprising the identification code of the wireless signal transmitter and the augmented reality interactive content associated with the wireless signal transmitter is placed on the cloud server; and
a mobile device capable of shooting live-action images, which receives the augmented reality setting information comprising the identification code of the wireless signal transmitter and the augmented reality interaction content associated with the wireless signal transmitter from the cloud server;
when the mobile device detects the real-time live-action image of the wireless signal transmitter or the picture which is consistent with the wireless signal transmitter after the actual installation position is set by the wireless signal transmitter setting tool system through the electronic map, the mobile device executes the augmented reality action according to the augmented reality interaction content recorded by the augmented reality setting information comprising the identification code of the wireless signal transmitter and the augmented reality interaction content which is related to the wireless signal transmitter.
13. The system of claim 12, wherein the wireless signal transmitter is a Beacon (Beacon) transmitter, a Zigbee (Zigbee) transmitter, a Radio Frequency Identification (RFID) tag, an ultrasonic transmitter, an infrared transmitter, a Near Field Communication (NFC) device, or a wireless network base station, and the mobile device is a smart phone, a tablet, a notebook, or a smart glasses.
14. The system of claim 12, wherein the cloud server has an augmented reality backend system through which the augmented reality setting information is downloaded to the mobile device.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW107112739 | 2018-04-13 | ||
| TW107112739A TWI656447B (en) | 2018-04-13 | 2018-04-13 | Method and system for augmenting reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110377147A CN110377147A (en) | 2019-10-25 |
| CN110377147B true CN110377147B (en) | 2024-04-16 |
Family
ID=66995935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810481192.0A Active CN110377147B (en) | 2018-04-13 | 2018-05-18 | Method and system for amplifying reality |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110377147B (en) |
| TW (1) | TWI656447B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI744737B (en) * | 2019-12-11 | 2021-11-01 | 中華電信股份有限公司 | System and method for content control in augmented reality and computer readable storage medium |
| TWI804294B (en) * | 2022-04-28 | 2023-06-01 | 中華電信股份有限公司 | Remote device control system, method and computer readable medium for augmented reality collaboration |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104008357A (en) * | 2013-02-25 | 2014-08-27 | 陈郁文 | Audio-video interaction system and operation carrier for audio-visual interaction system |
| CN104346081A (en) * | 2013-07-25 | 2015-02-11 | 邱美虹 | Augmented reality learning system and method thereof |
| CN106371585A (en) * | 2016-08-23 | 2017-02-01 | 塔普翊海（上海）智能科技有限公司 | Augmented reality system and method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101429954B1 (en) * | 2010-06-25 | 2014-08-14 | 에스케이텔레콤 주식회사 | Method for Generating In-Building Radio Wave Evnironment Map, Apparatus therefor |
| US8174931B2 (en) * | 2010-10-08 | 2012-05-08 | HJ Laboratories, LLC | Apparatus and method for providing indoor location, position, or tracking of a mobile computer using building information |
| US20130297460A1 (en) * | 2012-05-01 | 2013-11-07 | Zambala Lllp | System and method for facilitating transactions of a physical product or real life service via an augmented reality environment |
| CN103543700B (en) * | 2012-06-27 | 2016-08-17 | 尤比奎蒂网络公司 | The method and apparatus controlling sensor device |
| TW201638560A (en) * | 2015-04-22 | 2016-11-01 | 金成珍 | Beacon device and operating method for providing various messages via recognizing identification tag position |
| TWM548945U (en) * | 2017-07-10 | 2017-09-11 | 李義順 | System and platform for providing location-based service |
-
2018
- 2018-04-13 TW TW107112739A patent/TWI656447B/en active
- 2018-05-18 CN CN201810481192.0A patent/CN110377147B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104008357A (en) * | 2013-02-25 | 2014-08-27 | 陈郁文 | Audio-video interaction system and operation carrier for audio-visual interaction system |
| CN104346081A (en) * | 2013-07-25 | 2015-02-11 | 邱美虹 | Augmented reality learning system and method thereof |
| CN106371585A (en) * | 2016-08-23 | 2017-02-01 | 塔普翊海（上海）智能科技有限公司 | Augmented reality system and method |
Non-Patent Citations (1)
| Title |
|---|
| 基于增强现实和位置服务的手机广告系统;叶小榕;邵晴;;科技导报(04);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110377147A (en) | 2019-10-25 |
| TW201944262A (en) | 2019-11-16 |
| TWI656447B (en) | 2019-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102124017B1 (en) | Image photographing apparatus , user device and method for establishing communications between image photographing apparatus and user device | |
| CN102317969A (en) | Digital photo frame with dial-a-tag functionality | |
| JP6264870B2 (en) | Information providing apparatus, program, and system | |
| KR101574241B1 (en) | Qr code recognition processing system | |
| CN105530607A (en) | User recommending method, device and system | |
| CN104951498B (en) | Method for generating the content under augmented reality mode | |
| CN104243928A (en) | Electronic terminal and remote monitoring method implemented by same | |
| CN110377147B (en) | Method and system for amplifying reality | |
| US9424361B2 (en) | Information communication method and information communication apparatus | |
| CN102572183A (en) | Sharing of media file including META information | |
| CN106027872A (en) | Camera control method and system | |
| US11048345B2 (en) | Image processing device and image processing method | |
| CN104065742A (en) | Picking-up person information processing method and device for safe kindergarten picking up | |
| CN102810109A (en) | Storing method and device for augmented reality view | |
| JP5954417B2 (en) | Order system | |
| KR20170040492A (en) | Method and apparatus for registering device for smart service environment | |
| CN105809162A (en) | Method and device for acquiring WIFI hot pot and picture associated information | |
| CN102893295B (en) | Storage card | |
| CN104239842A (en) | Visual sense identification realization method, device and system | |
| US9854132B2 (en) | Image processing apparatus, data registration method, and data registration program | |
| JP7012485B2 (en) | Image information processing device and image information processing method | |
| KR20170083944A (en) | Method of providing reward to smart device and landing page server | |
| KR20170000191A (en) | Mehod for providing content in terminal and terminal thereof | |
| KR20130026586A (en) | Wireless terminal and information processing method | |
| US20140057647A1 (en) | Mobile terminal, cloud server, and method for identifying hot spot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |