JP6548241B1 - Augmented reality program and information processing apparatus - Google Patents

Abstract

An augmented reality program that allows a virtual object placed in an augmented reality space to be easily shared among a plurality of terminals. An augmented reality program displays on a display 22 an augmented reality space based on an image photographed by a camera 21 on a control unit 26 of a terminal 20, and specifies a virtual object placed in the augmented reality space. Generating object data including object information including information to be performed and information specifying the position and orientation of the virtual object, transmitting object data to the server 50, and requesting the server 50 for specific object data And a step of receiving the requested specific object data from the server 50 and a step of arranging the virtual object specified by the object information included in the received specific object data in the augmented reality space 30. [Selection] Figure 1

Description

  The present invention relates to an augmented reality program and an information processing apparatus, and more particularly to an augmented reality program in which an augmented reality space in which virtual objects are arranged in a real space is shared among a plurality of terminals.

  BACKGROUND In recent years, development of technology for adding information by computer to the real world perceived by humans, that is, augmented reality (AR) technology is in progress. As one of such augmented reality techniques, one that adds a virtual object to an image of a physical space taken by a camera and displays it is known. In addition, a technology for sharing a virtual object added to such a real space between a plurality of terminals has also been developed (see, for example, Patent Document 1). However, in the technology described in Patent Document 1, setting is required for each group sharing virtual objects, and sharing of virtual objects is not easy.

U.S. Patent Application Publication No. 2011/216002

  The present invention has been made in view of such problems in the prior art, and it is an object of the present invention to provide an augmented reality program that allows a plurality of terminals to easily share a virtual object placed in the augmented reality space. The first purpose.

  Another object of the present invention is to provide an information processing apparatus capable of easily sharing a virtual object arranged in an augmented reality space among a plurality of terminals.

According to a first aspect of the present invention, there is provided an augmented reality program that enables virtual terminals placed in the augmented reality space to be easily shared among a plurality of terminals. The augmented reality program comprises the steps of: displaying, on the display unit, an augmented reality space based on an image captured by the camera on a processor of a terminal including a camera, a display unit, and a communication unit; Generating object data including one or more pieces of object information including information specifying the virtual object to be played and information specifying the position and orientation of the virtual object disposed in the augmented reality space; Transmitting the generated object data to a server connected to the network via a communication unit; receiving from the server an identifier uniquely identifying the object data transmitted to the server; and Generating a URL including an address to be identified and the identifier; Transmitting the created URL to another terminal, receiving the URL transmitted from the other terminal, and transmitting the identifier included in the URL to the server specified by the URL. , receiving object data identified by the identifier from the server, the virtual object identified by the one or more object information included in Kio object data on which the received, identified by the object information Placing in the augmented reality space in position and orientation.

  According to such an augmented reality program, object data can be transmitted and received between a plurality of terminals via a server, and virtual objects arranged in the augmented reality space can be easily shared among a plurality of terminals. It becomes possible.

Also, the object data may include a plurality of object information.

According to the above-described augmented reality program, since the location information of the terminal is associated with the object data, it is possible to easily share the same virtual object among a plurality of terminals in the same physical space.

According to a second aspect of the present invention, there is provided an information processing apparatus capable of easily sharing a virtual object arranged in an augmented reality space among a plurality of terminals. The information processing apparatus includes a communication unit capable of communicating with a plurality of terminals via a network, a storage unit storing information on a virtual object arranged in the augmented reality space, and the virtual object among the plurality of terminals. And a control unit that makes it possible to share the The control unit is object data received from a first terminal among the plurality of terminals via the communication unit, and information for specifying a virtual object arranged in the augmented reality space; Object data including one or more object information including information specifying the position and orientation of the virtual object arranged in the space, and the position information of the first terminal are associated with a unique identifier and the storage The unique identifier is acquired from the URL received from the second terminal among the plurality of terminals via the communication unit, and the object data associated with the unique identifier is stored. The object data extracted from the unit and transmitted via the communication unit to the second terminal.

  According to such an information processing apparatus, it is possible to transmit object data from the first terminal to the second terminal, so that the virtual object arranged in the augmented reality space is divided into the first terminal and the second terminal. It is possible to share easily.

Also, the object data may include a plurality of object information.

According to the above information processing apparatus, since the position information of the terminal and the object data are associated with each other and stored in the storage unit, it is possible to easily share the same virtual object among a plurality of terminals in the same physical space. It becomes.

  According to the present invention, virtual objects arranged in the augmented reality space can be easily shared among a plurality of terminals.

FIG. 1 is a conceptual view schematically showing an information processing system in the first embodiment of the present invention. FIG. 2 is a flowchart showing processing performed in the terminal of FIG. FIG. 3A is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3B is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3C is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3D is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3E is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3F is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3G is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3H is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 3I is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 4 is a conceptual diagram showing a data structure of object data generated in the terminal of FIG. FIG. 5 is a conceptual diagram showing processing performed between the terminal of FIG. 1 and a server. FIG. 6 is a conceptual diagram showing the data structure of a database stored in the storage unit in the server of FIG. FIG. 7 is a conceptual view showing processing performed between the other terminal of FIG. 1 and the server. FIG. 8 is a conceptual view schematically showing an information processing system in the second embodiment of the present invention. FIG. 9 is a diagram showing an example of a screen of a display of the terminal of FIG. FIG. 10 is a conceptual diagram showing processing performed between the terminal of FIG. 8 and the server. FIG. 11 is a conceptual diagram showing a data structure of a database stored in the storage unit in the server of FIG. FIG. 12 is a conceptual diagram showing processing performed between the terminal of FIG. 8 and the server.

  Hereinafter, embodiments of an augmented reality program and an information processing apparatus according to the present invention will be described in detail with reference to FIGS. 1 to 12. Note that, in FIG. 1 to FIG. 12, the same or corresponding components are given the same reference numerals, and duplicate explanations are omitted. In addition, in FIGS. 1 to 12, the scale and dimensions of each component may be exaggerated and shown, or some components may be omitted.

  FIG. 1 is a conceptual view schematically showing an information processing system in the first embodiment of the present invention. This information processing system is composed of a plurality of terminals 20 (or 20 ') connected to a network 10 such as the Internet and a server 50 as an information processing apparatus. Each terminal 20 can generate an augmented reality space in which virtual objects are arranged in the real space as described later, and these virtual objects can be shared among a plurality of terminals 20 via the server 50. ing. Although only the configuration of the terminal 20 will be described below, the terminal 20 ′ also has the same configuration and function as the terminal 20.

  As shown in FIG. 1, each of the terminals 20 is constituted by, for example, a smartphone or a tablet computer, and as a camera 21 for imaging the real world, a display 22 as a display unit, and an input unit for receiving input from a user. A touch panel 23, a storage unit 24 including a ROM, a RAM, a flash memory, etc., a communication unit 25 for performing data communication by connecting to the network 10, and a control unit 26 for controlling the operation of each component There is. The storage unit 24 includes an OS (Operating System), a program for controlling the terminal 20, an augmented reality program (hereinafter referred to as "AR program") for realizing the augmented reality space according to the present invention, and various other data. Is stored. The control unit 26 includes a processor (CPU), a ROM, a RAM, and the like, and realizes various functions by loading a program stored in the storage unit 14 into the RAM and executing the program by the processor.

  The server 50 further includes a storage unit 51 including a ROM, a RAM, a flash memory, etc., a communication unit 52 for performing data communication by connecting to the network 10, and a control unit 53 for controlling the operation of each component. Have. The storage unit 51 stores an OS, a program for controlling the server 50, a database 54 described later, still images and videos uploaded from the terminal 20, and various other data. The control unit 53 includes a processor (CPU), a ROM, a RAM, and the like, and realizes various functions by loading a program stored in the storage unit 51 into the RAM and executing the program by the processor.

  FIG. 2 is a flowchart showing processing performed in the terminal 20. In the information processing system configured as described above, when the AR program is executed by the control unit 26, the control unit 26 activates the camera 21 (step S1), and based on the image of the physical space photographed by the camera 21. The augmented reality space is displayed on the display 22 (step S2). At this stage, virtual objects to be described later have not been arranged in the augmented reality space yet, so an image of the reality space captured by the camera 21 is displayed as it is on the display 22 as the augmented reality space.

  At this time, as shown in FIG. 3A, in addition to the augmented reality space 30, the buttons 31 and 32 for generating a virtual object and the button 41 for starting imaging are also displayed on the display 22. The button 31 is a button for generating a virtual object composed of a stamp image, and the button 32 is a button for generating a virtual object composed of a character string.

  Next, the control unit 26 determines whether or not the buttons 31 and 32 for generating virtual objects are pressed through the touch panel 23 (step S3), and it is determined that one of the buttons 31 and 32 is pressed. In the case, a virtual object is generated in accordance with the pressed button 31, 32 (step S4). That is, when the button 31 is pressed, a virtual object consisting of a stamp image is generated, and when the button 32 is pressed, a virtual object consisting of a character string is generated.

  Then, the control unit 26 arranges the generated virtual object in the augmented reality space 30 based on the position and orientation of the terminal 20 at that time (step S5), and generates object data including object information on the generated virtual object. The object data is generated and stored in the storage unit 24 (step S6).

  FIG. 4 is a conceptual diagram showing the data structure of this object data. As shown in FIG. 4, object data contains one or more object information. One piece of object information corresponds to one virtual object, and is a state for specifying an object number as an identifier uniquely determined in one object data, and a position and an orientation of a virtual object arranged in the augmented reality space Specific data and model data for specifying the content of the virtual object are included. As the object numbers, for example, those to which serial numbers are attached in the order of creation of virtual objects can be used. Further, as the state identification data, for example, four-dimensional matrix data used in AR Kit of Apple Inc. can be used. Model data includes information according to the type of virtual object to be created.

  Thereafter, the control unit 26 displays the virtual object arranged in the augmented reality space on the display 22 together with the image of the real space (step S2). Thereby, the display 22 is displayed as if the virtual object is actually arranged in the real space.

  On the other hand, when the control unit 26 determines in step S3 that neither of the buttons 31 and 32 is pressed, it determines whether the button 41 for starting imaging is pressed (step S7). When the control unit 26 determines that the button 41 is pressed, as described later, the control unit 26 captures an image of the augmented reality space 30 (step S8), and transmits the captured data and the object data described above to the server (step S9). . If the control unit 26 determines that the button 41 is not pressed, the process returns to step S2.

  Here, to describe generation of a virtual object in more detail, in step S3, when the control unit 26 determines that the button 31 for creating a virtual object made of a stamp image is pressed among the three buttons 31 and 32, The control unit 26 reads the stamp images stored in the storage unit 24 and displays a list of these stamp images 61 on the display 22 as shown in FIG. 3B. The control unit 26 also displays a cancel button 62 and an enter button 63 on the display 22. When the user selects a desired stamp image 61 from the list via the touch panel 23 and presses the determination button 63, a virtual object consisting of the selected stamp image 61 is created (step S4). Are arranged in the augmented reality space 30 with reference to the position and orientation of the terminal 20 at that time (step S5). When the cancel button 62 is pressed, the generation of the virtual object is canceled, and the process returns to step S2.

  At this time, when one or more virtual objects are already generated and the object data is stored in the storage unit 24, object information on the virtual object consisting of the selected stamp image is added to the object data. In the example, no object data is generated yet, so object data including object information on a virtual object consisting of the selected stamp image 61 is newly created and stored in the storage unit 24 (step S6).

  For example, when the user selects the star stamp image 61A on the screen shown in FIG. 3B, as shown in FIG. 3C, a virtual object consisting of the star stamp image 61A based on the position and orientation of the terminal 20 at that time. 71 are arranged in the augmented reality space 30. At this time, for example, “0” as an object number, four-dimensional matrix data representing the position and orientation of the virtual object 71 based on the position and orientation of the terminal 20 at this time as state identification data, and within the terminal 20 as model data Object data including object information including the file name (for example, “star. Png”) of the stored stamp image is generated and stored in the storage unit 24. This object data is described in, for example, a JSON (JavaScript Object Notation) format.

  The display 22 displays the augmented reality space 30 in which the virtual object 71 consisting of the star stamp image 61A is arranged, and when the position or the orientation of the terminal 20 is changed, the orientation, the position, or the size of the virtual object 71 As shown in FIG. 3D, the virtual object 71 is displayed as if it were actually placed in the real space.

  If the control unit 26 determines in step S3 that the button 32 for creating a virtual object composed of a character string is pressed among the three buttons 31 and 32, the control unit 26 determines that the character string is displayed as shown in FIG. 3E. The display 22 displays an input box 64 for inputting a color picker 65, a color picker 65 for selecting a character color, a cancel button 62, and an enter button 63. When the user selects the input box 64 via the touch panel 23, the character input mode is set, and a character string can be input to the input box 64. When the user selects a desired color in the color picker 65 through the touch panel 23, the color of the character string in the input box 64 changes to the selected color. When the user selects the input box 64, inputs a desired character string, and presses the determination button 63, a virtual object consisting of the input character string is created (step S4), and this virtual object is the terminal at that time It is arranged in the augmented reality space 30 based on the position and orientation of 20 (step S5). When the cancel button 62 is pressed, the generation of the virtual object is canceled, and the process returns to step S2.

  At this time, since the object data is already stored in the storage unit 24, object information on a virtual object consisting of the input character string is generated and added to the object data (step S6). For example, when the user inputs a character string "patent" in the input box 64 and presses the determination button 63, as shown in FIG. 3F, the character string "patent" with reference to the position and orientation of the terminal 20 at that time. Are arranged in the augmented reality space 30. At this time, for example, “1” as an object number, four-dimensional matrix data representing the position and orientation of the virtual object 72 based on the position and orientation of the terminal 20 at this time as state identification data, and a character string input as model data Object information including “patent” and information of the selected color is generated, and this object information is added to the object data stored in the storage unit 24. Note that an interface capable of changing the font and size of the character string may be added to the screen shown in FIG. 3E, and information specifying the font and size of the character string may be included as model data in the object information.

  The display 22 displays an augmented reality space 30 in which a virtual object 71 consisting of a stamp image of asterisks and a virtual object 72 consisting of a character string "Patent" are arranged. When the position or orientation of the terminal 20 is changed, Along with this, the direction, position, and size of the virtual objects 71 and 72 change, and as shown in FIG. 3G, the virtual objects 71 and 72 are displayed as if they are actually arranged in the real space.

  In this way, the user can place one or more virtual objects in any position and orientation within the augmented reality space. After all virtual objects are placed, when the shooting start button 41 (see FIG. 3A etc.) is pressed, the control unit 26 shoots the augmented reality space 30 displayed on the display 22, and stores the shooting data 24 (step S8). The shooting data is data in which the virtual object created as described above is added to the image data of the real space shot by the camera 21. The shooting data may be still image data or moving image data.

  When imaging of the augmented reality space is completed, the control unit 26 displays an upload button 66 on the display 22, as shown in FIG. 3H. When the user presses the upload button 66 via the touch panel 23, the control unit 26 accesses the server 50 connected to the network 10 via the communication unit 25 and captures the object data generated as described above The data is sent to the server 50 (step S9). At this time, information (for example, “AAA”) of the user operating the terminal 20 is also transmitted to the server 50 together with the object data.

  FIG. 5 is a conceptual diagram showing processing performed between the terminal 20 and the server 50 at this time. As shown in FIG. 5, first, the control unit 26 of the terminal 20 transmits the imaging data to the server 50 via the communication unit 25 (step S11). When the communication unit 52 of the server 50 receives the imaging data from the terminal 20, the control unit 53 stores the received imaging data in the storage unit 51 (step S12). Further, the control unit 26 of the terminal 20 transmits the object data and the user information to the server 50 (step S13). When the communication unit 52 of the server 50 receives object data and user information from the terminal 20, the control unit 53 stores the received information in the database 54 stored in the storage unit 51 (step S14).

  FIG. 6 is a conceptual diagram showing the data structure of the database 54 stored in the storage unit 51 in the server 50. As shown in FIG. As shown in FIG. 6, the database 54 includes a record including an identifier 81 for uniquely identifying the received object data, user information 82 for identifying the transmitting user, and object data 83. In step S14, when the communication unit 52 of the server 50 receives object data and user information from the terminal 20, the control unit 53 generates an identifier 81 (for example, "3") that uniquely identifies the received object data. Received object data 83 (for example, data (JSON data 3) describing object data including object information of virtual object 71 and object information of virtual object 72 in JSON format) and user information 82 (for example, “AAA”) It is stored in the database 54 in association with the generated identifier 81.

  Next, the control unit 53 of the server 50 transmits the generated identifier 81 (for example, “3”) to the terminal 20 via the communication unit 52 (step S15). When the communication unit 25 of the terminal 20 receives the identifier 81 from the server 50, the control unit 26 determines that the transmission of the imaging data and the object data to the server 50 is completed, and as shown in FIG. The button 67 is displayed on the display 22 (step S16). When the user presses the share button 67 via the touch panel 23, the control unit 26 operates to share the identifier 81 transmitted from the server 50 with the other terminal 20 '(step S17). For example, the control unit 26 of the terminal 20 generates a URL (Uniform Resource Locator) including a protocol for activating an AR program, an address specifying the server 50, and an identifier 81 (for example, "3"). May be transmitted to another terminal 20 'via e-mail, SNS, etc., and the identifier 81 may be shared with the other terminal 20'. Further, the URL may be further shortened and transmitted to another terminal 20 '.

  FIG. 7 is a conceptual diagram showing processing performed between the other terminal 20 ′ receiving the identifier 81 and the server 50. When the terminal 20 'receives the URL including the identifier 81 from the terminal 20 via the mail or SNS as described above (step S21), the control unit 26 of the terminal 20' follows the protocol described in the received URL, The above-described AR program is activated (step S22). Then, the control unit 26 of the terminal 20 ′ accesses the server 50 specified by the received URL via the communication unit 25 and transmits the identifier 81 (for example, “3”) described in the URL to the server 50 (see FIG. Step S23). When the communication unit 52 of the server 50 receives the identifier 81 from the terminal 20 ′, the control unit 53 responds from the database 54 stored in the storage unit 51 using the received identifier 81 (for example, “3”) as a key. A record is searched (step S24). Thereby, in the example shown in FIG. 6, the record whose identifier 81 is “3”, the user information 82 is “AAA”, and the object data 83 is “JSON data 3” is extracted.

  Next, the control unit 53 of the server 50 transmits the object data 83 in the extracted record to the terminal 20 'via the communication unit 25 (step S25). When the communication unit 25 of the terminal 20 ′ receives the object data 83 from the server 50, the control unit 26 generates a virtual object (the virtual object 71 and the virtual object 72 in this example) from the object information included in the received object data 83 Then, the virtual objects 71 and 72 are placed in the augmented reality space 30 at the position and orientation specified by the object information (step S26). Then, the control unit 26 displays the augmented reality space 30 in which the virtual objects 71 and 72 are arranged on the display 22 (step S27). As a result, as shown in FIG. 3G, the display 22 is displayed as if the virtual object generated by the user "AAA" is actually arranged in the real space.

  As described above, according to the present embodiment, the virtual objects 71 and 72 arranged in the augmented reality space in the terminal 20 can be reproduced in the augmented reality space of the other terminal 20 ′ at the same position and orientation as the terminal 20. It becomes possible.

  FIG. 8 is a conceptual view schematically showing an information processing system in the second embodiment of the present invention. As shown in FIG. 8, the terminal 20 (or 20 ′) in the present embodiment has a GPS (Global Positioning System) 127 as a position information acquisition unit that acquires position information of the terminal 20.

  As in the first embodiment described above, when the AR program is executed by the control unit 26 of the terminal 20, the control unit 26 activates the camera 21 and based on the image of the physical space photographed by the camera 21. The augmented reality space is displayed on the display 22. At this time, as shown in FIG. 9, the display 22 includes an augmented reality space 30, a button 31 for generating a virtual object consisting of a stamp image, and a button 32 for generating a virtual object consisting of a character string. A button 131 for reproducing one or more virtual objects already created and a button 41 for starting shooting are displayed. The processing in the case where the button 31, 32, 41 is pressed is the same as that of the first embodiment described above, and thus the description thereof is omitted here.

  In the present embodiment, after the user presses the shooting start button 41 to shoot the augmented reality space, when the upload button 66 (see FIG. 3H) is pressed, the process shown in FIG. 10 is performed. That is, the control unit 26 of the terminal 20 transmits the imaging data to the server 50 via the communication unit 25 (step S31). When the communication unit 52 of the server 50 receives the imaging data from the terminal 20, the control unit 53 stores the received imaging data in the storage unit 51 (step S32).

  Then, the control unit 26 of the terminal 20 acquires position information (for example, longitude and latitude) of the terminal 20 by the GPS 127 (step S33), and transmits the position information to the server 50 together with object data and user information (step S34). . When the communication unit 52 of the server 50 receives the position information, the object data, and the user information from the terminal 20, the control unit 53 stores the received information in the database 154 stored in the storage unit 51 (step S35).

FIG. 11 is a conceptual diagram showing the data structure of the database 154 stored in the storage unit 51 in the server 50. As shown in FIG. As shown in FIG. 11, this database 54 includes an identifier 81 for uniquely identifying the received object data, user information 82 for identifying the user who sent the data, object data 83, and the terminal 20 for which the object data has been generated. A record including position information 184 is included. In step S35, when the communication unit 52 of the server 50 receives the position information, the object data, and the user information from the terminal 20, the control unit 53 determines an identifier 81 (for example, "3") that uniquely identifies the received object data. The generated object data 83 (for example, JSON data 3), the user information 82 (for example, “AAA”), and the position information (for example, “X ₃ , Y ₃ ”) are associated with the generated identifier 81 and save.

  Next, the control unit 53 of the server 50 transmits the generated identifier 81 (for example, “3”) to the terminal 20 via the communication unit 52 (step S36). When the communication unit 25 of the terminal 20 receives the identifier 81 from the server 50, the control unit 26 determines that the transmission of the imaging data and the object data to the server 50 is completed, and the share button 67 (see FIG. 3I) is displayed on the display 22. (Step S37). When the user presses the share button 67, the control unit 26 operates to share the identifier 81 transmitted from the server 50 with the other terminal 20 '(step S38).

  Next, processing when the button 131 shown in FIG. 9 is pressed will be described. This button 131 is a button for reproducing one or more virtual objects already created. FIG. 12 is a conceptual diagram showing processing performed between the terminal 20 and the server 50 when the button 131 is pressed.

As illustrated in FIG. 12, when the control unit 26 of the terminal 20 determines that the button 131 is pressed, the position information (for example, “X ₂ , Y ₂ ”) of the terminal 20 is acquired by the GPS 127 (step S41). The position information is transmitted to the server 50 (step S42). When the communication unit 52 of the server 50 receives the position information from the terminal 20, the control unit 53 uses the received position information (for example, “X ₂ , Y ₂ ”) as a key to store the database 154 stored in the storage unit 51. The corresponding record is retrieved from (step S43). Thereby, in the example shown in FIG. 11, a record in which the identifier 81 is “2”, the user information 82 is “BBB”, the object data 83 is “JSON data 2”, and the position information is “X ₂ , Y ₂ ” A record in which the identifier 81 is “4”, the user information 82 is “CCC”, the object data 83 is “JSON data 4”, and the position information is “X ₂ , Y ₂ ” is extracted.

  Next, the control unit 53 of the server 50 transmits the object data 83 in the extracted record to the terminal 20 via the communication unit 25 (step S44). When the communication unit 25 of the terminal 20 receives the object data 83 from the server 50, the control unit 26 displays a list of the received object data 83 on the display 22 (step S45). For the display of the list, for example, a virtual object can be generated from object information included in each object data 83 and displayed as a thumbnail of the virtual object.

  Then, when the user selects any of the object data 83 via the touch panel 23, the control unit 26 generates a virtual object from the object information included in the selected object data 83, and this virtual object is used as the object information. It arrange | positions in the augmented reality space 30 by the identified position and direction (step S46). Then, the control unit 26 displays the augmented reality space 30 in which the virtual object is arranged on the display 22 (step S47). For example, when the user selects the object data 83 identified by the identifier 81 “2”, the virtual object generated by the user “BBB” is actually placed in the real space in the same place as the terminal 20 It is displayed on the display 22 as if it were done.

  As described above, according to the present embodiment, since the position information of the terminal 20 is associated with the object data 83 and stored in the database 154, the same virtual object can be easily obtained between the plurality of terminals 20 in the same physical space. It becomes possible to share.

  Here, the database 154 includes information representing the display order when displaying the list of object data 83 on the display 22 of the terminal 20 as described above, and the list of object data 83 is displayed in the display order of the display 20. It may be displayed at 22. In this case, the display order may be determined by bidding between users. Alternatively, information representing the expiration date of the object data 83 may be included in the database 154, and only the object data 83 that has not passed the expiration date may be displayed on the display 22 of the terminal 20. In this case, the user who created the object data 83 or another user may be able to extend the expiration date of the object data 83 by payment of compensation.

  In the embodiment described above, an example using the stamp image stored in the storage unit 24 in the terminal 20 as a virtual object has been described, but a photo or URL stored in the storage unit 24 in the terminal 20 as a virtual object It is also possible to use an image on the network identified by. Also, a line drawn on the touch panel 23 by the user can be used as a virtual object.

  The AR program described above may be stored in a storage device of a server for data distribution, and may be distributed to the terminal 20 via the network 10 such as the Internet. Furthermore, the storage medium may be sold or distributed in a state where the AR program is stored in a storage medium such as an optical disc such as a CD, a DVD, and a BD (Blu-Ray Disk), a USB memory, and a memory card.

  Further, although the above-described network 10 is exemplified by the Internet, the network 10 may be a wired LAN (Local Area Network), a wireless LAN, or another network.

  Although the preferred embodiments of the present invention have been described above, it is needless to say that the present invention is not limited to the above-described embodiments and may be implemented in various different forms within the scope of the technical idea thereof.

REFERENCE SIGNS LIST 10 network 14 storage unit 20, 20 'terminal 21 camera 22 display 23 touch panel 24 storage unit 25 communication unit 26 control unit 30 augmented reality space 50 server 51 storage unit 52 communication unit 53 control unit 54 database 61 stamp image 71 virtual object 72 virtual Object 127 GPS
154 databases

Claims (2)

To the processor of the terminal including the camera, the display unit and the communication unit,
Displaying on the display unit an augmented reality space based on an image captured by the camera;
Object data including one or more object information including information specifying a virtual object arranged in the augmented reality space and information specifying a position and an orientation of the virtual object arranged in the augmented reality space Generating the
Acquiring location information of the terminal;
Transmitting the generated object data and position information of the terminal to a server connected to a network via the communication unit;
Receiving from the server an identifier that uniquely identifies the object data sent to the server;
Generating a URL including an address identifying the server and the identifier;
Sending the generated URL to another terminal;
Receiving the URL sent from another terminal;
Sending the identifier contained in the URL to the server identified by the URL;
Receiving from the server object data identified by the identifier;
Placing a virtual object specified by the one or more pieces of object information contained in the received object data in the augmented reality space at a position and an orientation specified by the object information Reality program.   The augmented reality program according to claim 1, wherein the object data includes a plurality of object information.

Images