JP2012108711A - Terminal device, operation method of terminal device, and expanded reality system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To compose an image, which should be composed in a past visit place, in a place different from the past visit place.SOLUTION: A terminal device transmits acquired position information to an external server in which additional information related to the position information in association with the position information is stored, and adds the additional information acquired from the external server to an image to display it. A composite image generation unit 141 generates a composite image obtained by adding additional information to an acquired image. Storage means stores the composite image as an image for re-display, and stores at least one of the position information for acquiring the additional information which should be added to the predetermined image for re-display and acquired additional information which should be added to the predetermined image for re-display, in association with the predetermined image for re-display. The composite image generation unit 141 generates the image based upon the image for re-display, and the additional information acquired from the external server based upon the position information stored in association with the image for re-display.

Description

  The present invention relates to a terminal device, a terminal device operation method, and an augmented reality system.

  In recent years, augmented reality (AR) services that provide additional information to a user by combining and displaying information generated by a computer on a camera preview image have increased.

  Specifically, the AR service providing device acquires position information by a GPS function or the like in response to activation of an application linked to the camera, accesses a database of an external server based on the acquired position information, and receives peripheral information. Is downloaded from an external server, and the downloaded AR tag is combined with the preview image of the camera and displayed. Thus, in the AR service, it becomes possible to present additional information related to the surrounding environment in the real world to the user. For example, there are utilization examples such as advertisements for stores in the vicinity of the current location, sightseeing guidance for tourist sites currently visited, and the user leaving his / her own AR tag for meeting. There is also an example in which the WEB page can be accessed via the AR tag displayed on the synthesized image.

  Patent Document 1 describes an information processing system in which a user virtually gives information to a real-world situation, and allows the user to find desired information quickly and easily.

JP 2006-209784 A

However, in the current AR service, only the AR tag associated with the current position of the terminal can be acquired. Therefore, after moving to another location, the AR tag that can be acquired at the original location cannot be acquired again. As a result, there is a problem that the synthesized image synthesized at the original location cannot be synthesized at another location, which is not convenient.
An object of the present invention is to re-synthesize an image to be synthesized at a past visited place at a place different from the past visited place without going to the past visited place.

  A terminal device according to the present invention transmits a location information to an external server in which an AR tag is stored in association with the location information, and adds the AR tag received from the external server to an image for display. An image acquisition unit that acquires an image indicating the periphery of the current position of the terminal, a position acquisition unit that acquires the position information indicating the current position of the terminal, and the position acquired by the position acquisition unit An AR tag acquisition unit that acquires the AR tag from the external server by transmitting position information to the external server, a composite image generation unit that generates a composite image based on the image and the AR tag, The AR tag to be added to the predetermined redisplay image while storing the image acquired by the image acquisition unit or the image generated by the composite image generation unit as a redisplay image Storage means for storing at least one of the position information to be acquired and the acquired AR tag to be added to the predetermined redisplay image in association with the predetermined redisplay image. The composite image generation unit applies the AR tag or the redisplay image acquired from the external server based on the redisplay image and the position information stored in association with the redisplay image. An image is generated based on the AR tag stored in association with the AR tag.

  The operation method of the terminal device according to the present invention includes the AR tag transmitted from the external server to the external server in which the AR tag related to the positional information is stored in association with the positional information. Is a method of operating a terminal device that adds an image to an image and stores the acquired image or a composite image obtained by adding the AR tag to the acquired image as a redisplay image, At least one of the position information for acquiring the AR tag to be added to the redisplay image and the acquired AR tag to be added to the predetermined redisplay image is the predetermined redisplay image. The A obtained from the external server based on the re-display image and the position information stored in association with the re-display image. Wherein the accessory image stored in association with the tag or the re-display image, to generate an image based on.

  The system according to the present invention also includes an external server in which an AR tag is stored in association with location information, and the location information is transmitted to the external server, and the AR tag received from the external server is added to the image. A terminal device that displays the image, and the terminal device acquires an image acquisition unit that acquires an image showing the periphery of the current position of the terminal and the position information that indicates the current position of the terminal A position acquisition unit, an AR tag acquisition unit that acquires the AR tag from the external server by transmitting the position information acquired by the position acquisition unit to the external server, the image, and the AR tag. And a composite image generation unit that generates a composite image, and an image acquired by the image acquisition unit or an image generated by the composite image generation unit is stored as a redisplay image. Both at least one of the position information for acquiring the AR tag to be added to the predetermined image for redisplay and the acquired AR tag to be added to the predetermined image for redisplay is determined in advance. Storage means for storing in association with the image for redisplay, and the composite image generation unit stores the image for redisplay and the position information stored in association with the image for redisplay. An image is generated based on the AR tag acquired from the external server or the AR tag stored in association with the redisplay image.

  According to the present invention, it is possible to re-synthesize an image to be synthesized at a past visited place at a place different from the past visited place without going to the past visited place.

1 is a block diagram of an augmented reality system according to a first exemplary embodiment. 3 is a table for storing position information according to the first exemplary embodiment; 3 is a table for storing composite image data according to the first embodiment; FIG. 4 is a mode switching diagram for each time according to the first embodiment. 3 is a flowchart of a display mode according to the first embodiment. 3 is a flowchart of a recording mode according to the first embodiment. 3 is a flowchart of a reproduction mode according to the first embodiment. FIG. 3 is a block diagram of an augmented reality system according to a second exemplary embodiment. 10 is a table for storing original image data according to the second embodiment. 10 is a flowchart of a recording mode according to the second embodiment. 10 is a flowchart of a reproduction mode according to the second embodiment. FIG. 6 is a block diagram of an augmented reality system according to a third exemplary embodiment. It is a table which memorize | stores the AR tag concerning Embodiment 3. 10 is a flowchart of a recording mode according to the third embodiment. 10 is a flowchart of a reproduction mode according to the third embodiment.

Embodiment 1
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of an augmented reality system (AR recording / playback system) 1. Hereinafter, a description will be given with reference to FIG.

  As shown in FIG. 1, the augmented reality system 1 includes a terminal device 100 and a data server 200. The terminal device 100 is a mobile phone (mobile communication terminal) that can execute an AR service. The data server 200 has a database that stores position information and AR tags (attached information) in an associated manner. In other words, the database server stores the database described on the left. When receiving the location information from the terminal device 100, the data server 20 searches for the AR tag related to the received location information based on the received location information, and transmits the AR tag hit by the search to the terminal device 100. .

  As illustrated in FIG. 1, the terminal device 100 includes an operation unit 110, an application unit 111, an image acquisition unit 120, a position information processing unit 130, an AR tag acquisition unit 133, a composition processing unit 14, a display unit 145, a storage unit 150, And a call function unit 170. The terminal device 100 includes a current time acquisition unit (not shown).

  The operation unit 110 is an input unit that inputs an instruction corresponding to a user operation. Typically, the operation unit 110 includes a keyboard, a pointing device, or a touch panel, but is not limited to these examples. In this example, the user can select the operation mode of the terminal device 100 by operating the operation unit 110. As will be apparent from the description below, in this example, the display mode, the recording mode, and the playback mode are set, but the present invention is not limited to this. The operation unit 110 outputs an operation signal to the application unit 111.

  The application unit 111 is a control unit that generates a control signal based on the input operation signal and controls the operation of the terminal device 100. The application unit 111 outputs the generated control signal to the image acquisition unit 120, the position information processing unit 130, the AR tag acquisition unit 133, the synthesis processing unit 14, and the storage unit 150. The application unit 111 is realized, for example, by executing a program by the CPU.

  The image acquisition unit 120 is a general image acquisition device (such as a camera), captures a landscape around the terminal device 100, and acquires image data (hereinafter, the acquired image data is simply referred to as an acquired image). Sometimes). When the display mode or the recording mode is selected on the operation unit 110, the image acquisition unit 120 starts shooting and acquires an image. Individual image data continuously acquired by the image acquisition unit 120 is subjected to image processing, and is handled as one image data. The image acquisition unit 120 outputs the acquired image data to the composite image generation unit 141.

  The position information processing unit 130 includes a position information acquisition unit 131 and a position information storage unit 132. The position information processing unit 130 operates based on a control signal input from the application unit 111.

  The position information acquisition unit 131 acquires position information (position data) indicating the current position of the terminal device 100. The position information acquisition unit 131 typically has a GPS (Global Positioning System) function. For example, the position information acquisition unit 131 includes an antenna, and calculates the current location of the terminal device 100 by communicating with three or more GPS satellites via the antenna. For example, the position information acquisition unit 131 acquires position information in the display mode and the recording mode. The position information acquisition unit 131 outputs the acquired position information to the position information storage unit 132 and the AR tag acquisition unit 133.

The position information storage unit 132 stores the position information supplied from the position information acquisition unit 131 and the acquisition time of the position information in association with each other. Specifically, the position information storage unit 132 stores the position information supplied from the position information acquisition unit 131 and the time when the position information is acquired by the position information acquisition unit 131 in association with each other in the table. FIG. 2 is an example of a table included in the position information storage unit 132. As shown in FIG. 2, the position information is stored in a table in association with the acquisition time of the position information. The position information storage unit 132 outputs information on the stored position information to the synthesis processing unit 14 and the storage unit 150. The position information storage unit 132 outputs the stored position information to the AR tag acquisition unit 133 in the reproduction mode.
The position information storage unit 132 is, for example, a memory, a hard disk drive, or a storage medium that is externally connected to the terminal device 100, and the storage unit is not limited thereto.

  The AR tag acquisition unit 133 includes a position information transmission unit 134 and an AR tag reception unit 135. The AR tag acquisition unit 133 acquires the AR tag by transmitting the acquired position information to the external server.

  The position information transmission unit 134 transmits the position information supplied from the position information acquisition unit 131 to the data server 200. The location information transmitting unit 134 preferably transmits the requested AR tag detail level to the data server 200. For example, the location information transmission unit 134 sends a signal to the data server 200 indicating whether to request a simple AR tag in which a short message or a link address is described, or to request an AR tag in which more detailed information is described. To send.

  The AR tag receiving unit 135 receives the AR tag transmitted from the data server 200. The AR tag reception unit 135 outputs the received AR tag to the composite image generation unit 141.

  The composition processing unit 14 includes a composite image generation unit 141, an encoder 142, and a decoder 143. The synthesis processing unit 14 operates based on a control signal input from the application unit 111.

  The composite image generation unit 141 generates composite image data (hereinafter sometimes simply referred to as a composite image) based on the image data supplied from the image acquisition unit 120 and the AR tag supplied from the AR tag acquisition unit 133. Generate. The composite image generation unit 141 outputs the generated composite image to the encoder 142 and the display unit 145.

  The encoder 142 encodes the composite image data generated by the composite image generation unit 141. The encoding method of the encoder 142 is arbitrary. Encoding by the encoder 142 may be realized by hardware or software. The encoder 142 outputs the encoded image data to the storage unit 150.

  The decoder 143 performs decoding of the composite image data stored in the storage unit 150. The composite image data decoded by the decoder 143 is supplied to the composite image generation unit 141. By decoding the composite image data by the decoder 143, the composite image stored in the storage unit 150 in an encoded state becomes a format that can be displayed on the display unit 145.

  The display unit 145 is a general display device (liquid crystal display device or the like), and displays the composite image generated by the composite image generation unit 141. The user can confirm the state in which the AR tag is added to the acquired image in the real world by looking at the display unit 145 in the display mode or the recording mode.

  The storage unit 150 stores the encoded combined image output from the combining processing unit 14 as a redisplay image according to control by the application unit 111. At this time, the storage unit 150 stores the sequentially stored composite images in association with the acquisition time of the acquired image from which the composite image is generated. Accordingly, the composite image sequentially written in the storage unit 150 is associated with the position information sequentially written in the position information storage unit 132 with reference to time. Note that the time information stored in association with the composite image indicates date, hour, minute and second. The storage unit 150 is, for example, a memory, a hard disk drive, or a storage medium that is externally connected to the terminal device 100.

  The call function unit 170 communicates with a communication device provided outside. For example, the call function unit 170 may perform transmission / reception of e-mail or the like in addition to transmission / reception of audio signals to / from other terminal devices.

  Next, the operation of the augmented reality system 1 will be described. For example, as shown in FIG. 3, the user switches the display mode, the recording mode, and the playback mode in order according to the passage of time. The user starts the display mode at time t1, switches from the display mode to the recording mode at time t2, and ends the recording mode at time t3. Further, the user starts the reproduction mode at time t4. Hereinafter, each operation procedure in the display mode, the recording mode, and the reproduction mode will be described with reference to FIGS.

  FIG. 4 shows an operation flow in the display mode. First, the user selects a display mode (ST1). The user operates the operation unit 110 to activate an application selection screen and select a display mode. Based on the selection of the display mode by the user, the application unit 111 starts control of each functional unit for synthesizing and displaying the AR tag with respect to the acquired image.

  Next, the terminal device 100 starts photographing and starts an AR tag acquisition operation (ST2). Specifically, the application unit 111 instructs the image acquisition unit 120 to capture a surrounding landscape. The application unit 111 instructs the position information acquisition unit 131 to acquire the current position of the terminal device 100. The application unit 111 instructs the position information transmission unit 134 to transmit the position information acquired by the position information acquisition unit 131 to the data server 200. When the position information is transmitted from the position information transmission unit 134 to the data server 200, the data server 200 searches for the AR tag based on the received position information, and the AR associated in advance with the received position information. The tag is returned to the terminal device 100. In this way, the AR tag receiving unit 135 receives the AR tag from the data server 200. For example, a short message, a URL, and the like are described in the AR tag received by the AR tag receiving unit 135.

  Next, the composition processing unit 14 generates a composite image based on the acquired image and the AR tag (ST3). Specifically, the composite image generation unit 141 generates new image data by adding the AR tag sequentially supplied from the AR tag reception unit 135 to the acquired image data sequentially supplied from the image acquisition unit 120. . The acquired image synthesized by the synthesized image generating unit 141 and the AR tag are linked to each other at a position on the earth. Since the AR tag indicates information related to the current position of the terminal 100, an AR tag is added to the acquired image to provide a display in which the surrounding scenery and information related thereto are integrated. Is possible.

  Next, a composite image is displayed (ST4). Specifically, the display unit 145 displays an image based on the composite image data supplied from the composite image generation unit 141.

  FIG. 5 shows an operation flow in the recording mode.

  First, the recording mode starts (ST10). Specifically, the user activates the application selection screen and selects the recording mode by operating the operation unit 110 as in the case of the mode selection in step ST1 described above. The application unit 111 controls each functional unit as will be described later based on the selection of the recording mode by the user.

  Next, shooting and AR tag acquisition operations are started, and the location information and the acquisition time are stored (ST20). The terminal device 100 starts image acquisition similarly to step ST2 described above. In parallel with this, the terminal device 100 sequentially stores the acquisition time of the acquired image data. The terminal device 100 starts an AR tag acquisition operation as in step ST2 described above. As shown in FIG. 2A, the terminal device 100 stores the positional information acquired sequentially and the acquisition time in association with each other. Specifically, the position information acquisition unit 131 writes the acquired position information in the position information storage unit 132 together with the acquisition time.

  Next, as in step ST3 described above, the composition processing unit 14 generates a composite image based on the acquired image and the AR tag (ST30). When the composite image is generated, the display unit 145 displays the composite image as in step ST3 described above.

Next, encoding is performed (ST40). Specifically, the encoder 142 encodes data supplied from the composite image generation unit 141.
Next, the encoded composite image data is stored in association with the time (ST50). Specifically, as illustrated in FIG. 2B, the composition processing unit 14 stores the composite image data and time in association with each other. Note that the time associated with the composite image data is the time when the acquired image data from which the composite image data is generated is acquired.

  Through the above-described steps, the table shown in FIG. 2A is stored in the position information storage unit 132, and the table shown in FIG. 2B is enabled in the storage unit 150. It becomes a state. In this way, by associating and storing the composite image and the position information in association with the time, as will be apparent from the description below, the composite image is synthesized at the original location even after moving to a different location. It becomes possible to re-synthesize the synthesized image to be recombined.

  FIG. 6 shows an operation flow in the playback mode. First, the playback mode starts (ST110). Specifically, as in the case of mode selection in step ST1 described above, the playback mode is selected by the operation of the operation unit 110 by the user. The time t4 is, for example, an arbitrary time after t2 to t3 when recording is performed. The application unit 111 controls each functional unit as will be described later based on the selection of the playback mode by the user.

  First, the stored composite image data is decoded (ST120). Based on the control signal from the application, the decoder 143 decodes the redisplay image stored in the storage unit 150 (ST120). The composite image stored in the storage unit 150 is in an encoded state, and the decoder 143 decodes the composite image so that the composite image can be viewed.

  Next, position information associated with the composite image to be decoded is specified (ST130). Specifically, the application unit 111 acquires the time related to the composite image data to be decoded based on the correspondence shown in FIG. Next, the application unit 111 specifies position information corresponding to the time acquired as described above, based on the correspondence relationship illustrated in FIG. 2A stored in the position information storage unit 132.

  Next, the AR tag acquisition operation starts (ST140). Specifically, the position information specified by the application unit 111 as described above is transferred from the position information storage unit 132 to the position information transmission unit 134. Then, by the same mechanism as described above, the AR tag receiving unit 135 receives an AR tag associated with the position information transmitted by the position information transmitting unit 134. Here, the received AR tag indicates more detailed information than the tag information already added to the composite image.

  Next, composite image data is generated (ST150). Specifically, the composite image generation unit 141 generates composite image data in which an AR tag downloaded from the data server 200 is added to the image data supplied from the decoder 143. The image data processed by the composite image generation unit 141 is image data synthesized based on image data taken at a certain past time. Further, the AR tag processed by the composite image generation unit is auxiliary information that can be acquired from the data server 200 based on position information acquired at a certain past time. Thus, by storing image data and position information linked to each other on a time basis, even when a composite image is generated afterwards, a mismatch between the image data and the AR tag can be avoided and It is possible to generate a composite image.

  Note that the specific mode of association based on time is arbitrary. The image data and the positional information may be associated with each other to the extent that an error is prevented from occurring in the combination between the image data and the AR tag.

  Next, a composite image is displayed (ST160). The method for displaying the composite image is the same as described above. As a result, it is possible to generate a composite image to be generated at a past time point even in a place different from a past time point, and to effectively improve the convenience of the AR service. .

  As is clear from the above description, the terminal device 100 according to the present embodiment stores the position information indicating the current position in association with the current time and records the composite image to be currently displayed in the recording mode. It is stored in association with the time (in this example, the acquisition time of the image data that is the source of the composite image data). In the playback mode, the terminal device 100 acquires position information based on the time associated with the stored composite image data, acquires an AR tag based on the position information, and the AR tag and the above-described description. A new composite image is generated based on the composite image data. By adopting this configuration, it is possible to generate a composite image to be generated at a past time point even at a place different from a past time point, and effectively enhance the convenience of the AR service. It becomes possible. In addition, the user can receive the latest AR tag or detailed AR tag from the data server 200 and view the composite image based on the received AR tag.

  In the recording mode, the position information acquisition unit 131 acquires position information as needed, and the position information storage unit 132 stores the position information together with the acquisition time. Therefore, there is no problem even if the user takes a picture while moving in the recording mode.

Embodiment 2
The second embodiment will be described below with reference to FIGS. FIG. 7 is a block diagram of the augmented reality system (AR recording / playback system) 2. The description which overlaps with Embodiment 1 is omitted.

  In the present embodiment, unlike Embodiment 1, the redisplay image data stored in the storage unit 150 is the original image data before adding the AR tag. As shown in FIG. 7, in this embodiment, unlike the first embodiment, the original image acquired by the image acquisition unit 120 is encoded by the encoder 142 and stored in the storage unit 150. Even in such a case, the same effect as in the first embodiment can be obtained. Unlike the case of the first embodiment, in the present embodiment, the storage unit 150 stores the table shown in FIG. In the present embodiment, the flows as shown in FIGS. 9 and 10 are performed.

  A brief supplementary explanation will be given below. The storage unit 150 stores original image data in association with time as schematically shown in FIG. The time stored in association with the image data corresponds to the acquisition time of the image data.

  As shown in FIG. 9, in step ST210, the recording mode is started as in step ST10 shown in the first embodiment. In step ST220, as in step ST20, shooting and AR tag acquisition operations are started, and the location information and the acquisition time are stored. In step S230, as in step ST30, the composition processing unit 14 generates a composite image based on the acquired image and the AR tag. Unlike the first embodiment, the original image data is encoded in step ST240. Thereafter, in step ST250, the encoded original image data and the acquisition time of the original image data are stored in association with each other.

  As shown in FIG. 10, in step ST310, the playback mode is started as in step ST110 shown in the first embodiment. Unlike the first embodiment, the original image data is decoded in ST320. For ST330, the position information is specified in the same manner as in the first embodiment. That is, as shown in FIG. 8, the time associated with the image data to be displayed is specified, and the position information is acquired based on this time by the same method as in the first embodiment. In step ST340, as in step ST140, an AR tag acquisition operation is started. In step ST350, similar to step ST150, composite image data is generated. In step ST360, the composite image is displayed as in step ST160.

  According to the present embodiment, it is possible to exclude old information indicated by an old AR tag captured in the past in the composite image, and it is possible to capture the latest AR tag related to a point visited in the past. Further, since the image data stored in the storage unit 150 does not include the data capacity according to the AR tag, it is possible to reduce the consumption of the free capacity of the storage unit 150.

Embodiment 3
The third embodiment will be described below with reference to FIGS. FIG. 11 is a block diagram of the augmented reality system (AR recording / playback system) 3.

  In this embodiment, unlike Embodiment 2, instead of storing location information in association with time, an AR tag downloaded from the data server 200 based on location information is stored in association with time. Thus, the AR tag itself is associated with the composite image data stored in the storage unit 150 according to the time. In this case, it is not necessary to download the AR tag again as in the second embodiment, and the time required for the resynthesis time can be reduced.

  As shown in FIG. 11, an AR tag storage unit 136 is provided instead of the position information storage unit 132. As shown in FIG. 12, the AR tag storage unit 136 sequentially stores AR tags received by the AR tag reception unit 135 from the data server 200 in association with time. The time stored in association with the AR tag is preferably the acquisition time of the original image to which the AR tag is to be added. However, the time when the AR tag is acquired, the time when the position information is transmitted in order to acquire the AR tag, and the like may be used. Also in this case, the correspondence between the original image and the AR tag can be maintained with high reliability. The AR tag storage unit 136 outputs information related to the stored AR tag to the storage unit 150. In the reproduction mode, the AR tag storage unit 136 outputs the stored AR tag to the composition processing unit 144.

  FIG. 13 shows steps executed in the recording mode. As shown in FIG. 13, in step ST410, the recording mode is started as in step ST210 shown in the second embodiment. In step ST420, the same operation (shooting and AR tag acquisition operation) as in the second embodiment is performed, and the AR tag received by the AR tag receiving unit 135 is stored in association with the time described above. In step ST430, as in step ST230, the composition processing unit 14 generates a composite image based on the acquired image and the AR tag. In step ST440, the original image data is encoded as in step ST240. In step ST450, as in step ST250, the encoded original image data and the acquisition time of the original image data are stored in association with each other.

  FIG. 14 shows steps executed in the playback mode. As shown in FIG. 14, in step S510, the playback mode is started as in step ST310. In step S520, the original image data is decoded as in step ST320. In step ST530, an AR tag corresponding to the original image data is specified. Specifically, similarly to the above-described embodiment, based on the time associated with the original image to be redisplayed (see FIG. 8), the AR tag associated with the time is specified (see FIG. 8). 12). In step ST540, similar to step ST350, composite image data is generated. In step ST550, similarly to step ST360, the composite image is displayed.

  In the present embodiment, it is not necessary to download the AR tag again as in the second embodiment, and the time required for the resynthesis time can be reduced.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, in the above description, the position information storage unit 132 records the time from the start of the recording mode and the position information in the form of a table in the recording mode, but the recording format is not limited to this format. Moreover, although the memory | storage part 150, the positional information memory | storage part 132, and the AR tag memory | storage part 136 were described as another memory | storage part, the same memory | storage means may be sufficient.

DESCRIPTION OF SYMBOLS 1 Augmented reality system 2 Augmented reality system 3 Augmented reality system 100 Terminal device 110 Operation part 111 Application part 120 Image acquisition part 130 Position information processing part 131 Position information acquisition part 132 Position information storage part 133 AR tag acquisition part 134 Position information transmission part 135 AR tag reception unit 136 AR tag storage unit 14 synthesis processing unit 141 composite image generation unit 142 encoder 143 decoder 145 display unit 150 storage unit 170 call function unit 200 data server 300 terminal device 400 terminal device

Claims (6)

A terminal device that transmits position information to an external server in which attached information is stored in association with the position information, and displays the attached information received from the external server in addition to an image,
An image acquisition unit for acquiring an image showing the periphery of the current position of the terminal;
A position acquisition unit that acquires the position information indicating the current position of the terminal;
An auxiliary information acquisition unit that acquires the auxiliary information from the external server by transmitting the positional information acquired by the position acquisition unit to the external server;
A composite image generating unit that generates a composite image based on the image and the attached information;
The image acquired by the image acquisition unit or the image generated by the composite image generation unit is stored as a redisplay image, and the attached information to be added to the predetermined redisplay image is acquired. Storage means for storing at least one of the position information for acquisition and the acquired additional information to be added to the predetermined image for re-displaying in association with the predetermined image for re-displaying,
The composite image generation unit applies the redisplay image to the auxiliary information or the redisplay image acquired from the external server based on the position information stored in association with the redisplay image. A terminal device that generates an image based on the associated information stored in association with each other. The storage unit stores the image generated by the composite image generation unit as a redisplay image, and the position information for acquiring the attached information to be added to the predetermined redisplay image. Storing it in association with a predetermined image for redisplay,
The composite image generation unit includes the redisplay image stored in the storage unit, and the auxiliary information acquired from the external server based on the position information stored in association with the redisplay image. The terminal device according to claim 1, wherein an image is generated based on.   The terminal device according to claim 1, wherein the storage unit manages the position information or the attached information sequentially acquired as time elapses at each acquisition time. The attached information is an AR tag,
The attached information acquisition unit
A position information transmission unit that transmits the position information acquired by the position acquisition unit;
The terminal device according to any one of claims 1 to 3, further comprising: an AR tag receiving unit that receives an AR tag based on the position information from the external server. A terminal device that transmits the position information to an external server that stores the attached information related to the position information in association with the position information, and adds the attached information received from the external server to an image for display. The operation method of
Storing the acquired image or a composite image obtained by adding the attached information to the acquired image as a redisplay image;
At least one of the position information for acquiring the auxiliary information to be added to the predetermined image for redisplay and the acquired auxiliary information to be added to the predetermined image for redisplaying is added to the predetermined re-display. Store it in association with the display image,
The auxiliary image acquired from the external server based on the position information stored in association with the image for redisplay and the image for redisplay or the image stored in association with the image for redisplay An operation method of a terminal device that generates an image based on an attached image. An external server in which attached information is stored in association with location information;
A terminal device that transmits position information to the external server and displays the attached information received from the external server by adding it to an image,
The terminal device
An image acquisition unit for acquiring an image showing the periphery of the current position of the terminal;
A position acquisition unit that acquires the position information indicating the current position of the terminal;
An auxiliary information acquisition unit that acquires the auxiliary information from the external server by transmitting the positional information acquired by the position acquisition unit to the external server;
A composite image generating unit that generates a composite image based on the image and the attached information;
The image acquired by the image acquisition unit or the image generated by the composite image generation unit is stored as a redisplay image, and the attached information to be added to the predetermined redisplay image is acquired. Storage means for storing at least one of the position information for acquisition and the acquired additional information to be added to the predetermined image for re-displaying in association with the predetermined image for re-displaying,
The composite image generation unit applies the redisplay image to the auxiliary information or the redisplay image acquired from the external server based on the position information stored in association with the redisplay image. A system for generating an image based on the associated information stored in association therewith.

Images