JP2006091390A - Information display system and method, program and information display terminal device for making computer perform information display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information providing system with which a user can easily grasp the latest positions and contents of a store etc. on a scenery image. <P>SOLUTION: A content managing server 2 picks up a piece of content information corresponding to the position of a terminal 1 from the piece of content information recorded by its own recording means. The terminal 1 calculates the display position to display by overlapping the piece of content information on the scenery image photographed by the terminal 1 based on the position of the terminal 1 and the contents picked up by the content managing server 2, and displays the piece of content information so as to overlap at this calculated position. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information display system, an information display method, and an information display terminal device that superimpose and display content information obtained from position information of a portable terminal on a real landscape.

In a conventional system for providing information around a terminal, by using the position information of the terminal and the map information in which the content information is written, the current contents and the surrounding content information are displayed on the map. Information was provided.
For example, NTT Docomo's service called “where Navi” is provided to the user by displaying local information such as stores around the mobile phone user on a map.

  In addition, car navigation systems are widely used as systems for providing peripheral information to car drivers. The car navigation system uses GPS or the like to identify the current position of the car, and displays surrounding information using a plane map, a bird's-eye view, or a 3D map from the driver's viewpoint, thereby providing the driver with the surrounding information. It is a system to provide to.

  In addition, a method of providing surrounding information by constructing a three-dimensional layout that reproduces the landscape of the target from the terminal using the terminal position information and object information such as structures has been proposed (for example, Patent Document 1).

  In addition, a 3D layout that reproduces the landscape from the terminal is constructed using the location information of the terminal and 3D map data, and surrounding information is provided by superimposing regional data such as store information on the landscape image. There has also been proposed a method (for example, Patent Document 2).

In addition to these, it is not a system that provides surrounding information, but information based on image recognition, such as providing information associated with a building specified using the characteristics of the building obtained from a video of the appearance of the building, etc. The providing system is also a widely known information providing system.
JP 2002-340607 A JP 2003-44982 A

The conventional system for providing information around the terminal has the following problems.
That is, first, there is a problem that the displayed plan view, bird's-eye view, and three-dimensional layout map must be replaced with a real scene in the head to grasp the target position. This “replacement with real scenery in the head” is difficult for a person who is not familiar with the actual scenery.

  Secondly, since the surrounding information is displayed based on the map information and object information such as buildings, it is necessary to always use the latest map information and object information to be used. When the original map information is old, information completely different from the actual scenery is displayed, and there is a possibility that the current position as well as the surrounding information may not be known. When a detailed three-dimensional layout diagram such as a bird's-eye view or a three-dimensional layout diagram is displayed, there is a possibility that the destination will be mistaken if the shape of the building changes or the signboard or the like that becomes a landmark disappears.

  Thirdly, the surrounding information displayed is a large range of location information and content information such as department stores and buildings, and small range information such as location information and content information of stores in department stores and buildings is not provided. There's a problem. Therefore, even if you go to a department store, you do not know the location of the target store, so you need to find a map of each floor and use the map to find the location of the store, so it is not suitable for shopping purposes. .

  Fourth, object information such as map information and buildings to be used and position information and content information associated with them are often recorded on the terminal side without being centrally managed, and can therefore be updated frequently. Therefore, there is a problem that the surrounding information displayed lacks real-time properties. Even when map information, object information, position information, and content information are centrally managed, it is difficult to maintain the latest information in every detail, which causes a similar problem.

  Further, even in the information providing system based on the image recognition described above, there is a problem that when the shape of a building or the like associated with the information is changed, it is recognized as a different building and correct information is not provided. In addition, when there is a building having the same shape, there is a problem that information is erroneously provided.

  The present invention has been made to solve the problem store as described above, and does not require map information, object information, or image recognition, and the user can use the latest location guidance and content information of a store etc. on a real landscape. An object of the present invention is to provide an information providing system that can obtain information and easily grasp surrounding information.

The information display system according to the present invention includes a recording unit in which content information is recorded, and a content information providing unit that selects terminal location information corresponding content information corresponding to the terminal location information from the content information recorded in the recording unit. A content management server having
Based on the location information acquisition means for connecting to the content management server and acquiring the terminal location information, the imaging means for shooting a surrounding landscape video, the terminal location information and the terminal location information corresponding content information Display position calculating means for calculating a display position for superimposing and displaying the terminal position information corresponding content information on video; and displaying the landscape video photographed by the photographing means; and the terminal position information corresponding content information at the display position And a terminal having display means for displaying in a superimposed manner.

  As described above, the present invention superimposes and displays the terminal location information corresponding content information corresponding to the terminal location information selected by the content management server on the surrounding landscape video captured by the terminal, thereby enabling actual scenery to be displayed. Since the content information can be displayed on the video, the user can easily grasp the location indicated by the content information.

Embodiment 1 FIG.
FIG. 1 is a configuration diagram of a 3D (three-dimensional, hereinafter 3D indicates three-dimensional) information display system according to the first embodiment.
In FIG. 1, a terminal 1 and a content management server 2 are connected via the Internet 100 and a wireless base station 101.
The terminal 1 includes a position information acquisition unit 11 that acquires the position information of the terminal 1, a position information transmission unit 12 that transmits the position information to the content management server 2 via the antenna 16, and a photographing unit that acquires an actual landscape image. 13, display position calculation means 14 for calculating the display position of the content information associated with the position information from the position information obtained from the content management server 2 on the actual landscape, and the display position together with the landscape video obtained from the photographing means 13 A display unit 15 that superimposes and displays content information at a position obtained from the calculation unit 14 is provided, and is a mobile terminal such as a mobile phone, a PDA (Personal Digital Assistant), or a car navigation terminal.

  The content management server 2 records the landscape video acquired by the photographing unit 13 of the terminal 1 from the content information recorded in the recording unit 21 based on the recording unit 21 that records the content information and the position information obtained from the terminal 1. Content information providing means 22 for selecting content information included in the range and position information associated therewith and transmitting it to the terminal 1 is provided.

  The position information acquisition means 11 of the terminal 1 specifies the direction in which the terminal 1 is facing, along with the latitude, longitude, and altitude, and the inclination angle of the terminal 1, and provides it as position information. As a means for specifying latitude, longitude, and altitude, a means for specifying using positioning satellites such as GPS may be used, a device such as an electronic gyroscope may be used for the direction, and an inclination angle may be specified. Devices such as speed measuring devices may be used.

  The recording means 21 of the content management server 2 records a large amount of content information and position information associated with the content information. The content information providing means 22 of the content management server 2 is the photographing means 13 of the terminal 1 based on the position information received from the position information transmitting means 12 of the terminal 1 and the position information of the content information recorded in the recording means 22. The content information corresponding to the position within the acquired real landscape is selected, and the content information and the position information associated therewith are provided to the display position calculation means 14 of the terminal 1.

Next, the operation will be described.
FIG. 2 is a sequence diagram showing the processing operation of the 3D information display system in the present embodiment.
First, the terminal 1 acquires the scenery around the terminal 1 as a landscape video using the photographing unit 13 and also uses the position information acquisition unit 11 to acquire the position information of the terminal 1 (for the latitude / longitude / altitude of the current position). Azimuth and tilt angle). Here, FIG. 3 shows a state where the scenery around the terminal 1 is acquired as a landscape video, and FIG. 4 shows a state where the position information of the terminal 1 is acquired.
Thereafter, the acquired position information is transmitted to the content management server 2 using the position information transmission means 12.

  The position information transmitted to the content management server 2 is received by the content information providing unit 22. The content information providing unit 22 calculates the display range of the landscape video acquired by the photographing unit 13 of the terminal 1 based on the received position information of the terminal 1.

Furthermore, the content information providing unit 22 includes only the content information in which the position information of the content information is included in the landscape video display range acquired by the photographing unit 13 of the terminal 1 from the content information recorded in the recording unit 21. Is elected.
FIG. 5 is a diagram showing how content information is selected by the content management server 2, and selects content information included in a landscape video display range extending in a conical shape from the terminal. Here, the content information included in the landscape video display range is “Takeda Shoten”, “XX Pharmacy”, “△△ Internal Medicine”, and “XX Soba”.

  Thereafter, the content information providing unit 22 transmits the selected plurality of content information to the terminal 1. The display position calculation means 14 receives the content information transmitted to the terminal 1.

The display position calculation means 14 displays the display position of the received content information on the landscape video obtained by the photographing means 13 based on the position information obtained from the position information acquisition means 11 of the terminal 1 and the position information of the received content information. Is calculated.
Finally, the display unit 15 displays the landscape video acquired by the photographing unit 13 and displays the content information superimposed on the display position calculated by the display position calculation unit 14. Here, a landscape video (scenery video only) around the terminal 1 acquired by the photographing unit 13 is shown in FIG. 6, and a landscape video in which content information is superimposed on the display position calculated by the display position calculating unit 14 is shown in FIG. Show.

  Note that the photographing means 13 may be one that obtains a landscape image continuously such as a video camera in addition to one that obtains a landscape image like a camera, and in that case, acquisition of location information and transmission of location information. -By continuously performing content information acquisition / superimposition display, content information can be displayed so as to move with the movement of the landscape.

As described above, according to the present embodiment, the landscape image acquired by the photographing unit 13 is displayed, and the content information is superimposed and displayed on the display position calculated by the display position calculating unit 14, so that the actual landscape image is displayed. Since the content information is displayed on the screen, it is not necessary to replace the map information with the actual landscape in the head, and the location indicated by the content information can be captured more easily than the display using the planar map or the three-dimensional map. be able to.
Further, since the map is not used, if the location indicated by the content information is not changed, the user can easily grasp the location indicated by the content information regardless of how the surrounding scenery changes. That is, the user can easily grasp the location and content indicated by the content information, rather than being displayed on the map.

Embodiment 2. FIG.
FIG. 8 is a configuration diagram of the 3D information display system according to the second embodiment.
In FIG. 8, the terminal 3 has acquired the content information input means 31 for acquiring the content information input by the user and the processing type, the position information input means 32 for acquiring the position information of the content information input by the user, and The content information transmitting unit 33 transmits the content information, the position information, and the processing type to the content management server 4, and the editing result display unit 34 notifies the user of the editing result received from the content management server 4. The terminal 3 may be the same terminal as the terminal 1 in FIG.

  The content management server 4 includes a recording unit 41 that records the content information and its position information, a content information editing unit 42 that edits the content information recorded in the recording unit 41 using the content information, the position information, and the processing type. The editing result transmitting unit 43 transmits the editing result by the content information editing unit 42 to the terminal 3. The content management server 4 may be the same content management server as the content management server 2 of FIG. Further, the recording means 41 may be the same recording means as the recording means 21 of FIG.

Next, the operation will be described.
FIG. 9 is a sequence diagram showing processing operations of the 3D information display system in the present embodiment.
First, the user inputs content information, its position information, and a processing type to the terminal 3.
This processing type includes addition, change, and deletion. In the case of adding content information, the contents information and location information to be disclosed are input. When editing the content information, the content information ID and the edited content information are input.

  As a method for obtaining the ID of the content information, there are a method of using a previously specified ID, a method of using the ID of the content information acquired by the 3D information display system, and the like. In addition, when the position information of the content information is changed, the changed position information is also input. When deleting the content information, the ID of the content information is input as in the editing. In the case of deletion, it is not necessary to input position information.

As the input format of the location information of the content information, the latitude / longitude / altitude of the terminal input by the user, the latitude / longitude / altitude of the terminal acquired using the positioning satellite, etc., the terminal acquired using the positioning satellite, etc. Possible formats include latitude, longitude, and distance from the altitude to the direction the terminal is facing.
The input content information, position information, and processing type are transmitted to the content management server 4 by the content information transmitting means 33.

Next, the content information editing unit 42 of the content management server 4 edits the content information recorded in the recording unit using the content information, the position information, and the processing type received from the terminal 3.
The editing result of the content information is transmitted to the terminal 3 by the editing result transmitting unit 43. Subsequently, the editing result display means 34 of the terminal 3 displays the editing result received from the content management server 4 and notifies the user of the editing result.

  As described above, according to the present embodiment, content information can be freely edited, so that the real-time property of content information can be improved by frequently updating, adding, and deleting content information. In addition, content information can be freely added and placed in various places, so it is possible to register a small range of information such as small stores that are not on the map, local information and guidance information, and as a result, there is no map Information can also be provided to the user through the 3D information display system.

Embodiment 3 FIG.
In the first embodiment, the case where the display position calculating means for calculating the display position of the content information on the landscape video is arranged on the terminal has been described. However, in the present embodiment, the display position calculating means is provided on the content management server. The case where it arrange | positions to is demonstrated.
FIG. 10 is a configuration diagram of the 3D information display system according to the third embodiment.
The terminal 1 includes a position information acquisition unit 11 that acquires the position information of the terminal 1, a position information transmission unit 12 that transmits the position information to the content management server 2 via the antenna 16, and a photographing unit that acquires an actual landscape image. 13.

  The content management server 2 includes a recording unit 21 that records content information, and a landscape video range acquired by the photographing unit of the terminal 1 from the content information recorded in the recording unit 21 based on the position information obtained from the terminal 1. Content information providing means 22 for selecting and acquiring content information included in the content information and information associated therewith, and display position calculating means 23 for calculating the display position of the content information on the landscape video.

  The display position calculation means 23 is a means for calculating the display position of the content information on the landscape video, similar to the display position calculation means 14 of the first embodiment, and other means are also the same as the means of the first embodiment. It has the same function.

Next, the operation will be described.
FIG. 11 is a sequence diagram showing the processing operation of the 3D information display system in the present embodiment.
Here, the processing is the same as in the first embodiment until the location information of the terminal is acquired and the content information is selected based on the location information.
The difference from the first embodiment is that the content management server 2 has a display position calculation unit 23 that calculates the display position on the landscape video of the plurality of content information acquired by the content information providing unit 22 before transmitting the content information. Is a point.

The display position calculating unit 23 uses the position information of the plurality of pieces of content information acquired from the content information providing unit 22 and the position information received from the position information transmitting unit 12 of the terminal 1, and is acquired by the photographing unit 13 of the terminal 1. The display position of the content information on the landscape video is calculated. After calculating the display position, the display position and content information are transmitted to the display means 15 of the terminal 1.
Finally, the display unit 15 displays the landscape video acquired by the photographing unit 13 and displays the content information associated with the coordinates superimposed on the coordinates received from the display position calculation unit 23.

  As described above, according to the present embodiment, the same effect as in the first embodiment can be obtained, and the load on the terminal can be reduced.

Embodiment 4 FIG.
In the first embodiment, the case where the content information is superimposed on the terminal has been described. In the present embodiment, the case where the content information is superimposed on the content management server will be described.
FIG. 12 is a configuration diagram of the 3D information display system according to the fourth embodiment.
In FIG. 12, the terminal 1 transmits position information acquisition means 11 for acquiring position information of the terminal 1, photographing means 13 for acquiring an actual landscape image, and the acquired landscape image and position information to the content management server 2. A landscape video / position information transmitting unit 17 and a display unit 15 for displaying the superimposed video acquired from the content management server 2 are configured.

  The content management server 2 is included in the range of the landscape video obtained from the terminal 1 from the content information recorded in the recording means 21 based on the recording means 21 for recording the content information and the position information obtained from the terminal 1. Content information providing means 22 for selecting content information, display position calculating means 23 for calculating the display position of the selected content information on the landscape image obtained from the terminal 1, and display on the landscape image obtained from the terminal 1 Superimposition display means 24 that superimposes content information on the display position obtained from the position calculation means 23 and transmits it to the terminal 1 is provided.

The display position calculation means 23 is a means for calculating the display position of the content information on the landscape video, like the display position calculation means 14 of the first embodiment.
The superimposing display unit 24 uses the landscape video obtained from the terminal 1, the content information obtained from the content information providing unit 22, and the display position obtained from the display position calculation unit to display the content information at the display position on the landscape video. Is superimposed and displayed, and the created superimposed video is transmitted to the terminal 1.

Next, the operation will be described.
FIG. 13 is a sequence diagram showing processing operations of the 3D information display system in the present embodiment.
First, the terminal 1 acquires the scenery around the terminal using the photographing unit 13 as a landscape video, and the position information acquisition unit 11 uses the position information acquisition unit 11 to indicate the position information of the terminal 1 (which is suitable for the latitude, longitude, and altitude of the current position). Get azimuth and tilt angle. The acquired landscape video and position information are transmitted to the content management server 2 using the landscape video / position information transmission means 17.

Next, the content information providing unit 22 of the content management server 2 calculates the display range of the received landscape video based on the received position information. Subsequently, only the content information included in the display range is selected from the content information stored in the storage unit 21.
The display position calculation unit 23 calculates the display position on the landscape video of the content information selected by the content information providing unit 22 based on the received position information.

The superimposed display unit 24 creates a superimposed video in which all content information selected by the content information providing unit 22 is superimposed on the display position acquired by the display position calculating unit 23 on the received landscape video. The created superimposed video is transmitted to the terminal 1.
Finally, the display unit 15 of the terminal 1 acquires and displays the superimposed video, thereby providing content information to the user.

  As described above, according to the present embodiment, the same effect as in the first embodiment can be obtained, and the load on the terminal can be further reduced as compared with the second embodiment.

Embodiment 5. FIG.
In the 3D information display system according to the first embodiment, when there is a large amount of content information, the display range used by the content information is too wide so that landscapes and other content information cannot be seen and the original function of the 3D information display system can be performed. There is a possibility of disappearing. In such a case, this problem can be solved by dividing and registering the content information into a plurality of parts and displaying the content information partially. In the present embodiment, a case will be described in which content information is divided into a plurality of pieces and registered, and the content information is partially displayed.

Hereinafter, a procedure for providing content information when content information is registered in a main part and a sub part will be described.
The 3D information display system receives the content information as in the first embodiment, but does not display the content information as it is and displays only the main part of the content information at the display position.
FIG. 14 is a diagram showing a superimposed image displaying only the main part of the content information, and only the store name registered as the main part is displayed.

  Here, when the content information in which only the main part is displayed is selected, the main part and the sub part are displayed only for the selected content information. FIG. 15 shows a state in which the content information “Takeda Shoten” in FIG. 14 is selected, and in addition to the main store name, information such as the business hours of the sub portion is displayed.

Further, by displaying the content information including the sub part in a separate window as shown in FIG. 16, the details of the content information can be provided to the user without changing the already displayed content information.
When displaying the sub part, in addition to the method of displaying the sub part information received at the same time as the main part, as shown in the sequence diagram of FIG. 17, the ID of the content information of the selected main part is displayed in the content management server. It is also possible to use a method of transmitting to 2 and obtaining and displaying a sub-part of the content information corresponding to the ID.

  As described above, according to the present embodiment, content information is divided and registered and partially displayed, so that more content information can be displayed and the position indicated by the information can be conveyed to the user. Further, since the user can eliminate unnecessary information and select and obtain only the details of the desired information, the convenience of the content information is improved.

Embodiment 6 FIG.
In the 3D information display system according to the first embodiment, when a large amount of content information is registered, it may be difficult for the user to find the content information he / she wants. In such a case, the problem can be solved by tagging the content information in advance and providing (displaying) only the content information corresponding to the designated tag to the user. In the present embodiment, a case will be described in which a tag is attached to content information in advance and only the content information corresponding to the designated tag is provided to the user.

Hereinafter, an operation procedure when only content information corresponding to a designated tag is displayed will be described.
FIG. 18 is a sequence diagram showing a processing operation when only content information corresponding to a designated tag is displayed.
First, tag information associated with desired content information is specified, and a landscape is photographed. For example, here, “food” is designated as tag information and a landscape is photographed. Thereafter, the terminal 1 transmits position information to the content management server 2, and the content management server 2 transmits content information to the terminal 1.

  Subsequently, the terminal 1 selects only content information corresponding to “food” designated by the user from the tag information among the content information received from the content management server 2 (here, “XX soba”) and selects it. Only the subsequent content information is superimposed and displayed. FIG. 19 is a diagram showing a display state at this time.

The content management server 2 can also select content information based on tag information.
FIG. 20 is a sequence diagram showing a processing operation when the content management server 2 selects content information based on tag information.

  First, a user captures a landscape by specifying tag information associated with desired content information. For example, here, “food” is designated as tag information and a landscape is photographed. Thereafter, the terminal transmits the tag information together with the position information to the content management server.

The content management server 2 selects content information using the position information received from the terminal 1 and selects only content information having the same tag information as the tag information received from the terminal 1 and transmits it to the terminal. FIG. 21 is a diagram showing a state at this time.
The terminal 1 that has received the content information superimposes and displays the content information on the photographed landscape video as shown in FIG.

  As described above, according to the present embodiment, by registering content information with a tag, the user can select and acquire only the desired content information, thereby improving the convenience of the 3D information display system. Can be improved.

Embodiment 7 FIG.
In the 3D information display system according to the first embodiment, the positional relationship of content information may be difficult to understand. For example, when two pieces of content information are arranged on the same straight line, if the two pieces of content information are displayed in the same manner, it becomes difficult to know which is the closest piece of content information. Such a problem can be solved by displaying the content information in an overlapping manner according to the distance, or by displaying the content information as the distance increases. In the present embodiment, a case will be described in which content information is displayed in an overlapping manner according to the distance, or is displayed smaller as the distance increases.

FIG. 22 is a diagram illustrating an example of a superimposed image in which the display unit 15 of the terminal 1 displays two pieces of content information. “XX pharmacy” is content information arranged at a position closer to “XX soba” and is displayed before “XX soba”. Since “XX soba” is located farther from “XX pharmacy”, it is displayed smaller depending on the distance. When the content information is selected, it is displayed large at the front only when selected, as shown in FIG.
By displaying in this way, the user can more visually grasp the position of the content information.

  Further, the display means 15 can change the display method according to the distance from the terminal 1 to the position where the content information is arranged, so that the positional relationship of the content information can be grasped in more detail. That is, by changing the display state displayed by the display means 15 according to the distance from the current position of the terminal 1 to the position of the landscape image where the content information is displayed, the user can grasp the positional relationship of the content information in more detail. can do.

  24 to 26 display content information in separate tabs depending on the distance from the terminal to the position where the content information is arranged. 24 to 26, the content information is classified into three categories of 0 to 20 m, 21 m to 100 m, and 100 m or more, and each is displayed in a separate tab.

  As described above, according to the present embodiment, the user can grasp the positional relationship of the content information in detail.

Embodiment 8 FIG.
In the 3D information display system according to the first embodiment, the content information to be displayed is associated with the landscape video, so the displayable range of the content information is a range where the location where the content information is arranged can be confirmed on the landscape video. .
However, there is a case where it is desired to provide content information in a place that is several kilometers away, which cannot be confirmed on the landscape video. For example, landmarks such as buildings, towers, and mountains correspond to this, and should be widely provided as information for position confirmation and as representative of the area.
As described above, when it is desired to provide specific content information even at a long distance, it can be solved by adding a “public distance” to the content information.
In the present embodiment, a case where “public distance” is added to content information will be described.

Hereinafter, an operation procedure when the disclosure distance is added to the content information will be described.
First, public distance information is added when content information is edited and registered using the content information editing means 42. The public distance information is a limit distance for publishing the content information. If the distance from the terminal 1 to the content information is within the public distance information, that is, from the current position of the terminal 1 to the position of the landscape video where the content information is displayed. If the distance is within the public distance information, the content information is provided by the 3D information display system. When the public distance information is not designated, an initial value (for example, 100 m) is used for the public distance information.

Next, content information is provided using a 3D information display system.
FIG. 27 is a sequence diagram illustrating a processing operation in the case of providing content information with public distance information.
First, the user captures a landscape, and the terminal 1 transmits position information to the content management server 2.
The content management server 2 acquires the distance between the terminal and the content information from the position information of the content information, and narrows down the target content information.

FIG. 28 is a diagram showing how content information is narrowed down by the distance between the terminal 1 and the content information.
“XX Hanaya” and “Mount Fuji” are adopted as candidates for provision to the user because the distance to the terminal 1 is less than or equal to the public distance information given to each content information. However, “XX soba”, which should be closer to the terminal than “Mt. Fuji”, is excluded from the candidates for provision to users because the distance to the terminal is larger than the public distance information given. The

  After narrowing down the content information, the content information included in the range of the landscape video is selected from the narrowed content information and transmitted to the terminal. Subsequently, the terminal 1 superimposes the content information received from the content management server 2 on the landscape video and provides it to the user.

  As described above, according to the present embodiment, by adding the public distance information to the content information, the content information is reflected in the content information and the important content information is provided to a wider range. can do.

Embodiment 9 FIG.
If the above-described first to eighth embodiments are used, the following service can be performed.
Next, the first service will be described.
As the first service, there is a service for constructing an area where content information can be provided to a user using a 3D information display system.

FIG. 29 is a configuration diagram illustrating a configuration for executing the first service.
The area 301 is an area where content information can be provided to the user using the 3D information display system.
A terminal 302 is a terminal of a 3D information display system, and provides content information to a user and edits content information registered in the content management server 303.
The content management server 303 is a server that manages content information to be provided to the user. The content management server 303 records all content information in the area 301 and communicates with the terminal 302 so that the content information in the area 301 is stored in the terminal 302. Provide to users who use or edit content information. There may be a plurality of content management servers in the area.

  In the first service, the area 301 in FIG. 29 is constructed. The first service may include a content information registration agency in the area 301 to the content management server 303. Further, a loan of the terminal 302 may be included.

  The first service can newly provide content information to a user using a 3D information display system in response to a request from an information provider who intends to release the content information using the 3D information display system. It is a service that constructs a simple area.

  For example, it is assumed that the area 301 is constructed using the first service when opening a new amusement park. The amusement park visitors can know the location, content and waiting time of the attraction, the holding time, location and content of the event using a mobile terminal owned by the visitor or a lent terminal. The amusement park manager can provide the latest content information to the visitors by updating the content information. And the side which provides the 1st service can obtain the service charge by construction of an area and loan of a terminal.

Embodiment 10 FIG.
Next, the second service using the first to eighth embodiments will be described.
As the second service, there is a service in which an area where content information can be provided to a user using a 3D information display system is constructed in advance and lent out in response to a request.

FIG. 30 is a configuration diagram illustrating a configuration for executing the second service.
Areas 411 to 414 are constructed in advance, and are areas in which content information can be provided to the user using the 3D information display system.
A terminal 421 is a terminal of a 3D information display system, and provides content information to a user and edits content information registered in a content management server.
The content management server 422 is a server that manages content information to be provided to the user, records all content information in the corresponding area (here, area 413), and communicates with the terminal 421, so that the area The content information in 413 is provided to the user or the content information is edited. There may be a plurality of content management servers in one area.

  In the second service, the areas 411 to 414 in FIG. 30 are lent out. The second service may include a content information registration agency in the area lent to the content management server 422. Further, the terminal 421 may be lent.

  The second service is to hold an event that uses the venue by creating an area that can provide content information to users in advance using a 3D information display system in a place such as an event hall or exhibition hall. It is a service that lends an area to a person as needed.

For example, suppose that an area is borrowed using the second service when an event is held using an event hall in which the area has been constructed.
In this case, the event visitor can obtain information such as the location, contents, and waiting time of the event participation booth using a portable terminal owned by the visitor or a lent terminal.
In addition, the event organizer can provide the latest content information to visitors by updating the content information.
The side providing the second service can obtain a service fee for lending the area and lending the terminal.

1 is a configuration diagram of an information display system according to Embodiment 1. FIG. FIG. 3 is a sequence diagram showing a processing operation of the information display system in the first embodiment. FIG. 3 is a diagram illustrating a situation where a landscape around the terminal 1 is photographed in the first embodiment. FIG. 3 shows position information of a terminal in the first embodiment. The figure which shows the mode of the content information selection by the content management server in Embodiment 1. FIG. FIG. 5 is a diagram showing a landscape video around the terminal acquired by the photographing unit 13 in the first embodiment. The figure which shows the landscape image which superimposed and displayed content information on the display position which the display position calculation means 14 in Embodiment 1 calculated. FIG. 3 is a configuration diagram of an information display system according to a second embodiment. FIG. 11 is a sequence diagram showing a processing operation of the information display system in the second embodiment. FIG. 6 is a configuration diagram of an information display system according to a third embodiment. FIG. 11 is a sequence diagram showing processing operations of the information display system in the third embodiment. FIG. 6 is a configuration diagram of an information display system according to a fourth embodiment. FIG. 10 is a sequence diagram showing processing operations of the information display system in the fourth embodiment. The figure which showed the superimposed image | video which displayed only the main part of content information in Embodiment 5. FIG. The figure which showed the superimposed image | video at the time of selecting content information in Embodiment 5. FIG. The figure which showed the superimposed image | video at the time of displaying content information in Embodiment 5. FIG. FIG. 20 is a sequence diagram showing another processing operation in the fifth embodiment. FIG. 17 is a sequence diagram showing processing operations when only content information corresponding to a tag specified in the sixth embodiment is displayed. The figure which showed a mode that only the content information after the terminal 1 elected in Embodiment 6 was superimposed and displayed. FIG. 20 is a sequence diagram showing another processing operation in the sixth embodiment. The figure which showed the mode at the time of the content management server 2 narrowing down content information in Embodiment 6. FIG. The figure which showed the example of a superimposed image | video which displayed two near and far content information in Embodiment 7. FIG. FIG. 20 shows an example of a superimposed video in a state where content information is selected in the seventh embodiment. FIG. 20 is a diagram illustrating an example of a superimposed image in the seventh embodiment. FIG. 20 is a diagram illustrating an example of a superimposed image in the seventh embodiment. FIG. 20 is a diagram illustrating an example of a superimposed image in the seventh embodiment. The sequence diagram which showed the processing operation in the case of providing the content information which provided public distance information in Embodiment 8. FIG. The figure which showed a mode that the content information is narrowed down by the distance of a terminal and content information in Embodiment 8. FIG. FIG. 25 is a configuration diagram illustrating a configuration for executing the first service in the ninth embodiment. FIG. 25 is a configuration diagram illustrating a configuration for executing a second service in the tenth embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Terminal, 11 Position information acquisition means, 12 Position information transmission means, 13 Imaging means, 14 Display position calculation means, 15 Display means, 16 Antenna, 2 Content management server, 21 Recording means, 22 Content information provision means, 23 Display position Calculation means, 24 superimposition display means, 100 Internet, 101 wireless base station, 3 terminal, 31 content information input means, 32 position information input means, 33 content information transmission means, 34 editing result display means, 35 antenna, 4 content management server 41 Recording means 42 Content information editing means 43 Editing result transmitting means 200 Internet 201 Wireless base station.

Claims (15)

A content management server comprising: recording means for recording content information; and content information providing means for selecting content information corresponding to terminal location information corresponding to terminal location information from content information recorded in the recording means;
Based on the location information acquisition means for connecting to the content management server and acquiring the terminal location information, the imaging means for shooting a surrounding landscape video, the terminal location information and the terminal location information corresponding content information Display position calculating means for calculating a display position for superimposing and displaying the terminal position information corresponding content information on video; and displaying the landscape video photographed by the photographing means; and the terminal position information corresponding content information at the display position An information display system comprising: a terminal having display means for superimposing and displaying. The storage means records the content information and position information associated with the content information,
2. The information display system according to claim 1, wherein the content information providing means selects the terminal position information corresponding content information based on the terminal position information and the position information recorded in the storage means. The content information providing means calculates a display range of the landscape video captured by the photographing means based on the terminal position information, and selects the content information corresponding to the terminal position information included in the display range. The information display system according to claim 1 or 2, characterized by the above. The terminal includes user-input content information input by a user and a processing type for adding, changing, or deleting the user-input content information, and a position of the user-input content information A position information input means for acquiring information,
The content management server includes content information recorded in the recording unit based on the user input content information, the processing type, and location information of the user input content information, and location information associated with the content information. 3. An information display system according to claim 2, further comprising content information editing means for editing the content. The content management server adds the terminal location information corresponding content to the landscape video based on the terminal location information corresponding content information selected by the content information providing unit and the terminal location information acquired by the location information acquisition unit. 2. The information display system according to claim 1, further comprising display position calculation means for content management server for calculating a display position for displaying information. The content management server displays the landscape video imaged by the imaging unit, and superimposes and displays the terminal location information corresponding content information on the display position calculated by the content management server display position calculation unit 6. The information display system according to claim 5, further comprising display means. The terminal location information corresponding content information is composed of a main part indicating the main part of the content information and a sub part explaining the main part,
The display means displays the landscape video photographed by the photographing means, and superimposes and displays the main part of the terminal position information corresponding content information on the display position,
2. The information according to claim 1, wherein when the main part of the content information corresponding to the terminal position information displayed by the display means is selected, a main part and a sub part of the content information corresponding to the terminal position information are displayed. Display system. The photographing means designates tag information associated with the requested content information and photographs the landscape video,
The terminal selects requested content information related to the tag information from the content information corresponding to the terminal location information selected by the content information providing means, and superimposes and displays the requested content information on the display position. The information display system according to claim 1, wherein: The content management server selects requested content information related to the tag information from the terminal location information corresponding content information based on the terminal location information and the tag information,
The information display system according to claim 8, wherein the terminal displays the requested content information selected by the content management server in a superimposed manner at the display position. The information display system according to claim 1, wherein the display unit displays the content information corresponding to the terminal position information while changing the size according to the distance of the landscape video. The display means changes a display method of the terminal position information corresponding content information according to a distance from a current position of the terminal to a position of the landscape image where the terminal position information corresponding content information is displayed. 1. The information display system according to 1. Release distance information indicating a limit distance for releasing the content information is added to the content information recorded in the recording means,
The content management server narrows down the content information whose distance from the current position of the terminal to the position of the landscape video where the content information is displayed is within the public distance information, and includes the content information The information display system according to claim 1, wherein the content information corresponding to the terminal position information is selected from. A shooting step for shooting landscape images around the device,
A location information acquisition step of acquiring terminal location information of the terminal;
A recording step for recording content information;
A content information providing step of selecting terminal location information corresponding content information corresponding to the terminal location information acquired by the location information acquisition step from the content information recorded by the recording step;
Corresponding to the terminal location information corresponding to the landscape video imaged in the imaging step based on the terminal location information acquired in the location information acquisition step and the terminal location information corresponding content information selected in the content information providing step A display position calculating step for calculating a display position for superimposing and displaying content information;
An information display method comprising: a display step of superimposing and displaying the terminal position information corresponding content information on the display position calculated in the display position calculating step. A shooting step for shooting landscape images around the device,
A location information acquisition step of acquiring terminal location information of the terminal;
A recording step for recording content information;
A content information providing step of selecting terminal location information corresponding content information corresponding to the terminal location information acquired by the location information acquisition step from the content information recorded by the recording step;
The terminal position information corresponding content is captured in the landscape image captured by the photographing step based on the terminal position information acquired by the position information acquiring step and the terminal position information corresponding content information selected by the content information providing step. A display position calculating step for calculating a display position for superimposing and displaying information;
A program for causing a computer to execute an information display method comprising: a display step of superimposing and displaying the terminal position information corresponding content information on the display position calculated in the display position calculating step. Photographing means for photographing surrounding landscape images;
Position information acquisition means for acquiring position information;
The image captured by the imaging unit based on the location information corresponding content information corresponding to the location information transmitted from the content distribution server connected via the Internet and the location information acquired by the location information acquisition unit Display position calculating means for calculating a display position for superimposing and displaying the terminal position information corresponding content information on a landscape video;
An information display terminal device comprising: display means for superimposing and displaying the terminal position information corresponding content information on the display position calculated by the display position calculating means.

Images