JP2009192448A - Information display device and information providing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information display device capable of displaying information acquired in exchange of a user's own positional information in association with an actual landscape following the field of view from the user's own position. <P>SOLUTION: This information display device which displays the information acquired based on the user's positional information in association with the user's position has a current position detection means for detecting the user's current position, a line-of-sight direction detection means for detecting the user's line of sight, an image pick-up means to pick up the actual landscape following the line of sight detected by the line-of-sight direction detection means, an identification means for identifying an object in the actual landscape picked up by the image pick-up means, and an eyeglass type display means which overlays the acquired information with the actual landscape corresponding to the user's line of sight and displays the information. The information display device displays on the display means the information acquired based on the user's position detected by the current position detection means in association with the object in the actual landscape identified by the identification means. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

The present invention relates to an information display device and an information providing system, and more particularly, to an information display device and an information providing system capable of displaying information acquired in exchange for own position information in association with a real landscape.

Conventionally, a technique for acquiring information related to self-location information is used in exchange for the user's self-location information.
For example, in the case of a mobile phone having a GPS function, after the user's self-location information is detected by the GPS function, the detected self-location information is transmitted to the base station, and information related to the self-location information from various servers via the network Is sent from the base station to the mobile phone and displayed on the mobile phone screen.
The information related to the self-location information includes, for example, various information such as store information, bargain information, and navigation information in a predetermined area including the current position of the user.

However, such a mobile phone has the following technical problems.
That is, when information related to the self-location information is acquired, there is a problem in how to display the acquired information to the user. More specifically, for example, a nearby map is displayed on the screen of the mobile phone, and the acquired information, for example, navigation information is displayed in association with the current position of the user on the map, but from the current position of the user. The relevance between the actual landscape along the field of view and the acquired information is unknown, and the user can rely on landmarks such as intersections, traffic lights, and specific facilities displayed on the screen. It is necessary to confirm the route by visually checking the placemark.
Therefore, for example, the target store is actually in front of you, but the information displayed on the screen does not match the actual actual scenery, and you lose the scene of using the acquired information in a timely manner. There are also many.
In particular, unlike a portable type navigation device such as a mobile phone, in the case of a vehicle-mounted type navigation device, particularly in the case of a two-wheeled vehicle navigation device, driving without leaving the line of sight while driving. Since the necessity is high, it is strongly desired that navigation information is displayed on the scenery (road) that is actually viewed so that the acquired information can be understood instantly.

On the other hand, depending on the type of information related to the self-location information acquired in exchange for the self-location information, there is a problem in the display method.
For example, if the information to be acquired is music information, still image or video information,
When such information is accessed and necessary information is selected, music information itself is directly acquired as auditory information, or image information with a large amount of information is directly accessed as visual information. Sorting is difficult. In this case, in order to separate the information selection and access to the information itself, and to contribute to the convenience of the information selection, the information obtained in exchange for its own location information is once implemented in another mode. It is desirable to display in association with the landscape.

In view of the above technical problems, an object of the present invention is to provide an information display device capable of displaying information acquired in exchange for user's own position information in association with a real landscape along the field of view from the user's own position, and An object is to provide an information providing system including such an information display device.

In order to achieve the above object, an information display device according to the present invention provides:
In an information display device that displays information acquired based on user position information in association with the user position,
Current position detecting means for detecting the current position of the user;
Gaze direction detection means for detecting the user's gaze direction;
Imaging means for imaging a real landscape along the line of sight detected by the line-of-sight direction detection means;
An identification unit for identifying an object in a real landscape imaged by the imaging unit;
Glasses-type display means for displaying the acquired information in an overlay with the actual scenery corresponding to the user's line of sight;
Information acquired based on the position of the user detected by the current position detection unit is displayed on the display unit in association with the object in the actual scene identified by the identification unit.

According to the information display device of the present invention having the above-described configuration and the information providing system including the information display device, the position of the user is detected by the position detection unit, and the user's line of sight is detected by the line-of-sight detection unit. The real scene is imaged along the detected user's line of sight by means, the object in the captured real scene is identified by the identification means, and acquired based on the detected user position by the glasses-type display means By displaying the obtained information so as to be overlaid with the actual scenery along the user's line of sight, the acquired information can be displayed in association with the objects in the identified actual scenery.
The display means may be a transparent or translucent organic EL display, and the acquired information may be displayed in an overlaid manner on a real landscape that can be visually recognized by the user via the display means.
Alternatively, the actual landscape image captured by the imaging unit may be displayed on the display unit, and the acquired information may be displayed on the actual landscape image.
Furthermore, the information acquired based on the user's location information is music information,
When an object in a real landscape is an information source of music information, it is preferable that title information of music information is associated with the object and displayed on the display means.
In addition, the information display device is a display display of a navigation device for a motorcycle, the display display constitutes a visor of a helmet worn by a motorcycle driver,
Information acquired based on the user's location information is navigation map information,
When the object in the real scenery is a road in the real scenery while the motorcycle is running, the navigation information may be associated with the object and displayed as a graphic on the display means.
Furthermore, the information acquired based on the user's position information is thumbnail image information related to the actual scenery that has been imaged, compressed, and temporarily stored in the external storage device.
The thumbnail image information may be displayed as a graphic on the display means in association with the actual scenery.
Furthermore, when displaying the thumbnail image information as a graphic, it is preferable to associate the thumbnail image information with the actual scenery so that the size of the graphic changes according to the distance between the current position of the user and the imaging position.

In order to achieve the above object, an information providing system according to the present invention includes:
In an information providing system having at least one information display device that displays information desired by a user, and an information providing device that acquires the information and provides the information to the information display device,
The information display device includes:
Current position calculating means for calculating the current position of the user;
First transmission means for transmitting current position information calculated by the current position calculation means and identification information of the information providing apparatus to the information providing apparatus through a communication line;
First receiving means for receiving desired information transmitted from the information providing apparatus;
Gaze direction detecting means for detecting the gaze direction of the user;
Imaging means for imaging a real landscape along the line of sight detected by the line-of-sight direction detection means;
Identification means for identifying an object in a real landscape imaged by the imaging means;
Display means for displaying desired information received by the first receiving means, and the display means is an eyeglass type that displays the acquired information in an overlay with a real scene corresponding to the user's line of sight,
As a result, desired information acquired based on the current position of the user or the moving object detected by the position detection unit is displayed on the display unit in association with the object in the real scene identified by the identification unit. And
The information providing apparatus includes:
Information acquisition means for acquiring desired information;
Information storage means for storing desired information acquired by the information acquisition means;
Second receiving means for receiving current position information and identification information transmitted from the first transmitting means;
Information search means for searching the information storage means for desired information within a predetermined range from the position specified by the current position information received by the second receiving means;
Second information is transmitted through a communication line to the information display device specified by the identification information received by the second receiving means.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
As shown in FIG. 1, an information providing system 10 according to this embodiment includes an information display device 12 that displays navigation information desired by a user who is a motorcycle driver, and an information display device that acquires information related to navigation information. 12 and the information providing device 14 are connected to each other via a communication line 16 such as mobile communication.

The information display device 12 displays on the display 28 (FIG. 2) the current location (own vehicle position) and destination of the moving body, or the guidance route from the current location to the destination to inform the user, and the information providing device 14 The user is requested to provide information desired by the user, and the information provided from the information providing device 14 is displayed on the display 28 to notify the user.
The information providing apparatus 14 acquires various types of information from a plurality of types of servers connected via a network such as the Internet, and sends information that matches the user request sent from the information display apparatus 12 to the information display apparatus 12. I am trying to send it.

As shown in FIG. 2, the navigation device which is the information display device 12 of the present embodiment is provided in a helmet 18 worn when riding a two-wheeled vehicle, particularly as a navigation device for two-wheeled vehicles. The apparatus main body 20 is connected to a server which is the providing apparatus 14, and has an eyeglass-type information display unit 22 connected to the apparatus main body 20 and worn by the user when used.
The apparatus main body 20 has a hardware configuration that can reproduce functions equivalent to those of a personal computer having a communication function. However, it is preferable that the outer casing be portable. In addition, in the present embodiment, the helmet 18 may have a functional configuration equivalent to that of the personal computer.
The glasses-type information display unit 22 includes a helmet body 24, a line-of-sight direction detection sensor 26 fixed to the helmet body 24, a perspective display 28 that forms a visor of the helmet 18, and an image pickup fixed to the helmet body 24. Means 30.
The gaze direction detection sensor 26 uses a known azimuth sensor or geomagnetic sensor, detects the gaze direction of the user, and transmits a signal related to the detected gaze direction to the arithmetic processing unit 32 of the apparatus main body described later. I have to.

The transparent display 28 is made of transparent or translucent organic EL, and allows the user to visually recognize the actual scenery along the user's line of sight through the display 28. As will be described later, The navigation information acquired from the information providing device 14 in exchange for the position information is displayed on the display 28 so as to be overlaid with the actual scenery, particularly the road on which the vehicle is traveling. Thereby, the user can acquire and understand navigation information safely and instantaneously without taking his eyes off from the traveling direction during traveling.
The perspective display 28 is preferably flexible and thin, and may be attached to the surface of the visor. As such type of organic EL materials, for example, organic thin film transistors are used, PES (polyether sulfone) is used as a plastic substrate material, and pentacene (C ₂₂ H ₁₄ ) is used as an organic transistor material. . By adopting an organic thin film transistor, it is possible to form an organic thin film transistor on a plastic film, stack an organic EL light emitting element thereon, and then stack a plastic film thereon, thereby insulating the thin film transistor. By removing the hard inorganic insulating material as the film and using only the organic insulating material, it is possible to realize a thin, light and bent display display 28.

The imaging means 30 is a video camera, a still camera, or the like, and is disposed at a position where the user can image an actual landscape visually recognized through the visor along the line of sight detected by the line-of-sight direction detection sensor 26. It is fixed to the frame of the helmet 18.

Next, the apparatus body 20 will be described.
As shown in FIG. 2, the apparatus body 20 includes an arithmetic processing unit 32, a display control unit 34, an external interface 36, an input unit 38, a storage unit 40, a communication unit 42, which are connected to each other via a system bus. The imaging processing unit 52 and the I / O 44 are roughly configured.
The arithmetic processing unit 32 is a CPU that controls the entire navigation device and performs information processing necessary for navigation. The arithmetic processing unit 32 receives signals from each component unit, and displays navigation information based on the user's own position information. A control signal is transmitted to the display control unit 34 so as to overlay the actual actual scenery on the display 28. The arithmetic processing unit 32 is connected to a storage unit 40, and is provided with a ROM for storing a program or data executed by the CPU, a RAM constituting the storage unit 40 necessary for information processing in the CPU, and the like.
The input unit 38 is configured with operation keys and the like for receiving an instruction from the user, and transfers the received instruction information to the arithmetic processing unit 32.
The display control unit 34 converts the data sent from the arithmetic processing unit 32 into image data displayed on the display 28.
The external interface 36 serves as an interface with an external system, and a mobile phone, a mobile terminal, a wireless LAN terminal, or the like can be connected as the external system.
The communication unit 42 is connected to a server constituting the navigation system as a whole together with the navigation apparatus of the present embodiment via a wireless communication line (not shown), and transmits information received from the server to the arithmetic processing unit 32 through the I / O 44. Like to do.
The I / O 44 performs conversion or control of input / output data of peripheral devices, and a communication unit 42, a GPS reception unit 48, and a line-of-sight detection processing unit 50 are connected.
The GPS receiver 48 receives a radio wave signal from a so-called GPS satellite, calculates position information specifying the current position from the signal, and transmits it to the arithmetic processing unit 32 through the I / O 44. More specifically, the GPS receiver 48 receives signals from three or more GPS satellites, and measures the distance between each GPS satellite and the moving body (rider) and the rate of change of this distance, The current location, traveling direction, and traveling direction of the moving object are calculated.

The line-of-sight detection processing unit 50 transmits a detection signal transmitted from the line-of-sight direction detection sensor 26 of the display device to the arithmetic processing unit 32 through the I / O 44.
The captured image processing unit 52 analyzes an image of a real landscape (also referred to as an imaging object) that is captured by the imaging unit 30 in the user's viewing direction, and obtains it from the information providing device 14 in exchange for the user's own position information. The 3D graphic vector data (hereinafter also simply referred to as “3D data”) at the current position and direction is acquired and held, and the information is sent to the arithmetic processing unit 32 through the I / O 44 for the matching process described later. I am trying to send it.
As described above, the arithmetic processing unit 32 controls each component unit of the information display device 12 in an integrated manner. More specifically, the arithmetic processing unit 32 is a central unit that performs two processes of a navigation process that is a process performed by the information display device 12 and an information display process.
FIG. 3 is a functional configuration diagram of a portion related to the execution of the navigation process of the arithmetic processing unit 32.
As shown in FIG. 3, regarding the functional configuration of the arithmetic processing unit 32, the current position calculation unit 60, the route calculation unit 62, the route guidance unit 64, the matching processing unit 66, the texture / icon information generation unit 68, , An object identification unit 70 and a graphic processing unit 72.
The current position calculator 60 calculates the current position based on the position data obtained from the GPS receiver 48.
The route calculation unit 62 searches for a route connecting the two specified points (current location and destination) from the map data stored in the map storage unit 40 on the information providing device 14 side. Determine the guidance route.
Whether the route guidance unit 64 should go straight before passing the intersection, for example, by comparing the link information of the guidance route obtained by the route calculation unit 62 and the current position information obtained by the current position calculation unit 60, It is determined whether to turn left or right, and based on this, the direction to travel on the display 28 is drawn in the form of textures or icons to guide the user.
The texture / icon information generation unit 68 converts the navigation information into texture or icon information based on the guidance data determined by the route guidance unit 64.

The matching processing unit 66 refers to the imaging processing unit 52 based on the current position derived from the guidance data in the map data determined by the route guidance unit 64 and the detection result of the line-of-sight direction detection sensor 26. The image object in the line-of-sight direction is matched with the corresponding 3D data.
The object identification unit 70 identifies the positional relationship of the texture that is overlaid on the imaging object based on the matching result. For example, when the object of the imaging object to be overlaid is a road, the road layout of the imaging object is specified as a vector value by the processing result of the matching processing unit 66, and the texture layout is positioned at the position of the graphic layout equal to this vector value. An arrangement relationship is determined.
Next, when the graphic layout position information associated with the road position is sent to the graphic processing unit 72, the graphic processing unit 72 generates image information generated by the texture / icon information generating unit 68 based on the graphic layout position information. Play.
Next, the display control unit 34 displays image data such as textures reproduced by the graphic processing unit 72 on the display area of the display display 28 that is a visor visually recognized by the user, so that the drawing data can be displayed at an appropriate display position. Generate. Here, since the imaging area of the imaging means 30 and the display area of the display 28 are associated in advance (see FIG. 5), the road position of the imaging object analyzed by the imaging processing unit 52 is specified. Therefore, by displaying the reproduced image information on the display 28, it is possible to display it on the display 28 as if the information acquired in exchange for the self position and the actual scenery are associated with each other.
In the example of the present embodiment, it is possible to obtain a visual effect as if a carpet illustrating the traveling direction is laid on a road in progress, and a rider who is a user travels by tracing the carpet. You will get a feeling as if you are.
In the above embodiment, the positional relationship of the captured imaging object is analyzed, and only the graphic corresponding to the position is generated and displayed. However, the image itself acquired by the imaging unit 30 has a texture. A similar effect can be obtained by overlaying the image and displaying it on the display 28.
In this case, the imaging object analyzed by the imaging processing unit 52 is sent to the object identification unit 70, the road position in this object is specified as a vector value, and then the imaging object including the vector value of the road position is displayed in the graphic processing unit. Then, the image is transferred to 72 so that the texture image is overlaid on this object.

Next, the information providing apparatus 14 will be described. As shown in FIG. 4, the information providing apparatus 14 includes a map information acquisition unit 80, a map area setting unit 82, a data reading processing unit 84, a map information storage unit 86, and a provision. Providing information processing for obtaining map information provided by various servers connected via a network, and providing information processing, and information providing, which is schematically configured from a side communication unit 88 and a control unit 90 that controls the providing side communication unit 88 Two processes of the information providing process for providing the acquired information to the information display device 12 that issued the request are executed.

Based on the calculated current position, the map area setting unit 82 sets a map area to be searched according to a predetermined algorithm.
The data read processing unit 84 reads map data corresponding to the set map area from the map storage unit 40 on the information providing device 14 side.
The map storage unit 40 performs matching processing with the object in the captured image captured by the imaging unit 30 and holds 3D vector data for specifying the position of the texture to be laid out at the road position. The necessary data is read from the storage medium in accordance with the command.
In particular, this 3D vector data includes three-dimensional coordinate point sequence data and data indicating the connection relationship of coordinate point sequences at the vertices that make up structures such as artifacts and structures existing at the absolute position of the earth coordinates. Including coordinate group data of a vector position from a predetermined coordinate base point. Further, in addition to the attributes given to the artifacts, structures, etc., road structured data including road links and intersections as nodes is included.

The operation of the information display device 12 having the above configuration will be described below with reference to the drawings.
When a driver of a motorcycle who is a user wears a helmet 18 provided with a visor on the information display device 12 and drives the motorcycle, navigation information is acquired in exchange for self-location information as follows, It is displayed in association with the actual scenery viewed through the visor.
First, the GPS receiver 48 and the line-of-sight direction detection sensor 26 detect the current position, information on the traveling direction, and the user's line-of-sight direction.
Next, the detected real landscape along the direction of the user's line of sight is captured by the camera.
Next, information regarding the current position and the traveling direction is transmitted to the arithmetic processing unit 32 via the I / O 44 and the captured image data captured by the imaging unit 30 via the imaging processing unit 52.
Next, the current position calculation unit 60 calculates the current position based on information on the current position and the traveling direction. Here, by appropriately adopting a configuration that refers to the azimuth information detected by the line-of-sight direction detection sensor 26, the accuracy of detection of the traveling direction can be increased.
Next, the calculated current position is transmitted to the information providing apparatus 14 via the communication unit 42.
Next, the information providing apparatus 14 receives the current position via the communication unit 42.
Next, based on the received current position, the map area setting unit 82 uses a predetermined algorithm (for example, a forward area having a predicted movement distance with respect to the traveling (running) speed as a radius, and a shorter distance as a radius. The map area to be searched is set in accordance with the rear area, and further, a calculation process for specifying a side area according to the road attribute (such as a general road, a toll road, and a highway) during traveling.
Next, based on the set map area, the data reading processing unit 84 searches the map storage area for corresponding map data (3D data), and reads the map information associated with the current position.
Next, the read map information is transmitted to the information display device 12 via the communication unit 42.

Here, in exchange for the user's own position information, map information is acquired from the information providing device 14 and, based on this map information, as will be described later, the display coordinates on the display 28 for displaying navigation information as textures or icons. After being associated with the position, the navigation information is displayed in association with the road in the actual scenery that the user visually recognizes through the perspective display 28.
Next, the information display device 12 receives the map information via the communication unit 42.
Next, the route calculation unit 62 calculates a route from the current position to the target position based on the current position, the target position, and the map information.
Next, the route guiding unit 64 specifies a route to be guided and displayed in relation to the current position of the user based on the calculated route.
Next, the texture / icon information generation unit 68 generates texture or icon information (for example, an arrow or a carpet to be displayed along the road) based on the guided route, while the matching processing unit 66 is a captured image. Matching between certain imaging object data and the corresponding 3D data is performed.
The matching processing unit 66 refers to the direction detection result of the line-of-sight direction detection sensor 26, and specifies 3D data of the elevation angle range based on this detection result. That is, when a rider who is a user deflects his / her line of sight from the traveling direction, matching processing may be performed with an imaging object in that direction.
Next, the object identification unit 70 specifies a layout position such as a texture.
Next, the graphics processing unit 72 reproduces the generated texture icon information as image information.
In these processes, a process of overlaying the texture icon information on the imaging data may be employed.
Next, the reproduction data subjected to the graphic processing is sent to the display control unit 34, and based on the coordinate position corresponding to the imaging area of the imaging means 30, the position of the road visually recognized by the user on the perspective display 28 is obtained. Control to display texture icon information.
Next, navigation information is displayed on the road in the form of a texture icon display on the perspective display 28. Thereby, the driver of the motorcycle can obtain navigation information without taking his eyes off the traveling direction during traveling, and can realize safe traveling. In addition, since navigation information can be obtained in association with an actual real landscape, navigation information can be understood instantly.

In this case, the navigation information is not limited to the guidance arrows displayed on the road, but is broad information associated with objects such as buildings, roads, signals, and intersections that the user visually recognizes based on the user's own position information. is there. For example, when there is a very conspicuous building at the destination, the building object identified by the matching process 66 is identified as an object in order to display an arrow indicating the building after identifying such a building. After the coordinate relationship between the display positions is specified by the unit 70, the display control unit 34 may be displayed on the transparent display 28 so as to overlay the building in the actual scenery. Although not directly related to the navigation information, various information in accordance with the user's preference (for example, a nearby restaurant, entertainment information, traffic information at the current user position) when the predetermined position is reached or predetermined May be displayed on the display 28 via the display control unit 34, for example, in the form of overlaying a restaurant in the actual scenery. In this case, such information is stored in the database of the server, and the retrieved information may be transmitted in response to a request from the navigation device. However, unlike the navigation information, the RAM of the information display device 12 or the like You may store in the memory | storage part 40.

As described above, according to the present embodiment, the visor of the helmet 18 is configured as a navigation device for two-wheeled vehicles, for example, by acquiring information for graphically displaying guidance on the road in exchange for the driver's own position information. On the perspective display 28, the road in the actual scenery that the driver visually recognizes via the display 28 and the information regarding such graphic display can be displayed as if they are overlaid. Therefore, a safe driving can be realized by instantly understanding the displayed icon information without taking any line of sight from the traveling direction during traveling. In particular, when touring with several motorcycles, for example, in exchange for the current position information, the navigation information of the other party of the touring (for example, the course ahead of the road that is currently running) is mutually acquired, and the graphic display is displayed on each display By doing so, the route to the touring destination can be confirmed while traveling without having a conversation with a mobile phone or a microphone. In this case, it is possible to instantly understand the path of each texture icon display by distinguishing, for example, the red arrow, the color of the tooling opponent, such as the blue arrow, or the shape of the icon figure. is there.

(Second Embodiment)
Below, the 2nd Embodiment of this invention is described in detail, referring drawings. In the present embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted. Hereinafter, characteristic portions of the present embodiment will be described in detail.
A feature of the present embodiment is that the information display device 12 is music information in which information acquired in exchange for the user's own position information is associated with the user's own position. In particular, the music information is not acquired as auditory information. The music title information is displayed in the form of visual information in an overlaid form on the perspective display 28 in association with a building or the like in the actual scenery that is the information source of the title information. This makes it possible to select music information efficiently, and for example, to visually grasp music information that is currently popular in this region, or to perform your favorite music in a nearby concert hall. It is also possible to know what is being played in a timely manner and actually listen to music.

The information display device 12 of this embodiment does not constitute the visor of the helmet 18 as in the first embodiment, but is a so-called glasses type, and is suitable for casual wear when the user goes out, for example. It is supposed to be. As in the first embodiment, a thin organic EL display 28 may be pasted on the lens surface of the glasses that the user normally uses.
On the other hand, unlike the first embodiment, the information providing apparatus 14 according to the present embodiment is music information in which information acquired in exchange for the user's self-location information is associated with the self-location. Since the information is diverse, it is different as follows in that it is necessary to access various servers to acquire such music information.

The information providing device 14 will be described. As shown in FIG. 6, the information providing device 14 is roughly configured by a music information acquisition unit 102, a music information storage unit 104, a providing communication unit 106, and a control unit 108. Two processes are provided: information processing for obtaining music information provided by various servers connected via a network, and information providing processing for providing the acquired information to the information display device 12 that has issued a request for information provision. I am trying to do it.
The music information acquisition unit 102 is connected to a network such as the Internet, and acquires music information sent from various servers similarly connected to the network via this network.
The music information storage unit 104 stores various music information acquired by the music information acquisition unit 102.
The providing communication unit 106 exchanges data with the information display device 12 via the communication line 16 such as mobile communication.
The control unit 108 comprehensively controls each component unit of the information providing apparatus 14. More specifically, it is a central unit that performs the above-described provision information processing and information provision processing.

FIG. 7 shows a functional configuration of the control unit 108.
In FIG. 7, the control unit 108 includes an individual music information receiving unit 110, an individual music information updating unit 112, a music information holding unit 114, a search target setting unit 116, an individual music information requesting unit 118, and a user request analysis. Unit 120 and a music information search unit 122 are schematically configured.
The individual music information receiving unit 110 analyzes the provider of the music information acquired by the music information acquiring unit 102. Examples of the music information provider include places where concerts are held, CD or DVD stores, restaurants where music flows in the stores, and the like.
The individual music information updating unit 112 uses the individual music information receiving unit 110 to store the music information of the providing source stored in the music information storage unit 104 based on the information providing source analyzed by the individual music information receiving unit 110. The provider updates the analyzed music information, so that the latest music information can always be stored in the music information storage unit 104. For example, the music information storage unit 104 goes to a place where a concert is held, but it is actually performed. It is possible to avoid problems such as not having been made in advance.
The music information holding unit 114 holds information on the address of music information provided by each server, the access method to the music information, and the like.
The search target setting unit 116 sets a list of servers to be accessed in order to periodically acquire music information from various servers connected to the network. Information for accessing a server from which music information is to be acquired is read from the music information holding unit 114 in accordance with the set list. Here, only when there is a request for providing information from the information display device 12, the search target setting unit 116 may set a list of servers to be accessed based on the search condition included in this request. Good. For example, the list may be set so that only music information within a predetermined range from the current location of the user wearing the information display device 12 is accessed. By doing so, it is possible to minimize the number of servers that are accessed when music information is required, and thus it is possible to reduce the load on the network.

The individual music information request unit 118 is a server in the list set by the search target setting unit 116 based on information on the address, access method, etc. of the music information read from the music information holding unit 114 by the search target setting unit 116. To request the provision of music information.
Such an information providing apparatus 14 of the present embodiment can be realized by employing a computer system such as a personal computer equipped with a communication function such as a modem.

Next, the information providing process will be described.
It is assumed that the user wears the glasses-type information display device 12 and goes out.
First, the user request analysis unit 120 waits for data to be transmitted from the information display device 12 via the providing side communication unit 106.
Next, when the user enters a certain area, he / she wants to know the music information related to this area, and in the same way as in the first embodiment, the search condition regarding the music information to be known is set together with the current position information of the user. Then, the information is transmitted from the information display device 12 to the information providing device 14 side.
Next, the user request analysis unit 120 analyzes the transmitted data and detects user identification information and information related to the search condition included in the data.
Next, the music information search unit 122 searches the music information stored in the music information storage unit 104 in accordance with the search condition analyzed by the user request analysis unit 120, thereby detecting music information that matches the search condition. . For example, if the search condition analyzed by the user request analysis unit 120 is the current position of the user, the music information storage unit 104 is searched for music information within a predetermined range from the current position.
The music information search unit 122 classifies various server attributes hierarchically in advance, sets a search range according to the server attributes of the search conditions analyzed by the user request analysis unit 120, and searches. Thus, it is possible to quickly detect information that matches the search condition. For example, for music information within a predetermined range from the current location, select one or more of music genre, vocal or instrumental, vocal for singer name, instrument type for instrument, composer, songwriter, etc. Can be set.
The searched music information is transmitted to the identified information display device 12 side through the communication unit 42, and is displayed on the user's perspective display 28 so as to be overlaid with the building in the actual scenery as the information source.
An example is shown in FIG. FIG. 8 is an example of a screen that displays, for example, the current position information of the user and the music information acquired as a search condition that is within a radius of 500 m from the current position and the genre is jazz, in association with the actual scenery. In the building A, the jazz music of the displayed title is played in the shop, and in the building B, the jazz masterpiece is sold for sale.

Thus, according to this embodiment, it is possible to access music information in a timely manner. The user can enter the building, for example, to listen to the music performance, and obtain a CD or DVD of the music. As described above, after acquiring the information desired by the user in exchange for the self-location information, it is the same as in the first embodiment, and the music information acquired in exchange for the user's self-location information is temporarily stored in the music title information. By displaying in association with the actual scenery along the field of view from the user's own position, the music information desired by the user can be accessed in a timely and efficient manner.

(Third embodiment)
Below, the 3rd Embodiment of this invention is described in detail, referring drawings. The characteristic part of this embodiment is that information acquired in exchange for self-location information is image information of a still image or a moving image with a large amount of information. In this case, the image information is once compressed and generated as so-called thumbnail information. However, by displaying these thumbnailed information groups in association with the actual scenery, the individual image information is accessed by selecting them at the thumbnail information level.
In addition, “thumbnail” used in ordinary technical common sense refers to an image in which individual images are reduced and arranged in a matrix on a single sheet so that a list of video images taken with a camera can be listed. The present embodiment is different from the present embodiment in that it indicates a compressed or reduced image group for all imaging information related to the self-position information, as will be described later, rather than simply referring to a video group arranged in a matrix. For convenience of explanation, hereinafter, a so-called thumbnail information group is simply referred to as thumbnail information.

As shown in FIG. 9, in this embodiment, the information display system 200 controls the loupe type information display device 202 used in a form in which the user looks in, and the loupe type information display device 202 by the user's operation (motion). An information display device 206 having a motion controller 204 for performing the operation, and an information providing device 208 connected to the information display device 206 via a network. The information provided from the information providing device 208 via the network is displayed as information. When the information is displayed on the device 206, the information display device 206 transmits the self-location information to the information providing device 208 and obtains the information from the information providing device 208 in return. They are displayed in relation to each other.
The loupe type information display device 202 has a hardware configuration in which the fluoroscopic display 212 is sandwiched between an inner casing 214 positioned on the side closer to the user's line of sight and an outer casing 216 positioned on the far side. Have. Both the inner casing 214 and the outer casing 216 are ring-shaped, and a transparent plate 218 is fitted in the hollow portion. The user can use the transparent plate 218 of the inner casing 214, the transparent display 212, and the transparent plate of the outer casing 216. Through 218, the actual scenery can be seen. The size of the ring is preferably such that the loupe type information display device 202 is used in such a form that the user looks into it. A camera such as a still camera is installed on the outer periphery of the outer casing 216, and image information captured by the camera is processed by the imaging processing unit 226. The see-through display 212 is made of a so-called transparent or translucent organic EL, and is preferably a film substrate, and is controlled by the display control unit 222. By adopting such a perspective display 212, the user can visually recognize the actual scenery through the perspective display 212 and display the image displayed on the display 212 as if it was overlaid with the actual scenery. It is possible to visually recognize.

The loupe type information display device 202 further includes a control unit 224, an imaging processing unit 226, a display control unit 222, a communication unit 228 for communicating with the motion controller 204, and a terminal identification information holding unit 230. A posture detection unit 232 including a geomagnetic sensor, a direction sensor, a position information acquisition unit 234, a communication unit 236 for communicating with the base station, a thumbnail information holding unit 238, and an actual image recording unit 240, an image display instruction unit 242, a timer unit 244, and a compressed image specifying unit 246.
The control unit 224 controls each component unit of the information display device in an integrated manner. More specifically, the control unit 224 performs two processes: an information display process which is a process performed by the information display device, and a communication process between the information providing device 208 and the motion controller 204. Unit.
The imaging processing unit 226 converts an image captured by the camera into information that can be processed by the information display device 206.
The display control unit 222 controls to generate a display image from the thumbnail information held in the thumbnail information holding unit 238 and the real image information held in the real image recording unit 240 and to display the display image on the perspective display 212.
The terminal identification information holding unit 230 stores and holds the identification ID information of the loupe type information display device 202.
The posture detection unit 232 detects the posture direction of the loupe type information display device 202 using the direction information detected by the magnetic sensor or the direction sensor.
The position information acquisition unit 234 acquires the user's own position. The position information acquisition unit 234 uses a known GPS device or measures a time delay in a notification line with a base station, so-called three-point positioning, A configuration using point observation obtained by distance calculation may be used.
The communication unit 236 has a function of transmitting and receiving information to and from the information providing device 208, and transmits imaging information obtained from the imaging processing unit 226 and information held by the information display device 206 to a base station by a predetermined carrier signal. The thumbnail information held by the information providing device 208 is acquired by a predetermined transport signal.
The thumbnail information holding unit 238 holds thumbnail information generated on the information providing apparatus 208 side and transmitted to the information display apparatus 206 side. This holding may be temporary or permanent.
The real image recording unit 240 records the real image held on the information providing apparatus 208 side and transmitted to the information display apparatus 206 side. This holding may be temporary or permanent.
The image display instruction unit 242 is enjoyed by a user operation, and generates image display instruction information based on this operation.
The time measuring unit 244 measures information related to the year / month / day or hour / minute / second, and is used in the present embodiment to obtain time information that defines imaging information captured by the camera.
The compressed image specifying unit 246 specifies individual images specified by a user instruction from the thumbnail information held in the thumbnail information holding unit 238.

On the other hand, as shown in FIG. 10, the motion controller 204 uses a known two-axis or three-axis acceleration sensor, measures the amount of displacement of the housing in the three-dimensional direction, and based on this, measures displacement information of the housing. And a control unit 300, an acceleration sensor unit 302, a key operation definition unit 304, a reference unit 306, and a communication unit 308 that communicates with the information display device 206. The outer casing is sized to be easily gripped by the user, and the main function operates in cooperation with the CPU constituting the control unit 300 and the built-in software program.
The control unit 300 controls each component unit of the motion controller 204 in an integrated manner. More specifically, the control unit 300 is a central unit that performs a process of giving an instruction according to the motion of the motion controller 204 to the information display device. The acceleration sensor unit 302 detects the acceleration of the motion controller 204. The key operation definition unit 304 defines a correspondence relationship between the motion of the motion controller 204 and the functional operation instruction of the information display device 206 in association with the reference unit 306. As shown in FIG. 10, the reference unit 306 is associated with an instruction operation corresponding to the motion of the motion controller 204 together with an ID number. For example, ID number 1 indicates a motion in the horizontal direction of the motion controller 204, thereby indicating that a power-on instruction operation is performed. Hereinafter, in response to the motion, the power is turned off and the communication unit 236 of the information display device 202 Are sent, thumbnail information is called, individual image information is discarded, and individual image information is selected. In use, the motion controller 204 is positioned so as to be linked to an image displayed on the perspective display 212 when viewed from the user side, and a specific image is moved by the motion of the motion controller 204 on the display 212. It has a function.

The information providing apparatus 208 will be described with reference to FIG. 9. The information providing apparatus 208 includes a control unit 400, a communication unit 402 connected to a network, a thumbnail information generation unit 404, and an imaging information recording unit 406. It is roughly composed.
The information providing device 208 is a network server. The information providing device 208 can be configured by a computer device having, for example, a CPU, a memory (RAM, ROM, etc.), an external storage device such as an HD, an external communication unit such as Ethernet (registered trademark), and the like. For example, the information providing apparatus 208 includes a basic computer (OS: Operating system) and a predetermined application program for a database server function and a communication function incorporated in a computer that is hardware and executed. In response to the request, it is possible to execute predetermined information processing and realize each function. The information providing device 208 may be configured by a single computer device, or may be configured to operate in cooperation with a plurality of computer devices connected to a network.
The control unit 400 controls each component unit of the information providing apparatus 208 in an integrated manner. More specifically, the control unit 400 communicates with the information display device 206 to receive and record image information captured on the information display device 206 side, and to perform thumbnails based on the image information. It is a central unit that performs processing for generating information and transmitting it to the information display device 206.
The thumbnail information generation unit 404 generates thumbnail information based on the captured image.
The imaging information recording unit 406 records image information captured on the information display device 206 side.
As shown in FIG. 11, the thumbnail information generation unit 404 includes a control unit 400, a target image specifying unit 408, an image display position definition unit 410, a random number generation unit 412, a thumbnail information filing unit 414, and an image compression. The processing unit 416, a distance calculation unit 418, and a masking processing unit 420 are roughly configured.
The control unit 400 controls each component unit of the thumbnail information generation unit 404 in an integrated manner.
The target image specifying unit 408 specifies an image to be compressed by the image compression processing unit 416.
The image display position definition unit 410 defines the display position on the perspective display 212 of the information display device 206 for the image compressed by the image compression processing unit 416.
In order to display the thumbnail information on the perspective display 212, the random number generation unit 412 generates a random number corresponding to the position (height) of the image information of the thumbnail information.
The thumbnail information filing unit 414 files (archives) the thumbnailed information group into one file.
The image compression processing unit 416 compresses all images included in a predetermined radius from the current position for the captured image.
The distance calculation unit 418 calculates the distance between the imaging position associated with the imaging information and the current position.
The masking processing unit 420 performs masking on the designated image. Alternatively, a masking image that substitutes for the designated image is specified.

The operation of the information display system 200 having the above-described configuration will be described below with reference to the drawings, divided into a stage of imaging and recording, a stage of referring to thumbnails, and a stage of referring to individual images.
Specifically, the stage where the user captures a scene, a person, etc. at a certain place and records it on the information providing apparatus 208 side corresponds to the imaging recording stage, and the user visits the place again at a later date. When accessing information captured in the past, the step of acquiring the imaging information using the thumbnail corresponds to the thumbnail reference step, and the step of referring to the individual image based on the thumbnail information referred by the user is the individual image reference. Corresponds to the stage.

In the first imaging / recording stage, the current position is acquired by the position information acquisition unit 234. Next, photographing is performed with a camera. In this case, it may be a still image or a moving image. Next, the orientation detection unit 232 acquires the captured direction information. Next, the imaging processing unit 226 gives a file name (serial number, etc.) to the captured information, and (1) the shooting date, (2) the shooting time, (3) the shooting direction, and (4) the information about the shooting position. Append. Next, the user gives a motion using the motion controller 204, and the key operation information is received by the communication unit 228. Next, the key operation information of the motion controller 204 is acquired by the communication unit 228, and the control unit 224 analyzes that the acquired information is a “transmission instruction”. Next, an ID number is further added by the terminal identification information holding unit 230 to the imaging information to which the information related to the file name and shooting is added, and the imaging information is transmitted to the information providing device 208 via the communication unit 236. Next, on the information providing apparatus 208 side, the communication unit 402 receives the transmitted imaging information, and records the received imaging information in the imaging information recording unit 406. As a result, the imaging information can be recorded on the information providing apparatus 208 side.

FIG. 12 shows an example of recorded imaging information. Image information is recorded in association with a terminal ID, an imaging ID, an imaging date, an imaging time, an imaging position, and an imaging direction. The imaging position is specified by longitude and latitude, and the imaging direction is determined by a clockwise angle with true north as 0 degree.
Next, in the second thumbnail reference stage, first, the user gives a motion by the motion controller 204, and the key operation information is received by the communication unit 228. Next, the control unit 224 analyzes that the received information is “calling of imaging file list”. Next, the position information acquisition unit 234 acquires the current position. Next, the control unit 224 transmits the terminal identification information by the terminal identification information holding unit 230 and the acquired current position information to the information providing apparatus 208 via the communication unit 236. Next, on the information providing apparatus 208 side, image thumbnail information is generated by the thumbnail generation unit in accordance with the information received by the communication unit 402. Next, the image thumbnail information generated by the communication unit 402 is transmitted to the information display device 206. Next, on the information display device 206 side, the communication unit 236 receives image thumbnail information. Next, the received image thumbnail information is stored in the thumbnail information holding unit 238. Next, the posture detection unit 232 detects the current direction. Next, based on the detected current direction, the display control unit 222 generates a display image from the stored image thumbnail information. Next, the generated display image is displayed on the perspective display 212.

Here, generation of thumbnail information on the information providing apparatus 208 side will be described in more detail. First, after the communication unit 402 receives the terminal identification information and the current position information, the target image specifying unit 408 determines that all images within a predetermined range (for example, within a radius of 200 m) from the current position based on the current position information. Is identified. FIG. 13 shows a list of identified images. When the terminal ID and current position information are 001 and in front of the JPO main gate, each item of image ID, shooting date, shooting time, shooting position, and shooting direction is specified. It is specified based on the converted position. For example, the image ID 002 and the image ID 003 are in front of the front gate of the Patent Office with the same imaging position, but the imaging direction is 270 degrees in the former and 180 degrees in the latter. . Next, the distance calculation unit 418 calculates the distance based on the current position information and the position information associated with the imaging information. More specifically, the distance is calculated using the current position and the imaging position associated with the imaging information shown in FIG. Next, based on the calculated distance, the image compression processing unit 416 performs image compression processing of a predetermined pixel size (3 to 5% of the original image) on the target image specified by the target image specifying unit 408. Next, the image compression processing unit 416 further compresses the image as shown in FIG. This compression process may be performed simultaneously with the compression of the current image, or may be performed by post-processing.

More specifically, FIG. 14 defines a further compression ratio of the file size after compression in accordance with the distance between the target image calculated previously and the current position, that is, the radius from the current position. When the compression ratio is increased to be smaller and displayed on the perspective display 212, a perspective can be expressed. In this regard, the thumbnail information displayed on the perspective display 212 is obtained in exchange for the self-position information in that the display size is determined according to the distance to the object to be imaged. Is displayed on the display 212 in association with the object to be imaged in the actual landscape. In FIG. 14, when the radius is 51 m or more, an alternative image such as (dot) may be used instead of the compression rate of 1%.

Next, the display position of the information display device 202 on the perspective display 212 is defined for the compressed image by the image display position specifying unit. In the definition of the display position, the relative position on the earth's ground surface is specified by the coordinate position (x, y) of each image specified in FIG. The spatial direction of the image, that is, the vertical direction is defined by the random value (z) generated by the random number generation unit 412. Thereby, the coordinate position (x, y, z) of each image is specified, and the relative positional relationship based on the current self position is grasped. In addition, since the coordinate position in the spatial direction is obtained by a random value, when displaying these images on the perspective display 212, the positional relationship can be made random, as if each image of the thumbnail is The visual state as if floating in space can be simulated.
Next, based on the terminal identification information, the masking processing unit 420 performs a masking process on an image other than that specified by the terminal identification information on the compressed image, or defines an alternative image. Accordingly, even when image information of another person is acquired, it is possible to avoid displaying the details of the image on the perspective display 212, and privacy can be protected.
Next, the thumbnail information file processing unit combines the thumbnail images that have undergone the above processing into one file.
Next, the thumbnail image group into one file is transmitted to the information display device 206.
Here, the point that the thumbnail information is reproduced and the image is displayed will be described in more detail.
First, the thumbnail image group into one file is stored in the thumbnail information holding unit 238 of the information display device 206. FIG. 15 shows a list of thumbnail image groups to be stored. In FIG. 15, each compressed image is associated with a terminal ID, an image ID, an imaging date, an imaging time, an imaging position, and a display position under a thumbnail name: AAA, a terminal ID: 001, and a current position: the JPO main gate. Is displayed. Next, based on the “image display instruction” information acquired by the image display instruction unit or the motion controller 204, the posture detection unit 232 detects the current posture direction. Next, the compressed image specifying unit 246 reads out the compressed image in the detected posture direction from the thumbnail information holding unit 238. Next, based on the display position of the compressed image, the image group specified by the compressed image specifying unit 246 is subjected to mapping processing by the display control unit 222 and displayed on the perspective display 212.
Here, the thumbnail name information held in the thumbnail holding unit 238 includes captured position information (x ″, y ″, z ″) for each image. Further, the information display device 206 includes a thumbnail holding unit. When the image group to be displayed is specified from 238, the self position (X, Y, Z) and the viewing direction are referred to.
That is, based on the self position and the viewing direction, the elevation angle direction from the own viewpoint is specified (X1, Y1, Z1), and the display range (− Xa, + Xa) are all identified (the coordinate range of the identified image is [(X1-Xa ≦ x ″ ≦ X1 + Xa), Y1 ± y ″, (random value)]).
The image group specified in this way is arranged at a position corresponding to the coordinate position of the display area of the perspective display 212 based on the respective coordinate positions.
Note that reference to the axial direction from its own viewpoint may be omitted as appropriate depending on the size of the thumbnail information.
In the above processing, in preparation for the case where the user changes the orientation, measurement by the posture detection unit 232 is performed every moment, and each time this posture direction is changed, the above processing is executed and the viewing direction for the occasion is changed. Specify and display thumbnail images.

Next, in the third individual image reference stage, first, the user gives a motion by the motion controller 204, and the key operation information is received by the communication unit 228. Next, the control unit 224 analyzes that the received information is “individual image reference instruction”. Next, based on the “individual image reference instruction”, the imaging ID stored in the thumbnail information holding unit 238 is specified, and the specified imaging ID is transmitted to the information providing apparatus 208 side via the communication unit 236. Next, on the information providing apparatus 208 side, the communication unit 402 receives the imaging ID, searches the imaging information recording unit 406 based on the acquired imaging ID, and displays an actual image (still image or moving image) specified by the imaging ID. Including). Next, the acquired real image information is communicated to the information display device 206 side via the communication unit 402. Next, on the information display device 206 side, after the communication unit 236 receives the real image information, the acquired real image information is stored in the real image recording unit 240. Next, the display control unit 222 performs a drawing process based on the stored real image information, and displays a real image on the perspective display 212.

Here, the step of selecting individual images will be described. Similarly, first, the user gives a motion by the motion controller 204, and the key operation information by the user is received by the communication unit 228. This will be described in more detail with reference to FIG. FIG. 16 shows a plurality of pieces of thumbnail information displayed on the perspective display 212. Each thumbnail information has a rounded closed curve shape, and a part of the image information (for example, a human face) is displayed in the closed curve. The image information can be grasped. Each thumbnail information is different in size and height, and gives an impression that a plurality of thumbnails are floating on the perspective display 212. It should be noted that the hatched thumbnail information is the masked thumbnail information. As shown in FIG. 16, when discarding the masked thumbnail information A, the motion controller 204 is held behind the perspective display 212 (outside the outer casing 216), and the display 212 is viewed from the user. By performing a motion to flip the thumbnail information A horizontally at the tip of the motion controller 204,
Image processing can be performed so that the thumbnail information A disappears from the display 212. On the other hand, FIG. 17 is a diagram similar to FIG. 16 showing a case where thumbnail information B is selected. In this case, the motion controller 204 is held behind the perspective display 212 (outside the outer housing 216), and the thumbnail information B is moved forward on the display 212 at the tip of the motion controller 204,
Only thumbnail information B can be selected and image processed to be displayed on the display 212.

As described above, according to the present embodiment, in order to acquire still or moving image information related to the position information, the thumbnail information is once displayed on the perspective display 212 in association with the actual landscape. At this time, in order to display the thumbnail information to be displayed in a linked form with the actual landscape, each thumbnail information is displayed on the display 212 with a size or a height, and a loupe type information display device 202 is used. It is possible to give a sense of realism that thumbnail information is floating in the landscape by adopting a method of peeking in. Further, the information display device 202 having a sense of play is provided by giving the user a preference to select the information by selecting the floating thumbnail information by moving the balloon floating on the display 212 with a finger by the movement of the motion controller 204. It is possible.

Although the embodiments of the present invention have been described in detail, those skilled in the art can make various modifications or changes without departing from the scope of the present invention. For example, in the present embodiment, a transparent or translucent organic EL display 212 is adopted as the display display 212, so that the actual position viewable by the user via the display 212 is exchanged with the current position information of the user. However, the present invention is not limited to this. For example, an actual landscape image captured by a camera is displayed on the display 212, and the acquired information is overlaid and displayed. May be.

1 is a schematic diagram of an information providing system according to a first embodiment of the present invention. 1 is a schematic view of an information display device according to a first embodiment of the present invention. It is the schematic which shows the detail of the arithmetic processing part of FIG. It is the schematic of the information provision apparatus which concerns on 1st Embodiment of this invention. It is an example of the image displayed on the display which concerns on 1st Embodiment of this invention. It is the schematic which shows the information provision apparatus which concerns on 2nd Embodiment of this invention. It is the schematic which shows the detail of the control part of the information provision apparatus which concerns on 2nd Embodiment of this invention. It is an example of the image displayed on the display which concerns on 2nd Embodiment of this invention. It is the schematic of the information provision system which concerns on 3rd Embodiment of this invention. It is a functional diagram of the motion controller which concerns on 3rd Embodiment of this invention. It is a functional diagram of the thumbnail production | generation part of the information provision apparatus which concerns on 3rd Embodiment of this invention. 10 is a table showing an example of recorded imaging information in the third embodiment of the present invention. In 3rd Embodiment of this invention, the list | wrist of the image which the target image specific | specification part specified is shown. In 3rd Embodiment of this invention, the list | wrist of the image compression rate changed according to the radius from a present position is shown. In the third embodiment of the present invention, a list of thumbnail images stored in the thumbnail information holding unit is shown. It is an example of the image displayed on the display which concerns on 3rd Embodiment of this invention. It is an example of the image displayed on the display which concerns on 3rd Embodiment of this invention.

Explanation of symbols

Information providing system 10
Arithmetic processor 32
Input unit 38
Geomagnetic sensor 51
GPS receiver 48
Display side communication unit external interface 36
Imaging processing unit 226
Gaze detection unit display control unit 34
Current position calculation unit 60
Route calculation unit 62
Route guidance unit 64
Matching processing unit 66
Graphic processing unit object identification unit 70
Texture / icon information generator 68
Map area setting unit 82
Data reading processing unit 84
Individual music information request unit 118
Individual music information receiving unit 110
Individual music information update unit 112
User request analysis unit 120
Music information search unit 122
Information display system 200
Loupe type information display device 10
Motion controller 204
Information display device 206
Information providing device 208
Perspective display 212
Inner housing 214
Outer housing 216
Transparent plate 218
Control unit 224
Imaging processing unit 226
Display control unit 224
Communication unit 228
Terminal identification information holding unit 230
Posture detection unit 232
Position information acquisition unit 234
Communication unit 236
Thumbnail information holding unit 238
Real image recording unit 240
Image display instruction unit 242
Timekeeping unit 244
Compressed image specifying unit 246
Control unit 300
Acceleration sensor unit 302
Key operation definition unit 304
Reference unit 306
Communication unit 308
Control unit 400
Communication unit 402
Thumbnail information generation unit 404
Imaging information recording unit 406
Target image specifying unit 408
Image display position definition unit 410
Random number generator 412
Thumbnail information filing unit 414
Compressed image processing unit
Distance calculation unit 418
Masking processing unit 420

Claims (8)

In an information display device that displays information acquired based on user position information in association with the user position,
Current position detecting means for detecting the current position of the user;
Gaze direction detection means for detecting the user's gaze direction;
Imaging means for imaging a real landscape along the line of sight detected by the line-of-sight direction detection means;
An identification unit for identifying an object in a real landscape imaged by the imaging unit;
Glasses-type display means for displaying the acquired information in an overlay with the actual scenery corresponding to the user's line of sight;
Information acquired based on the position of the user detected by the current position detection unit is displayed on the display unit in association with the object in the real scene identified by the identification unit.
An information display device characterized by that.     The information display device according to claim 1, wherein the display unit is a transparent or translucent organic EL display, and the acquired information is overlaid and displayed on a real landscape that is visible to the user via the display unit. The information display apparatus according to claim 1, wherein an actual landscape image captured by the imaging unit is displayed on the display unit, and the acquired information is displayed on the actual landscape image in an overlay manner. Information acquired based on the user's location information is music information,
The information display device according to claim 1, wherein when an object in a real scene is an information source of music information, title information of music information is displayed on the display unit in association with the object. The information display device is a display display of a navigation device for two-wheeled vehicles, and this display display constitutes a visor of a helmet worn by a motorcycle driver,
Information acquired based on the user's location information is navigation map information,
The information display device according to claim 1, wherein when the object in the real landscape is a road in the real landscape while the motorcycle is running, the navigation information is associated with the object and graphically displayed on the display means. Information acquired based on the user's position information is thumbnail image information related to the actual scenery that has been imaged, compressed, and temporarily stored in the external storage device.
The information display apparatus according to claim 1, wherein the thumbnail image information is displayed in a graphic form on the display unit in association with a real landscape.     The thumbnail image information is associated with an actual scene so that the size of the figure changes according to the distance between the current position of the user and the imaging position when displaying the thumbnail image information as a figure. Information display device. In an information providing system having at least one information display device that displays information desired by a user, and an information providing device that acquires the information and provides the information to the information display device,
The information display device includes:
Current position calculating means for calculating the current position of the user;
First transmission means for transmitting current position information calculated by the current position calculation means and identification information of the information providing apparatus to the information providing apparatus through a communication line;
First receiving means for receiving desired information transmitted from the information providing apparatus;
Gaze direction detecting means for detecting the gaze direction of the user;
Imaging means for imaging a real landscape along the line of sight detected by the line-of-sight direction detection means;
Identification means for identifying an object in a real landscape imaged by the imaging means;
Display means for displaying the desired information received by the first receiving means, the display means is a glasses type that displays the acquired information overlaid on the actual scenery corresponding to the user's line of sight,
As a result, desired information acquired based on the current position of the user or the moving object detected by the position detection unit is displayed on the display unit in association with the object in the real scene identified by the identification unit. And
The information providing apparatus includes:
Information acquisition means for acquiring desired information;
Information storage means for storing desired information acquired by the information acquisition means;
Second receiving means for receiving current position information and identification information transmitted from the first transmitting means;
Information search means for searching the information storage means for desired information within a predetermined range from the position specified by the current position information received by the second receiving means;
Second transmission means for transmitting desired information retrieved by the information retrieval means to an information display device specified by the identification information received by the second reception means, via a communication line;
An information providing system characterized by comprising:

Images