JP2003134510A - Image information distribution system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display system that displays a virtual character on an image display device worn by a user when the user runs or walks in a real world so as to produce an effect for the user as if the user were running or taking a walk with the character. SOLUTION: A storage means stores the virtual character with position information. An image display terminal is provided with a position acquisition means, and displays the image of the virtual character at a position of the vision of the user so that the virtual characteristic is viewed while being superimposed on a real scene depending on the acquired position.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for delivering different images depending on the position of an image display terminal.

[0002]

2. Description of the Related Art Conventionally, when a person runs for health or the like, he or she tends to only run monotonously, and it has been difficult to continue even if it is clearly effective for health. Some people were running while listening to the sound through a stereo on their mobile phone in order to distract the monotony. The same applies to walks and the like. In addition, the current situation is that the map is simply displayed on an image display terminal or the like even for directions, etc.

[0003]

[Problems to be Solved by the Invention] As described above, when a person runs a virtual run with a famous runner, the pace distribution is stable and enjoyable from a dry taste. It will be possible. Similarly, if you can walk with a virtual idol, it will be a lot of fun.

Even in directions for going to somewhere, if an adult is a virtual actor or idol, or if a child is a virtual animal, it will be very enjoyable. .

[0005]

In order to solve the above problems, the inventors of the present invention have made the following measures as a result of earnest research.
That is, in a system composed of a user's image display terminal and a server for delivering an image to the above-mentioned image display terminal, A: positioning means for acquiring the current position of the above-mentioned image display terminal, B: this image display terminal and the above Connection means for connecting to the server by communication, C: Positioning information transmitting means for transmitting the positioning information acquired by the above-mentioned positioning means to the server, D: Character image and characteristics stored in the server for distributing the image Accumulating means, E: a character state calculating means provided in the server for calculating the character state from the positioning information of the image display terminal and the character characteristics, F: the state of the calculated character Character image transmission means for transmitting an image to the user's image display terminal, G: transmitted from the above server The image state display means for displaying the image of the displayed character on the above-mentioned image display terminal including the state of the character, and the system having each of the above means as components are adopted.

When the above-mentioned positioning means further acquires the direction of the image display terminal, it may be possible to enhance the sense of reality of the virtual character arranged in the real space by using the current position and direction.

The above-mentioned character is at least one character selected from humans, animals, and animations, and is distributed to an image display terminal such as goggles-shaped eyewear that can be worn by the user when the user walks or runs. Just do it. In the case of eyewear, it is good to display a character image on the lens part. If the eyewear is equipped with a line-of-sight acquisition unit that detects the direction of the user's line of sight, the position and direction of the eyewear are comprehensively calculated to realistically reproduce the above-mentioned character seen from the user's viewpoint. It may be possible to display an image at the location.

At this time, if the user has a character selecting means capable of selecting a character to be distributed from the image display terminal according to the user's request, it is convenient because the character can be changed according to the user's preference. In addition, for example, when jogging, the characteristic of the character is a predetermined moving course such as one lap of the Imperial Palace and the speed of the character that changes depending on the course situation such as a gradient, or a movement pattern such as a face expression in agony. This is image information and is registered and accumulated. Then, the corresponding image may be distributed according to the positioning information acquired from the image display terminal described above.

Further, if necessary, the above-mentioned image display terminal is provided with a voice reproducing means, and a voice pattern is also accumulated in the above-mentioned characteristic, and the corresponding voice is delivered simultaneously with the corresponding image according to the positioning information of the image display terminal. Good.

Further, the above-mentioned image display terminal may be provided with biometric information acquisition means for acquiring biometric information of the user, and the pattern of movement of the image may be changed by the information acquired by this biometric information acquisition means. For example, when the user's heart rate has risen, the face of the character may be displayed in an anguished expression.

As the above-mentioned biometric information, the information detected by the biometric information detecting means mounted on the user's body may be fetched and a predetermined process may be performed. This biological information may be at least one selected from body temperature, pulse rate, blood pressure, body weight, body fat percentage, behavior time, sleep time, and adrenaline secretion amount.

Next, the route guidance by the character will be described. A system comprising a user's image display terminal and a server for delivering an image to this image display terminal, which inputs the user's destination from the user's image display terminal and guides the user to the destination, A: current of the image display terminal Positioning means for acquiring the position, B: Connection means for connecting the above-mentioned image display terminal and the server for distributing the image by communication, C: Positioning information transmitting means for transmitting the positioning information acquired by the above-mentioned positioning means to the server, D : Map information storage means for storing map information, E: Image storage means for storing character images for guidance provided on the server, F: Positioning information of the image display terminal and the input destination From this, a search search means for searching and searching for a course up to this destination, G: To guide the course searched by the search search means described above. Each means of character image transmitting means for transmitting the image of the matched character to the image display terminal, H: image display means for displaying the image of the character transmitted from the server on the image display terminal, is configured. A system of elements was adopted.

When the above-mentioned positioning means further acquires the direction of the image display terminal, it may be possible to enhance the realism of the virtual character arranged in the real space by using the current position and direction.

The above-mentioned character may be at least one character selected from people, animals, and animation. Further, this character may be provided with a character selection means that allows the user to select from the image display terminal according to the user's request. By doing so, the user can get a desired character such as an animal for a child or an idol for an adult to be guided.

When the user walks or runs, it may be delivered to an image display terminal that can be worn by the user, such as goggles-shaped eyewear. In the case of eyewear, it is good to display a character image on the lens part. Also,
If the eyewear is equipped with a line-of-sight acquisition unit that detects the direction of the wearer's line of sight, the position and direction of the eyewear are comprehensively calculated to reproduce the above-mentioned character seen from the user's point of view on the lens. It may be possible to display an image at the location.

Further, if necessary, the above-mentioned image display terminal is provided with a voice reproducing means, and a voice pattern is also accumulated in the above-mentioned characteristic, and the corresponding voice is delivered simultaneously with the corresponding image according to the positioning information of the image display terminal. Good.

[0017]

DETAILED DESCRIPTION OF THE INVENTION

[First Embodiment] A more detailed description will be given below based on an actual example. FIG. 1 is a general outline of the first embodiment. 101
Is a site with an image distribution server, and 102 is a database group, in which images and characteristics of each character are stored. An example of the data stored in the database is shown in FIG. Reference numeral 103 is an image display terminal, and 104 is a terminal base station for wirelessly connecting to the image display terminal and a server for distributing the image of 101.

FIG. 3 is a block diagram of the image display terminal.
It comprises a positioning means, a line-of-sight detection means, an image processing means, a site access means, a wireless communication line connection means, an image display means, and a sound reproduction means. A goggle-shaped image display terminal was adopted. The user wears the goggle-shaped image display terminal and runs.

The positioning means is provided with a GPS unit for acquiring the position of the image display terminal and an attitude detection unit for acquiring the direction of the image display terminal. The GPS unit generates position information represented by latitude and longitude by analyzing signals from a plurality of GPS satellites received by a GPS antenna mounted on the image display terminal 103. The attitude detection unit employs a geomagnetic sensor to detect absolute values in north, south, east, and west.

The line-of-sight detecting means includes an eye-movement measuring unit for measuring the movements of the right and left eyes, and a line-of-sight calculating unit for calculating the three-dimensional direction of the human's line of sight from the movements of both eyes obtained from the eye-movement calculating unit. Composed of.

FIG. 4 is an external view of a goggle-shaped image display terminal. A communication unit 401 and an image processing unit 40 which constitute a site access unit and a wireless communication line connection unit.
2. Lenses 403R and 403L for displaying images, eye movement measuring units 404R and 404L, line-of-sight calculation unit 4
05, GPS unit 406, attitude detection unit 40
7. The audio reproduction units 408R and 408L.

FIG. 5 is a flow chart for explaining the operation of displaying a character image so that it can be seen at an appropriate position in the visual field of the user. In a setting input step 501, setting input such as selection of a character and a course at the start of the service and halfway end is performed. Next, positioning step 5
In 02, the position and the direction in which the image display terminal is facing are acquired from the outputs of the GPS unit 406 and the attitude detection unit 407 described above. In the end judgment step 503, it is judged from the positioning information and the setting input information whether to continue or to end. In the case of continuing, in the line-of-sight detection step 504, the line-of-sight calculation unit analyzes the information captured by the eye movement measuring unit 404 including a sensor such as a CCD to obtain the line of sight to which the user's eyes are facing. In the image acquisition step 505, a character image corresponding to the acquired positioning information is acquired. In the screen generation step 506, a screen in which the acquired character image matches the positioning information and the line of sight is generated. In the screen display step 507, a character image is projected on the lens part of the goggles. Next, positioning step 50
Returning to step 2, the steps are similarly repeated in a predetermined cycle to supply the user with a realistic character image.

When running, the user needs to select various items in the setting input step 501. The states of the screens selected by the user are shown in FIGS. 6 to 9. First, in the purpose selection screen of FIG. 6, "walk",
The user may select from "jogging", "sprinting", "long-distance running", and "marathon". Here, the user has selected the marathon, so the screen transitions to the screen shown in Fig. 7 and the person who wants to run together ("Naoko Takaishi", "Shury Edward", "Nobutoshi Seto", "..." Will be prompted to choose. Since Naoko Takaishi is selected here, the screen transitions to the screen of FIG. 8, but the running speed of the character Naoko Takaishi can be set here according to the user. Here, the ability (speed "100%", "90
% "," 80% "," 70% "," 60% "," 50 "
% ”...)). Next, transition to FIG. 9 and select a course. Here, the course close to the current position acquired by the position acquisition means of the image display terminal is displayed (“1 round of Imperial Palace”,
"1 lap of the palace", "○ x circle" ...

An image of Naoko Takaishi is displayed on the lens portion of the goggle type image display terminal based on the selected course and the positioning information acquired by the positioning means of the image display terminal.
The situation is shown in FIG. FIG. 11 is a diagram schematically showing the positional relationship between the user and virtual Naoko Takaishi.
FIG. 12 is a diagram schematically showing a goggle-shaped image display terminal and virtual Naoko Takaishi.

At this time, the voice of the virtual breath of Naoko Takaishi or the like may be reproduced. Further, if the user is provided with a detecting means for detecting biological information such as a pulse, the virtual image, voice, etc. may be changed according to the physical condition of the user.

FIG. 13 is an external view of a user wearing the biological information detecting means. User is biometric information detection means 1
301 and the image processing device 1302 are attached to the body, and the goggle-shaped image display terminal 1303 is attached to the face. FIG. 14 is a block diagram showing the configuration of the biometric information detection means worn by the user, which has a configuration including a body temperature detection means, a pulse detection means, a blood pressure detection means, a biometric information processing means, an information storage means, and a communication means. Biometric information and processing results are transmitted by communication with the image display terminal and reflected in the character image. For example, when the pulse exceeds 140, the character speaks “Please slow down a little” or displays an image of a pose in which the hand is turned downward.

[0027]

[Embodiment 2] Next, a second embodiment in which a character guides directions will be described. FIG. 15 is an outline of the whole. Here, 1501 is a site having an image distribution server, and 1502 is a database group. Here, map information and character information (including images, sounds, etc.) are stored. An example of the database is shown in FIG. 150
3 is an image display terminal, and 1504 is an image display terminal and 15
This is a terminal base station for wirelessly connecting to a server that distributes the image 01.

FIG. 17 is a block diagram of an image display terminal, which is a goggle-shaped image display terminal having a positioning means, an image processing means, a site access means, a wireless communication line connecting means, an image display means, and a sound reproducing means. The user attaches this goggle-shaped image display terminal and asks the character displayed therein to guide the driver.

The positioning means is provided with a GPS unit for acquiring the position of the image display terminal and an attitude detection unit for acquiring the direction of the image display terminal. The GPS unit analyzes the signals from the plurality of GPS satellites received by the GPS antenna attached to the image display terminal 1503, thereby obtaining the latitude,
Generates location information represented by longitude. The attitude detection unit employs a geomagnetic sensor to detect absolute values in north, south, east, and west.

FIG. 18 is an external view of a goggle-shaped image display terminal. A communication unit 1801, an image processing unit 1802, and lenses 1803R and 1803 for displaying an image, which form a site access unit and a wireless communication line connection unit
L, eye movement measurement units 1804R and 1804L, line-of-sight calculation unit 1805, GPS unit 1806, posture detection unit 1807, sound reproduction unit 1808.
The configuration is R, 1808L.

FIG. 19 is a flow chart for explaining the operation of displaying a character image so that it can be seen at an appropriate position in the visual field of the user. In a setting input step 1901, setting input such as character selection and destination input at the start of service is performed. Next, positioning step 1
At 902, the position and the facing direction of the image display terminal are acquired. In the route search step 1903, a course search search from the positioning information or the setting input information to the destination is performed. In image acquisition step 1904, a character image corresponding to the acquired positioning information is acquired. Screen generation step 19
In 05, a screen in which the acquired character image matches the positioning information is generated. Screen display step 1906
Then, the character image is projected and displayed on the lens part of the goggles. Next, returning to the positioning step 1902, the steps are similarly repeated in a predetermined cycle to supply a realistic character image to the user.

In the setting input step, the user needs to input and select various items.
The screens to be selected are shown in FIGS. 20 to 22. First, FIG.
As shown in, the user inputs the destination from the image display terminal. If the destination is entered as XX and the send button is pressed, the screen changes to the screen shown in FIG. Here, select the destination XX and the genre of the character who will guide you after confirmation.
If an animal is selected here, the screen changes to the screen shown in FIG. When a dog is selected on the screen of FIG. 21, the screen transitions to the screen of FIG. 22, and the dog guiding the user is displayed here. Therefore, the dog guiding the user can be selected from the dogs.

FIG. 23 shows how the virtual dog is displayed on the goggle type image display terminal. FIG. 24 is a diagram schematically showing the positional relationship between the user and the virtual dog that guides the user. At this time, the virtual dog may play a voice such as "here right, one, one, one". Guide users to their destinations with images and sounds.

[0034]

As described above, according to the present invention, a user can run or walk with a virtual character when he or she runs or walks alone. In addition, even if you go somewhere, you will be able to take you to your favorite character.

[Brief description of drawings]

FIG. 1 is a schematic diagram of a first embodiment.

FIG. 2 is a block diagram of an image display terminal.

[Figure 3] Database example

FIG. 4 is an external view of a goggle-shaped image display terminal.

[Fig. 5] Flowchart of operation for displaying a character image

[Figure 6] Objective selection screen

[Figure 7] Selection screen for people who want to run

[Figure 8] Speed selection screen

[Figure 9] Course selection screen

Fig. 10 Image of Naoko Takaishi

FIG. 11 is a diagram schematically showing a positional relationship.

FIG. 12 is a diagram schematically showing an image display terminal and virtual Naoko Takaishi.

FIG. 13 is an external view of a user wearing biometric information detection means.

FIG. 14: Configuration of biometric information detection means

FIG. 15: Overall outline of Example 2

FIG. 16: Example of database

FIG. 17 is a block diagram of an image display terminal.

FIG. 18 is an external view of a goggle-shaped image display terminal.

FIG. 19 is a flowchart of an operation for displaying a character image.

[Figure 20] Destination input screen

[FIG. 21] Genre selection screen

FIG. 22: Animal selection screen

[FIG. 23] Selection screen

FIG. 24 is a virtual dog displayed on the image display terminal.

FIG. 25 is a diagram schematically showing a positional relationship with a virtual dog.

Claims (20)

[Claims] 1. A system comprising a user's image display terminal and a server for delivering an image to the image display terminal, A: positioning means for acquiring the current position of the image display terminal, B: the image display terminal Connection means for connecting the server and the server by communication, C: positioning information transmission means for transmitting the positioning information acquired by the positioning means to the server, D: the image and characteristics of the character provided in the server are accumulated Accumulating means, E: a character state calculating means provided in the server for calculating the state of the character from the position information of the image display terminal and the characteristics of the character, F: the state of the calculated character and the image Character image transmitting means for transmitting to the image display terminal, G: of the character transmitted from the server An image information distribution system characterized in that each unit of an image state display unit for displaying an image including the state of a character on the image display terminal is a constituent element. 2. The image information distribution system according to claim 1, wherein the positioning means further acquires the direction of the image display terminal. 3. The image information distribution system according to claim 1, wherein the character is at least one character selected from a person, an animal, and an animation. 4. The image information distribution system according to claim 1, wherein the character has a character selection unit that the user can select from the image display terminal according to the user's request. 5. The image information distribution system according to claim 1, wherein the image display terminal of the user is an image display terminal that can be worn by the user when the user moves. 6. The image information distribution system according to claim 5, wherein the image display terminal of the user is eyewear, and the image is projected on a lens portion of the eyewear. 7. The eyewear includes line-of-sight acquisition means for detecting a line-of-sight direction of a user who wears the eyewear, and displays the image at a position of the lens unit determined by referring to the detected line-of-sight. The image information distribution system according to claim 6. 8. The characteristic of the character is a predetermined moving course and a movement pattern of a character image corresponding to the course, and the corresponding image is distributed to the image display terminal according to positioning information. The image information distribution system according to claim 1. 9. The image display terminal has a voice reproducing means,
The image information distribution system according to claim 1, wherein the characteristic includes a sound pattern, and the sound is distributed at the same time as the corresponding image. 10. The image display terminal has biometric information acquisition means for acquiring biometric information of a user, and the pattern of movement of an image changes according to the information acquired by the biometric information acquisition means. The image information distribution system according to claim 1. 11. The image information distribution system according to claim 10, wherein the biometric information is obtained by taking in the information detected by the biometric information detection means mounted on the user's body. . 12. The biological information is at least one selected from a body temperature, a pulse rate, a blood pressure, a body weight, a body fat percentage, a working time, a sleeping time and an adrenaline secretion amount. Image information distribution system described in the section. 13. A system comprising a user's image display terminal and a server for delivering the image to the image display terminal, wherein the image is guided to a destination input from the user's image display terminal, A: the image display Positioning means for acquiring the current position of the terminal, B: Connection means for connecting the image display terminal and the server for distributing the image by communication, C: Positioning information transmission for transmitting the positioning information acquired by the positioning means to the server Means, D: Map information accumulating means for accumulating map information, E: Image accumulating means for accumulating images of characters for guidance provided in the server, F: Positioning information of the image display terminal and the input purpose Search and search means for searching and searching for a course from the ground to this destination, G: Proposed course searched by the search and search means Character image transmitting means H for transmitting the image of the character that matches the content to the image display terminal: image display means for displaying the image of the character transmitted from the server on the image display terminal. An image information distribution system characterized by being a component. 14. The positioning device further acquires the direction of the image display terminal.
The image information distribution system described in item 3. 15. The image information distribution system according to claim 13, wherein the character is at least one character selected from a person, an animal, and an animation. 16. The character selection unit according to claim 1, wherein the character is selected by a character selection unit that operates in response to an input of a request from the image display terminal.
The image information distribution system described in item 3. 17. The image information distribution system according to claim 13, wherein the image display terminal of the user is an image display terminal that can be worn by the user when the user moves. 18. The image information distribution system according to claim 17, wherein the image display terminal of the user is eyewear, and the image is projected on a lens portion of the eyewear. 19. The eyewear includes line-of-sight acquisition means for detecting a line-of-sight direction of a user who wears the eyewear, and displays the image at a position of the lens unit determined by referring to the detected line-of-sight. The image information distribution system according to claim 18. 20. The image display terminal has a voice reproducing means, a voice pattern is added to the image, and the voice is delivered simultaneously with the image in accordance with the positioning information. The image information distribution system according to claim 13.