WO2015033446A1 - Running assistance system and head mount display device used in same - Google Patents

Running assistance system and head mount display device used in same Download PDF

Info

Publication number
WO2015033446A1
WO2015033446A1 PCT/JP2013/074137 JP2013074137W WO2015033446A1 WO 2015033446 A1 WO2015033446 A1 WO 2015033446A1 JP 2013074137 W JP2013074137 W JP 2013074137W WO 2015033446 A1 WO2015033446 A1 WO 2015033446A1
Authority
WO
WIPO (PCT)
Prior art keywords
travel
data
runner
unit
traveling
Prior art date
Application number
PCT/JP2013/074137
Other languages
French (fr)
Japanese (ja)
Inventor
政雄 冨永
Original Assignee
株式会社フューチャースコープ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社フューチャースコープ filed Critical 株式会社フューチャースコープ
Priority to JP2014527425A priority Critical patent/JPWO2015033446A1/en
Priority to PCT/JP2013/074137 priority patent/WO2015033446A1/en
Publication of WO2015033446A1 publication Critical patent/WO2015033446A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium

Definitions

  • the present invention relates to a running support system and a head mounted display device used therefor.
  • Running can be done outdoors or indoors using a running machine.
  • a device Conventionally, when running using a running machine indoors, a device has been devised so that the runner can run without getting tired.
  • a television receiver is installed in front of a running machine so that a television broadcast can be viewed while running.
  • image data of a traveling course recorded on a recording medium is reproduced by an information reproducing device and displayed on a display screen (for example, see Patent Documents 1 and 2).
  • the fixed-position running device described in Patent Document 1 records a running course against a scenic landscape on a video tape, reproduces it on an information reproducing device, and displays it on the screen of a television receiver. Therefore, the run speed of the runner is detected and the playback speed of the video tape is controlled according to the speed. In other words, if the runner's stepping speed increases, the videotape playback speed is increased accordingly. Conversely, if the runner's stepping speed decreases, the videotape playback speed is decreased accordingly, The timing for displaying the driving course is adjusted.
  • landscape image information corresponding to a plurality of courses is stored in the server, and the server receives control information and forward speed information from the terminal device, so that the user uses them.
  • a course is set, and landscape image information of the course is transmitted from the server to the terminal device in correspondence with the forward speed of the user.
  • HMD head mounted display
  • an image data storage unit that stores frame image data
  • a walking speed calculation unit that counts the number of steps per unit time
  • a variable speed according to the counting result of the walking speed calculation unit.
  • a reproduction control unit that reads frame image data from the image data storage unit and a display control unit that displays the read frame image data on a display device are integrated in the chip of the HMD device.
  • Patent Documents 1 to 3 the user can run while enjoying the image of the running course displayed on the display.
  • an image of a running course can be viewed, it is indoor running, and lacks a sense of realism and refreshment. Therefore, there are very many runners who prefer outdoor running.
  • the devices described in Patent Documents 1 and 2 cannot be used.
  • the HMD device described in Patent Document 3 can be used by wearing it on the head, it can also be used when running outdoors. However, if an image of a traveling course different from the actual traveling course is displayed, the runner is confused. On the other hand, even if an image of the same traveling course as the actual traveling course is displayed while being reproduced according to the traveling speed of the runner, it is not interesting for the runner and has no meaning at all.
  • Patent Documents 1 to 3 cannot be used at all when running outdoors. On the other hand, there are many runners who are lonely to run alone, although outdoor running is more realistic and refreshing than indoor running.
  • the present invention has been made in view of such circumstances, and when running alone outdoors, the runner can run while enjoying alone without feeling lonely.
  • the purpose is that.
  • moving image data of a traveling course is reproduced from a storage medium, and an image of the traveling course is displayed on a display screen of a display device carried by the runner.
  • a character image of the virtual runner is superimposed and displayed on the top.
  • the recorded run position data reproduced from the storage medium together with the moving image data is compared with the actual run position data detected at any time for the real runner currently running on the run course. The distance difference between the virtual runner and the virtual runner is calculated and superimposed on the image of the traveling course.
  • the recorded traveling position data and recorded traveling time data reproduced from the storage medium together with the moving image data, the current traveling position data detected at any time for the actual runner currently traveling on the traveling course, and the present By comparing the running time data, the time difference between the real runner and the virtual runner is calculated, and this is superimposed and displayed on the image of the running course.
  • the display screen of the display device carried by a real runner who is actually traveling on an outdoor traveling course is as if traveling on the same traveling course with him.
  • a character image of the virtual runner is displayed, and a distance difference or a time difference between the user and the virtual runner is also displayed.
  • FIG. 1 is a diagram illustrating an example of the overall configuration of a running support system according to the present embodiment.
  • the running support system of the present embodiment includes an HMD device 100 carried by a runner, a wireless communication repeater 200, and a server device 300.
  • the wireless communication repeater 200 and the server device 300 are connected via the Internet 400.
  • the HMD device 100 communicates with the server device 300 via the Internet 400 to acquire image data, thereby displaying a moving course moving image or a virtual runner character image on the display of the HMD device 100. It is displayed on the screen.
  • FIG. 2 is a diagram illustrating a configuration example of a main part of the HMD device 100.
  • the HMD device 100 includes a microcomputer 11, a wireless communication unit 12, a display 13, a GPS receiver 14, and an acceleration sensor 15.
  • the wireless communication unit 12 performs wireless communication using a wireless communication technology such as Wi-Fi or WiMAX.
  • the microcomputer 11 includes a CPU, a RAM, a ROM, a semiconductor memory, and the like, and the following functional configuration is realized by operating a program stored in the RAM, the ROM, or the semiconductor memory. That is, the microcomputer 11 includes a data reproducing unit 21, a reproduction data selecting unit 22, a character display control unit 23, a running state detection unit 24, a calculation unit 25, and a travel difference display control unit 26 as functional configurations realized by program operations.
  • the preceding runner determination unit 27 and the reflection detection unit 28 are provided.
  • the data reproducing unit 21 reproduces data stored in a storage medium included in the server device 300 by communicating with the server device 300 via the wireless communication unit 12. That is, the data reproduction unit 21 acquires data reproduced from the storage medium of the server device 300 by transmitting a data reproduction request to the server device 300 via the wireless communication unit 12.
  • the storage medium of the server device 300 stores moving image data of a traveling course, recorded traveling position data representing each point on the traveling course, and character image data representing a virtual runner character image.
  • the moving image data is captured by the camera when the runner actually travels, and information relating to various travel courses is stored. You may memorize
  • the character image data one or a plurality of pre-generated ones are stored in the storage medium.
  • image data such as famous IP (Intellectual Property) characters, CG idols, celebrities (talents, athletes, etc.) may be stored in a storage medium.
  • the reproduction data selection unit 22 operates in cooperation with the wireless communication unit 12 and selects data to be reproduced by the data reproduction unit 21. For example, the reproduction data selection unit 22 acquires a list of traveling courses in which moving image data is stored in the storage medium of the server device 300 in response to a user operation on an operation unit (not shown) provided in the HMD device 100. The server apparatus 300 is requested to obtain a list of traveling courses from the server apparatus 300 and displayed on the display 13.
  • a list is generated so that the user can select and reproduce desired moving image data from among them. It is displayed on the display 13. For example, as shown in FIG. 3, by displaying the traveling course and the traveling time as items in the list, it is possible to select the one that is close to the pace at which one is going to run.
  • the travel time is the same as the playback time from the beginning to the end of the moving image data.
  • the reproduction data selection unit 22 selects a desired traveling course from the list displayed on the display 13 (in the case where there are a plurality of moving image data in the same traveling course) in response to a user operation on the operation unit included in the HMD device 100. , Related to the desired travel time). Then, the data reproducing unit 21 is notified of which moving image data has been selected.
  • the data reproduction unit 21 transmits a reproduction request for the selected moving image data to the server device 300 via the wireless communication unit 12 as described above, so that the storage of the server device 300 is performed.
  • the selected moving image data reproduced from the medium is acquired.
  • the data reproducing unit 21 acquires the recording travel position data together with the moving image data.
  • the reproduction data selection unit 22 causes the server device 300 to acquire a list of virtual runners in which character image data is stored in the storage medium of the server device 300 in response to a user operation on the operation unit included in the HMD device 100. Request, obtain a list of virtual runners from the server device 300 and display it on the display 13.
  • the reproduction data selection unit 22 selects a desired virtual runner from the list displayed on the display 13 in accordance with a user operation on the operation unit provided in the HMD device 100. Then, the data reproduction unit 21 is notified of which virtual runner has been selected.
  • the data reproducing unit 21 transmits a reproduction request for the character image data of the selected virtual runner to the server device 300 via the wireless communication unit 12, thereby storing the storage medium of the server device 300. To acquire the character image data of the selected virtual runner.
  • the data reproducing unit 21 moves the moving image data when the real runner starts running from the start point in response to a user operation by a runner who will actually run the selected run course (hereinafter referred to as a real runner). Start playing.
  • the data reproducing unit 21 reproduces moving image data at the same normal speed as when moving image data was recorded.
  • the recorded traveling position data is also sequentially reproduced at the same speed.
  • the character display control unit 23 displays a running course image on the display 13 based on the moving image data reproduced by the data reproducing unit 21 and displays the virtual runner character image superimposed on the running course image. .
  • the character image of the virtual runner is dynamically displayed with a body movement that seems to run.
  • the traveling state detection unit 24 detects current traveling position data representing the traveling point of the actual runner currently traveling on the traveling course as the traveling state of the actual runner at any time.
  • the traveling state detection unit 24 receives current position information output from the GPS receiver 14 and detects current traveling position data representing a traveling point on the traveling course as needed.
  • the calculation unit 25 records the travel position data (representing the travel point of the virtual runner) reproduced together with the moving image data by the data replay unit 21, and the current travel position data (real runners) detected by the travel state detection unit 24.
  • the distance difference between the real runner and the virtual runner is calculated on the basis of
  • the calculation unit 25 constantly calculates the travel distance from the start point of the travel course to the travel point of the virtual runner indicated by the recorded travel position data reproduced by the data reproduction unit 21.
  • the calculation unit 25 constantly calculates the travel distance from the start point of the travel course to the travel point of the real runner indicated by the current travel position data detected by the travel state detection unit 24. Then, a distance difference between the real runner and the virtual runner is calculated by comparing the travel distance of the virtual runner and the travel distance of the real runner.
  • the traveling difference display control unit 26 displays the distance difference calculated by the computing unit 25 so as to be superimposed on the image of the traveling course.
  • the distance difference is preferably displayed with a sign of ⁇ . For example, if the virtual runner is running ahead of the real runner, the distance difference is displayed with a plus sign, and if the real runner is running ahead of the virtual runner, the minus sign is displayed. The distance difference is displayed.
  • FIG. 4 shows an example of an image displayed on the display 13 when the virtual runner is running ahead of the real runner.
  • the preceding runner determination unit 27 determines whether the real runner or the virtual runner is traveling ahead. For example, the preceding runner determination unit 27 determines whether the real runner or the virtual runner is traveling ahead by comparing the travel distance of the virtual runner calculated by the calculation unit 25 with the travel distance of the real runner. To do. That is, it is determined that the longer travel distance is ahead. Then, the preceding runner determination unit 27 supplies the determination result to the travel difference display control unit 26. The traveling difference display control unit 26 receives the notification of the determination result by the preceding runner determination unit 27 and displays the distance difference between the real runner and the virtual runner with a sign of ⁇ .
  • the calculation unit 25 may have the function of the preceding runner determination unit 27. In other words, the calculation unit 25 calculates the distance traveled by the virtual runner and the distance traveled by the real runner, and calculates the distance difference between the real runner and the virtual runner by taking the difference between the travel distances. You may make it determine whether it is doing. Alternatively, the traveling state detection unit 24 may calculate the traveling distance of the virtual runner and the traveling distance of the real runner.
  • the distance difference between the real runner and the virtual runner calculated by the calculation unit 25 is not only displayed on the display 13 by the travel difference display control unit 26, but also the display mode of the character image is changed according to the calculated distance difference. May be. Therefore, in the present embodiment, the distance difference calculated by the calculation unit 25 is also supplied to the character display control unit 23.
  • the character display control unit 23 changes and displays at least one of the size and the position of the character image representing the virtual runner according to the distance difference calculated by the calculation unit 25, for example. For example, when the distance difference between the real runner and the virtual runner is small, the virtual runner is displayed large, and when the distance difference is large, the virtual runner is displayed small, thereby expressing the perspective according to the distance difference. It is preferable to express the sense of distance from the virtual runner in a more realistic manner by changing the display position on the travel course according to not only the size of the virtual runner but also the distance difference.
  • the character according to which of the real runner or the virtual runner is running first You may make it change the display mode of an image. Therefore, in this embodiment, the determination result by the preceding runner determination unit 27 is notified to the character display control unit 23 in addition to the travel difference display control unit 26.
  • the character display control unit 23 changes the display mode of the virtual runner character image according to the determination result by the preceding runner determination unit 27. For example, when it is determined that the real runner is running ahead of the virtual runner, the character display control unit 23 displays the virtual runner in a sweated state. Alternatively, the virtual runner's body may be displayed with a larger or faster movement so that it seems to run hard.
  • whether or not the character image is displayed may be controlled depending on whether the real runner or the virtual runner is running ahead.
  • the look-back detection unit 28 detects whether or not a real runner wearing the HMD device 100 looks back.
  • the reflection detection unit 28 determines whether or not acceleration is continuously detected in a certain direction for a certain time or more based on a signal output from the acceleration sensor 15, and when such acceleration is detected. , Detect that the reality runner looked back.
  • the acceleration sensor 15 is used here, other sensors such as an angular velocity sensor may be used.
  • the character display control unit 23 When the preceding runner determination unit 27 determines that the real runner is running ahead of the virtual runner, the character display control unit 23 indicates that the real runner has turned back by the reflection detection unit 28. Only when the character is detected, the character image representing the virtual runner is displayed on the display 13. By doing in this way, the real runner can enjoy the image running with the virtual runner with a sense closer to the actual situation.
  • the moving image data of the traveling course in which the reflected state is photographed is not recorded in the storage medium of the server device 300 and cannot be reproduced by the data reproducing unit 21. Therefore, even when the real runner looks back, an image of the traveling course being reproduced as usual is displayed. Alternatively, when the real runner looks back, the character image may be displayed in a state where there is no image of the running course.
  • moving image data of the traveling course is reproduced from the storage medium of the server device 300, and the image of the traveling course is displayed on the display 13 of the HMD device 100 worn by the real runner.
  • the character image of the virtual runner is superimposed and displayed on the image of the traveling course.
  • the distance difference between the real runner and the virtual runner is calculated, and this is displayed superimposed on the image of the running course. Furthermore, in this embodiment, it is determined which of the real runner or the virtual runner is running first, and the display of the distance difference or the display of the character image is changed according to the determination result.
  • the display 13 of the HMD device 100 worn by a real runner who is actually traveling on an outdoor traveling course seems to be traveling along the same traveling course with himself / herself.
  • the character image of the virtual runner is displayed at the same time, and the distance difference between the user and the virtual runner is also displayed. Also, the distance difference and the display mode of the character image change depending on whether the real runner or the virtual runner is running ahead.
  • FIG. 5 is a diagram illustrating a configuration example of the HMD device 100 in that case.
  • those given the same reference numerals as those shown in FIG. 2 have the same functions, and therefore redundant description is omitted here.
  • the data reproducing unit 21 ′ records the travel time data representing the travel time from the start point of the travel course to each point in addition to the moving image data and the recorded travel position data of the travel course. Playback from 300 storage media. That is, in the example of FIG. 5, the storage medium of the server device 300 stores recorded travel time data in addition to the moving course moving image data and the recorded travel position data.
  • the traveling state detection unit 24 ′ detects current traveling time data representing traveling time from the starting point of the traveling course by the actual runner to the traveling point in addition to the current traveling position data as the traveling state of the actual runner at any time. That is, the traveling state detection unit 24 ′ receives the current position information and the current time information output from the GPS receiver 14, receives the current traveling position data representing the traveling point on the traveling course, and the start point to the traveling point. Current travel time data representing travel time is detected at any time. The travel time from the start point to the travel point is calculated from the difference between the current time information detected by the GPS receiver 14 at the start time and the current time information detected by the GPS receiver 14 at the current travel point. can do.
  • the calculation unit 25 ′ replaces or in addition to the above-described distance difference with the recorded travel position data and the recorded travel time data reproduced by the data reproduction unit 21 ′ and the current travel position detected by the travel state detection unit 24 ′.
  • a time difference between the real runner and the virtual runner is calculated based on the data and the current running time data.
  • the calculation unit 25 ′ has recorded travel position data indicating the same travel point as the travel point indicated by the current travel position data detected by the travel state detection unit 24 ′, and the record stored in association therewith.
  • the travel time data is reproduced from the server device 300 by the data reproducing unit 21 ′.
  • the calculation unit 25 ′ compares the travel time indicated by the recorded travel time data reproduced by the data reproduction unit 21 ′ with the travel time indicated by the current travel time data detected by the travel state detection unit 24 ′. By doing so, the time difference between the real runner and the virtual runner is calculated.
  • the traveling difference display control unit 26 ′ displays the time difference calculated by the computing unit 25 ′ on the traveling course image in place of or in addition to the above-described distance difference.
  • This time difference is also preferably displayed with a ⁇ sign. For example, when a virtual runner is running ahead of a real runner, the time difference is displayed with a sign of-, and when a real runner is running ahead of a virtual runner, a plus sign is displayed. To display the time difference.
  • the preceding runner determination unit 27 determines whether the real runner or the virtual runner is running ahead. This may be determined by the above-described method, but the recording time data is reproduced in addition to the recorded travel position data by the data reproducing unit 21 ′, and the travel state detecting unit 24 ′ in addition to the current travel position data.
  • the preceding runner may be determined as follows.
  • the preceding runner determination unit 27 ′ includes the travel time indicated by the recorded travel time data reproduced by the data reproduction unit 21 ′ and the travel time indicated by the current travel time data detected by the travel state detection unit 24 ′. To determine whether the real runner or the virtual runner is running ahead. Note that the calculation unit 25 ′ may have the function of the preceding runner determination unit 27 ′.
  • the character display control unit 23 ′ changes and displays at least one of the size and position of the character image representing the virtual runner in accordance with the time difference calculated by the calculation unit 25 ′ instead of the distance difference described above. May be. How to change the display mode is as described above.
  • FIG. 6 is a diagram illustrating a configuration example of the HMD device 100 in that case.
  • those given the same reference numerals as those shown in FIG. 2 have the same functions, and therefore redundant description is omitted here.
  • the captured image input unit 31 inputs moving image data captured by the camera 16 when the runner is actually traveling on a certain traveling course.
  • the data recording unit 32 receives the moving image data input by the captured image input unit 31 and the current traveling position data detected by the traveling state detection unit 24 simultaneously with the photographing by the camera 16 via the wireless communication unit 12. By transmitting to 300, these data are stored in the storage medium of the server apparatus 300.
  • the recording travel position data is stored in the storage medium of the server device 300 and is reproduced by the data reproducing unit 22, and the calculation units 26, 26 ′ or the travel state detection is performed from the recorded travel position data.
  • the part 25 and 25 demonstrated the example which calculates the travel distance of a virtual runner, this invention is not limited to this.
  • recorded travel distance data representing the travel distance from the starting point of the travel course to each point is stored in the storage medium of the server device 300, and this is reproduced by the data reproducing unit 22. You may make it do.
  • the present invention is not limited to this.
  • only character image data may be stored in the HMD device 100.
  • the server apparatus 300 includes a storage medium
  • the HMD apparatus 100 has been described with respect to an example in which various data including moving image data is acquired from the server apparatus 300.
  • the present invention is not limited to this.
  • the HMD device 100 may include a storage medium.
  • the wireless communication unit 12 is not necessary.
  • the HMD device 100 is described as an example of the display device carried by the runner, but the present invention is not limited to this.
  • a mobile terminal such as a smartphone may be used, or a display device of a type used by being wrapped around a runner's arm may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A running assistance system reproduces moving image data for a running course and displays images of the running course on a display (13) of a HMD device (10) while also superimposing and displaying the image of a virtual runner character on the image of the running course, calculating the distance between the actual runner and the virtual runner, and superimposing and displaying same on the image of the running course. As a result, the image of a virtual runner character is displayed on a HMD device (10) that a runner who is actually running an outdoor running course is wearing to seem as if the virtual runner is running the same running course with the runner, making it possible for the runner to enjoy running alone without feeling lonely even when running outdoors alone.

Description

ランニング支援システムおよびこれに用いるヘッドマウントディスプレイ装置Running support system and head mounted display device used therefor
　本発明は、ランニング支援システムおよびこれに用いるヘッドマウントディスプレイ装置に関するものである。 The present invention relates to a running support system and a head mounted display device used therefor.
　近年、ランニングがブームとなっている。ランニングは屋外で行うこともできるし、屋内でランニングマシンを使って行うこともできる。従来、屋内でランニングマシンを使って走る場合に、走者が飽きることなくランニングできるようにするための工夫がなされている。例えば、ランニングマシンの前方にテレビジョン受像機を設置し、走りながらテレビ放送を視聴できるようにしたものが提供されている。また、記録媒体に記録された走行コースの画像データを情報再生装置で再生し、これをディスプレイ画面上に表示させるようにしたものも提供されている（例えば、特許文献１，２参照）。 In recent years, running has become a boom. Running can be done outdoors or indoors using a running machine. Conventionally, when running using a running machine indoors, a device has been devised so that the runner can run without getting tired. For example, a television receiver is installed in front of a running machine so that a television broadcast can be viewed while running. In addition, there is also provided one in which image data of a traveling course recorded on a recording medium is reproduced by an information reproducing device and displayed on a display screen (for example, see Patent Documents 1 and 2).
　特許文献１に記載の定位置ランニング装置は、風光明媚な風景を背景とした走行コースをビデオテープに録画しておき、それを情報再生装置で再生してテレビジョン受像機の画面上に表示するもので、走者の歩進速度を検出してその速度に応じてビデオテープの再生速度を制御するようにしている。すなわち、走者の歩進速度が速くなれば、それに応じてビデオテープの再生速度を速くし、逆に、走者の歩進速度が遅くなれば、それに応じてビデオテープの再生速度も遅くして、走行コースを表示するタイミングを調整している。 The fixed-position running device described in Patent Document 1 records a running course against a scenic landscape on a video tape, reproduces it on an information reproducing device, and displays it on the screen of a television receiver. Therefore, the run speed of the runner is detected and the playback speed of the video tape is controlled according to the speed. In other words, if the runner's stepping speed increases, the videotape playback speed is increased accordingly. Conversely, if the runner's stepping speed decreases, the videotape playback speed is decreased accordingly, The timing for displaying the driving course is adjusted.
　また、特許文献２に記載のトレーニングシステムでは、サーバに複数のコースに対応した風景画像情報を保存し、端末装置からの制御情報および前進速度情報をサーバが受信することで、利用者が利用するコースを設定し、そのコースの風景画像情報を利用者の前進速度に対応させてサーバから端末装置に送信する。これによって、利用者が気軽に種々のコースの風景を選択して楽しみながらトレーニングを行うことができるようにしている。 In the training system described in Patent Literature 2, landscape image information corresponding to a plurality of courses is stored in the server, and the server receives control information and forward speed information from the terminal device, so that the user uses them. A course is set, and landscape image information of the course is transmitted from the server to the terminal device in correspondence with the forward speed of the user. As a result, the user can easily perform training while selecting and enjoying the scenery of various courses.
　この特許文献２に記載のトレーニングシステムではさらに、同一のコースを複数の利用者が選択している場合に、利用者本人の人物画像および他の利用者の人物画像を風景画像に合成して表示させる。そして、利用者本人と他の利用者との距離差に応じて人物画像の表示位置を調整することにより、利用者本人が他の利用者を追い越したり他の利用者から追い越されたりする様子を表示するようにしている。 In the training system described in Patent Document 2, when a plurality of users select the same course, the person image of the user and the person image of another user are combined and displayed on the landscape image. Let Then, by adjusting the display position of the person image according to the distance difference between the user himself / herself and other users, the user himself / herself is overtaken by other users or overtaken by other users. It is trying to display.
　さらに、再生した走行コースの画像をヘッドマウントディスプレイ（ＨＭＤ）装置に表示するようにしたものも提案されている（例えば、特許文献３参照）。この特許文献３に記載のＨＭＤ装置では、フレーム画像データを記憶する画像データ記憶部と、単位時間当たりの歩数を計数する歩行速度算出部と、歩行速度算出部の計数結果に応じた可変速度で画像データ記憶部からフレーム画像データを読み出す再生制御部と、読み出されたフレーム画像データを表示装置に表示させる表示制御部とをＨＭＤ装置のチップ内に集積化している。 Further, there has been proposed an apparatus in which a reproduced image of a traveling course is displayed on a head mounted display (HMD) device (for example, see Patent Document 3). In the HMD device described in Patent Document 3, an image data storage unit that stores frame image data, a walking speed calculation unit that counts the number of steps per unit time, and a variable speed according to the counting result of the walking speed calculation unit. A reproduction control unit that reads frame image data from the image data storage unit and a display control unit that displays the read frame image data on a display device are integrated in the chip of the HMD device.
特開平５－２２０２３７号公報Japanese Patent Laid-Open No. 5-220237 特開２００２－２６３２３２号公報JP 2002-263232 A 特開２００９－２９７３１０号公報JP 2009-297310 A
　上記特許文献１～３に記載の技術によれば、ユーザは、ディスプレイに表示される走行コースの画像を楽しみながらランニングを行うことができる。しかしながら、走行コースの画像を見ることができるといっても、あくまでも屋内でのランニングであるため、臨場感や爽快感に欠ける。そのため、屋外でのランニングを好むランナーは非常に多い。しかし、屋外でランニングをする場合、特許文献１，２に記載の装置は何れも利用することができない。 According to the techniques described in Patent Documents 1 to 3, the user can run while enjoying the image of the running course displayed on the display. However, even if an image of a running course can be viewed, it is indoor running, and lacks a sense of realism and refreshment. Therefore, there are very many runners who prefer outdoor running. However, when running outdoors, the devices described in Patent Documents 1 and 2 cannot be used.
　これに対し、特許文献３に記載のＨＭＤ装置であれば、頭に装着して使うことができるため、屋外で走る際にも利用することが可能である。しかしながら、実際に走るコースと異なる走行コースの画像を表示させると、ランナーに混乱が生じてしまう。逆に、実際に走るコースと同じ走行コースの画像をランナーの走行速度に合わせて再生しながら表示させても、ランナーにとっては面白みがなく、全く意味もない。 On the other hand, since the HMD device described in Patent Document 3 can be used by wearing it on the head, it can also be used when running outdoors. However, if an image of a traveling course different from the actual traveling course is displayed, the runner is confused. On the other hand, even if an image of the same traveling course as the actual traveling course is displayed while being reproduced according to the traveling speed of the runner, it is not interesting for the runner and has no meaning at all.
　以上のことから、特許文献１～３に記載の技術は、屋外でランニングをする場合には全く利用することができない。その一方で、屋外でのランニングは屋内でのランニングに比べて臨場感や爽快感はあっても、一人で走るのは寂しいというランナーが少なくない。 From the above, the techniques described in Patent Documents 1 to 3 cannot be used at all when running outdoors. On the other hand, there are many runners who are lonely to run alone, although outdoor running is more realistic and refreshing than indoor running.
　本発明は、このような実情に鑑みて成されたものであり、屋外において一人でランニングをする際に、ランナーが寂しさを感じることなく、一人でも楽しみながらランニングをすることができるようにすることを目的としている。 The present invention has been made in view of such circumstances, and when running alone outdoors, the runner can run while enjoying alone without feeling lonely. The purpose is that.
　上記した課題を解決するために、本発明では、記憶媒体から走行コースの動画像データを再生して、ランナーが携行する表示装置のディスプレイ画面に走行コースの画像を表示させるとともに、走行コースの画像上に仮想ランナーのキャラクタ画像を重畳して表示させる。さらに、本発明では、動画像データと共に記憶媒体から再生される記録走行位置データと、走行コースを現に走行している現実ランナーについて随時検出される現在走行位置データとを比較することにより、現実ランナーと仮想ランナーとの距離差を算出し、これを走行コースの画像上に重畳して表示させるようにしている。 In order to solve the above-described problems, in the present invention, moving image data of a traveling course is reproduced from a storage medium, and an image of the traveling course is displayed on a display screen of a display device carried by the runner. A character image of the virtual runner is superimposed and displayed on the top. Further, in the present invention, the recorded run position data reproduced from the storage medium together with the moving image data is compared with the actual run position data detected at any time for the real runner currently running on the run course. The distance difference between the virtual runner and the virtual runner is calculated and superimposed on the image of the traveling course.
　本発明の他の態様では、動画像データと共に記憶媒体から再生される記録走行位置データおよび記録走行時間データと、走行コースを現に走行している現実ランナーについて随時検出される現在走行位置データおよび現在走行時間データとを比較することにより、現実ランナーと仮想ランナーとの時間差を算出し、これを走行コースの画像上に重畳して表示させるようにしている。 In another aspect of the present invention, the recorded traveling position data and recorded traveling time data reproduced from the storage medium together with the moving image data, the current traveling position data detected at any time for the actual runner currently traveling on the traveling course, and the present By comparing the running time data, the time difference between the real runner and the virtual runner is calculated, and this is superimposed and displayed on the image of the running course.
　上記のように構成した本発明によれば、屋外の走行コースを現に走行している現実ランナーが携行している表示装置のディスプレイ画面に、あたかも同じ走行コースを自分と一緒に走っているように仮想ランナーのキャラクタ画像が表示されるとともに、自分と仮想ランナーとの距離差または時間差も表示される。これにより、屋外において一人でランニングをする際に、ランナーが寂しさを感じることなく、仮想ランナーと伴走する感覚あるいは競争する感覚で、一人でも楽しみながらランニングをすることができる。 According to the present invention configured as described above, the display screen of the display device carried by a real runner who is actually traveling on an outdoor traveling course is as if traveling on the same traveling course with him. A character image of the virtual runner is displayed, and a distance difference or a time difference between the user and the virtual runner is also displayed. As a result, when running alone outdoors, the runner can run while enjoying alone, with the feeling of running alongside or competing with the virtual runner without feeling lonely.
本実施形態によるランニング支援システムの全体構成例を示す図である。It is a figure showing the example of whole composition of the running support system by this embodiment. 本実施形態によるＨＭＤ装置の構成例を示す図である。It is a figure which shows the structural example of the HMD apparatus by this embodiment. 再生データの選択リストの構成例を示す図である。It is a figure which shows the structural example of the selection list | wrist of reproduction | regeneration data. 本実施形態によるＨＭＤ装置のディスプレイに表示される画像の一例を示す図である。It is a figure which shows an example of the image displayed on the display of the HMD apparatus by this embodiment. 本実施形態によるＨＭＤ装置の他の構成例を示す図である。It is a figure which shows the other structural example of the HMD apparatus by this embodiment. 本実施形態によるＨＭＤ装置の他の構成例を示す図である。It is a figure which shows the other structural example of the HMD apparatus by this embodiment.
　以下、本発明の一実施形態を図面に基づいて説明する。図１は、本実施形態によるランニング支援システムの全体構成例を示す図である。図１に示すように、本実施形態のランニング支援システムは、ランナーが携行するＨＭＤ装置１００と、無線通信中継器２００と、サーバ装置３００とを備えている。無線通信中継器２００とサーバ装置３００との間はインターネット４００により接続されている。 Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of the overall configuration of a running support system according to the present embodiment. As shown in FIG. 1, the running support system of the present embodiment includes an HMD device 100 carried by a runner, a wireless communication repeater 200, and a server device 300. The wireless communication repeater 200 and the server device 300 are connected via the Internet 400.
　本実施形態のランニング支援システムは、ＨＭＤ装置１００がインターネット４００を介してサーバ装置３００と通信して画像データを取得することにより、走行コースの動画像や仮想ランナーのキャラクタ画像をＨＭＤ装置１００のディスプレイ画面に表示させるようにしたものである。 In the running support system of the present embodiment, the HMD device 100 communicates with the server device 300 via the Internet 400 to acquire image data, thereby displaying a moving course moving image or a virtual runner character image on the display of the HMD device 100. It is displayed on the screen.
　図２は、ＨＭＤ装置１００の要部構成例を示す図である。図２に示すように、ＨＭＤ装置１００は、マイクロコンピュータ（マイコン）１１、無線通信部１２、ディスプレイ１３、ＧＰＳ受信機１４および加速度センサ１５を備えている。無線通信部１２は、例えばＷｉ－ＦｉやＷｉＭＡＸなどの無線通信技術を利用して無線通信を行う。 FIG. 2 is a diagram illustrating a configuration example of a main part of the HMD device 100. As shown in FIG. 2, the HMD device 100 includes a microcomputer 11, a wireless communication unit 12, a display 13, a GPS receiver 14, and an acceleration sensor 15. The wireless communication unit 12 performs wireless communication using a wireless communication technology such as Wi-Fi or WiMAX.
　マイコン１１は、ＣＰＵ、ＲＡＭ、ＲＯＭ、半導体メモリなどを備えて構成され、ＲＡＭ、ＲＯＭまたは半導体メモリに記憶されたプログラムが動作することによって以下の機能構成が実現される。すなわち、マイコン１１は、プログラムの動作によって実現される機能構成として、データ再生部２１、再生データ選択部２２、キャラクタ表示制御部２３、走行状態検出部２４、演算部２５、走行差表示制御部２６、先行ランナー判定部２７および振り返り検出部２８を備えている。 The microcomputer 11 includes a CPU, a RAM, a ROM, a semiconductor memory, and the like, and the following functional configuration is realized by operating a program stored in the RAM, the ROM, or the semiconductor memory. That is, the microcomputer 11 includes a data reproducing unit 21, a reproduction data selecting unit 22, a character display control unit 23, a running state detection unit 24, a calculation unit 25, and a travel difference display control unit 26 as functional configurations realized by program operations. The preceding runner determination unit 27 and the reflection detection unit 28 are provided.
　データ再生部２１は、無線通信部１２を介してサーバ装置３００との間で通信を行うことにより、サーバ装置３００が備える記憶媒体に記憶されているデータの再生を行う。すなわち、データ再生部２１は、無線通信部１２を介してサーバ装置３００に対してデータの再生要求を送信することにより、サーバ装置３００の記憶媒体から再生されたデータを取得する。 The data reproducing unit 21 reproduces data stored in a storage medium included in the server device 300 by communicating with the server device 300 via the wireless communication unit 12. That is, the data reproduction unit 21 acquires data reproduced from the storage medium of the server device 300 by transmitting a data reproduction request to the server device 300 via the wireless communication unit 12.
　サーバ装置３００の記憶媒体には、走行コースの動画像データと、当該走行コース上の各地点を表す記録走行位置データと、仮想ランナーのキャラクタ画像を表すキャラクタ画像データとが記憶されている。動画像データは、実際にランナーが走行したときにカメラで撮影したものであり、様々な走行コースに関するものが記憶されている。同じ走行コースについて、同じまたは異なるランナーが走行したときの撮影によって得られた複数の動画像データを記憶しておいてもよい。 The storage medium of the server device 300 stores moving image data of a traveling course, recorded traveling position data representing each point on the traveling course, and character image data representing a virtual runner character image. The moving image data is captured by the camera when the runner actually travels, and information relating to various travel courses is stored. You may memorize | store several moving image data obtained by imaging | photography when the same or different runner drive | worked about the same driving | running | working course.
　キャラクタ画像データに関しては、あらかじめ生成されたものが１つまたは複数、記憶媒体に記憶されている。複数のキャラクタ画像データを記憶する場合、有名なＩＰ（Intellectual Property）キャラクタ、ＣＧアイドル、著名人（タレント、スポーツ選手など）などの画像データを記憶媒体に記憶させるようにしてもよい。 As for the character image data, one or a plurality of pre-generated ones are stored in the storage medium. When storing a plurality of character image data, image data such as famous IP (Intellectual Property) characters, CG idols, celebrities (talents, athletes, etc.) may be stored in a storage medium.
　再生データ選択部２２は、無線通信部１２と連携して動作し、データ再生部２１によって再生するデータを選択する。例えば、再生データ選択部２２は、ＨＭＤ装置１００が備える操作部（図示せず）に対するユーザの操作に応じて、サーバ装置３００の記憶媒体に動画像データが記憶されている走行コースのリストの取得をサーバ装置３００に要求し、サーバ装置３００から走行コースのリストを取得してディスプレイ１３に表示させる。 The reproduction data selection unit 22 operates in cooperation with the wireless communication unit 12 and selects data to be reproduced by the data reproduction unit 21. For example, the reproduction data selection unit 22 acquires a list of traveling courses in which moving image data is stored in the storage medium of the server device 300 in response to a user operation on an operation unit (not shown) provided in the HMD device 100. The server apparatus 300 is requested to obtain a list of traveling courses from the server apparatus 300 and displayed on the display 13.
　ここで、同じ走行コースについて複数の動画像データが記憶媒体に記憶されている場合は、それらの中からユーザが所望の動画像データを選択して再生することができるようなリストを生成してディスプレイ１３に表示させる。例えば、図３に示すように、走行コースおよび走行時間をリストの項目として表示させることにより、自分がこれから走ろうとするペースに近いものを選択できるようにする。なお、走行時間は、動画像データの始めから終わりまでの再生時間と同じである。 Here, when a plurality of moving image data is stored in the storage medium for the same traveling course, a list is generated so that the user can select and reproduce desired moving image data from among them. It is displayed on the display 13. For example, as shown in FIG. 3, by displaying the traveling course and the traveling time as items in the list, it is possible to select the one that is close to the pace at which one is going to run. The travel time is the same as the playback time from the beginning to the end of the moving image data.
　再生データ選択部２２は、ＨＭＤ装置１００が備える操作部に対するユーザの操作に応じて、ディスプレイ１３に表示されたリストの中から所望の走行コース（同じ走行コースに複数の動画像データがある場合は、所望の走行時間に関するもの）の動画像データを選択する。そして、どの動画像データが選択されたのかをデータ再生部２１に通知する。 The reproduction data selection unit 22 selects a desired traveling course from the list displayed on the display 13 (in the case where there are a plurality of moving image data in the same traveling course) in response to a user operation on the operation unit included in the HMD device 100. , Related to the desired travel time). Then, the data reproducing unit 21 is notified of which moving image data has been selected.
　データ再生部２１は、この通知を受けて、上述したように無線通信部１２を介してサーバ装置３００に対して、選択された動画像データの再生要求を送信することにより、サーバ装置３００の記憶媒体から再生された上記選択された動画像データを取得する。このときデータ再生部２１は、動画像データと共に記録走行位置データも取得する。 In response to this notification, the data reproduction unit 21 transmits a reproduction request for the selected moving image data to the server device 300 via the wireless communication unit 12 as described above, so that the storage of the server device 300 is performed. The selected moving image data reproduced from the medium is acquired. At this time, the data reproducing unit 21 acquires the recording travel position data together with the moving image data.
　キャラクタ画像の選択も同様に行う。すなわち、再生データ選択部２２は、ＨＭＤ装置１００が備える操作部に対するユーザの操作に応じて、サーバ装置３００の記憶媒体にキャラクタ画像データが記憶されている仮想ランナーのリストの取得をサーバ装置３００に要求し、サーバ装置３００から仮想ランナーのリストを取得してディスプレイ１３に表示させる。 ・ Select the character image in the same way. That is, the reproduction data selection unit 22 causes the server device 300 to acquire a list of virtual runners in which character image data is stored in the storage medium of the server device 300 in response to a user operation on the operation unit included in the HMD device 100. Request, obtain a list of virtual runners from the server device 300 and display it on the display 13.
　そして、再生データ選択部２２は、ＨＭＤ装置１００が備える操作部に対するユーザの操作に応じて、ディスプレイ１３に表示されたリストの中から所望の仮想ランナーを選択する。そして、どの仮想ランナーが選択されたのかをデータ再生部２１に通知する。 Then, the reproduction data selection unit 22 selects a desired virtual runner from the list displayed on the display 13 in accordance with a user operation on the operation unit provided in the HMD device 100. Then, the data reproduction unit 21 is notified of which virtual runner has been selected.
　データ再生部２１は、この通知を受けて、無線通信部１２を介してサーバ装置３００に対して、選択された仮想ランナーのキャラクタ画像データの再生要求を送信することにより、サーバ装置３００の記憶媒体から上記選択された仮想ランナーのキャラクタ画像データを取得する。 In response to this notification, the data reproducing unit 21 transmits a reproduction request for the character image data of the selected virtual runner to the server device 300 via the wireless communication unit 12, thereby storing the storage medium of the server device 300. To acquire the character image data of the selected virtual runner.
　ここで、データ再生部２１は、選択された走行コースを現にこれから走ろうとするランナー（以下、現実ランナーという）によるユーザ操作に応じて、現実ランナーがスタート地点から走り始めるときに合わせて動画像データの再生を開始する。データ再生部２１は、動画像データが記録されたときと同じ等倍速で動画像データを再生する。記録走行位置データもこれに合わせて等倍速で順次再生する。 Here, the data reproducing unit 21 moves the moving image data when the real runner starts running from the start point in response to a user operation by a runner who will actually run the selected run course (hereinafter referred to as a real runner). Start playing. The data reproducing unit 21 reproduces moving image data at the same normal speed as when moving image data was recorded. The recorded traveling position data is also sequentially reproduced at the same speed.
　キャラクタ表示制御部２３は、データ再生部２１により再生された動画像データに基づいて走行コースの画像をディスプレイ１３に表示させるとともに、走行コースの画像上に仮想ランナーのキャラクタ画像を重畳して表示させる。ここで、仮想ランナーのキャラクタ画像は、あたかも走っているように見えるような体の動きを付けて動的に表示させるのが好ましい。 The character display control unit 23 displays a running course image on the display 13 based on the moving image data reproduced by the data reproducing unit 21 and displays the virtual runner character image superimposed on the running course image. . Here, it is preferable that the character image of the virtual runner is dynamically displayed with a body movement that seems to run.
　走行状態検出部２４は、走行コースを現に走行している現実ランナーの走行地点を表す現在走行位置データを現実ランナーの走行状態として随時検出する。本実施形態では、走行状態検出部２４は、ＧＰＳ受信機１４から出力される現在位置情報を受けて、走行コース上の走行地点を表す現在走行位置データを随時検出する。 The traveling state detection unit 24 detects current traveling position data representing the traveling point of the actual runner currently traveling on the traveling course as the traveling state of the actual runner at any time. In the present embodiment, the traveling state detection unit 24 receives current position information output from the GPS receiver 14 and detects current traveling position data representing a traveling point on the traveling course as needed.
　演算部２５は、データ再生部２１により動画像データと共に再生された記録走行位置データ（仮想ランナーの走行地点を表している）と、走行状態検出部２４により検出された現在走行位置データ（現実ランナーの走行地点を表している）とに基づいて、現実ランナーと仮想ランナーとの距離差を算出する。 The calculation unit 25 records the travel position data (representing the travel point of the virtual runner) reproduced together with the moving image data by the data replay unit 21, and the current travel position data (real runners) detected by the travel state detection unit 24. The distance difference between the real runner and the virtual runner is calculated on the basis of
　例えば、演算部２５は、走行コースのスタート地点から、データ再生部２１により再生された記録走行位置データにより示される仮想ランナーの走行地点までの走行距離を常時計算している。また、演算部２５は、走行コースのスタート地点から、走行状態検出部２４により検出された現在走行位置データにより示される現実ランナーの走行地点までの走行距離を常時計算している。そして、仮想ランナーの走行距離と現実ランナーの走行距離とを比較することにより、現実ランナーと仮想ランナーとの距離差を算出する。 For example, the calculation unit 25 constantly calculates the travel distance from the start point of the travel course to the travel point of the virtual runner indicated by the recorded travel position data reproduced by the data reproduction unit 21. The calculation unit 25 constantly calculates the travel distance from the start point of the travel course to the travel point of the real runner indicated by the current travel position data detected by the travel state detection unit 24. Then, a distance difference between the real runner and the virtual runner is calculated by comparing the travel distance of the virtual runner and the travel distance of the real runner.
　走行差表示制御部２６は、演算部２５により算出された距離差を走行コースの画像上に重畳して表示させる。ここで、距離差は、±の符号付きで表示するのが好ましい。例えば、現実ランナーよりも仮想ランナーの方が先行して走っているときは＋の符号付きで距離差を表示し、仮想ランナーよりも現実ランナーの方が先行して走っているときは－の符号付きで距離差を表示する。図４は、現実ランナーよりも仮想ランナーの方が先行して走っているときにディスプレイ１３に表示される画像の一例を示している。 The traveling difference display control unit 26 displays the distance difference calculated by the computing unit 25 so as to be superimposed on the image of the traveling course. Here, the distance difference is preferably displayed with a sign of ±. For example, if the virtual runner is running ahead of the real runner, the distance difference is displayed with a plus sign, and if the real runner is running ahead of the virtual runner, the minus sign is displayed. The distance difference is displayed. FIG. 4 shows an example of an image displayed on the display 13 when the virtual runner is running ahead of the real runner.
　先行ランナー判定部２７は、現実ランナーまたは仮想ランナーのどちらが先行して走行しているかを判定する。例えば、先行ランナー判定部２７は、演算部２５により算出された仮想ランナーの走行距離と現実ランナーの走行距離とを比較することにより、現実ランナーまたは仮想ランナーのどちらが先行して走行しているかを判定する。すなわち、走行距離の長い方が先行していると判定する。そして、先行ランナー判定部２７は、その判定結果を走行差表示制御部２６に供給する。走行差表示制御部２６は、先行ランナー判定部２７による判定結果の通知を受けて、現実ランナーと仮想ランナーとの距離差を±の符号付きで表示する。 The preceding runner determination unit 27 determines whether the real runner or the virtual runner is traveling ahead. For example, the preceding runner determination unit 27 determines whether the real runner or the virtual runner is traveling ahead by comparing the travel distance of the virtual runner calculated by the calculation unit 25 with the travel distance of the real runner. To do. That is, it is determined that the longer travel distance is ahead. Then, the preceding runner determination unit 27 supplies the determination result to the travel difference display control unit 26. The traveling difference display control unit 26 receives the notification of the determination result by the preceding runner determination unit 27 and displays the distance difference between the real runner and the virtual runner with a sign of ±.
　なお、先行ランナー判定部２７の機能を演算部２５が持つようにしてもよい。すなわち、演算部２５は、仮想ランナーの走行距離と現実ランナーの走行距離とをそれぞれ計算し、両者の差分を取ることによって現実ランナーと仮想ランナーとの距離差を算出するとともに、どちらが先行して走行しているかを判定するようにしてもよい。あるいは、仮想ランナーの走行距離および現実ランナーの走行距離の計算を走行状態検出部２４が行うようにしてもよい。 Note that the calculation unit 25 may have the function of the preceding runner determination unit 27. In other words, the calculation unit 25 calculates the distance traveled by the virtual runner and the distance traveled by the real runner, and calculates the distance difference between the real runner and the virtual runner by taking the difference between the travel distances. You may make it determine whether it is doing. Alternatively, the traveling state detection unit 24 may calculate the traveling distance of the virtual runner and the traveling distance of the real runner.
　演算部２５により算出された現実ランナーと仮想ランナーとの距離差を走行差表示制御部２６によってディスプレイ１３に表示させるだけでなく、算出された距離差に応じてキャラクタ画像の表示態様を変えるようにしてもよい。そのために本実施形態では、演算部２５により算出された距離差をキャラクタ表示制御部２３にも供給している。 The distance difference between the real runner and the virtual runner calculated by the calculation unit 25 is not only displayed on the display 13 by the travel difference display control unit 26, but also the display mode of the character image is changed according to the calculated distance difference. May be. Therefore, in the present embodiment, the distance difference calculated by the calculation unit 25 is also supplied to the character display control unit 23.
　キャラクタ表示制御部２３は、例えば、演算部２５により算出された距離差に応じて、仮想ランナーを表すキャラクタ画像の大きさおよび位置の少なくとも一方を変えて表示させる。例えば、現実ランナーと仮想ランナーとの距離差が小さいときは仮想ランナーを大きく表示させ、距離差が大きいときは仮想ランナーを小さく表示させることにより、距離差によって遠近感が出るように表現する。仮想ランナーの大きさだけでなく、距離差に応じて走行コース上の表示位置を変えることにより、仮想ランナーとの距離感をより現実に近い態様で表現するのが好ましい。 The character display control unit 23 changes and displays at least one of the size and the position of the character image representing the virtual runner according to the distance difference calculated by the calculation unit 25, for example. For example, when the distance difference between the real runner and the virtual runner is small, the virtual runner is displayed large, and when the distance difference is large, the virtual runner is displayed small, thereby expressing the perspective according to the distance difference. It is preferable to express the sense of distance from the virtual runner in a more realistic manner by changing the display position on the travel course according to not only the size of the virtual runner but also the distance difference.
　また、演算部２５により算出された現実ランナーと仮想ランナーとの距離差に応じてキャラクタ画像の表示態様を変えることに加えて、現実ランナーまたは仮想ランナーのどちらが先行して走っているかに応じてキャラクタ画像の表示態様を変えるようにしてもよい。そのために本実施形態では、先行ランナー判定部２７による判定結果を、走行差表示制御部２６の他にキャラクタ表示制御部２３にも通知している。 Further, in addition to changing the display mode of the character image according to the distance difference between the real runner and the virtual runner calculated by the calculation unit 25, the character according to which of the real runner or the virtual runner is running first. You may make it change the display mode of an image. Therefore, in this embodiment, the determination result by the preceding runner determination unit 27 is notified to the character display control unit 23 in addition to the travel difference display control unit 26.
　キャラクタ表示制御部２３は、先行ランナー判定部２７による判定結果に応じて、仮想ランナーのキャラクタ画像の表示態様を変える。例えば、仮想ランナーよりも現実ランナーの方が先行して走っていると判定された場合、キャラクタ表示制御部２３は、汗をかいた状態にして仮想ランナーを表示させる。あるいは、一生懸命に走っているように見えるように、仮想ランナーの体の動きを大きくしたり速くしたりするように表示してもよい。 The character display control unit 23 changes the display mode of the virtual runner character image according to the determination result by the preceding runner determination unit 27. For example, when it is determined that the real runner is running ahead of the virtual runner, the character display control unit 23 displays the virtual runner in a sweated state. Alternatively, the virtual runner's body may be displayed with a larger or faster movement so that it seems to run hard.
　また、現実ランナーまたは仮想ランナーのどちらが先行して走っているかに応じて、キャラクタ画像の表示の有無を制御するようにしてもよい。この制御のために、振り返り検出部２８は、ＨＭＤ装置１００を装着して走っている現実ランナーが後ろを振り返ったか否かを検出する。 Also, whether or not the character image is displayed may be controlled depending on whether the real runner or the virtual runner is running ahead. For this control, the look-back detection unit 28 detects whether or not a real runner wearing the HMD device 100 looks back.
　例えば、振り返り検出部２８は、加速度センサ１５より出力される信号に基づいて、一定方向に一定時間以上連続して加速度が検出されたか否かを判定し、そのような加速度が検出された場合に、現実ランナーが後ろを振り返ったことを検出する。なお、ここでは加速度センサ１５を用いているが、角速度センサなど他のセンサを用いてもよい。 For example, the reflection detection unit 28 determines whether or not acceleration is continuously detected in a certain direction for a certain time or more based on a signal output from the acceleration sensor 15, and when such acceleration is detected. , Detect that the reality runner looked back. Although the acceleration sensor 15 is used here, other sensors such as an angular velocity sensor may be used.
　キャラクタ表示制御部２３は、仮想ランナーよりも現実ランナーの方が先行して走行していると先行ランナー判定部２７により判定された場合には、振り返り検出部２８により現実ランナーが後ろを振り返ったことが検出されたときにのみ、仮想ランナーを表すキャラクタ画像をディスプレイ１３に表示させる。このようにすることにより、より実際の状況に近い感覚で仮想ランナーと一緒に走っているイメージを現実ランナーが享受することができる。 When the preceding runner determination unit 27 determines that the real runner is running ahead of the virtual runner, the character display control unit 23 indicates that the real runner has turned back by the reflection detection unit 28. Only when the character is detected, the character image representing the virtual runner is displayed on the display 13. By doing in this way, the real runner can enjoy the image running with the virtual runner with a sense closer to the actual situation.
　なお、振り返った状態を撮影した走行コースの動画像データはサーバ装置３００の記憶媒体に記録されておらず、データ再生部２１によって再生することができない。よって、現実ランナーが後ろを振り返ったときも、通常通り再生されている走行コースの画像を表示させておく。あるいは、現実ランナーが振り返ったときには、走行コースの画像がない状態でキャラクタ画像を表示させるようにしてもよい。 It should be noted that the moving image data of the traveling course in which the reflected state is photographed is not recorded in the storage medium of the server device 300 and cannot be reproduced by the data reproducing unit 21. Therefore, even when the real runner looks back, an image of the traveling course being reproduced as usual is displayed. Alternatively, when the real runner looks back, the character image may be displayed in a state where there is no image of the running course.
　以上詳しく説明したように、本実施形態では、サーバ装置３００の記憶媒体から走行コースの動画像データを再生して、現実ランナーが装着するＨＭＤ装置１００のディスプレイ１３に走行コースの画像を表示させるとともに、走行コースの画像上に仮想ランナーのキャラクタ画像を重畳して表示させるようにしている。 As described above in detail, in the present embodiment, moving image data of the traveling course is reproduced from the storage medium of the server device 300, and the image of the traveling course is displayed on the display 13 of the HMD device 100 worn by the real runner. The character image of the virtual runner is superimposed and displayed on the image of the traveling course.
　また、本実施形態では、現実ランナーと仮想ランナーとの距離差を算出し、これを走行コースの画像上に重畳して表示させるようにしている。さらに、本実施形態では、現実ランナーまたは仮想ランナーのどちらが先行して走っているかを判定し、その判定結果に応じて距離差の表示やキャラクタ画像の表示を変えるようにしている。 Further, in this embodiment, the distance difference between the real runner and the virtual runner is calculated, and this is displayed superimposed on the image of the running course. Furthermore, in this embodiment, it is determined which of the real runner or the virtual runner is running first, and the display of the distance difference or the display of the character image is changed according to the determination result.
　このように構成した本実施形態によれば、屋外の走行コースを現に走行している現実ランナーが装着しているＨＭＤ装置１００のディスプレイ１３に、あたかも同じ走行コースを自分と一緒に走っているように仮想ランナーのキャラクタ画像が表示されるとともに、自分と仮想ランナーとの距離差も表示される。また、現実ランナーまたは仮想ランナーのどちらが先行して走っているかに応じて、距離差やキャラクタ画像の表示態様も変わる。 According to the present embodiment configured as above, the display 13 of the HMD device 100 worn by a real runner who is actually traveling on an outdoor traveling course seems to be traveling along the same traveling course with himself / herself. The character image of the virtual runner is displayed at the same time, and the distance difference between the user and the virtual runner is also displayed. Also, the distance difference and the display mode of the character image change depending on whether the real runner or the virtual runner is running ahead.
　これにより、屋外において一人でランニングをする際に、ランナーが寂しさを感じることなく、一人でも楽しみながらランニングをすることができる。例えば、他の誰かと伴走または競争をしながら走る感覚でランニングを楽しむことが可能である。また、目標タイムで走り切るための練習用として、仮想ランナーをペースメーカとしながら走る感覚でランニングを楽しむことも可能である。 This makes it possible for a runner to enjoy running alone without having to feel lonely when running alone outdoors. For example, it is possible to enjoy running as if running while competing or competing with someone else. In addition, it is also possible to enjoy running as if running while using a virtual runner as a pacemaker for practice to run at the target time.
　なお、上記実施形態では、現実ランナーと仮想ランナーとの距離差を算出して表示する例について説明したが、時間差を算出して表示するようにしてもよい。図５は、その場合におけるＨＭＤ装置１００の構成例を示す図である。なお、この図５において、図２に示した符号と同一の符号を付したものは同一の機能を有するものであるので、ここでは重複する説明を省略する。 In the above embodiment, the example in which the distance difference between the real runner and the virtual runner is calculated and displayed has been described, but the time difference may be calculated and displayed. FIG. 5 is a diagram illustrating a configuration example of the HMD device 100 in that case. In FIG. 5, those given the same reference numerals as those shown in FIG. 2 have the same functions, and therefore redundant description is omitted here.
　図５に示す構成において、データ再生部２１’は、走行コースの動画像データおよび記録走行位置データの他に、走行コースのスタート地点から各地点までの走行時間を表す記録走行時間データをサーバ装置３００の記憶媒体から再生する。すなわち、図５の例においてサーバ装置３００の記憶媒体は、走行コースの動画像データおよび記録走行位置データの他に記録走行時間データも記憶している。 In the configuration shown in FIG. 5, the data reproducing unit 21 ′ records the travel time data representing the travel time from the start point of the travel course to each point in addition to the moving image data and the recorded travel position data of the travel course. Playback from 300 storage media. That is, in the example of FIG. 5, the storage medium of the server device 300 stores recorded travel time data in addition to the moving course moving image data and the recorded travel position data.
　走行状態検出部２４’は、現在走行位置データに加え、現実ランナーによる走行コースのスタート地点から走行地点までの走行時間を表す現在走行時間データを現実ランナーの走行状態として随時検出する。すなわち、走行状態検出部２４’は、ＧＰＳ受信機１４から出力される現在位置情報および現在時刻情報を受けて、走行コース上の走行地点を表す現在走行位置データと、スタート地点から走行地点までの走行時間を表す現在走行時間データとを随時検出する。なお、スタート地点から走行地点までの走行時間は、スタート時点においてＧＰＳ受信機１４により検出された現在時刻情報と、現在の走行地点においてＧＰＳ受信機１４により検出された現在時刻情報との差分から算出することができる。 The traveling state detection unit 24 ′ detects current traveling time data representing traveling time from the starting point of the traveling course by the actual runner to the traveling point in addition to the current traveling position data as the traveling state of the actual runner at any time. That is, the traveling state detection unit 24 ′ receives the current position information and the current time information output from the GPS receiver 14, receives the current traveling position data representing the traveling point on the traveling course, and the start point to the traveling point. Current travel time data representing travel time is detected at any time. The travel time from the start point to the travel point is calculated from the difference between the current time information detected by the GPS receiver 14 at the start time and the current time information detected by the GPS receiver 14 at the current travel point. can do.
　演算部２５’は、上述した距離差に代えてまたは加えて、データ再生部２１’により再生された記録走行位置データおよび記録走行時間データと、走行状態検出部２４’により検出された現在走行位置データおよび現在走行時間データとに基づいて、現実ランナーと仮想ランナーとの時間差を算出する。 The calculation unit 25 ′ replaces or in addition to the above-described distance difference with the recorded travel position data and the recorded travel time data reproduced by the data reproduction unit 21 ′ and the current travel position detected by the travel state detection unit 24 ′. A time difference between the real runner and the virtual runner is calculated based on the data and the current running time data.
　すなわち、演算部２５’は、走行状態検出部２４’により検出された現在走行位置データにより示される走行地点と同じ走行地点を示している記録走行位置データと、それに関連付けられて記憶されている記録走行時間データとをデータ再生部２１’によってサーバ装置３００より再生させる。そして、演算部２５’は、データ再生部２１’により再生された記録走行時間データにより示される走行時間と、走行状態検出部２４’により検出された現在走行時間データにより示される走行時間とを比較することにより、現実ランナーと仮想ランナーとの時間差を算出する。 That is, the calculation unit 25 ′ has recorded travel position data indicating the same travel point as the travel point indicated by the current travel position data detected by the travel state detection unit 24 ′, and the record stored in association therewith. The travel time data is reproduced from the server device 300 by the data reproducing unit 21 ′. Then, the calculation unit 25 ′ compares the travel time indicated by the recorded travel time data reproduced by the data reproduction unit 21 ′ with the travel time indicated by the current travel time data detected by the travel state detection unit 24 ′. By doing so, the time difference between the real runner and the virtual runner is calculated.
　走行差表示制御部２６’は、上述した距離差に代えてまたは加えて、演算部２５’により算出された時間差を走行コースの画像上に重畳して表示させる。この時間差も、±の符号付きで表示するのが好ましい。例えば、現実ランナーよりも仮想ランナーの方が先行して走っているときは－の符号付きで時間差を表示し、仮想ランナーよりも現実ランナーの方が先行して走っているときは＋の符号付きで時間差を表示する。 The traveling difference display control unit 26 ′ displays the time difference calculated by the computing unit 25 ′ on the traveling course image in place of or in addition to the above-described distance difference. This time difference is also preferably displayed with a ± sign. For example, when a virtual runner is running ahead of a real runner, the time difference is displayed with a sign of-, and when a real runner is running ahead of a virtual runner, a plus sign is displayed. To display the time difference.
　先行ランナー判定部２７’は、現実ランナーまたは仮想ランナーのどちらが先行して走っているかを判定する。これを上述した方法で判定するようにしても良いが、データ再生部２１’により記録走行位置データの他に記録走行時間データが再生され、走行状態検出部２４’により現在走行位置データの他に現在走行時間データが検出される場合には、以下のようにして先行ランナーの判定を行うようにしてもよい。 The preceding runner determination unit 27 'determines whether the real runner or the virtual runner is running ahead. This may be determined by the above-described method, but the recording time data is reproduced in addition to the recorded travel position data by the data reproducing unit 21 ′, and the travel state detecting unit 24 ′ in addition to the current travel position data. When the current travel time data is detected, the preceding runner may be determined as follows.
　すなわち、先行ランナー判定部２７’は、データ再生部２１’により再生された記録走行時間データにより示される走行時間と、走行状態検出部２４’により検出された現在走行時間データにより示される走行時間とを比較することにより、現実ランナーまたは仮想ランナーのどちらが先行して走っているかを判定する。なお、この先行ランナー判定部２７’の機能を演算部２５’が持つようにしてもよい。 That is, the preceding runner determination unit 27 ′ includes the travel time indicated by the recorded travel time data reproduced by the data reproduction unit 21 ′ and the travel time indicated by the current travel time data detected by the travel state detection unit 24 ′. To determine whether the real runner or the virtual runner is running ahead. Note that the calculation unit 25 ′ may have the function of the preceding runner determination unit 27 ′.
　キャラクタ表示制御部２３’は、上述した距離差に代えて、演算部２５’により算出された時間差に応じて、仮想ランナーを表すキャラクタ画像の大きさおよび位置の少なくとも一方を変えて表示させるようにしてもよい。どのように表示態様を変えるかについては、上述した通りである。 The character display control unit 23 ′ changes and displays at least one of the size and position of the character image representing the virtual runner in accordance with the time difference calculated by the calculation unit 25 ′ instead of the distance difference described above. May be. How to change the display mode is as described above.
　また、上記実施形態では、サーバ装置３００の記憶媒体にあらかじめ動画像データを含む各種データが記憶されている例について説明したが、本発明はこれに限定されない。例えば、ユーザが動画像データ等をサーバ装置３００に送信して記憶媒体に記憶させることができるようにしてもよい。図６は、その場合におけるＨＭＤ装置１００の構成例を示す図である。なお、この図６において、図２に示した符号と同一の符号を付したものは同一の機能を有するものであるので、ここでは重複する説明を省略する。 In the above embodiment, the example in which various data including moving image data is stored in advance in the storage medium of the server apparatus 300 has been described, but the present invention is not limited to this. For example, the user may be able to transmit moving image data or the like to the server device 300 and store it in a storage medium. FIG. 6 is a diagram illustrating a configuration example of the HMD device 100 in that case. In FIG. 6, those given the same reference numerals as those shown in FIG. 2 have the same functions, and therefore redundant description is omitted here.
　図６に示す構成において、撮影画像入力部３１は、ある走行コースをランナーが実際に走行しているときにカメラ１６により撮影された動画像データを入力する。データ記録部３２は、撮影画像入力部３１により入力された動画像データと、カメラ１６による撮影と同時に走行状態検出部２４により検出された現在走行位置データとを無線通信部１２を介してサーバ装置３００に送信することにより、これらのデータをサーバ装置３００の記憶媒体に記憶させる。 In the configuration shown in FIG. 6, the captured image input unit 31 inputs moving image data captured by the camera 16 when the runner is actually traveling on a certain traveling course. The data recording unit 32 receives the moving image data input by the captured image input unit 31 and the current traveling position data detected by the traveling state detection unit 24 simultaneously with the photographing by the camera 16 via the wireless communication unit 12. By transmitting to 300, these data are stored in the storage medium of the server apparatus 300.
　このように構成することにより、過去に自分が走ったときの動画像データを選択して再生することができる。これにより、過去の自分と競争をしながら自己記録の更新を目指す感覚でランニングを楽しむことが可能となる。なお、ここでは図２に示した構成に対してカメラ１６、撮影画像入力部３１およびデータ記録部３２を追加する例について説明したが、図５に示した構成に対して追加するようにしてもよい。 By configuring in this way, it is possible to select and reproduce moving image data when the user has run in the past. This makes it possible to enjoy running as if aiming to update the self-record while competing with the past. Here, the example in which the camera 16, the captured image input unit 31, and the data recording unit 32 are added to the configuration illustrated in FIG. 2 has been described. However, the configuration may be added to the configuration illustrated in FIG. Good.
　また、上記実施形態では、サーバ装置３００の記憶媒体に記録走行位置データを記憶しておいてこれをデータ再生部２２が再生し、この記録走行位置データから演算部２６，２６’または走行状態検出部２５，２５’が仮想ランナーの走行距離を算出する例について説明したが、本発明はこれに限定されない。例えば、記録走行位置データに代えて、走行コースのスタート地点から各地点までの走行距離を表す記録走行距離データをサーバ装置３００の記憶媒体に記憶しておいて、これをデータ再生部２２が再生するようにしてもよい。 Further, in the above embodiment, the recording travel position data is stored in the storage medium of the server device 300 and is reproduced by the data reproducing unit 22, and the calculation units 26, 26 ′ or the travel state detection is performed from the recorded travel position data. Although the part 25 and 25 'demonstrated the example which calculates the travel distance of a virtual runner, this invention is not limited to this. For example, instead of the recorded travel position data, recorded travel distance data representing the travel distance from the starting point of the travel course to each point is stored in the storage medium of the server device 300, and this is reproduced by the data reproducing unit 22. You may make it do.
　また、上記実施形態では、仮想ランナーのキャラクタ画像データもサーバ装置３００の記憶媒体に記憶させる例について説明したが、本発明はこれに限定されない。例えば、キャラクタ画像データだけはＨＭＤ装置１００に記憶させるようにしてもよい。 In the above embodiment, the example in which the character image data of the virtual runner is also stored in the storage medium of the server device 300 has been described, but the present invention is not limited to this. For example, only character image data may be stored in the HMD device 100.
　また、上記実施形態では、図１に示したように、サーバ装置３００が記憶媒体を備えており、ＨＭＤ装置１００がサーバ装置３００から動画像データを含む各種データを取得する例について説明したが、本発明はこれに限定されない。例えば、ＨＭＤ装置１００が記憶媒体を備えるようにしてもよい。この場合、無線通信部１２は不要である。 In the above embodiment, as illustrated in FIG. 1, the server apparatus 300 includes a storage medium, and the HMD apparatus 100 has been described with respect to an example in which various data including moving image data is acquired from the server apparatus 300. The present invention is not limited to this. For example, the HMD device 100 may include a storage medium. In this case, the wireless communication unit 12 is not necessary.
　また、上記実施形態では、ランナーが携行する表示装置の例としてＨＭＤ装置１００を挙げて説明したが、本発明はこれに限定されない。例えば、スマートフォンのような携帯端末であってもよいし、ランナーの腕に巻き付けて使用するタイプの表示装置であってもよい。 In the above embodiment, the HMD device 100 is described as an example of the display device carried by the runner, but the present invention is not limited to this. For example, a mobile terminal such as a smartphone may be used, or a display device of a type used by being wrapped around a runner's arm may be used.
　その他、上記実施形態は、何れも本発明を実施するにあたっての具体化の一例を示したものに過ぎず、これによって本発明の技術的範囲が限定的に解釈されてはならないものである。すなわち、本発明はその要旨、またはその主要な特徴から逸脱することなく、様々な形で実施することができる。 In addition, each of the above-described embodiments is merely an example of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the gist or the main features thereof.
　１１　マイコン
　１２　無線通信部
　１３　ディスプレイ
　１４　ＧＰＳ受信機
　１５　加速度センサ
　１６　カメラ
　２１，２１’　データ再生部
　２２　再生データ選択部
　２３，２３’　キャラクタ表示制御部
　２４，２４’　走行状態検出部
　２５，２５’　演算部
　２６，２６’　走行差表示制御部
　２７，２７’　先行ランナー判定部
　２８　振り返り検出部
　３１　撮影画像入力部
　３２　データ記録部
　１００　ＨＭＤ装置
　３００　サーバ装置 DESCRIPTION OF SYMBOLS 11 Microcomputer 12 Wireless communication part 13 Display 14 GPS receiver 15 Acceleration sensor 16 Camera 21, 21 'Data reproduction part 22 Reproduction data selection part 23, 23' Character display control part 24, 24 'Running state detection part 25, 25' Calculation Unit 26, 26 'travel difference display control unit 27, 27' preceding runner determination unit 28 reflection detection unit 31 photographed image input unit 32 data recording unit 100 HMD device 300 server

Claims (20)

  1. 　ランナーが携行する表示装置に走行コースを含む画像を表示させるようになされたランニング支援システムであって、
    　上記走行コースの動画像データ、上記走行コース上の各地点を表す記録走行位置データを記憶した記憶媒体から、上記動画像データを上記記録走行位置データと共に再生するデータ再生部と、
    　上記走行コースを現に走行している現実ランナーの走行地点を表す現在走行位置データを上記現実ランナーの走行状態として随時検出する走行状態検出部と、
    　上記データ再生部により再生された上記動画像データに基づいて上記走行コースの画像を上記表示装置のディスプレイ画面に表示させるとともに、上記走行コースの画像上に仮想ランナーのキャラクタ画像を重畳して表示させるキャラクタ表示制御部と、
    　上記データ再生部により上記動画像データと共に再生された上記記録走行位置データと、上記走行状態検出部により検出された上記現在走行位置データとに基づいて、上記現実ランナーと上記仮想ランナーとの距離差を算出する演算部と、
    　上記演算部により算出された上記距離差を上記走行コースの画像上に重畳して表示させる走行差表示制御部とを備えたことを特徴とするランニング支援システム。     A running support system configured to display an image including a running course on a display device carried by a runner,
    A data reproduction unit for reproducing the moving image data together with the recorded traveling position data from a storage medium storing moving image data of the traveling course and recorded traveling position data representing each point on the traveling course;
    A traveling state detection unit for detecting current traveling position data representing a traveling point of a real runner who is actually traveling on the traveling course as a traveling state of the real runner as needed;
    Based on the moving image data reproduced by the data reproduction unit, the image of the traveling course is displayed on the display screen of the display device, and the character image of the virtual runner is superimposed and displayed on the image of the traveling course. A character display control unit;
    A distance difference between the real runner and the virtual runner based on the recorded running position data reproduced together with the moving image data by the data reproducing unit and the current running position data detected by the running state detecting unit. An arithmetic unit for calculating
    A running support system, comprising: a running difference display control unit that displays the distance difference calculated by the computing unit superimposed on an image of the running course.
  2. 　上記データ再生部は、上記走行コースのスタート地点から上記各地点までの走行距離を表す記録走行距離データを上記記録走行位置データに代えて記憶した上記記憶媒体から、上記動画像データを上記記録走行距離データと共に再生し、
    　上記走行状態検出部は、上記現在走行位置データに代えて、上記現実ランナーの上記スタート地点から上記走行地点までの走行距離を表す現在走行距離データを上記現実ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により上記動画像データと共に再生された上記記録走行距離データと、上記走行状態検出部により検出された上記現在走行距離データとに基づいて、上記現実ランナーと上記仮想ランナーとの距離差を算出する
    ことを特徴とする請求項１に記載のランニング支援システム。     The data reproducing unit records the moving image data from the storage medium storing the recorded travel distance data representing the travel distance from the start point of the travel course to the points instead of the recorded travel position data. Play with distance data,
    The travel state detection unit detects current travel distance data representing the travel distance from the start point of the real runner to the travel point instead of the current travel position data as the travel state of the real runner as needed,
    The calculation unit is configured to calculate the real runner and the virtual based on the recorded travel distance data reproduced together with the moving image data by the data reproduction unit and the current travel distance data detected by the travel state detection unit. The running support system according to claim 1, wherein a distance difference from the runner is calculated.
  3. 　上記データ再生部は、上記走行コースの動画像データおよび上記記録走行位置データの他に、上記走行コースのスタート地点から上記各地点までの走行時間を表す記録走行時間データを記憶した上記記憶媒体から、上記動画像データ、上記記録走行位置データおよび上記記録走行時間データを再生し、
    　上記走行状態検出部は、上記現在走行位置データに加え、上記現実ランナーによる上記走行コースのスタート地点から上記走行地点までの走行時間を表す現在走行時間データを上記ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により再生された上記記録走行位置データおよび上記記録走行時間データと、上記走行状態検出部により検出された上記現在走行位置データおよび上記現在走行時間データとに基づいて、上記現実ランナーと上記仮想ランナーとの時間差を算出し、
    　上記走行差表示制御部は、上記距離差に代えてまたは加えて、上記演算部により算出された上記時間差を上記走行コースの画像上に重畳して表示させることを特徴とする請求項１に記載のランニング支援システム。     The data reproduction unit includes, from the storage medium storing recorded travel time data representing travel time from the start point of the travel course to each of the points in addition to the moving image data of the travel course and the recorded travel position data. , Reproducing the moving image data, the recording travel position data and the recording travel time data,
    The travel state detection unit detects current travel time data representing travel time from the start point of the travel course by the real runner to the travel point in addition to the current travel position data as the travel state of the runner as needed,
    The calculation unit is based on the recorded travel position data and the recorded travel time data reproduced by the data reproduction unit, and the current travel position data and the current travel time data detected by the travel state detection unit. , Calculate the time difference between the real runner and the virtual runner,
    The said travel difference display control part replaces or adds to the said distance difference, The said time difference calculated by the said calculating part is superimposed and displayed on the image of the said travel course, The display of Claim 1 characterized by the above-mentioned. Running support system.
  4. 　上記データ再生部は、上記走行コースのスタート地点から上記各地点までの走行距離を表す記録走行距離データを上記記録走行位置データに代えて記憶した上記記憶媒体から、上記動画像データ、上記記録走行距離データおよび上記記録走行時間データを再生し、
    　上記走行状態検出部は、上記現在走行位置データに代えて、上記現実ランナーの上記スタート地点から上記走行地点までの走行距離を表す現在走行距離データを、上記現在走行時間データと共に上記現実ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により再生された上記記録走行距離データおよび上記記録走行時間データと、上記走行状態検出部により検出された上記現在走行距離データおよび上記現在走行時間データとに基づいて、上記現実ランナーと上記仮想ランナーとの時間差を算出する
    ことを特徴とする請求項２に記載のランニング支援システム。     The data reproduction unit stores the moving image data and the recorded travel from the storage medium storing the recorded travel distance data representing the travel distance from the start point of the travel course to each point in place of the recorded travel position data. Reproduce the distance data and the recorded travel time data,
    The travel state detection unit replaces the current travel position data with current travel distance data representing a travel distance from the start point of the real runner to the travel point together with the current travel time data. Detect at any time as a state,
    The calculation unit is based on the recorded travel distance data and the recorded travel time data reproduced by the data reproduction unit, and the current travel distance data and the current travel time data detected by the travel state detection unit. The running support system according to claim 2, wherein a time difference between the real runner and the virtual runner is calculated.
  5. 　上記キャラクタ表示制御部は、上記演算部により算出された上記距離差に応じて、上記仮想ランナーを表す上記キャラクタ画像の大きさおよび位置の少なくとも一方を変えて表示させる請求項１または２に記載のランニング支援システム。 The said character display control part changes and displays at least one of the magnitude | size and position of the said character image showing the said virtual runner according to the said distance difference calculated by the said calculating part. Running support system.
  6. 　上記キャラクタ表示制御部は、上記演算部により算出された上記時間差に応じて、上記仮想ランナーを表す上記キャラクタ画像の大きさおよび位置の少なくとも一方を変えて表示させる請求項３または４に記載のランニング支援システム。 The running according to claim 3 or 4, wherein the character display control unit displays at least one of a size and a position of the character image representing the virtual runner in accordance with the time difference calculated by the calculation unit. Support system.
  7. 　カメラにより撮影された動画像データを入力する撮影画像入力部と、
    　上記撮影画像入力部により入力された動画像データと、上記カメラによる撮影と同時に上記走行状態検出部により検出された上記現在走行位置データとを上記記憶媒体に記憶させるデータ記録部とを更に備えたことを特徴とする請求項１または２に記載のランニング支援システム。     A captured image input unit for inputting moving image data captured by the camera;
    A data recording unit for storing the moving image data input by the captured image input unit and the current traveling position data detected by the traveling state detection unit simultaneously with the photographing by the camera in the storage medium; The running support system according to claim 1 or 2, characterized in that.
  8. 　カメラにより撮影された動画像データを入力する撮影画像入力部と、
    　上記撮影画像入力部により入力された動画像データと、上記カメラによる撮影と同時に上記走行状態検出部により検出された上記現在走行位置データおよび上記現在走行時間データを上記記憶媒体に記憶させるデータ記録部とを更に備えたことを特徴とする請求項３または４に記載のランニング支援システム。     A captured image input unit for inputting moving image data captured by the camera;
    A data recording unit for storing the moving image data input by the captured image input unit and the current traveling position data and the current traveling time data detected by the traveling state detecting unit simultaneously with the photographing by the camera in the storage medium The running support system according to claim 3 or 4, further comprising:
  9. 　上記記憶媒体、上記データ再生部、上記走行状態検出部、上記キャラクタ表示制御部、上記演算部および上記走行差表示制御部を全てヘッドマウントディスプレイ装置に実装したことを特徴とする請求項１～８の何れか１項に記載のランニング支援システム。 9. The storage medium, the data reproduction unit, the running state detection unit, the character display control unit, the calculation unit, and the running difference display control unit are all mounted on a head mounted display device. The running support system according to any one of the above.
  10. 　上記記憶媒体を備えたサーバ装置と、上記データ再生部、上記走行状態検出部、上記キャラクタ表示制御部、上記演算部および上記走行差表示制御部を備えたヘッドマウントディスプレイ装置とを有し、
    　上記ヘッドマウントディスプレイ装置は、無線通信を行う無線通信部を更に備え、
    　上記データ再生部は、上記無線通信部を介して上記サーバ装置との間で通信を行うことにより、上記サーバ装置が備える上記記憶媒体に記憶されているデータの再生を行うことを特徴とする請求項１～８の何れか１項に記載のランニング支援システム。     A server device including the storage medium, and a head mounted display device including the data reproduction unit, the running state detection unit, the character display control unit, the calculation unit, and the travel difference display control unit,
    The head mounted display device further includes a wireless communication unit that performs wireless communication,
    The data reproduction unit reproduces data stored in the storage medium included in the server device by performing communication with the server device via the wireless communication unit. Item 9. The running support system according to any one of Items 1 to 8.
  11. 　上記ヘッドマウントディスプレイ装置は、
    　上記現実ランナーまたは上記仮想ランナーのどちらが先行して走行しているかを判定する先行ランナー判定部と、
    　上記現実ランナーが後ろを振り返ったか否かを検出する振り返り検出部とを更に備え、
    　上記キャラクタ表示制御部は、上記仮想ランナーよりも上記現実ランナーの方が先行して走行していると上記先行ランナー判定部により判定された場合、上記振り返り検出部により上記現実ランナーが後ろを振り返ったことが検出されたときにのみ、上記仮想ランナーを表す上記キャラクタ画像を表示させることを特徴とする請求項９または１０に記載のランニング支援システム。     The head mounted display device is
    A preceding runner determination unit that determines which of the real runner or the virtual runner is running ahead,
    A reflection detector that detects whether or not the reality runner looks back;
    When the preceding runner determination unit determines that the real runner is running ahead of the virtual runner, the character display control unit looks back at the real runner by the reflection detection unit. The running support system according to claim 9 or 10, wherein the character image representing the virtual runner is displayed only when the event is detected.
  12. 　走行コースの動画像データ、上記走行コース上の各地点を表す記録走行位置データを記憶した記憶媒体から、上記動画像データを上記記録走行位置データと共に再生するデータ再生部と、
    　上記走行コースを現に走行している現実ランナーの走行地点を表す現在走行位置データを上記現実ランナーの走行状態として随時検出する走行状態検出部と、
    　上記データ再生部により再生された上記動画像データに基づいて上記走行コースの画像をディスプレイ画面に表示させるとともに、上記走行コースの画像上に仮想ランナーのキャラクタ画像を重畳して表示させるキャラクタ表示制御部と、
    　上記データ再生部により上記動画像データと共に再生された上記記録走行位置データと、上記走行状態検出部により検出された上記現在走行位置データとに基づいて、上記現実ランナーと上記仮想ランナーとの距離差を算出する演算部と、
    　上記演算部により算出された上記距離差を上記走行コースの画像上に重畳して表示させる走行差表示制御部とを備えたことを特徴とするヘッドマウントディスプレイ装置。     A data reproduction unit for reproducing the moving image data together with the recorded traveling position data from a storage medium storing moving image data of the traveling course and recorded traveling position data representing each point on the traveling course;
    A traveling state detection unit for detecting current traveling position data representing a traveling point of a real runner who is actually traveling on the traveling course as a traveling state of the real runner as needed;
    A character display control unit for displaying an image of the traveling course on a display screen based on the moving image data reproduced by the data reproducing unit and for displaying a virtual runner character image superimposed on the image of the traveling course. When,
    A distance difference between the real runner and the virtual runner based on the recorded running position data reproduced together with the moving image data by the data reproducing unit and the current running position data detected by the running state detecting unit. An arithmetic unit for calculating
    A head mounted display device, comprising: a travel difference display control unit that displays the distance difference calculated by the arithmetic unit superimposed on an image of the travel course.
  13. 　上記データ再生部は、上記走行コースのスタート地点から上記各地点までの走行距離を表す記録走行距離データを上記記録走行位置データに代えて記憶した上記記憶媒体から、上記動画像データを上記記録走行距離データと共に再生し、
    　上記走行状態検出部は、上記現在走行位置データに代えて、上記現実ランナーの上記スタート地点から上記走行地点までの走行距離を表す現在走行距離データを上記現実ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により上記動画像データと共に再生された上記記録走行距離データと、上記走行状態検出部により検出された上記現在走行距離データとに基づいて、上記現実ランナーと上記仮想ランナーとの距離差を算出する
    ことを特徴とする請求項１２に記載のヘッドマウントディスプレイ装置。     The data reproducing unit records the moving image data from the storage medium storing the recorded travel distance data representing the travel distance from the start point of the travel course to the points instead of the recorded travel position data. Play with distance data,
    The travel state detection unit detects current travel distance data representing the travel distance from the start point of the real runner to the travel point instead of the current travel position data as the travel state of the real runner as needed,
    The calculation unit is configured to calculate the real runner and the virtual based on the recorded travel distance data reproduced together with the moving image data by the data reproduction unit and the current travel distance data detected by the travel state detection unit. The head-mounted display device according to claim 12, wherein a distance difference from the runner is calculated.
  14. 　上記データ再生部は、上記走行コースの動画像データおよび上記記録走行位置データの他に、上記走行コースのスタート地点から上記各地点までの走行時間を表す記録走行時間データを記憶した上記記憶媒体から、上記動画像データ、上記記録走行位置データおよび上記記録走行時間データを再生し、
    　上記走行状態検出部は、上記現在走行位置データに加え、上記現実ランナーによる上記走行コースのスタート地点から上記走行地点までの走行時間を表す現在走行時間データを上記ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により再生された上記記録走行位置データおよび上記記録走行時間データと、上記走行状態検出部により検出された上記現在走行位置データおよび上記現在走行時間データとに基づいて、上記現実ランナーと上記仮想ランナーとの時間差を算出し、
    　上記走行差表示制御部は、上記距離差に代えてまたは加えて、上記演算部により算出された上記時間差を上記走行コースの画像上に重畳して表示させることを特徴とする請求項１２に記載のヘッドマウントディスプレイ装置。     The data reproduction unit includes, from the storage medium storing recorded travel time data representing travel time from the start point of the travel course to each of the points in addition to the moving image data of the travel course and the recorded travel position data. , Reproducing the moving image data, the recording travel position data and the recording travel time data,
    The travel state detection unit detects current travel time data representing travel time from the start point of the travel course by the real runner to the travel point in addition to the current travel position data as the travel state of the runner as needed,
    The calculation unit is based on the recorded travel position data and the recorded travel time data reproduced by the data reproduction unit, and the current travel position data and the current travel time data detected by the travel state detection unit. , Calculate the time difference between the real runner and the virtual runner,
    13. The travel difference display control unit, instead of or in addition to the distance difference, displays the time difference calculated by the calculation unit superimposed on an image of the travel course. Head mounted display device.
  15. 　上記データ再生部は、上記走行コースのスタート地点から上記各地点までの走行距離を表す記録走行距離データを上記記録走行位置データに代えて記憶した上記記憶媒体から、上記動画像データ、上記記録走行距離データおよび上記記録走行時間データを再生し、
    　上記走行状態検出部は、上記現在走行位置データに代えて、上記現実ランナーの上記スタート地点から上記走行地点までの走行距離を表す現在走行距離データを、上記現在走行時間データと共に上記現実ランナーの走行状態として随時検出し、
    　上記演算部は、上記データ再生部により再生された上記記録走行距離データおよび上記記録走行時間データと、上記走行状態検出部により検出された上記現在走行距離データおよび上記現在走行時間データとに基づいて、上記現実ランナーと上記仮想ランナーとの時間差を算出する
    ことを特徴とする請求項１４に記載のヘッドマウントディスプレイ装置。     The data reproduction unit stores the moving image data and the recorded travel from the storage medium storing the recorded travel distance data representing the travel distance from the start point of the travel course to each point in place of the recorded travel position data. Reproduce the distance data and the recorded travel time data,
    The travel state detection unit replaces the current travel position data with current travel distance data representing a travel distance from the start point of the real runner to the travel point together with the current travel time data. Detect at any time as a state,
    The calculation unit is based on the recorded travel distance data and the recorded travel time data reproduced by the data reproduction unit, and the current travel distance data and the current travel time data detected by the travel state detection unit. The head-mounted display device according to claim 14, wherein a time difference between the real runner and the virtual runner is calculated.
  16. 　カメラにより撮影された動画像データを入力する撮影画像入力部と、
    　上記撮影画像入力部により入力された動画像データと、上記カメラによる撮影と同時に上記走行状態検出部により検出された上記現在走行位置データとを上記記憶媒体に記憶させるデータ記録部とを更に備えたことを特徴とする請求項１２または１３に記載のヘッドマウントディスプレイ装置。     A captured image input unit for inputting moving image data captured by the camera;
    A data recording unit for storing the moving image data input by the captured image input unit and the current traveling position data detected by the traveling state detection unit simultaneously with the photographing by the camera in the storage medium; The head-mounted display device according to claim 12 or 13,
  17. 　カメラにより撮影された動画像データを入力する撮影画像入力部と、
    　上記撮影画像入力部により入力された動画像データと、上記カメラによる撮影と同時に上記走行状態検出部により検出された上記現在走行位置データおよび上記現在走行時間データを上記記憶媒体に記憶させるデータ記録部とを更に備えたことを特徴とする請求項１４または１５に記載のヘッドマウントディスプレイ装置。     A captured image input unit for inputting moving image data captured by the camera;
    A data recording unit for storing the moving image data input by the captured image input unit and the current traveling position data and the current traveling time data detected by the traveling state detecting unit simultaneously with the photographing by the camera in the storage medium The head mounted display device according to claim 14, further comprising:
  18. 　上記現実ランナーまたは上記仮想ランナーのどちらが先行して走行しているかを判定する先行ランナー判定部と、
    　上記現実ランナーが後ろを振り返ったか否かを検出する振り返り検出部とを更に備え、
    　上記キャラクタ表示制御部は、上記仮想ランナーよりも上記現実ランナーの方が先行して走行していると上記先行ランナー判定部により判定された場合、上記振り返り検出部により上記現実ランナーが後ろを振り返ったことが検出されたときにのみ、上記仮想ランナーを表す上記キャラクタ画像を表示させることを特徴とする請求項１２～１５の何れか１項に記載のヘッドマウントディスプレイ装置。     A preceding runner determination unit that determines which of the real runner or the virtual runner is running ahead,
    A reflection detector that detects whether or not the reality runner looks back;
    When the preceding runner determination unit determines that the real runner is running ahead of the virtual runner, the character display control unit looks back at the real runner by the reflection detection unit. The head-mounted display device according to any one of claims 12 to 15, wherein the character image representing the virtual runner is displayed only when this is detected.
  19. 　上記記憶媒体を更に備えたことを特徴とする請求項１２～１６の何れか１項に記載のヘッドマウントディスプレイ装置。 The head mounted display device according to any one of claims 12 to 16, further comprising the storage medium.
  20. 　無線通信を行う無線通信部を更に備え、
    　上記データ再生部は、上記無線通信部を介してサーバ装置との間で通信を行うことにより、上記サーバ装置が備える上記記憶媒体に記憶されているデータの再生を行うことを特徴とする請求項１２～１６の何れか１項に記載のヘッドマウントディスプレイ装置。     A wireless communication unit for performing wireless communication;
    The data reproducing unit reproduces data stored in the storage medium included in the server device by performing communication with the server device via the wireless communication unit. The head mounted display device according to any one of 12 to 16.
PCT/JP2013/074137 2013-09-06 2013-09-06 Running assistance system and head mount display device used in same WO2015033446A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2014527425A JPWO2015033446A1 (en) 2013-09-06 2013-09-06 Running support system and head mounted display device used therefor
PCT/JP2013/074137 WO2015033446A1 (en) 2013-09-06 2013-09-06 Running assistance system and head mount display device used in same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/074137 WO2015033446A1 (en) 2013-09-06 2013-09-06 Running assistance system and head mount display device used in same

Publications (1)

Publication Number Publication Date
WO2015033446A1 true WO2015033446A1 (en) 2015-03-12

Family

ID=52627951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/074137 WO2015033446A1 (en) 2013-09-06 2013-09-06 Running assistance system and head mount display device used in same

Country Status (2)

Country Link
JP (1) JPWO2015033446A1 (en)
WO (1) WO2015033446A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017145552A1 (en) * 2016-02-26 2017-08-31 株式会社セガゲームス Program and eye wear
WO2017212999A1 (en) * 2016-06-06 2017-12-14 シャープ株式会社 Video generation device, video generation method, and video generation program
WO2023233447A1 (en) * 2022-05-30 2023-12-07 マクセル株式会社 Device for displaying virtual object and method for displaying same
WO2024034817A1 (en) * 2022-08-08 2024-02-15 삼성전자 주식회사 Electronic device for providing exercise guidance and operation method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001029506A (en) * 1999-05-12 2001-02-06 Masanobu Kujirada Indoor exercise device
JP2003134510A (en) * 2001-08-16 2003-05-09 Space Tag Inc Image information distribution system
JP2005506111A (en) * 2001-04-23 2005-03-03 ガシオペイア カンパニー リミテッド Virtual competition system and method
JP2010139633A (en) * 2008-12-10 2010-06-24 Brother Ind Ltd Head mounted display
JP2011067277A (en) * 2009-09-24 2011-04-07 Brother Industries Ltd Head mounted display
JP2011167549A (en) * 2011-04-28 2011-09-01 Sharp Corp Exercise instruction device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001029506A (en) * 1999-05-12 2001-02-06 Masanobu Kujirada Indoor exercise device
JP2005506111A (en) * 2001-04-23 2005-03-03 ガシオペイア カンパニー リミテッド Virtual competition system and method
JP2003134510A (en) * 2001-08-16 2003-05-09 Space Tag Inc Image information distribution system
JP2010139633A (en) * 2008-12-10 2010-06-24 Brother Ind Ltd Head mounted display
JP2011067277A (en) * 2009-09-24 2011-04-07 Brother Industries Ltd Head mounted display
JP2011167549A (en) * 2011-04-28 2011-09-01 Sharp Corp Exercise instruction device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017145552A1 (en) * 2016-02-26 2017-08-31 株式会社セガゲームス Program and eye wear
JP2017151917A (en) * 2016-02-26 2017-08-31 株式会社セガゲームス Program and eye wear
WO2017212999A1 (en) * 2016-06-06 2017-12-14 シャープ株式会社 Video generation device, video generation method, and video generation program
WO2023233447A1 (en) * 2022-05-30 2023-12-07 マクセル株式会社 Device for displaying virtual object and method for displaying same
WO2024034817A1 (en) * 2022-08-08 2024-02-15 삼성전자 주식회사 Electronic device for providing exercise guidance and operation method thereof

Also Published As

Publication number Publication date
JPWO2015033446A1 (en) 2017-03-02

Similar Documents

Publication Publication Date Title
JP6663505B2 (en) Audience view perspective in VR environment
US10864433B2 (en) Using a portable device to interact with a virtual space
JP6679747B2 (en) Watching virtual reality environments associated with virtual reality (VR) user interactivity
KR101748401B1 (en) Method for controlling virtual reality attraction and system thereof
JP6548203B2 (en) Information processing program, information processing apparatus, information processing system, and panoramic video display method
CN109069934A (en) Spectators' view tracking to the VR user in reality environment (VR)
EP3117882B1 (en) Apparatus and method of user interaction
JP4965475B2 (en) Virtual moving display device
JP2012026844A (en) Information processor, information processing method and program
WO2012011345A1 (en) Information processing apparatus, information processing method, program, and recording medium
KR102155001B1 (en) Head mount display apparatus and method for operating the same
JP6348665B2 (en) Head mounted display, display control method and program
US20160045785A1 (en) Action sports tracking system and method
JP2010178777A (en) Exercise system with display function
KR101813018B1 (en) Appartus for providing 3d contents linked to vehicle and method thereof
WO2015033446A1 (en) Running assistance system and head mount display device used in same
JP5672814B2 (en) Information processing apparatus, information processing method, and program
US11010975B1 (en) Remote camera augmented reality system
CN110651304B (en) Information processing device, information processing method, and program
JP2003134510A (en) Image information distribution system
JP2020013416A (en) Virtual space image providing device, and virtual space image providing program
JP6052274B2 (en) Information processing apparatus, information processing method, and program
JP7397482B2 (en) Video processing system, video processing method, and video processing device using unmanned moving objects
CN112717411B (en) Track recording method, device, equipment and storage medium of virtual vehicle
JP6598732B2 (en) Electronic device, control device, control program, and moving image display method

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2014527425

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13892879

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13892879

Country of ref document: EP

Kind code of ref document: A1