JP2020012968A - Video display system for simulator - Google Patents

Video display system for simulator Download PDF

Info

Publication number
JP2020012968A
JP2020012968A JP2018134935A JP2018134935A JP2020012968A JP 2020012968 A JP2020012968 A JP 2020012968A JP 2018134935 A JP2018134935 A JP 2018134935A JP 2018134935 A JP2018134935 A JP 2018134935A JP 2020012968 A JP2020012968 A JP 2020012968A
Authority
JP
Japan
Prior art keywords
image
simulated
video
camera
simulator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2018134935A
Other languages
Japanese (ja)
Inventor
和司 竹田
Kazuji Takeda
和司 竹田
浩二 藤本
Koji Fujimoto
浩二 藤本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Precision Co Ltd
Original Assignee
Mitsubishi Precision Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Precision Co Ltd filed Critical Mitsubishi Precision Co Ltd
Priority to JP2018134935A priority Critical patent/JP2020012968A/en
Publication of JP2020012968A publication Critical patent/JP2020012968A/en
Pending legal-status Critical Current

Links

Images

Abstract

To provide a video display system for simulator capable of easily configuring a system for superimposing a real image of a steering operation on a virtual space image.SOLUTION: The video display system for simulator is constituted of: a simulated cockpit for aircraft simulator; a simulated control device 101; simulated image creation means 102; a headwear 103; a camera 104 attached to the headwear 103; image superimposing means 105 for superimposing a real image captured by camera 104 on a predetermined area of the virtual space image created by simulated image creation means 102; and a display device 106 that wears the head-mounted device 103 so as to cover both eyes of the wearer and displays a composite image superimposed by the image superimposing means 105.SELECTED DRAWING: Figure 1

Description

本発明は、シミュレータ装置の操作時に操作者が頭部に装着してシミュレーション映像を表示する映像表示システムに関するものである。   The present invention relates to a video display system that displays a simulation video by an operator wearing the head when operating a simulator device.

例えば、飛行機の操縦訓練において、実機を用いることなく、訓練者がみる仮想空間を映像生成手段により生成し、訓練者はこの映像が示す情景に応じて操縦するようにして、仮想空間内で飛行機を運用する。この際、訓練者は、仮想空間の映像を表示する映像表示装置を頭部に装着し、操縦者の視界を外界から遮断し、操縦装置を操作する。そのために装着する機器をヘッドマウントディスプレイ（以下、“ＨＭＤ”ということがある。）という。
操縦者がみる仮想空間は、飛行機の操縦席前方と操縦席からみる機外の情景であり、機外の情景は操縦に伴う移動する飛行機の位置に応じた操縦席からみた情景であるが、操縦席前方の操縦桿、計器板等を含む操縦機器部分の映像は操縦機器の操作に応じて生成されなければ操縦操作と操縦者が視認する映像表示とに違和感が生じることがある。 For example, in pilot training of an airplane, a virtual space viewed by the trainee is generated by the image generation means without using the actual machine, and the trainee operates in accordance with the scene shown by the image, and the airplane is controlled in the virtual space. Operate At this time, the trainee wears an image display device that displays an image of the virtual space on his / her head, blocks the operator's view from the outside, and operates the operation device. A device to be mounted for this purpose is called a head mounted display (hereinafter, sometimes referred to as “HMD”).
The virtual space seen by the pilot is a scene outside the aircraft viewed from the cockpit and the cockpit of the aircraft, and the scene outside the aircraft is a scene seen from the cockpit according to the position of the moving aircraft accompanying the flight. Unless the image of the control device portion including the control stick, the instrument panel, and the like in front of the cockpit is generated in accordance with the operation of the control device, a sense of incongruity may occur between the control operation and the image displayed by the driver.

そのため、本願発明者は、ＨＭＤにカメラを搭載し、そのカメラで操縦機器を撮影し、その映像と仮想空間の映像とを合成することを提案する。
初期には、仮想空間内にＨＭＤのカメラによる現実映像を重畳するために、現実空間に配置したマーカないし色を基に重畳していた。
ところが、現実空間にマーカないし色を配置するため、システムが大掛かりなものとなってしまう。 Therefore, the inventor of the present application proposes mounting a camera on the HMD, photographing the control device with the camera, and synthesizing the video and the video in the virtual space.
Initially, in order to superimpose a real image from an HMD camera in a virtual space, superimposition was performed based on markers or colors arranged in the real space.
However, since markers or colors are arranged in the real space, the system becomes large-scale.

特開昭６２−４６９９号公報JP-A-62-4699

解決しようとする問題点は、仮想空間の映像に操縦操作を撮影した現実映像を重畳するためのシステムが大掛かりなものとなる点である。   The problem to be solved is that a system for superimposing a real image obtained by capturing a steering operation on an image in a virtual space becomes large-scale.

本発明の請求項１に係るシミュレータ用映像表示システムは、航空機シミュレータ用の模擬操縦席と、模擬操縦装置と、模擬映像作成手段と、頭部装着具と、前記頭部装着具に取り付けたカメラと、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段と、前記頭部装着具の装着者の両眼を覆うように装着して前記映像重畳手段が重畳する合成映像を表示する表示装置とからなることを特徴とするものである。   An image display system for a simulator according to claim 1 of the present invention includes a simulated cockpit for an aircraft simulator, a simulated pilot device, a simulated image creating means, a head-mounted device, and a camera attached to the head-mounted device. And image superimposing means for superimposing a real image captured by the camera on a predetermined area of the virtual space image created by the simulated image creating means, and wearing the head wearing device so as to cover both eyes of the wearer. And a display device for displaying the composite video to be superimposed by the video superimposing means.

本発明の請求項２に係る移動体シミュレータ用の模擬操縦席と、移動体例えば電車あるいは自動車用の模擬操縦装置と、模擬映像作成手段と、頭部装着具と、前記頭部装着具に取り付けたカメラと、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段と、前記頭部装着具の装着者の両眼を覆うように装着して前記映像重畳手段が重畳する合成映像を表示する表示装置とからなることを特徴とするシミュレータ用映像表示システム。   A simulated cockpit for a moving body simulator according to claim 2 of the present invention, a simulated maneuvering device for a moving body such as a train or a car, a simulated image creating means, a head-mounted device, and a mounted to the head-mounted device. A camera, a video superimposing unit that superimposes a real image captured by the camera on a predetermined area of a virtual space image created by the simulated image creating unit, and a cover that covers both eyes of a wearer of the head wearing device. And a display device for displaying a composite image superimposed by the image superimposing means.

本発明の請求項１に係るシミュレータ用映像表示システムは、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段を備えるから、仮想空間映像の所定領域の指定が仮想空間で容易に指定することができ、システムが大掛かりとならずに構成することができる利点がある。 The image display system for a simulator according to claim 1 of the present invention includes an image superimposing unit that superimposes a real image captured by the camera on a predetermined area of the virtual space image created by the simulation image creating unit. There is an advantage that the specified area can be easily specified in the virtual space, and the system can be configured without increasing the size.

本発明の請求項２に係るシミュレータ用映像表示システムは、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段を備えるから、仮想空間映像の所定領域の指定が仮想空間で容易に指定することができ、システムが大掛かりとならずに構成することができる利点がある。 The video display system for a simulator according to claim 2 of the present invention includes video superimposing means for superimposing a real video taken by the camera on a predetermined area of the virtual space video created by the simulated video creating means. There is an advantage that the specified area can be easily specified in the virtual space, and the system can be configured without increasing the size.

本発明に係るシミュレータ用映像表示システムの一実施例を示すブロック図である。1 is a block diagram showing one embodiment of a video display system for a simulator according to the present invention. 映像の合成の一例を説明する図である。FIG. 4 is a diagram illustrating an example of video synthesis. 本発明に係るシミュレータ用映像表示システムの一実施例を示すブロック図である。1 is a block diagram showing one embodiment of a video display system for a simulator according to the present invention. 映像の合成の一例を説明する図である。FIG. 4 is a diagram illustrating an example of video synthesis.

（航空機シミュレータへの応用）
図１は、本発明に係るシミュレータ用映像表示システムの一実施例を示すブロック図であって、１０１は航空機シミュレータ用の模擬操縦席に備えられる操縦桿、計器板等の模擬操縦装置、１０２は模擬操縦装置１０１の操作状況に応じて設定する領域を模擬移動するときに変化する情景の模擬映像を作成する模擬映像作成手段、１０３は頭部装着具、１０４は前記頭部装着具に取り付けた動画用のカメラ、１０５は模擬映像作成手段１０２が作成した仮想空間映像に前記カメラ１０４が撮影した現実映像を重畳する映像重畳手段、１０６は前記頭部装着具１０３の装着者の両眼を覆うように装着して前記映像重畳手段１０５が重畳する合成映像を表示する表示装置、１０７は本発明装置全体を制御する制御部（コンピュータにより構成される）である。 (Application to aircraft simulator)
FIG. 1 is a block diagram showing one embodiment of a video display system for a simulator according to the present invention. Reference numeral 101 denotes a simulated control device such as a control stick and an instrument panel provided in a simulated cockpit for an aircraft simulator. Simulated image creating means for creating a simulated image of a scene that changes when simulating a region set according to the operation state of the simulated control device 101, 103 is a head mounted device, and 104 is mounted on the head mounted device. A camera for moving images, 105 is a video superimposing unit that superimposes the real video taken by the camera 104 on the virtual space video created by the simulated video creating unit 102, and 106 covers both eyes of the wearer of the head mounted device 103 A display device 107 mounted in such a manner as to display a composite image superimposed by the image superimposing means 105, 107 is a control unit (computer configured by ) It is.

模擬映像作成手段１０２が作成する映像は模擬操縦席から頭部装着具１０３を装着した操縦者がみることができる範囲の映像であり、その可能な範囲から操縦者が装着する表示装置１０６の表示面に頭部装着具１０３または表示装置１０６が向いている方向に応じた映像が操縦者からみることになる。
頭部装着具１０３は例えばヘルメットであり、所定の基準方向からの変位を測定する図示しない測定器を備える。カメラ１０４は頭部装着具１０３が向いている方向を撮影する。操縦者は模擬操縦装置１０１の前に座り、表示装置１０６の表示映像を見ながら模擬操縦装置１０１を操作する。このとき、カメラ１０４が模擬操縦装置１０１の方向を撮影していれば、その映像を模擬映像作成手段１０２が作成する操縦席内の情景および航空機窓外の情景に重畳する。
模擬映像作成手段１０２が作成する情景の中に、カメラ１０４の映像を重畳する所定の領域がある場合は、その領域（合成領域）を特定の識別信号または色信号としておく。模擬映像作成手段１０２が作成する情景は、模擬操縦席に座った操縦者からみる情景であるから、その視点は模擬操縦席から所定の高さであり、そこからみる重畳すべき模擬操縦装置１０１の位置は模擬映像作成手段１０２が作成する仮想空間において一定の位置に設定することができる。その仮想空間の一定の位置の信号を特定の識別信号または色信号としておくのである。
映像重畳手段１０５は模擬映像作成手段１０２が作成した仮想空間映像にある特定の識別信号または色信号が所定の領域（合成領域）に前記カメラ１０４が撮影した現実映像を重畳して合成する。
表示装置１０６は前記映像重畳手段１０５が重畳する合成映像を頭部装着具１０３からの測定方向に応じてその方向に見た映像を表示する。 The image created by the simulated image creation means 102 is an image in a range that can be seen by the operator wearing the head mounted device 103 from the simulated cockpit, and the display of the display device 106 worn by the operator from the possible range. An image corresponding to the direction in which the head mounted device 103 or the display device 106 faces the surface is viewed from the pilot.
The head mounted device 103 is, for example, a helmet, and includes a measuring device (not shown) for measuring a displacement from a predetermined reference direction. The camera 104 captures an image of the direction in which the head mounted device 103 is facing. The pilot sits in front of the simulation control device 101 and operates the simulation control device 101 while viewing the display image on the display device 106. At this time, if the camera 104 captures the image of the simulation control device 101 in the direction, the image is superimposed on the scene inside the cockpit and the scene outside the aircraft window created by the simulation image creation means 102.
If the scene created by the simulated image creating unit 102 includes a predetermined area on which the image of the camera 104 is superimposed, the area (synthetic area) is set as a specific identification signal or color signal. Since the scene created by the simulation image creation means 102 is a scene viewed from a driver sitting in the simulation cockpit, the viewpoint is at a predetermined height from the simulation cockpit, and the simulation control device 101 to be superimposed therefrom is viewed from there. Can be set to a fixed position in the virtual space created by the simulated image creating means 102. A signal at a certain position in the virtual space is set as a specific identification signal or color signal.
The video superimposing unit 105 superimposes a specific image or a color signal in the virtual space image created by the simulated image creating unit 102 on a predetermined area (synthesis area) by superimposing a real image captured by the camera 104 on the image.
The display device 106 displays an image obtained by viewing the composite image superimposed by the image superimposing means 105 in the measurement direction from the head mounted device 103 in that direction.

図２により、映像の合成を説明する。
図２（ａ）は、模擬映像作成手段１０２が、あらかじめ設定した仮想空間内で模擬航空機を飛行させるときの操縦席と飛行状況に応じた飛行機窓外を操縦席からみた情景を作成したときの映像の一例である。さらに、模擬映像作成手段１０２はこの映像の操縦装置の部分について特定の識別信号または色信号を設定しておく。設定する操縦装置の部分すなわち合成領域（図２（ａ）において、破線の閉曲線２０１ａで示す）は、仮想空間を設定する際にあらかじめ定めておく。
図２（ｂ）はカメラ１０４が撮影した実写映像の一例であり、操縦席前方ある計器板、操縦桿、タッチパネル等の模擬操縦装置１０１が撮影されている。この映像は操縦席からのものであるから、航空機の操縦状況にかかわらず、模擬操縦装置１０１とカメラ１０４との距離はほとんど一定であり、ピント調節、ズーム等は必要ない。
図２（ｃ）は合成映像の一例であり、図（ａ）の映像に図（ｂ）の映像を映像重畳手段１０５により重畳した合成映像の一例である。模擬映像作成手段１０２で作成される映像の姿勢は現実映像を撮影するカメラ１０４の姿勢でみている方向が一致する。映像重畳手段１０５は、模擬映像作成手段１０２が作成した模擬映像の合成領域をカメラ１０４が撮影した映像に置き換えて、合成画像を得る。図２（ｃ）においてカメラ１０４の映像を破線の閉曲線２０１ａで示しているが、表示装置１０６には表示されない。
カメラ１０４で撮像した映像は模擬映像作成手段１０２の合成領域を透き通って模擬映像と合成されるから、模擬操縦装置１０１を操作する状況がカメラ１０４から撮影されて表示装置１０６から見ることができ、その模擬操縦装置１０１の操作状況の模擬映像を作成する必要がない。 With reference to FIG. 2, the composition of the video will be described.
FIG. 2A shows a case where the simulated image creating means 102 creates a cockpit when flying a simulated aircraft in a preset virtual space and a scene seen from the cockpit outside the airplane window according to the flight situation. It is an example of a video. Further, the simulated image creating means 102 sets a specific identification signal or color signal for the portion of the image control device. The portion of the control device to be set, that is, the synthesis area (indicated by a broken closed curve 201a in FIG. 2A) is determined in advance when setting the virtual space.
FIG. 2B is an example of a photographed image captured by the camera 104, in which a simulated control device 101 such as an instrument panel, a control stick, and a touch panel in front of the cockpit is captured. Since this image is taken from the cockpit, the distance between the simulated control device 101 and the camera 104 is almost constant regardless of the operation condition of the aircraft, and focus adjustment, zooming, and the like are not required.
FIG. 2C shows an example of a composite image, in which the image shown in FIG. 2B is superimposed on the image shown in FIG. The orientation of the video created by the simulated video creation unit 102 matches the orientation of the camera 104 that captures the real video. The video superimposing unit 105 obtains a composite image by replacing the composite area of the simulated video created by the simulated video creation unit 102 with the video captured by the camera 104. In FIG. 2C, the image of the camera 104 is shown by a closed curve 201a of a broken line, but is not displayed on the display device 106.
Since the image captured by the camera 104 is synthesized with the simulated image through the synthesis area of the simulated image creation unit 102, the situation in which the simulated control device 101 is operated can be captured from the camera 104 and viewed from the display device 106, There is no need to create a simulation video of the operation status of the simulation control device 101.

（電車または自動車等の移動体シミュレータへの応用）
図３は、本発明に係るシミュレータ用映像表示システムの一実施例を示すブロック図であって、３０１は移動体シミュレータ用の模擬操縦席に備えられる運転操作機器、計器板等の模擬操縦装置、３０２は模擬操縦装置３０１の操作状況に応じて設定する領域を模擬移動するときに変化する情景の模擬映像を作成する模擬映像作成手段、３０３は頭部装着具、３０４は前記頭部装着具に取り付けた動画用のカメラ、３０５は模擬映像作成手段３０２が作成した仮想空間映像に前記カメラ３０４が撮影した現実映像を重畳する映像重畳手段、３０６は前記頭部装着具３０３の装着者の両眼を覆うように装着して前記映像重畳手段３０５が重畳する合成映像を表示する表示装置、３０７は本発明装置全体を制御する制御部（コンピュータにより構成される）である。 (Application to mobile simulators such as trains and cars)
FIG. 3 is a block diagram showing an embodiment of a video display system for a simulator according to the present invention. Reference numeral 301 denotes a simulated steering device such as a driving operation device and an instrument panel provided in a simulated cockpit for a mobile simulator. Reference numeral 302 denotes a simulated image creating unit that creates a simulated image of a scene that changes when simulated moving in an area set according to the operation state of the simulated control device 301; 303, a head-mounted device; The attached video camera, 305 is a video superimposing means for superimposing the real video taken by the camera 304 on the virtual space video created by the simulated video creating means 302, and 306 are both eyes of the wearer of the head mounted device 303 And a display unit 307 for displaying a composite image superimposed by the image superimposing unit 305 so as to cover the image display unit 305. Is the difference is).

模擬映像作成手段３０２が作成する映像は模擬操縦席から頭部装着具３０３を装着した操縦者がみることができる範囲の映像であり、その可能な範囲から操縦者が装着する表示装置３０６の表示面に頭部装着具３０３または表示装置３０６が向いている方向に応じた映像が操縦者からみることになる。
頭部装着具３０３は例えばヘルメットであり、所定の基準方向からの変位を測定する図示しない測定器を備える。カメラ３０４は頭部装着具３０３が向いている方向を撮影する。操縦者は模擬操縦装置３０１の前に座り、表示装置３０６の表示映像を見ながら模擬操縦装置３０１を操作する。このとき、カメラ３０４が模擬操縦装置３０１の方向を撮影していれば、その映像を模擬映像作成手段３０２が作成する操縦席内の情景および移動体窓外の情景に重畳する。
模擬映像作成手段３０２が作成する情景の中に、カメラ３０４の映像を重畳する所定の領域がある場合は、その領域（合成領域）を特定の識別信号または色信号としておく。模擬映像作成手段３０２が作成する情景は、模擬操縦席に座った操縦者からみる情景であるから、その視点は模擬操縦席から所定の高さであり、そこからみる重畳すべき模擬操縦装置３０１の位置は模擬映像作成手段３０２が作成する仮想空間において一定の位置に設定することができる。その仮想空間の一定の位置の信号を特定の識別信号または色信号としておくのである。
映像重畳手段３０５は模擬映像作成手段３０２が作成した仮想空間映像にある特定の識別信号または色信号が所定の領域（合成領域）に前記カメラ３０４が撮影した現実映像を重畳して合成する。
表示装置３０６は前記映像重畳手段３０５が重畳する合成映像を頭部装着具３０３からの測定方向に応じてその方向に見た映像を表示する。 The image created by the simulated image creating means 302 is an image in a range where the operator wearing the head mounted device 303 can see from the simulated cockpit, and the display of the display device 306 worn by the operator from the possible range. An image corresponding to the direction in which the head mounted device 303 or the display device 306 faces the surface is viewed from the pilot.
The head mounted device 303 is, for example, a helmet, and includes a measuring device (not shown) for measuring a displacement from a predetermined reference direction. The camera 304 captures an image of the direction in which the head mounted device 303 is facing. The pilot sits in front of the simulation control device 301 and operates the simulation control device 301 while watching the display image on the display device 306. At this time, if the camera 304 captures the image of the simulation control device 301 in the direction, the image is superimposed on the scene in the cockpit and the scene outside the moving body window created by the simulation image creation means 302.
If the scene created by the simulated image creating means 302 includes a predetermined area on which the image of the camera 304 is superimposed, that area (synthetic area) is set as a specific identification signal or color signal. Since the scene created by the simulation image creation means 302 is a scene viewed from a driver sitting in the simulation pilot seat, the viewpoint is at a predetermined height from the simulation pilot seat, and the simulation control device 301 to be superimposed therefrom is viewed from there. Can be set at a fixed position in the virtual space created by the simulation image creating means 302. A signal at a certain position in the virtual space is set as a specific identification signal or color signal.
The video superimposing unit 305 superimposes a specific image or a color signal in the virtual space image created by the simulated image creating unit 302 on a predetermined area (synthesis area) by superimposing a real image captured by the camera 304 on the image.
The display device 306 displays an image obtained by viewing the composite image superimposed by the image superimposing unit 305 in the measurement direction from the head mounted device 303 in that direction.

図４により、映像の合成を説明する。図４は自動車のシミュレータの場合を示す。
図４（ａ）は、模擬映像作成手段３０２が、あらかじめ設定した仮想空間内で模擬自動車を走行させるときの運転席と運転状況に応じた車両窓外を運転席（操縦席）からみた情景例えば道路上交差点付近の映像を作成したときの一例である。さらに、模擬映像作成手段３０２はこの映像の操縦装置の部分について特定の識別信号または色信号を設定しておく。設定する操縦装置の部分すなわち合成領域（図４（ａ）において、破線の閉曲線４０１ａで示す）は、仮想空間を設定する際にあらかじめ定めておく。
図４（ｂ）はカメラ３０４が撮影した実写映像の一例であり、操縦席前方ある計器板、ハンドル、タッチパネル等の模擬操縦装置３０１が撮影されている。この映像は操縦席からのものであるから、移動体の操縦状況にかかわらず、模擬操縦装置３０１とカメラ３０４との距離はほとんど一定であり、ピント調節、ズーム等は必要ない。
図４（ｃ）は合成映像の一例であり、図４（ａ）の映像に図４（ｂ）の映像を映像重畳手段３０５により重畳した合成映像の一例である。模擬映像作成手段３０２で作成される映像の姿勢は現実映像を撮影するカメラ３０４の姿勢でみている方向が一致する。映像重畳手段３０５は、模擬映像作成手段３０２が作成した模擬映像の合成領域をカメラ３０４が撮影した映像に置き換えて、合成画像を得る。図４（ｃ）においてカメラ３０４の映像を破線の閉曲線４０１ａで示しているが、表示装置３０６には表示されない。
カメラ３０４で撮像した映像は模擬映像作成手段３０２の合成領域を透き通って模擬映像と合成されるから、模擬操縦装置３０１を操作する状況がカメラ３０４から撮影されて表示装置３０６から見ることができ、その模擬操縦装置３０１の操作状況の模擬映像を作成する必要がない。 With reference to FIG. 4, the composition of the video will be described. FIG. 4 shows a case of an automobile simulator.
FIG. 4A shows a scene in which the simulated image creating means 302 looks at the driver's seat when the simulated vehicle runs in a preset virtual space and the outside of the vehicle window according to the driving situation from the driver's seat (pilot seat). This is an example when an image near an intersection on a road is created. Further, the simulated image creating means 302 sets a specific identification signal or color signal for the portion of the image control device. The portion of the control device to be set, that is, the combined area (indicated by a broken closed curve 401a in FIG. 4A) is determined in advance when setting the virtual space.
FIG. 4B is an example of a photographed image captured by the camera 304, in which a simulated control device 301 such as an instrument panel, a steering wheel, and a touch panel in front of a cockpit is captured. Since this image is taken from the cockpit, the distance between the simulated control device 301 and the camera 304 is almost constant regardless of the operation state of the moving body, and focus adjustment, zooming, and the like are not required.
FIG. 4C shows an example of the composite video, in which the video of FIG. 4B is superimposed on the video of FIG. The orientation of the video created by the simulated video creation unit 302 matches the orientation of the camera 304 that captures the real video. The video superimposing unit 305 obtains a composite image by replacing the composite area of the simulated video created by the simulated video creation unit 302 with the video captured by the camera 304. In FIG. 4C, the image of the camera 304 is shown by a closed curve 401a of a broken line, but is not displayed on the display device 306.
Since the image captured by the camera 304 is synthesized with the simulated image through the synthesis area of the simulated image creation unit 302, the situation in which the simulated control device 301 is operated can be captured from the camera 304 and viewed from the display device 306, There is no need to create a simulation video of the operation status of the simulation control device 301.

電車のシミュレータに応用する場合は、図４に相当する図は窓外に線路が表示され、カメラにより撮影された運転装置の映像が、模擬映像作成手段（図３の模擬映像作成手段３０２に相当する。）が作成した映像に合成される。   In the case of application to a train simulator, the diagram corresponding to FIG. 4 shows a track outside the window, and the image of the driving device taken by the camera is used as a simulation image creation unit (corresponding to the simulation image creation unit 302 in FIG. 3). Is combined with the created video.

１０１ 模擬操縦装置
１０２ 模擬映像作成手段
１０３ 頭部装着具
１０４ カメラ
１０５ 映像重畳手段
１０６ 表示装置
１０７ 制御部 Reference Signs List 101 Simulated control device 102 Simulated image creating means 103 Head mounted tool 104 Camera 105 Image superimposing means 106 Display device 107 Control unit

Claims (2)

航空機シミュレータ用の模擬操縦席と、模擬操縦装置と、模擬映像作成手段と、頭部装着具と、前記頭部装着具に取り付けたカメラと、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段と、前記頭部装着具の装着者の両眼を覆うように装着して前記映像重畳手段が重畳する合成映像を表示する表示装置とからなることを特徴とするシミュレータ用映像表示システム。   A simulated cockpit for an aircraft simulator, a simulated pilot device, a simulated image creating means, a head mounted device, a camera attached to the head mounted device, and a predetermined area of a virtual space image created by the simulated image creating device A video superimposing means for superimposing a real video taken by the camera, and a display device which is mounted so as to cover both eyes of a wearer of the head mounted device and displays a composite video superimposed by the video superimposing means. A video display system for a simulator, comprising: 移動体シミュレータ用の模擬操縦席と、模擬操縦装置と、模擬映像作成手段と、頭部装着具と、前記頭部装着具に取り付けたカメラと、模擬映像作成手段が作成した仮想空間映像の所定領域に前記カメラが撮影した現実映像を重畳する映像重畳手段と、前記頭部装着具の装着者の両眼を覆うように装着して前記映像重畳手段が重畳する合成映像を表示する表示装置とからなることを特徴とするシミュレータ用映像表示システム。

A simulated cockpit for a mobile body simulator, a simulated steering device, a simulated image creating means, a head-mounted device, a camera attached to the head-mounted device, and a predetermined virtual space image created by the simulated image creating device. A video superimposing unit that superimposes a real video captured by the camera on an area, a display device that is mounted so as to cover both eyes of a wearer of the head mounted device, and that displays a composite video superimposed by the video superimposing unit. An image display system for a simulator, comprising:

JP2018134935A 2018-07-18 2018-07-18 Video display system for simulator Pending JP2020012968A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018134935A JP2020012968A (en) 2018-07-18 2018-07-18 Video display system for simulator

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018134935A JP2020012968A (en) 2018-07-18 2018-07-18 Video display system for simulator

Publications (1)

Publication Number Publication Date
JP2020012968A true JP2020012968A (en) 2020-01-23

Family

ID=69170992

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018134935A Pending JP2020012968A (en) 2018-07-18 2018-07-18 Video display system for simulator

Country Status (1)

Country Link
JP (1) JP2020012968A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022154860A (en) * 2021-03-30 2022-10-13 三菱プレシジョン株式会社 Image generation device and image generation method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06176131A (en) * 1992-12-03 1994-06-24 Namco Ltd Picture synthesis device and virtual reality device using the same
JPH10282877A (en) * 1997-04-08 1998-10-23 Canon Inc Image forming method, its device, simulation system and storage medium
JP2000061144A (en) * 1998-08-25 2000-02-29 Namco Ltd Image generator, game device and information storage medium
JP2000506632A (en) * 1996-12-20 2000-05-30 シーメンス アクチエンゲゼルシヤフト Information display system for at least one occupant
JP2017196312A (en) * 2016-04-28 2017-11-02 株式会社バンダイナムコエンターテインメント Simulation system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06176131A (en) * 1992-12-03 1994-06-24 Namco Ltd Picture synthesis device and virtual reality device using the same
JP2000506632A (en) * 1996-12-20 2000-05-30 シーメンス アクチエンゲゼルシヤフト Information display system for at least one occupant
JPH10282877A (en) * 1997-04-08 1998-10-23 Canon Inc Image forming method, its device, simulation system and storage medium
JP2000061144A (en) * 1998-08-25 2000-02-29 Namco Ltd Image generator, game device and information storage medium
JP2017196312A (en) * 2016-04-28 2017-11-02 株式会社バンダイナムコエンターテインメント Simulation system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022154860A (en) * 2021-03-30 2022-10-13 三菱プレシジョン株式会社 Image generation device and image generation method
JP7286113B2 (en) 2021-03-30 2023-06-05 三菱プレシジョン株式会社 Image generation device and image generation method

Similar Documents

Publication Publication Date Title
US9202385B2 (en) Method for training a crew member of a, in particular, military vehicle
JP6026088B2 (en) Remote control system
CA2891377C (en) Method and device for the combined simulation and control of remote-controlled vehicles using a user-friendly projection system
KR101279869B1 (en) Apparatus and method for displaying flight simulator image using head mounted display
KR20170005971A (en) Training simulator and method for special vehicles using argmented reality technology
CN106163872A (en) For showing equipment and the method for information
KR20120044461A (en) The simulated training apparatus and method using mixed reality
CN104781873A (en) Image display device and image display method, mobile body device, image display system, and computer program
JP4614456B2 (en) Retroreflective material, projection device, aircraft, and aircraft simulator
CN105911696A (en) Virtual reality mapping device and integrated virtual reality equipment
Van Erp et al. Vibrotactile waypoint navigation at sea and in the air: two case studies
JP2020012968A (en) Video display system for simulator
US11151775B2 (en) Image processing apparatus, display system, computer readable recoring medium, and image processing method
Ernst et al. Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display
KR101892238B1 (en) System and method for remote simulating vehicles using head mounted displa
KR101772431B1 (en) driving simulation systems by HMD and chroma key
KR20170009304A (en) Apparatus for simulating aviation
CN112673620B (en) Optoelectronic device for piloting an aircraft
RU2695480C1 (en) Method of excluding the effect of separating an image by frames of monitors for visualizing the extra-cockpit environment of flight simulators
Lueken et al. Virtual cockpit instrumentation using helmet mounted display technology
JPH08322064A (en) Head mount display device
DE19906244A1 (en) Virtual reality transmission system, relaying scene perceived by e.g. robot or telechir to operator, includes stereoscopic camera pair turning in sympathy with operators head movement
KR20150131745A (en) Perspective 3d vitual training display method for various transportations
JP2020031413A (en) Display device, mobile body, mobile body control system, manufacturing method for them, and image display method
CA3018454A1 (en) Camera-based display method and system for simulators

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200519

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210427

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210520

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210714

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220125

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220419

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20220419

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220524

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20220623

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20220713

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20220902

C211 Notice of termination of reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C211

Effective date: 20220913

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230818

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240411