WO2013111145A1 - Système et procédé de génération d'images en perspective corrigée pour utilisation en entraînement au combat virtuel - Google Patents

Système et procédé de génération d'images en perspective corrigée pour utilisation en entraînement au combat virtuel Download PDF

Info

Publication number
WO2013111145A1
WO2013111145A1 PCT/IN2012/000798 IN2012000798W WO2013111145A1 WO 2013111145 A1 WO2013111145 A1 WO 2013111145A1 IN 2012000798 W IN2012000798 W IN 2012000798W WO 2013111145 A1 WO2013111145 A1 WO 2013111145A1
Authority
WO
WIPO (PCT)
Prior art keywords
trainee
perspective
head
imagery
motion tracking
Prior art date
Application number
PCT/IN2012/000798
Other languages
English (en)
Inventor
Sudarshan RAMACHANDRAIAH
Original Assignee
Virtual Logic Systems Private Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Virtual Logic Systems Private Ltd filed Critical Virtual Logic Systems Private Ltd
Publication of WO2013111145A1 publication Critical patent/WO2013111145A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8076—Shooting
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality

Definitions

  • the present invention relates to a system for providing training process during weapons training in a virtual environment and particularly to a system for providing training during fire under cover process for the weapon simulators. Further, the present invention relates to a system and method of generating perspective corrected imagery for use in virtual combat training. The present invention helps to provide extremely realistic real life like scenario during virtual combat training operations. This is most beneficial during tactical training for trainees. BACKGROUND ART
  • laser type weapon fire simulation systems with visual score indicator means and holographic means are capable of producing a three dimensional virtual image of a target.
  • US6500008 relates to an augmented reality-based firefighter training system.
  • the system includes hardware and software components to create realistic-looking fire, smoke, and extinguishing graphics for interactive training experience for firefighters.
  • the said training system provides mixed view of both real and virtual world.
  • US20050219240 describes a hands-on simulator system having a display that can project horizontal perspective images into the open space and a device that allows the user to manipulate the images with hands or hand-held tools.
  • US20080158256 relates to a system and method for fusing a plurality of sensor data to provide a perspective view image.
  • US20110009241 relates to a virtual locomotion controller user interface and system that combines data from sensor devices to allow users to control their representations in a virtual world.
  • Another object of the present invention is directed to a system for providing training during fire under cover process in simulators.
  • a further object of the present invention is directed to a method of generating perspective corrected imagery for use in virtual combat training during fire under cover process. It is another object of the present invention, wherein trainee movements are captured using motion tracking device.
  • the trainee's movement and current pose in the real world is tracked using markers. It is further object of the present invention, wherein the trainee's movement in the real world is tracked using digital image processing technique, the said digital image of the trainee is captured which is then used as reference for the digital model for estimating the pose of the trainee inside the virtual world. It is another object of the present invention, wherein the system is implemented with software for receiving, storing, processing the data received from the motion tracking device and providing corrected imagery for use in virtual combat training.
  • the perspective corrected imagery provides position and viewpoint based corrections of the visual surroundings to the trainee to determine the best cover available in the scene for protection.
  • a system for generating perspective corrected imagery in virtual combat training station during fire under cover process comprising:
  • Motion tracking device for tracking head movement of a trainee
  • the motion tracking device captures information on position and orientation of the trainee's head
  • the display system comprising of one or more projectors and screens visualize the perspective corrected imagery and provides immersive display of 3D virtual environment.
  • the processing unit is provided with inbuilt software for receiving, storing, processing the information received from the motion tracking device and providing corrected imagery for use in virtual combat training.
  • the motion tracking technology is based on optical or infrared cameras or magnetic sensors or any other means for capturing both 3 Degrees of Freedom and 6 Degrees of Freedom motion.
  • Figure 1 Illustrates system according to the present invention.
  • the present invention is directed to a system and method for generating perspective corrected imagery for use in virtual combat training during fire under cover process in simulators.
  • the system for generating perspective corrected imagery using training simulator comprises of motion tracking device, processing unit and one or more display systems.
  • the motion tracking device further comprises of one or more passive markers positioned on the head or the head gear worn by the trainee. Markers are devices/ combination of devices, which are placed on various parts of the trainee's body and head. The markers could be powered / non- powered. Using these markers, the current pose of the trainee in the real world is tracked.
  • the motion tracking device captures information on position and orientation of the trainee's head. Tracking information is to decode trainee's eye position and determine where the trainee is looking and provide required perspective.
  • the display systems further comprises of one or more projector(s) and screen(s).
  • the processing unit is provided with inbuilt software. The processing unit determines the position and orientation information, estimates the perspective of the trainee and generates the required imagery according to the calculated perspective of the trainee.
  • the perspective view is used in the combat scenario as:
  • the processing unit with inbuilt software receives, stores, processes the data received from the motion tracking device and providing corrected imagery for use in the virtual combat training.
  • the display system helps to visualize the perspective corrected imagery and provide immersive display of three-dimensional (3D) virtual environment.
  • the projector projects a still picture or a moving background scene and a variable 3D target image for the background scene for view by the trainee.
  • the motion tracking technology is based on optical or infrared cameras or magnetic sensors or any other means for capturing both 3 Degrees of Freedom and 6 Degrees of Freedom extraction of body posture.
  • the motion tracking device captures both 3 Degrees of Freedom and 6 Degrees of Freedom [DOF] motion and tracks the movement of the trainee in the immersive virtual environment.
  • the trainee's movement in the real world is tracked using digital image processing technique, the said digital image of the trainee is captured which is then used as reference for the digital model for estimating the pose of the trainee inside the virtual environment.
  • the motion tracking device generates perspective corrected imagery for training to fire under cover in simulators during virtual combat training operations.
  • the system provides corrections to the perspective based on position and orientation information of the trainee's head.
  • the visual surroundings also changes based on the distance traversed and position of the trainee's head.
  • the perspective corrected imagery provides position and viewpoint based corrections of the visual surroundings to the trainee to determine the best cover available in the scene for protection.
  • the system of the present invention renders the perspective corrected imagery depending on the position of the trainee.
  • the perspective of the trainee is dynamically updated/ computed for each set of imagery generated from the 3D virtual environment i.e. for each refresh rate.
  • the position of the user is also updated depending on scenario requirements.
  • the system also generates the perspectives of variable three dimensional target objects in virtual environment.
  • a database stores and is used to retrieve the values of the tracking.
  • the system of the present invention can be extended from battle training to various other applications, which involve simulated environment.
  • a method of generating perspective corrected imagery in virtual combat training station during fire under cover process for 3D virtual environment using the said system is described in detail below.
  • markers are placed on the head or headgear of the trainee for tracking the position and orientation of the head of the trainee.
  • markers are placed on the weapon, which the trainee holds in his/her hand for tracking the weapon position and orientation along with point of aim. Markers are also placed on the trainee's shoulders, arms, torso and limb for full body tracking. Using these markers the current pose of the trainee in the real world is tracked using motion tracking device.
  • perspective corrected imagery which provides position and viewpoint based corrections of the visual surroundings to the trainee determines the best cover available in the scene to protect him/her self from the enemy fire, hide behind the cover and fire at the enemy.
  • the trainee hide behind a cover in the virtual world his line of sight changes according to the generated imagery of the trainee. The trainee would need to determine the most suitable cover in the area based on the trainee's distance from the same, get behind the cover and continue the firing on the enemy using their available line of sight.
  • the motion tracking device (motion capturing device) records and translates the trainee's movement in the real world on to a digital model using optical/inertial/mechanical motion capture/ electromagnetic technologies.
  • Information on position and orientation of the trainee's head or headgear is captured and sent to a processing .unit having inbuilt software, by communication means.
  • the new position coordinates sent to the inbuilt software is used to generate a view frustum in the virtual world, based on the calculations done by the software corresponding to the change in the physical position of the trainee.
  • the inbuilt software determines the position and orientation information, estimates the perspective of the trainee and generates the required imagery according to the calculated perspective of the trainee.
  • the perspective corrected imagery is projected on the display system. It is then mapped onto the real world projection screen.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention concerne un système permettant de fournir une formation pendant un processus de coups de feu sous couverture pour des simulateurs d'armes dans un environnement virtuel. En outre, la présente invention fournit un système pour générer des images à perspective corrigée dans une station d'entraînement au combat virtuel comprenant un dispositif de suivi de mouvement pour suivre le mouvement de la tête d'une personne en formation, une unité de traitement, et un ou plusieurs systèmes d'affichage. Le dispositif de suivi de mouvement capture des informations sur la position et l'orientation de la tête de la personne en formation. L'unité de traitement est pourvue d'un logiciel intégré pour recevoir, stocker, traiter les informations reçues en provenance du dispositif de suivi de mouvement, et pour fournir une imagerie corrigée selon la perspective calculée de la personne qui s'entraîne, en vue d'une utilisation dans l'entraînement au combat virtuel.
PCT/IN2012/000798 2011-12-14 2012-12-06 Système et procédé de génération d'images en perspective corrigée pour utilisation en entraînement au combat virtuel WO2013111145A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN4384/CHE/2011 2011-12-14
IN4384CH2011 2011-12-14

Publications (1)

Publication Number Publication Date
WO2013111145A1 true WO2013111145A1 (fr) 2013-08-01

Family

ID=48872950

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2012/000798 WO2013111145A1 (fr) 2011-12-14 2012-12-06 Système et procédé de génération d'images en perspective corrigée pour utilisation en entraînement au combat virtuel

Country Status (1)

Country Link
WO (1) WO2013111145A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015138181A1 (fr) * 2014-03-14 2015-09-17 Line Weight Llc Simulateur de réalité augmentée
CN107134194A (zh) * 2017-05-18 2017-09-05 河北中科恒运软件科技股份有限公司 沉浸式车辆模拟器
US10922992B2 (en) 2018-01-09 2021-02-16 V-Armed Inc. Firearm simulation and training system and method
US11204215B2 (en) 2018-01-09 2021-12-21 V-Armed Inc. Wireless independent tracking system for use in firearm simulation training
US11226677B2 (en) 2019-01-08 2022-01-18 V-Armed Inc. Full-body inverse kinematic (FBIK) module for use in firearm simulation training
US11631224B2 (en) 2016-11-21 2023-04-18 Hewlett-Packard Development Company, L.P. 3D immersive visualization of a radial array

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5913727A (en) * 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
WO2003015057A1 (fr) * 2001-08-09 2003-02-20 Information Decision Technologies Llc Systeme et procede d'entrainement pour les pompiers base sur des conditions reelles amplifiees
US20050270367A1 (en) * 1996-11-13 2005-12-08 Fakespace Labs, Inc. Multi-person stereo display system
US20070247457A1 (en) * 2004-06-21 2007-10-25 Torbjorn Gustafsson Device and Method for Presenting an Image of the Surrounding World
US20080143895A1 (en) * 2006-12-15 2008-06-19 Thomas Peterka Dynamic parallax barrier autosteroscopic display system and method
WO2011116765A2 (fr) * 2010-03-24 2011-09-29 Krauss-Maffei Wegmann Gmbh & Co. Kg Procédé pour former un membre d'équipage d'un véhicule, en particulier d'un véhicule militaire

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5913727A (en) * 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
US20050270367A1 (en) * 1996-11-13 2005-12-08 Fakespace Labs, Inc. Multi-person stereo display system
WO2003015057A1 (fr) * 2001-08-09 2003-02-20 Information Decision Technologies Llc Systeme et procede d'entrainement pour les pompiers base sur des conditions reelles amplifiees
US20070247457A1 (en) * 2004-06-21 2007-10-25 Torbjorn Gustafsson Device and Method for Presenting an Image of the Surrounding World
US20080143895A1 (en) * 2006-12-15 2008-06-19 Thomas Peterka Dynamic parallax barrier autosteroscopic display system and method
WO2011116765A2 (fr) * 2010-03-24 2011-09-29 Krauss-Maffei Wegmann Gmbh & Co. Kg Procédé pour former un membre d'équipage d'un véhicule, en particulier d'un véhicule militaire

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015138181A1 (fr) * 2014-03-14 2015-09-17 Line Weight Llc Simulateur de réalité augmentée
US9677840B2 (en) 2014-03-14 2017-06-13 Lineweight Llc Augmented reality simulator
US11631224B2 (en) 2016-11-21 2023-04-18 Hewlett-Packard Development Company, L.P. 3D immersive visualization of a radial array
CN107134194A (zh) * 2017-05-18 2017-09-05 河北中科恒运软件科技股份有限公司 沉浸式车辆模拟器
US10922992B2 (en) 2018-01-09 2021-02-16 V-Armed Inc. Firearm simulation and training system and method
US11204215B2 (en) 2018-01-09 2021-12-21 V-Armed Inc. Wireless independent tracking system for use in firearm simulation training
US11371794B2 (en) 2018-01-09 2022-06-28 V-Armed Inc. Firearm simulation and training system and method
US11226677B2 (en) 2019-01-08 2022-01-18 V-Armed Inc. Full-body inverse kinematic (FBIK) module for use in firearm simulation training

Similar Documents

Publication Publication Date Title
US9892563B2 (en) System and method for generating a mixed reality environment
CN207895727U (zh) 作训系统
US9677840B2 (en) Augmented reality simulator
AU2005334472B2 (en) Instructor-lead training environment and interfaces therewith
WO2013111146A2 (fr) Système et procédé destinés à fournir des humains virtuels dans des opérations d'entraînement de combat humain
US10030937B2 (en) System and method for marksmanship training
US10030931B1 (en) Head mounted display-based training tool
US20120156652A1 (en) Virtual shoot wall with 3d space and avatars reactive to user fire, motion, and gaze direction
KR101498610B1 (ko) 가상환경 내 캐릭터와 훈련자 동작연동을 통한 전술 모의훈련 장치, 모의훈련 연동방법 및 모의훈련 모니터링 방법
WO2013111145A1 (fr) Système et procédé de génération d'images en perspective corrigée pour utilisation en entraînement au combat virtuel
Zhu et al. AR-Weapon: live augmented reality based first-person shooting system
US20230214007A1 (en) Virtual reality de-escalation tool for delivering electronic impulses to targets
KR101470805B1 (ko) 실내 훈련용 곡사화기 사격술 모의 훈련 시스템 및 이의 제어방법
AU2013254684B2 (en) 3D scenario recording with weapon effect simulation
Templeman et al. Immersive Simulation of Coordinated Motion in Virtual Environments: Application to Training Small unit Military Tacti Techniques, and Procedures
KR101617357B1 (ko) 실내 훈련용 곡사화기 사격술 모의 훈련 시스템 및 이의 제어방법
Amorim et al. Augmented reality and mixed reality technologies: Enhancing training and mission preparation with simulations
JP2018064836A (ja) バーチャルゲーム装置
CN106940899A (zh) 一种应用于ar场景下的武器瞄准系统的图层融合方法
JP2003240494A (ja) 訓練システム
Yavuz et al. Desktop Artillery Simulation Using Augmented Reality
Sibert et al. Initial assessment of human performance using the gaiter interaction technique to control locomotion in fully immersive virtual environments
Shin et al. Introduction to the Extended Reality-based LVCG Military Training System for Small Units at Korea Military Academy
US20240185736A1 (en) Magnetic tracking in an extended reality training system
Kehring Immersive Simulations for Dismounted Soldier Research

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12866719

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12866719

Country of ref document: EP

Kind code of ref document: A1