KR20150106992A - Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it - Google Patents

Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it Download PDF

Info

Publication number
KR20150106992A
KR20150106992A KR1020140028932A KR20140028932A KR20150106992A KR 20150106992 A KR20150106992 A KR 20150106992A KR 1020140028932 A KR1020140028932 A KR 1020140028932A KR 20140028932 A KR20140028932 A KR 20140028932A KR 20150106992 A KR20150106992 A KR 20150106992A
Authority
KR
South Korea
Prior art keywords
sensor
operation information
head
game machine
control
Prior art date
Application number
KR1020140028932A
Other languages
Korean (ko)
Inventor
한상진
한상욱
Original Assignee
주식회사 인큐브
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 인큐브 filed Critical 주식회사 인큐브
Priority to KR1020140028932A priority Critical patent/KR20150106992A/en
Publication of KR20150106992A publication Critical patent/KR20150106992A/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a game machine and a control method thereof, in which a sensor and a communication module mounted on a three-dimensional spectacles main body mutually transmit and receive through a controller of a game machine and an operation recognition control section and compare operation information data generated from operation information of a user's head, It is possible to control the game with high accuracy and fine control sensitivity as well as to improve the accuracy and range of the recognition technology and to make the interaction between the human and the game machine screen more natural And a control method thereof.

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus and method for controlling a screen of a game machine based on motion recognition using head tracking, and a control method thereof. [0002]

The present invention relates to an apparatus and method for controlling a game apparatus based on motion recognition based on motion tracking, and more particularly to a system and method for controlling a game apparatus, And more particularly, to an apparatus and method for controlling a game machine based on motion recognition using head tracking.

In accordance with the development of virtual reality and augmented reality technology, game technology is being developed in conjunction with it. In order to promote the development and dissemination of such virtual reality and virtual experience game machines, Various studies are being conducted.

In view of the above, a study on performance improvement and improvement of a sensor device which senses a user inputting a command on a game machine screen can be said to be a natural interaction between a human and a game machine.

In other words, for smooth interaction between the human and the game machine screen, there is a method of recognizing the operation of the user by the system that gives the command to the control unit of the game machine screen or the game machine screen and giving a control command accordingly.

However, the above-described method has a problem that accurate recognition and control commands can not be transmitted due to influence of illumination, shadow, shade or noise.

Accordingly, the image control of the game device screen has been performed by a remote controller, and further, a technology for controlling the game device screen while recognizing the user's operation has been required, and furthermore, The development of technology has become urgent.

Therefore, there is an urgent need to develop an external device and an internal system that improves the accuracy and range of the recognition technology and makes the interaction between the human and the game screen more natural.

Published Japanese Patent Application No. 10-1995-0035465

Disclosure of Invention Technical Problem [8] The present invention has been made in order to solve the above-mentioned problems, and it is an object of the present invention to provide an apparatus and a method for collecting data from motion information including motion of a head of a user, And a control method thereof.

In addition, the present invention provides an apparatus and method for controlling a game machine based on motion recognition using head tracking, which improves the accuracy and range of recognition technology and makes interaction between a human and a game machine screen more natural.

According to an aspect of the present invention, there is provided a three-dimensional spectacle body comprising: a three-dimensional eyeglass main body to be worn on a head of a user to input a three-dimensional image on the user's eye; A sensor mounted on the three-dimensional spectacle body to sense motion information of the head; A communication module mounted on the three-dimensional spectacles main body and transmitting operation information sensed by the sensor to a controller side of a separately provided game machine; And a motion recognition controller for transmitting a control command corresponding to the motion information of the head received from the communication module to the controller so as to be output to the control target game device screen. A screen control device can be provided.

Here, the sensor is a motion recognition sensor.

Here, the sensor may be at least one of a position sensor, a geomagnetism sensor, an acceleration sensor, a tilt sensor, a gyro sensor, and a temperature sensor.

The operation recognition control unit analyzes the operation information of the head received from the communication module, and generates an operation information data by recognizing the operation pattern and converting the operation information into data for each group or case, And a control command unit for comparing the operation information data with the control command and outputting a control command corresponding to the received operation information data to the display screen of the game machine.

The operation information may include at least one of acceleration, angular velocity, geomagnetism, and rolling, pitching, or yawing of the head of the user wearing the 3D glasses body, And a rotation angle at the time of rotation.

The gaming device screen control device based on the motion recognition further includes a display section for displaying the operation and control state of the control target game device in accordance with the recognition of the motion information through the communication module from the sensor of the three- .

The display unit is characterized by informing the user of one or at least one of a visual display reactor, a vibration reactor, an acoustic reactor, and a temperature reactor.

The game device screen control device based on the motion recognition may further include a sensor unit connected to the controller and measuring whether the control target game device is in a controlled state or in a normal operation state.

According to another aspect of the present invention, there is provided a three-dimensional spectacles body, comprising: a first step of sensing motion information of a user's head and transmitting sensed motion information; A second step of analyzing the operation information transmitted from the 3D glasses main body, recognizing an operation pattern, and generating operation information data by converting the operation information into data for each group or each case; And a third step of comparing the operation information data with the control command and outputting a control command corresponding to the received operation information data to the display screen of the game machine. Based game screen control method.

The operation information includes at least one of acceleration, angular velocity, geomagnetism, and rolling, pitching, or yawing of the head of the user wearing the 3D glasses body, And a rotation angle at the time of rotation.

According to the present invention, the following effects can be achieved.

That is, according to the present invention, the sensor and the communication module mounted on the 3D glasses body mutually transmit and receive through the controller of the game machine and the motion recognition controller, compare the motion information data generated from the motion information of the user's head and the preset control command, It is possible to control the game with high precision and fine control sensitivity as well as improve the accuracy and range of the recognition technology and make the interaction between the human and the game machine screen more natural.

In particular, the present invention makes it possible to achieve the aforementioned objects and objects by an operation recognition sensor or the like that can cope with the environment and operation of various users. Therefore, compared to the conventional infrared sensor, You can do it.

FIG. 1 is a conceptual diagram illustrating an overall configuration of a game device screen control device based on motion recognition using head tracking
2 is a block diagram illustrating a method of controlling a game device screen based on motion recognition using head tracking

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and how to accomplish them, will become apparent by reference to the embodiments described in detail below with reference to the accompanying drawings.

However, the present invention is not limited to the embodiments described below, but may be embodied in various other forms.

The present embodiments are provided so that the disclosure of the present invention is thoroughly disclosed and that those skilled in the art will fully understand the scope of the present invention.

And the present invention is only defined by the scope of the claims.

Thus, in some embodiments, well known components, well known operations, and well-known techniques are not specifically described to avoid an undesirable interpretation of the present invention.

In addition, throughout the specification, like reference numerals refer to like elements, and the terms (mentioned) used herein are intended to illustrate the embodiments and not to limit the invention.

In this specification, the singular forms include plural forms unless the context clearly dictates otherwise, and the constituents and acts referred to as " comprising (or comprising) " do not exclude the presence or addition of one or more other constituents and actions .

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs.

Also, commonly used predefined terms are not ideally or excessively interpreted unless they are defined.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 1 is a conceptual diagram illustrating the overall configuration of a game device screen control device based on motion recognition using head tracking, and FIG. 2 is a block diagram illustrating a method of controlling a game device screen based on motion recognition using head tracking.

It can be understood that the present invention includes the three-dimensional spectacle body 100, the sensor 200, the communication module 300, and the motion recognition control unit 500 as shown in FIG.

The 3D glasses body 100 is worn on the head of a user so that a three-dimensional screen is input to the user's eyes.

The sensor 200 is mounted on the 3D glasses main body 100 to detect motion information of the head.

The communication module 300 transmits operation information sensed by the sensor 200 mounted on the 3D glasses main body 100 to the controller 410 of the game machine 400 separately provided.

The operation recognition control unit 500 transmits a control command corresponding to the head operation information received from the communication module 300 to the controller 410 so as to be output to the screen 420 of the game device 400 to be controlled.

Accordingly, the present invention not only enables the game to be controlled with high precision and fine control sensitivity, but also improves the accuracy and range of the recognition technology and makes the interaction between the human and the game machine screen more natural.

It is to be understood that the present invention may be embodied in many other specific forms without departing from the spirit or scope of the invention.

First, the sensor 200 mounted on the three-dimensional spectacle body 100 is preferably a motion recognition sensor. The motion recognition sensor may be a sensor, a geomagnetic sensor, an acceleration sensor, or the like, Various sensor, altimeter, gyro, etc. are included in one chip.

A normal motion recognition sensor can be used for a compass, a pedometer, a navigation function, a three-dimensional three-dimensional game function for enjoying a game according to the movement of a mobile phone, or the location tracking in case of a fire or an aged person.

It goes without saying that the sensor 200 may be implemented by a combination of at least one of a position sensor, a geomagnetic sensor, an acceleration sensor, a tilt sensor, a gyro sensor, and a temperature sensor.

The operation information of the user's head is based on the acceleration, the angular velocity and the geomagnetism of the 3D glasses body 100, and the head of the user wearing the 3D glasses main body 100 are rolled, a rotation angle when pitching or yawing, or a combination of at least one of them.

The motion recognition control unit 500 preferably includes a motion analysis unit 510 and a control instruction unit 520 in order to correspond to the analysis and control instruction of the motion information.

Specifically, the operation analyzing unit 510 analyzes the operation information of the head received from the communication module 300, recognizes the operation pattern, and generates operation information data by grouping the operation information by group or by case.

The control command unit 520 compares the operation information data with the control command and outputs a control command corresponding to the received operation information data to the display screen 420 of the game device 400. [

The present invention further includes a display unit 150 for displaying the operation and control state of the game device 400 to be controlled in accordance with the recognition of the operation information from the sensor 200 of the three-dimensional spectacle body 100 through the communication module 300 It is to be understood that the invention is not limited to the disclosed embodiments.

The display unit 150 that can be installed in the 3D glasses main body 100 includes a visual display reactor that allows the user to check the control status of the game machine 400 through the 3D glasses main body 100 through an LCD, .

The display unit 150 may be a vibration reactor that generates vibration at regular intervals for a predetermined period of time in accordance with a predetermined rule in the 3D glasses main body 100 when the user can not visually confirm or is inconvenient.

In addition, the display unit 150 may be an acoustic reactor in which a sound is generated by a signal such as a predetermined signal or a language in which a person can be interpreted.

The display unit 150 may be a temperature reactor in which the temperature of the three-dimensional spectacle body 100 is changed so that the user can check the control state through the tactile sense.

In addition, the display unit 150 may be one or a combination of at least one of the above-described visual display reactors, vibration reactors, acoustic reactors, temperature reactors, and the like. The control state can be confirmed in real time.

In order to check the control status of the game machine 400 of the display unit 150, the game machine 400 may be provided with a response (not shown) for transmitting the control status of the game machine 400 to the 3D glasses body 100, And an information output unit (not shown).

Here, the reaction information output unit may exist in the controller 410 or may exist separately, and transmits information on the control state of the game machine 400 to the communication module 300 of the 3D glasses main body 100.

At this time, in addition to the control state of the game device 400, the display unit 150 and the reaction information output unit can transmit and receive information on the overall state of the game device 400. [

For example, information on the power state of the game machine 400, whether normal operation and damage of each driver of the game machine 400, environmental information such as temperature and humidity around the game machine 400, The user can confirm the state of the game machine 400 through the 3D glasses main body 100 in addition to the control state of the game machine 400 so that the effective effect in the management of the game machine 400 This is because it can be obtained in addition.

In addition, the controller 410 transmits the state of the game device 400 to the controller 410 so that the game device 400 can determine whether the game device 400 can properly perform control commands such as emotional expression or physical movement You will need to provide information.

Therefore, the sensor unit 450 of the game device 400 may exist so that the information on the state of the game device 400 mentioned above may be measured and transmitted to the controller 410. [

The sensor unit 450 of the game device 400 may be installed and applied in addition to the game device 400 to which the motion recognition-based game device screen control device using head tracking according to an embodiment of the present invention is applied.

The controller 410 determines whether the sensor unit 450 of the game device 400 is in the state of executing the control command received from the control command unit 520, And then executes a control command.

A control method using an apparatus for controlling screen of a game device based on an operation recognition using head tracking according to the above embodiment will be briefly described with reference to FIG.

First, the 3D glasses body 100 mounted on the user's head detects motion information of the user's head and transmits the sensed motion information (S1).

Thereafter, the operation information transmitted from the 3D glasses main body 100 is analyzed, operation patterns are recognized, and operation information is converted into data for each group or each case to generate operation information data (S2).

Next, the operation information data and the control command are compared with each other, and a control command corresponding to the received operation information data is output to the display screen 420 of the game device 400 (S3).

As described above, according to the present invention, it is possible to control the game with high accuracy and fine control sensitivity by collecting data from the operation information including the movement of the head of the user, and to improve the accuracy and range of the recognition technology, It is a basic technical idea to provide a game device screen control device based on motion recognition using head tracking and a control method thereof so that the interaction of the screen can be performed more smoothly.

It will be apparent to those skilled in the art that many other modifications and applications are possible within the scope of the basic technical idea of the present invention.

100 ... three-dimensional glasses body
150 ... display
200 ... sensor
300 ... communication module
400 ... game machine
410 ... controller
420 ... screen
450 ... sensor unit
500 ... motion recognition control section
510 ... motion analysis unit
520 ... Control command section
S1 ... Step 1
S2 ... Step 2
S3 ... Step 3

Claims (10)

A three-dimensional spectacles main body which is worn on a head of a user to input a three-dimensional image on the user's eyes;
A sensor mounted on the three-dimensional spectacle body to sense motion information of the head;
A communication module mounted on the three-dimensional spectacles main body and transmitting operation information sensed by the sensor to a controller side of a separately provided game machine; And
And an operation recognition control unit for transmitting a control command corresponding to the operation information of the head unit received from the communication module to the controller so as to be output to the control target game apparatus screen. controller.
The method according to claim 1,
Wherein the sensor is a motion recognition sensor. 2. The apparatus of claim 1, wherein the sensor is a motion recognition sensor.
The method according to claim 1,
The sensor includes:
Wherein the controller is a combination of at least one of a position sensor, a geomagnetic sensor, an acceleration sensor, a tilt sensor, a gyro sensor, and a temperature sensor.
The method according to claim 1,
The operation recognition control unit,
An operation analyzing unit for analyzing operation information of the head received from the communication module and recognizing an operation pattern and generating operation information data by converting the operation information into data for each group or each case;
And a control command unit for comparing the operation information data with the control command and outputting a control command corresponding to the received operation information data to the display screen of the game machine.
The method according to claim 1,
Wherein the operation information includes:
An angular velocity and a geomagnetism according to movement of the three-dimensional spectacles main body, and a rotation angle when the head of the user wearing the three-dimensional spectacles main body wears rolling, pitching or yawing, Or a combination of at least one of the two or more games.
The method according to claim 1,
Wherein the motion recognition-based game device screen control device comprises:
Further comprising a display unit for displaying an operation and a control state of the control target game machine in accordance with the recognition of the operation information through the communication module from the sensor of the 3D glasses main body. .
The method of claim 6,
The display unit includes:
A visual display reactor, a vibration reactor, an acoustic reactor, a temperature reactor, or a combination of at least one of the temperature reactors.
The method according to claim 1,
Wherein the motion recognition-based game device screen control device comprises:
Further comprising a sensor unit connected to the controller for measuring a control state of the game device to be controlled and a normal operation state of the game device.
A first step of sensing the operation information of the user's head and transmitting the sensed operation information to the 3D glasses main body mounted on the head of the user;
A second step of analyzing the operation information transmitted from the 3D glasses main body, recognizing an operation pattern, and generating operation information data by converting the operation information into data for each group or each case; And
And a third step of comparing the operation information data with the control command and outputting a control command corresponding to the received operation information data to the display screen of the game machine. Of controlling the game screen of the game machine.
The method of claim 9,
Wherein the operation information includes:
An angular velocity and a geomagnetism according to movement of the three-dimensional spectacles main body, and a rotation angle when the head of the user wearing the three-dimensional spectacles main body wears rolling, pitching or yawing, Or a combination of at least one of them.
KR1020140028932A 2014-03-12 2014-03-12 Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it KR20150106992A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140028932A KR20150106992A (en) 2014-03-12 2014-03-12 Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140028932A KR20150106992A (en) 2014-03-12 2014-03-12 Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it

Publications (1)

Publication Number Publication Date
KR20150106992A true KR20150106992A (en) 2015-09-23

Family

ID=54245573

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140028932A KR20150106992A (en) 2014-03-12 2014-03-12 Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it

Country Status (1)

Country Link
KR (1) KR20150106992A (en)

Similar Documents

Publication Publication Date Title
CN110647237B (en) Gesture-based content sharing in an artificial reality environment
EP3320413B1 (en) System for tracking a handheld device in virtual reality
US10134192B2 (en) Generating and displaying a computer generated image on a future pose of a real world object
US9696547B2 (en) Mixed reality system learned input and functions
EP3486707B1 (en) Perception based predictive tracking for head mounted displays
US9395543B2 (en) Wearable behavior-based vision system
KR102275589B1 (en) Environmental interrupt in a head-mounted display and utilization of non field of view real estate
JP2020115352A (en) Menu navigation in head mount display
US11662589B2 (en) Geometry modeling of eyewear devices with flexible frames
WO2021242634A1 (en) Interactive augmented reality experiences using positional tracking
US11567569B2 (en) Object selection based on eye tracking in wearable device
TW201830050A (en) Tracking system, tracking device and tracking method
EP4172738A1 (en) Augmented reality experiences using social distancing
WO2022072192A1 (en) Pose tracking for rolling shutter camera
US20200301144A1 (en) Display device, display control method, and display system
US11366318B2 (en) Electronic device and control method thereof
US20220377306A1 (en) Misaligned vantage point mitigation for computer stereo vision
US11662805B2 (en) Periodic parameter estimation for visual-inertial tracking systems
US11442268B2 (en) Augmented reality gaming using virtual eyewear beams
KR20150106992A (en) Display panel controlling apparatus of motion recognition based game machine using head tracking and control method of it
US11704931B2 (en) Predicting display fit and ophthalmic fit measurements using a simulator
US20220374505A1 (en) Bending estimation as a biometric signal
KR101499044B1 (en) Wearable computer obtaining text based on gesture and voice of user and method of obtaining the text
KR102337908B1 (en) Method and device for assisting work
US20230205311A1 (en) Periodic parameter estimation for visual-inertial tracking systems

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application