WO2002075635A1

WO2002075635A1 - An interactive video game device, a method thereof and a recordable media directly used for the method

Info

Publication number: WO2002075635A1
Application number: PCT/KR2002/000095
Authority: WO
Inventors: Il-Ho Kim
Original assignee: Ocon Inc.
Priority date: 2001-01-19
Filing date: 2002-01-19
Publication date: 2002-09-26
Also published as: KR20020062093A

Abstract

The present invention provides an interactive video game device, a method and a recording media for receiving video signals, which include action data defining relationships with user actions, and user actions detected by external sensors.

Description

[DESCRIPTION]

[TITLE OF THE INVENTION]

An interactive video game device, a method thereof and a recordable

media directly used for the method

[TECHNICAL FIELD]

The present invention relates to an interactive video game device, a

method thereof and a recordable media directly used for the method. More

specifically, the present invention relates to an interactive video game device, a

method thereof and a recordable media directly used for the method, wherein a

user enjoys the game interactively with the moving picture, simultaneously views a

showing moving picture.

[BACKGROUND OF THE INVENTION] So far, various kinds of video game device is known. According to Korea

patent No. 94-8495, it is described a game control device of using a recorded

image player and a method thereof. According to the invention, records every kind

game program to a video tape, mounts a dynamic ram and hard disk to an outside

of a recorded image player, saves predetermined game program recorded in the

video tape to the dynamic ram and hard disk, and plays the game for controlling a

remote control transmitting unit.

But, according to above game control device, it is need to image playing

equipments like a television and expensive components like a dynamic ram and hard disk, and need to complex control device for controlling them, so it is a defect

to be expensive. Particularly according to the above former game device, the

problem is that a user cannot enjoy the game interactively with the moving picture,

while simultaneously viewing a showing moving picture.

Addition, according to the game device like a so-called "Playstation(TM)",

while playing the game program recorded previously in an auxiliary memory unit

like a so-called game pack via a predetermined control device, it displays an image

of the game program to connect an image playing device like a television.

Therefore, it is impossible to enjoy the game interactively with the moving picture,

while simultaneously viewing a showing moving picture, according to the recent

game device.

[SUMMARY OF THE INVENTION]

Present invention is invented to solve these above problem. Therefore, it is

an object of the present invention to provide an interactive video game device, a

method thereof and a recordable media directly used for the method to play a game

interactively with a moving picture, while viewing a showing moving picture.

[BRIEF DESCRIPTION OF THE DRAWINGS]

Fig. 1 shows a block diagram of a conventional game control device for

using a conventional recorded image player.

Fig. 2 shows a block diagram of an embodiment of the interactive video

game device according to the present invention. Fig. 3 shows a timing diagram of a video signal used by an embodiment of

the interactive video game device according to the present invention.

Fig. 4 shows a flowchart of operations of the interactive video game

device according to the present invention.

Fig. 5 shows an embodiment of an image displayed by an external display

connected to the interactive video game device according to the present invention.

Fig. 6 shows an embodiment of image displayed on the external display

apparatus connected to the game device of the present invention.

Fig. 7 shows another embodiment of image displayed on the external

display apparatus connected to the game device of the present invention.

[BEST MODE FOR CARRYING OUT THE INVENTION]

For achieving the above object, the present invention provides an

interactive video game device, which receives a video signal comprises action data

of a predetermined number of bits, the action data prescribes a mutual relation with

a user's motion, from an external image signal source and makes the user enjoy an

interactive video game by receiving the user's action detected by at least one of

external sensors, comprises an action data detector for receiving the video signal

inputted from the external image signal source and detecting the action data; a

sensor signal detector for determining whether or not the at least one of external

sensors are in normal operation and detecting a sensor signal from the sensor if the

at least one of external sensors are determined to be in normal operation; an sensor-signal-associated image processor for receiving the action data detected by the action data detector and the sensor signal detected by the sensor signal detector,

and generating a sensor-signal-associated image which is associated with mutual

relation of the received signals; and an image output controller for receiving the

sensor-signal-associated image, which is generated by the sensor-signal-associated

image processor, and outputs the sensor-signal-associated image signal of a

predetermined format which is appropriate to an external display apparatus.

According to another aspect of the present invention, an interactive video

game playing method, for making a user enjoy the game by receiving a video

signal, which comprises an action data of a predetermined number of bits, from an

external image signal source and the user's action detected by at least one of

external sensors, comprises the steps of: receiving video signal inputted from the

external image signal source; detecting the action data from the received video

signal; determining whether or not the at least one of external sensors are in

normal operation; detecting a sensor signal from the external sensor when the at

least one of external sensors are determined to be in normal operation; generating

sensor-signal-associated image which is associates with the detected action data

and the sensor signal; and outputting the generated sensor-signal-associated image

as video signal of a predetermined format which is appropriate to an external

display apparatus.

According to another aspect of the present invention, a recordable medium,

which is directly used for an interactive video game playing method in order for

the interactive video game to be played by receiving a user's action detected by at

least one of external sensors, wherein a predetermined signals are recorded on the medium and the predetermined signals comprise: video signal prescribing a main

image which can be displayed by an image displaying apparatus; and action data

signal of a predeteπnined number of bits prescribing a mutual relation with a

user's action, wherein the action data signal is included in the video signal.

Now, with reference to Figs. 2 to 4, a preferred embodiment of an

interactive video game device of the present invention is described in detail.

Referring to Fig. 2, Fig. 2 shows a block diagram of an embodiment of the

interactive video game device of the present invention. The interactive video game

device 100 (hereafter, simply called as "game device") includes an action data

detector 102, which receives video signal inputted from an external image signal

source 120 and detects action data included in the video signal. As shown in Fig. 2,

the video signal inputted into the game device 100 is outputted directly to the

external display apparatus 140 through an independent path, and also inputted into

the action data detector 102. The external display apparatus 140 can display

images from the image signal source 120 in case the game device 100 of the

present invention is not in operation.

The game device 100 of the present invention further includes a sensor

signal detector 106, which decides whether or not the external sensor 130 is in

normal operation and detects the sensor signal from the sensor 130 in case the

external sensor is determined to be in normal operation. The game device 100 further includes a sensor-signal-associated image processor 108, which receives a

sensor signal detected by the sensor signal detector 106 and generates a sensor-

signal-associated image associated with the received sensor signal. The sensor 130 is used for sensing a predetermined action which is performed by a user in

accordance with moving picture images played. The sensor 130 may be embodied

by, for example, a virtual reality glove used for a well-known virtual reality system.

The sensor 130 may also be a stepping-board type sensor used for a well-known

"DDR (TM) game machine". Appropriate one may be selected out of those

exampled above according to the moving picture being displayed.

The sensor-signal- associated image processor 104 includes a memory like

a ROM for saving a predetermined image data used to generate a sensor-signal-

associated image which is associated with the received sensor signal. It is

preferable that the processor 104 decodes the received sensor signal and outputs

image data, which is associated with decoded sensor signal, as on screen display

("OSD") signal.

Also, the sensor-signal-associated image processor 104 receives the action

data detected by the action data detector 102, and harmonizes the action data and

the signal detected by the sensor signal detector 106 so that various interactions

can be performed by comparing moving picture being displayed with a user's

action. For example, if it is recognized that a character of the present frame of the

moving picture being displayed touches a specific point, it is possible to display

that the user obtains a high score by recognizing the user's action to touch a sensor

130 corresponding to the specific point. The user may watch his or her action

displayed on the external display apparatus 140 by sensing the user's action and

processing it as a sensor-signal-associated image in accordance with the interaction.

An embodiment of the sensor-signal-associated image is described later with reference to Fig. 5.

The game device 100 of the present invention further includes an action-

data-associated image processor 104, which receives an action data detected by the

action data detector 102 and generates an action-data-associated image associated

with the received action data. The action-data-associated image processor 104

includes a memory like a ROM for saving a predetermined image data to generate

the action-data-associated image which is associated with the received action data.

It is preferable that the processor 104 decodes the received action data and outputs

image data, which is associated with the decoded action data, as OSD signal. An

embodiment of the action-data-associated image is described later with reference

to Fig. 5.

Further, the game device 100 of the present invention further includes an

image output controller 110, which receives a sensor-signal-associated image

generated by the sensor-signal-associated image processor 108, and outputs video

signal of an appropriate format for the external display apparatus 140. If the game

device 100 of the present invention includes the action-data-associated image

processor 104, it may also be possible to receive and output the action-data-

associated image generated by the action-data-associated image processor 104.

Further, the image output controller 110 may output the sensor-signal-associated

image and the action-data-associated image by simply superposing them as being

independent of each other. Or, it may output just necessary one(s) according to the

user's selection.

Detailed operation of the game device 100 of the present invention is described hereinafter with reference to Figs. 3 and 4.

The external image signal source 120 may be a signal source of a

broadcasting system, also may be a video tape player, or digital video disk player,

etc. The external image signal source 120 is anything all right that can generate the

video signal included an action data signal as shown in Fig. 3. Fig. 3 shows a

timing diagram of a video signal, which is applied to NTSC scanning signal, used

by an embodiment of the interactive video game device according to the present

invention.

As shown in the drawing, the video signal includes an action data of a

predetermined number of bits, such as 8 or 16 bits, within a predetermined

horizontal retrace line of every field. The action data is independent of the image

signal of the predetermined horizontal retrace line. Since the action data signal is

independent of the image signal displayed on the external display apparatus 140, as

described above, it does not affect quality of image display.

The predetermined horizontal retrace line may be the 21 ^st horizontal retrace

line, which is conventionally assigned to include caption data signals, for example.

In case the conventional caption data needs to be used, any one out of 11th to 15th

horizontal retrace lines may be used as the predetermined horizontal retrace line.

The actual selection of a specific horizontal retrace line is just simple design

consideration to practice the present invention. Practically, it is possible to achieve

natural and various images associated with actions by including a plurality of

action data in a plurality of horizontal retrace lines. Also, the action data of the

present invention may be easily included in interlaced scanning signals by a well- known conventional method. Further, the action data may also be included in PAL

type scanning signals, as well as NTSC type signals.

Fig. 4 shows a flowchart of operations of the interactive video game device

according to the present invention. The action data signals may have the same

signal levels with those of image signals for the external display apparatus 140

among the video signals. As shown in Fig. 4, a predetermined uppermost area 414

of an image 412 provided from the image signal source 120 is edited to be white,

and at least one of a predetermined sized black image sections 416 is selectively

inserted into the white image area 414. In this case, the image signal section 418 of

the corresponding horizontal retrace line (for example, the first horizontal retrace

line of the corresponding field) of a video signal provided from the image signal

source 120, includes both black and white level signals in turn after white level

signals. Therefore, it is possible for the action data detector 102 to detect the action

data signal by detecting the image signal section.

According to the above described method for recording the action data, the

action data can be included in the desired frame by using an image editor alone

without having additional recording apparatus. Particularly, as shown in Fig. 4, a

user cannot recognize the difference of image quality even in case the black and

white images are processed in the section 412, as described above, because the

image, which is formed by the video signal provided from the image signal source

120, has the section 412 which is not displayed on the external display apparatus

140.

The recorded action data is formed by a predetermined number of bits, and prescribes a relation of the user's action sensed by the sensor with the main image

displayed. For example, the action data prescribes a time relation (i.e. timing) of

the current main image being displayed with the user's action. Or, the action data

prescribes a motional relation of the current main image being displayed with the

user's action (e.g. a synchronized motion to the main image). For example, in case

the action data has 8 bits, the action data of "00000000" defines an image

corresponding to a skeleton character "standing at attention", and the action data of

"11111111" defines an image corresponding to a skeleton character stretching its

arms and legs, and so on. The detailed shape of an image and practical assignment

of the timing, etc. are just design options for practicing the present invention, so

the details are omitted.

Next, referring to Fig. 5, Fig. 5 shows an embodiment of an image

displayed by an external display connected to the interactive video game device

according to the present invention. As shown in Fig. 5, the game device 100 starts

its operation when electric power is applied to it, and then the video signal is

received from the external image signal source 120 (S402). Next, the action data

detector 102 detects the action data included in the video signal (S404). If the

action data is not detected (S406), the game device 100 of the present invention

completes its operation without performing any other processes on the inputted

video signal. So, the video signal inputted from the image signal source 120 is

displayed on the external display apparatus 140 without any change.

In case the action data is detected (S406), the game device 100 processes

the action-data-associated image associated with the detected action data if the game device 100 includes the action-data-associated image processor 104 (S408).

As described above, according to the present embodiment, the action-data-

associated image is processed to save a predetermined image data to the action-

data-associated image processor 104 in advance, and outputs the video signal,

which corresponds to the detected action data of the video signal, as on screen

display data, for example.

Next, when the action-data-associated image is processed, it is outputted by

the image output controller 110. The image output controller 110 is formed to

generate an appropriate video signal according to characteristics of the connected

external display apparatus 140, for example, an NTSC or PAL type scanning signal.

The sensor signal detector 106 included in the game device 100 of the

present invention senses the signal from the sensor 130 connected to it

simultaneously or separately with the process of the action-data-associated image

(S412). If the sensor 130 is not operating, the operation control of the game device

100 returns to the above described step S402. However, if the signal from the

sensor 130 is detected, the sensor-signal-associated image processor 108 processes

its associated image according to the relationship of the detected action data with

the sensor signal sensed by the sensor 130 (S414). The processing of the sensor-

signal-associated image is similar to that of the action-data-associated image

except that shapes of displayed images are different. Details on this are described

further with reference to Figs. 6 and 7.

Next, the image output controller 110 outputs the sensor-signal-associated

image as signals of a format appropriate to the external display apparatus 140 (S410). If both signals of the action-data-associated image and the sensor-signal-

associated image are inputted into the image output controller 110, the image

output controller 110 may be formed to output either all images or selected

image(s) of them according to the user's choice.

The above described operations are repeatedly processed until no external

video signal is inputted or until no more action data is detected even though the

external video signal is inputted.

Next, details of the action-data-associated image are described with

reference to Figs. 6 and 7. Fig. 6 shows an embodiment of image displayed on the

external display apparatus 140 connected to the game device 100 of the present

invention. Fig. 7 shows another embodiment of image displayed on the external

display apparatus 140 connected to the game device 100 of the present invention.

As shown in Fig. 6, the main image 510 provided from the external image signal

source 120 is displayed at the center of the screen. The sensor-signal-associated

image is displayed on an appropriate position of the screen. According to the

present embodiment, the sensor-signal-associated image 512 is applied to a game

for evaluating simultaneity of the main image and the user's action according to

the relationship of the detected action data and the sensor signal sensed by the

sensor 130, and the evaluated result is presented as the number of stars.

Next, referring to Fig. 7, there is shown an embodiment where the action-

data-associated image 514, which is associated with the detected action data, is

also displayed. The action-data-associated image 514 is expressed as a skeleton

character image to which the main image 510 is simplified. According to another embodiment of the present invention, the action-data-associated image 514 may

reflects the user's motion by mixing the user's action, which is sensed by the

sensor-signal-associated image processor 108, with the action-data-associated

image of the above described embodiment.

[INDUSTRIAL APPLICABILITY]

According to the present invention, a user may interactively enjoy various

games while watching moving pictures displayed.

Claims

[CLAIMS]

1. An interactive video game device, which receives a video signal

comprising action data of a predetermined number of bits, said action data

prescribing a mutual relation with a user's motion, from an external image signal

source and makes said user enjoy an interactive video game by receiving said

user's action detected by at least one of external sensors, comprising;

an action data detector for receiving said video signal inputted from said

external image signal source and detecting said action data;

a sensor signal detector for determining whether or not said at least one

of external sensors are in normal operation and detecting a sensor signal from

said sensor if said at least one of external sensors are determined to be in normal

operation;

an sensor-signal-associated image processor for receiving said action

data detected by said action data detector and said sensor signal detected by said

sensor signal detector, and generating a sensor-signal-associated image which is

associated with mutual relation of said received signals; and

an image output controller for receiving said sensor-signal-associated

image, which is generated by said sensor-signal-associated image processor, and

outputting said sensor-signal-associated image signal of a predetermined format

which is appropriate to an external display apparatus.

2. An interactive video game device as claimed in claim 1 further

comprising an action-data-associated image processor for receiving an action data detected by said action data detector and generating at least an action-data-

associated image which is associated with said received action data.

3. An interactive video game device as claimed in claim 2, wherein said

action-data-associated image processor comprises a memory, where

predetermined image data is stored, decodes said received action data and

outputs image data, which is associated with decoded action data, as on screen

display (OSD) signal.

4. An interactive video game device as claimed in claim 2, wherein said

image output controller outputs video signal of a predetermined format, which is

appropriate to said external display apparatus, by harmonizing said action-data-

associated image and said sensor-signal-associated image, where said action-

data-associated image is generated by said action-data-associated image

processor and said sensor-signal-associated image is generated by said sensor-

signal-associated image processor.

5. An interactive video game device as claimed in claim 1, wherein said

sensor-signal-associated image processor comprises a memory, where

predetermined image data is stored, decodes said received action data and

outputs image data, which is associated with decoded action data, as on screen

display (OSD) signal.

6. An interactive video game playing method, for making a user enjoy said

game by receiving a video signal, which comprises an action data of a

predetermined number of bits, from an external image signal source and said

user's action detected by at least one of external sensors, comprising the steps of:

receiving video signal inputted from said external image signal source;

detecting said action data from said received video signal;

determining whether or not said at least one of external sensors are in

normal operation;

detecting a sensor signal from said external sensor when said at least one

of external sensors are determined to be in normal operation;

generating sensor-signal-associated image which is associates with said

detected action data and said sensor signal; and

outputting said generated sensor-signal-associated image as video signal

of a predetermined format which is appropriate to an external display apparatus.

7. An interactive video game playing method as claimed in claim 6 further

comprising the step of generating an action-data-associated image which is

associated with said detected action data.

8. An interactive video game playing method as claimed in claim 7,

wherein said step for generating an action-data-associated image further

comprises the steps of;

decoding said received action data; and retrieving image data, which is associated with said decoded action data,

from a memory where said image data is previously stored and outputting said

retrieved image data.

9. An interactive video game playing method as claimed in claim 7 further

comprising the steps of harmonizing said generated action-data-associated image

and said generated sensor-signal-associated image, and outputting said

harmonized images as video signal of a predetermined format which is

appropriate to said external display apparatus.

10. An interactive video game playing method as claimed in claim 6,

wherein said step of generating said sensor-signal-associated image further

comprises the steps of:

decoding said received sensor signal; and

retrieving image data, which is associated with said decoded action data,

from a memory where said image data is previously stored and outputting said

retrieved image data.

11. A recordable medium, which is directly used for an interactive video

game playing method as claimed in any one of claims 6 to 10 in order for said

interactive video game to be played by receiving a user's action detected by at

least one of external sensors, wherein a predetermined signals are recorded on

said medium and said predetermined signals comprise:

video signal prescribing a main image which can be displayed by an image displaying apparatus; and

action data signal of a predetermined number of bits prescribing a mutual

relation with a user's action, wherein said action data signal is comprised in said

video signal.

12. A recordable medium as claimed in claim 11, wherein said action data

signal comprises a predetermined number of bits, which are comprised in one or

more of predetermined horizontal retrace lines of each field of said video signal,

and independent of image signal of said horizontal retrace lines.

13. A recordable medium as claimed in claim 11, wherein said action data

signal is recorded as image signal of any one of at least two different levels

within a predetermined horizontal retrace line of each field of said video signal.

14. A recordable medium as claimed in claim 13, wherein said one or more

of predetermined horizontal retrace lines, where said action data signal is

recorded, corresponds to an area, which is not seen by said user, of said external

display apparatus.

15. A recordable medium as claimed in claim 14, wherein said one or more

of predetermined horizontal retrace lines, where said action data signal is

recorded, comprises at least the first horizontal retrace line of each field.

16. A recordable medium as claimed in claim 14, wherein said one or more

of predetermined horizontal retrace lines, where said action data signal is

recorded, comprises at least the last horizontal retrace line of each field.

17. A recordable medium as claimed in claim 13, wherein said at least two

different levels comprises a white level and a black level.