JPH07333550A - Action teaching device - Google Patents

Abstract

PURPOSE:To provide a device capable of obtaining high teaching effect without an expert or a superviser by successively supplying a series of images from an image holding/supplying means for holding a series of images of a prescribed operation viewed from the view point of the expert to a head mounted display device (a see through MHD device). CONSTITUTION:This device is provided with a see through MDH device 1 and a video tape recorder reproducing device 2 holding a series of images of a prescribed operation viewed from the view point of the expert, reproducing the series of images and supplying them to the see through MDH device 1. When teaching is performed, a video tape in which the action as a teaching object is recorded is set in the video tape recorder reproducing device, the see through MDH device 1 is mounted on a person to be taught, an image at the time of starting a series of action is reproduced out of the images recorded in the video tape in the mounted state of the device 1 by the video tape recorder reproducing device 2 and supplied to the see through MDH device 1. Consequently, the reproduced image and the object to which a series of action is performed is observed in the superposed state.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a motion teaching device,
More specifically, a novel motion teaching device using a head-mounted display device (hereinafter, abbreviated as see-through HMD device) capable of superimposing a user's external field of view image and an artificial image at the same time. Regarding

[0002]

2. Description of the Related Art Conventionally, when an unskilled person is to perform a process having a complicated procedure such as an assembly operation of a mechanical device, the skilled person of the corresponding work is close to the unskilled person,
It is necessary to teach the correct assembly work to the unskilled person who is going to perform the work.

Also, when a beginner of sports is proficient in sports, an expert or an instructor is near the beginner and teaches a correct basic action to a beginner who wants to perform a basic action of sports. It is necessary.
In addition, as a method to achieve some teaching even if there is no expert or instructor, a method of adopting a textbook that describes basic operations of assembly work, sports, etc. or recording basic operations of assembly work, sports, etc. A method of playing back the recorded video tape with a video tape recorder playback device is adopted.

[0004]

When teaching for unskilled people and beginners using textbooks, assembly work,
Since it is almost impossible to teach movements such as basic movements of sports, a sufficient teaching effect cannot be achieved. When a method of playing a video tape using a video tape recorder playback device is adopted,
Since the movement itself can be taught, the teaching effect can be enhanced as compared with the case where a textbook is adopted. However, the image recorded on the video tape is not the image seen by the expert or the instructor, and is a view considerably different from that of the expert or the instructor performing the assembly work, the basic motion of sports, etc. Since it is an image recorded in, it is still impossible to achieve a sufficient teaching effect.

Therefore, in order to achieve a sufficient teaching effect, teaching by a skilled person or an instructor is necessary.
However, the number of unskilled persons, skilled persons who can effectively teach beginners, or instructors is limited, and these skilled persons and instructors always stand by for teaching. Therefore, there is no guarantee that an unskilled person or a beginner will always receive the instruction of an expert or an instructor when needed.

[0006]

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has a teaching effect similar to that when a trainee or an instructor does not have a trainee or an instructor. It is an object of the present invention to provide a motion teaching device that can achieve the above.

[0007]

In order to achieve the above object, the motion teaching apparatus according to claim 1 is a head capable of simultaneously superimposing a visual field image of a user's external field and an artificial image. As an artificial image for supplying to the mount display device and the head mount display device, a series of images viewed from the viewpoint of a person skilled in a predetermined operation is held, and the series of images are sequentially supplied to the head mount display device. Image holding and supplying means.

[0008]

According to the motion teaching device of claim 1, as an artificial image to be supplied to the head mounted display device, an image holding device that holds a series of images viewed from the viewpoint of a person skilled in a predetermined motion. By sequentially supplying a series of images from the supply means to the head-mounted display device, the visual field image of the user's external field and the artificial image can be superimposed and viewed simultaneously in the head-mounted display device. Therefore, when performing assembly work, basic sports activities, etc., it is possible to see the image of the target object and at the same time see the image supplied from the image holding and supplying means in a superimposed state. It is possible to achieve a high teaching effect by performing a predetermined operation such that the user's hand or the like is placed on the hand or the like included in the image supplied from the supply unit. still,
The image holding / supplying means generally has a rewind function, a frame advance function, a pause function, etc., so that by utilizing these functions, for example, an image corresponding to only an operation requiring teaching can be performed by the user. It can be seen by superimposing it on the field image of the outside world, and teaching can be performed according to the degree of proficiency.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to the accompanying drawings showing embodiments. FIG. 1 is a diagram schematically showing a motion teaching device of the present invention, which holds a series of images from the viewpoint of a see-through MHD device 1 and a person skilled in a predetermined motion, and sequentially reproduces the series of images. See-through HMD device 1
And a video tape recorder reproducing device 2 for supplying the video tape recorder. In addition, in FIG. 1, the broken line indicates the visual field range of the see-through HMD device wearer. Also, within this field of view, the hands of the see-through HMD device wearer and objects such as assembly work are shown.

The see-through HMD device 1 displays the image supplied from the video tape recorder reproducing device 2 on a liquid crystal display screen, a half mirror, or the like, so that the see-through HMD device can pass through the liquid crystal display screen or the half mirror. The image can be seen in a state in which the image is superimposed on the external image in the field of view of the wearer (see, for example, JP-A-5-303053).

When recording an image to be reproduced by the video tape recorder reproducing device 2, for example, as shown in FIG. 2, the video camera 3 is installed near the viewpoint position of an expert who performs a predetermined series of operations. A series of images that are mounted and shot by the video camera 3 may be recorded on a video tape by using the video tape recorder recording device 4. In this case, it is also possible to record on the videotape a voice indicating the operation procedure and the like when performing a series of operations. The sound may be recorded at the same time when the image is recorded, or may be recorded after the image is recorded. Furthermore, in recording the above image, 2
When the teaching is performed using the motion teaching device having the above-described configuration, which may be recorded as an eye-shaped stereoscopic image, the video tape recorder / reproducer 1 displays the video tape on which the motion to be taught is recorded. Set and see-through HMD
The device 1 is attached to an unskilled person or a beginner (see FIG. 3). Then, in this state, for example, of the images recorded on the video tape, the image at the time of starting a series of operations is reproduced by the video tape recorder reproducing device 2 and supplied to the see-through HMD device 1. Therefore,
An image reproduced by the video tape recorder reproducing device 2 and an object to be subjected to a series of operations can be seen in a superimposed state. Here, if the reproduced image and the object do not completely overlap with each other, the see-through HM
When the wearer of the D device changes his / her position, the reproduced image and the object can be completely overlapped with each other. After that, the video tape recorder playback device 2
Thus, a series of operations similar to those of a skilled person can be performed by sequentially reproducing images showing a series of operations and moving his or her hand so as to overlap the hands of the skilled person included in the reproduced image.

In this case, if the rewinding function, the frame advancing function, the pause function and the like of the video tape recorder reproducing apparatus 2 are utilized, it is possible to teach the see-through HMD device wearer as needed. Specifically, for example, the teaching effect can be enhanced by repeating only the portion that is difficult to learn. Further, if voices indicating cautions and the like are simultaneously recorded on the video tape, the teaching effect can be enhanced not only visually but also by voices. Further, when the twin-lens type stereoscopic image is recorded on the video tape, the stereoscopic effect can be easily grasped, so that the teaching effect can be further enhanced.

[0013]

According to the first aspect of the present invention, in the head mounted display device, the visual field image of the user's external field and the artificial image can be simultaneously superposed and viewed, so that the assembly work, the basic motion of sports, etc. In carrying out, the image of the object can be seen and at the same time the image supplied from the image holding and supplying means can be seen in a superimposed state, and the image is included in the image supplied from the image holding and supplying means. By performing a predetermined operation so that the user's hand or the like is overlaid on the hand or the like, it is possible to achieve a unique effect that a teaching effect as high as that of an expert or an instructor can be achieved.

[Brief description of drawings]

FIG. 1 is a diagram schematically showing a motion teaching device according to the present invention.

FIG. 2 is a schematic diagram illustrating recording of an image to be reproduced.

FIG. 3 is a diagram schematically showing a teaching state.

[Explanation of symbols]

1 See-through HMD device 2 Video tape recorder playback device

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Office reference number FI technical display location G09B 19/16 19/24 Z

Claims (1)

[Claims] 1. A head mount display device (1) capable of simultaneously superimposing a visual field image and an artificial image of a user on the outside world, and an artificial device for supplying the head mount display device (1). Image holding and supplying means (2) for holding a series of images viewed from the viewpoint of a person skilled in a predetermined operation and sequentially supplying the series of images to the head mounted display device (1). A motion teaching device characterized by the above.