JP5594060B2 - Amusement machine - Google Patents

Description

  The present invention relates to an amusement device using a three-dimensional image, and is suitable for learning applications such as languages.

  For example, various learning support software that operates on a personal computer (PC), a portable game machine, or the like has been put into practical use for learning languages and the like. Among them, there are those that reproduce English speech and perform dictation in which the user writes the read-out English speech, and those that perform shadowing that causes the user to repeat the English speech. Such dictation and shadowing can be expected to increase memory retention and improve pronunciation when learning languages.

  Although the learning support software described above can enhance the learning effect by writing and pronunciation by the user, it is basically executed by operating the keyboard, touch panel, etc. There are many cases where the element of doing is lacking.

  The present invention has been made in view of the above points, and by using a 3D image, the user can execute various contents including learning such as language in a game sense while moving the body. An object is to provide an amusement device.

In order to achieve the above-described object, an amusement device according to claim 1,
A display device for displaying a three-dimensional image;
Display control means for causing a display device to display a three-dimensional image in which a plurality of target images including a target image to be selected by the user are lifted and displayed at a position close to the user;
Detecting means for detecting movement of a user's hand located at a predetermined distance from the display device;
A determination means for determining whether or not the user has performed a hand movement to hit a target image to be selected, based on a detection result by the detection means;
Based on the determination result by the determination unit, a shall and a presenting means for presenting the user with evaluation results,
The amusement device is used for language learning,
Reading aloud a sentence or a word;
Voice detection means for detecting the voice uttered by the user;
A voice recognition unit that detects the voice by voice detection means when a sentence or a word is repeated by the user, and recognizes the detected voice;
The presenting means presents an evaluation result including a recognition result by the voice recognition unit .

By providing the above-described configuration, a plurality of target images including a target image to be selected are displayed at close positions as if the user's hand has reached. The user who sees such a 3D video display hits one of the target images by moving his / her hand so as to touch or hit the target image he / she wants to select. Then, it is determined whether or not the user has correctly hit the target image to be selected by the determining means, and the evaluation result is presented to the user based on the determination result by the presenting means. Therefore, the user can enjoy various contents using the 3D video display as if playing a game while moving his / her body. In particular, when the contents include learning contents such as language, learning is performed while exercising, so that the degree of concentration on learning increases and a higher learning effect can be expected.
Therefore, the amusement device has a reading unit that reads a sentence or a word, a voice detection unit that detects a voice uttered by the user, and a voice or a voice detection unit that detects the voice when the sentence or word is repeated by the user, A speech recognition unit for recognizing the detected speech, and the presenting unit presents an evaluation result including a recognition result by the speech recognition unit. Thereby, when the user performs language learning using the amusement device according to the present invention, an effect of improving pronunciation can be expected.

  As described in claim 2, the determination means sets a virtual plane within the reach of the user's hand, and when the user's hand reaches the virtual plane within an area corresponding to any target image, It is preferable to determine that the hand movement to hit the target image to be performed has been performed. As a result, when the user moves his hand to try to hit one of the target images, the movement of the hand trying to hit the target image can be reliably determined.

  According to a third aspect of the present invention, the display control means changes the display mode of the corresponding target image when the determination means determines that the user has performed a hand action to hit the target image to be selected. It is preferable to make it. For example, as a change in display mode, the target image is ruptured, moved away from the user, or disappeared while changing the color. Thereby, the user can visually recognize that the correct target image is hit. Further, the user can be entertained visually.

  According to a fourth aspect of the present invention, the display control means controls the display of the 3D video so that the target image is selected by the user a plurality of times, and the presentation means is the result of the selection of the plurality of times. It is also possible to present a comprehensive evaluation result for the user. As a result, learning while exercising can be continued for an appropriate time, and improvement of both the exercise effect and the learning effect can be expected. Note that the duration (number of target image selections) may be selected by the user.

It is the block diagram which showed the whole structure of the amusement apparatus by embodiment. It is the figure which showed an example of arrangement | positioning of each component at the time of comprising an amusement apparatus. (A)-(d) is a figure which shows the example of the various images displayed in an amusement apparatus.

  Hereinafter, an amusement device according to an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, an example in which the amusement device executes language learning content will be described.

  FIG. 1 is a block diagram showing the overall configuration of the amusement device according to the present embodiment. FIG. 2 shows an example of the arrangement of each component when configuring an amusement device. In the example shown in FIG. 2, a ceiling and a side plate are provided between the screen 2 and the user, and the screen 2 is covered with the ceiling and the side plate. However, these ceiling and side plates are not necessarily provided. Moreover, in FIG. 2, the top plate and the side plate are shown in a transparent state for easy understanding.

  As shown in FIGS. 1 and 2, the amusement device according to the present embodiment includes a 3D projector 1 and a screen 2 for displaying a three-dimensional image, a speaker 3 for outputting a reading voice of sentences and words, a user's speech And a computer 10 for detecting the movement of the user's hand, and a computer 10. In FIG. 2, illustration of a part of the configuration is omitted.

  In the present embodiment, the 3D projector 1 is a projector that can alternately project images viewed from different angles on the screen 2. The user wears glasses equipped with a liquid crystal shutter in which the left and right visual fields are alternately shielded, and views the projected image. At this time, by opening and closing the liquid crystal shutter of the glasses completely in synchronization with the two images, the right eye and the left eye can see only the right eye image and the left eye image, respectively, so that a stereoscopic effect can be obtained. It has become.

  However, instead of a projector, a normal display such as a liquid crystal display or a plasma display may be used as a device for displaying a three-dimensional image. Further, as a device for displaying a three-dimensional image, another method, for example, a three-dimensional display using a deflection glasses method, or a naked-eye type three-dimensional display using a holographic display may be adopted.

  The speaker 3 outputs a reading sound when a sentence or a word is read out by the language learning content. Then, the microphone 4 detects the voice uttered by the user when the user performs shadowing of the reading voice.

  The 3D camera 5 can use, for example, a TOF (time of flight) type distance image sensor capable of measuring a distance to an object. Note that the TOF type distance image sensor measures the distance to the reflective object for each pixel by, for example, modulating and projecting infrared light and measuring the phase difference with the reflected light from the reflective object for each pixel. It is possible. Further, a so-called stereo camera may be used as the 3D camera 5 and the distance to the object may be obtained using parallax.

  The computer 10 includes a well-known CPU, ROM, RAM, I / O and a bus line for connecting these components. In the ROM, a program to be executed by the computer 10 is written, and a CPU or the like executes predetermined arithmetic processing according to this program.

  However, in FIG. 1, for convenience of explanation, the processing (function) executed by the computer 10 is structurally represented by blocks. Hereinafter, functions executed by the computer 10 will be described with reference to FIG.

  The computer 10 has a content execution control unit 11. The content execution control unit 11 reads content software stored on, for example, a disc and controls the execution of the content. For example, based on the content software, the content execution control unit 11 causes the speaker 3 to output a voice that reads out a sentence such as a movie speech in a foreign language to be learned (for example, English) from the speaker 3. At that time, video data for displaying the Japanese translation of the words may be output to the drawing unit 13 and projected by the 3D projector 1. The drawing unit 13 gives a video signal to be displayed to the 3D projector.

  Next, the content execution control unit 11 displays a scene of a movie as a background, and a three-dimensional display in which a phrase obtained by dividing a read-out line into pieces is floated and displayed as a target image at a position close to the user. Video data for displaying a video is output to the drawing unit 13. At this time, the background image may be displayed three-dimensionally. Thereby, as shown in FIG. 3A, a plurality of target images are displayed by the 3D projector 1 and the screen 2 at close positions as if the user's hand reached. In FIG. 3A, the display of the background video is omitted.

  At that time, the display position of the target image may be randomly arranged at any one of a plurality of predetermined positions, or may be arranged completely at random. It is arranged so that it does not overlap even partly.

  Then, if the user hits the target image in the order of the example sentence from a plurality of target images displayed at close positions, the answer is correct, and if the user hits a target image different from the order, the answer is incorrect. Therefore, when a user hits one of the target images by moving his / her hand so as to touch or hit the target image to be selected, the user's hand hits one of the target images. The gesture is recognized by the gesture recognition unit 14.

  Specifically, when the content execution control unit 11 determines the arrangement of each target image, the content execution control unit 11 outputs the display position of each target image to the correctness determination unit 15, and the correctness determination unit 15 displays the display of each target image. Information about the position is given to the gesture recognition unit 14. The gesture recognition unit 14 recognizes the user's hand based on the video imaged by the 3D camera 5. Furthermore, the gesture recognition unit 14 sets a virtual plane between the position of the user in the play zone and the screen 2 and reaches the reach of the user's hand, and the user's hand corresponds to one of the target images. When the virtual plane is reached within the area, it is determined that the hand movement to hit the corresponding target image has been performed. Note that the virtual plane may be set at a predetermined position, or may be set each time based on the user's standing position.

  This makes it possible to reliably determine which target image is to be hit when the user moves his hand to hit any target image. This determination result, that is, information on the target image hit by the user is output to the correctness determination unit 15.

  Based on the display position of each target image given from the content execution control unit 11 and the target image hit by the user determined by the gesture recognition unit 14, the correctness determination unit 15 hits the correct target image. Determine whether or not. This determination result is output to the content execution control unit 11.

  Further, when the user hits any target image, the user is caused to pronounce the phrase of the target image, and the voice emitted by the user is detected by the microphone 4. The voice of the user detected by the microphone 4 is recognized by the voice recognition unit 16. The recognition result by the voice recognition unit 16 is output to the evaluation determination unit 17. The evaluation determination unit 17 obtains information on the phrase corresponding to the target image hit by the user from the content execution control unit 11, and compares the information on the phrase with the recognition result by the voice recognition unit 16, thereby allowing the user's Evaluate the quality of pronunciation.

  When the content execution control unit 11 obtains a determination result that the user has hit a correct target image from the correctness determination unit 15, the content execution control unit 11 changes the display mode of the target image. For example, as an example of a change in display mode, the target image is ruptured, moved away from the user, or disappeared while changing the color. Thereby, the user can visually recognize that the correct target image is hit. Further, the user can be entertained visually. FIG. 3B shows a state in which the first target image is correctly hit by the user and the target image is erased by rupture or the like.

  In the same manner, the content execution control unit 11 thereafter determines whether or not the user has hit the target image correctly according to the example sentence, determines whether the user's pronunciation is good, and hits the correct target image. The process of changing the display mode of the target image is repeated. When all the target images are hit, the content execution control unit 11 outputs video data for displaying a screen showing an evaluation related to the given example sentence to the drawing unit 13. FIG. 3C is a screen showing an example of a video showing the evaluation.

  When the preset number of questions or play time elapses, the content execution control unit 11 calculates a comprehensive evaluation, and outputs video data for displaying a screen showing the comprehensive evaluation to the drawing unit 13. . As the calculated evaluation, in addition to the correct answer rate at which the target image is hit and the answer time, the evaluation on the user's pronunciation, such as the match rate between the phrase pronounced by the user and the phrase of the target image and the quality of the pronunciation itself, is also calculated . Furthermore, the calories consumed by the user are also calculated mainly based on the play time. FIG. 3D shows an example of a screen that displays a total score obtained by, for example, weighting and summing the above-described evaluation items and calories consumed by the user due to exercise.

  As described above, the content execution control unit 11 controls the display of the 3D video so that the target image is selected by the user a plurality of times, and finally, the comprehensive evaluation result regarding the plurality of selection results. Is presented to the user. For this reason, it is possible to continue learning while exercising for an appropriate period of time, and it can be expected to improve both the exercise effect and the learning effect. Note that the duration time (number of questions and play time) may be selectable by the user.

  As described above, according to the amusement device according to the present embodiment, the user can enjoy the content for language learning using the 3D video display as if playing a game while moving his / her body. In this case, by performing learning while exercising, the degree of concentration on learning increases, and a higher learning effect can be expected.

  The above-described embodiment is a preferred embodiment of the amusement device according to the present invention. However, the amusement device according to the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention. Can be implemented.

  For example, in the above-described embodiment, an example has been described in which an amusement device reads out an example sentence and hits a target image in accordance with the order of the phrases of the example sentence. However, the amusement device can include other learning modes. For example, the word mode may be executed in an amusement device. In this word mode, a foreign language or Japanese word is displayed, and a candidate for Japanese translation of the word or a foreign language candidate corresponding to a Japanese word is displayed as a plurality of target images. Then, the target image of a Japanese translation candidate or a foreign language candidate that the user thinks is correct is made to hit. At this time, when a foreign language candidate is hit, the pronunciation of the foreign language candidate may be performed simultaneously.

  In the above-described embodiment, the example in which the amusement device executes the language learning content has been described. However, the content that can be executed in the amusement device is not limited to the language learning content. For example, it is possible to display math calculation questions and display their answer candidates as multiple target images, or to display Japanese kanji problems as questions and display their kanji candidates as multiple target images. It is. In other words, the amusement device according to the present invention is not limited to language learning but can be widely applied to learning purposes.

  Furthermore, the amusement device according to the present invention is not limited to the learning application, but can be applied to entertainment applications such as taking a quiz and displaying the answer selector as a target image.

DESCRIPTION OF SYMBOLS 1 ... 3D projector 2 ... Screen 3 ... Speaker 4 ... Microphone 5 ... 3D camera 10 ... Computer 11 ... Content execution control part 12 ... Amplifier part 13 ... Drawing part 14 ... Gesture recognition part 15 ... Correctness determination part 16 ... Voice recognition part 17 ... Evaluation judgment part

Claims (4)

A display device for displaying a three-dimensional image;
Display control means for displaying, on the display device, a three-dimensional image in which a plurality of target images including a target image to be selected by a user are lifted and displayed at a position close to the user;
A detecting means for detecting a motion of the hand of the user at a location spaced a predetermined distance from the display device,
A determination unit that determines whether or not the user has performed a hand movement to hit the target image to be selected, based on a detection result by the detection unit;
An amusement device comprising: presentation means for presenting an evaluation result to the user based on a determination result by the determination means ;
The amusement device is used for language learning,
Reading aloud a sentence or a word;
Voice detection means for detecting the voice uttered by the user;
A voice recognition unit that, when the sentence or word is repeated by the user, detects the voice by the voice detection means and recognizes the detected voice;
An amusement device using a three-dimensional image, wherein the presenting means presents an evaluation result including a recognition result by the voice recognition unit .   The determination means sets a virtual plane within the reach of the user's hand, and when the user's hand reaches the virtual plane within an area corresponding to any of the target images, the corresponding target image The amusement device according to claim 1, wherein the amusement device is determined to have performed an action of a hand that hits.   The display control means changes the display mode of the corresponding target image when the determination means determines that the user has performed a hand action to hit the target image to be selected. The amusement device according to claim 1 or 2. Wherein the display control unit, so that the selection of the target image by the user is performed a plurality of times, controls the display of the three-dimensional image,
Said presenting means, said plurality of amusement device according to any one of claims 1 to 3, characterized in that the overall evaluation results of the selection result is intended to be presented to the user.

Images