JP6778445B1 - Card learning system and card learning method - Google Patents

Abstract

[Problem] When learning such as word play or number play by rearranging cards, appropriate learning can be performed so that the person can surely understand the correct answer. [Solution] Word or number sequence by arrangement of letters or numbers , A storage unit 104 that stores the correct answer image corresponding to each word or number sequence, and each type of the plurality of captured cards based on the captured images of the plurality of cards in which characters or numbers are described. The image recognition unit 101a that recognizes the above, and the determination unit that determines whether the arrangement of characters or numbers written on a plurality of cards of the type recognized by the image recognition unit matches the word or number sequence stored in the storage unit. The 101b, the image superimposing unit 101c that superimposes the correct answer image stored in the storage unit corresponding to the word or the number sequence that matched in the determination unit, and the display unit 105 that displays the image on which the correct answer image is superimposed in the image superimposing unit. , Equipped with. [Selection diagram] Fig. 3

Description

The present invention relates to a card learning system and card learning how, especially AR Technology: relates to a technology for learning, such as words and numbers by running the card game with the (Augmented Reality technology augmented reality technology).

Conventionally, various cards for learning words and calculations have been known for educational purposes.
For example, character learning that creates meaningful words by writing characters such as "A", "B", "C", etc. on each card and rearranging the character cards. Are known. Specifically, the word "CAR" is created by arranging the card "C", the card "A", and the card "R" in a horizontal row.

Similarly, by preparing a number card on which different numbers are written on each card and arranging the number cards, it is possible to create a multi-digit number. In addition, by combining with a card with symbols such as "+" and "-", number learning such as simple calculation can be executed.

Patent Document 1 describes an example of a card game in which karuta can be played.

JP-A-2010-107541

As mentioned above, it has been known that word learning and calculation learning can be performed by rearranging cards on which words and numbers are written, but whether or not the result of arranging cards is correct is, for example, card learning. I was trying to teach by an adult who was helping. That is, unless there is a person who teaches the correct answer, there is a problem that it is not known whether the cards arranged by the child are a sequence of meaningful correct words.
For example, in the above example, the word "CAR" is created by arranging three cards "C", "A", and "R", but "CAR" means a car. Is not understood unless someone teaches the child (learner).

The present invention, in performing the learning using the card, such as word learning and numbers learning by rearrangement of the card, the card learning system and card learning how that can appropriate learning as seen to ensure the correct answer to the person The purpose is to provide.

Card learning system of the present invention, a character, or a plurality of card numbers and symbols have been described, a more composed card learning system with a terminal and a camera and a display unit, a word by the terminal, the sequence of the character image showing, or an image showing a calculation formula according to the sequence of numerals and symbols, and a storage unit stored with correct images indicating the meaning of each word or formula, letters, or numbers and symbols have been described of a plurality An image recognition unit that recognizes each type of multiple cards taken based on the images taken by the camera, and an arrangement of characters or numbers written on the multiple cards recognized by the image recognition unit. and symbol-sequence of a determination section for determining matches the stored word or calculation formula in the storage unit, the captured image obtained by photographing the camera painters over de image to superimpose the image stored in the storage unit It is provided with a superimposing portion.
Then, when the image recognition unit recognizes the card from the captured image, the image indicating the characters written on the card recognized by the image recognition unit or the image indicating the numbers and symbols is superimposed on the photographed image taken by the camera. When the judgment unit determines a match after displaying the image on the display unit, the display unit displays an image in which the correct image indicating the meaning of the word or calculation formula is superimposed on the captured image taken by the camera. It replaces the display.

The card learning method of the present invention, a character, or a plurality of card numbers and symbols have been described, a card learning method performed by a terminal and a camera and a display unit, characters, or numbers and symbols From the captured image of the multiple cards described by the camera, the recognition process in which the image recognition unit of the terminal recognizes each type of the multiple cards captured, and the multiple cards recognized by the image recognition unit. The image recognition unit is a judgment process in which the judgment unit of the terminal determines whether the arrangement of the described characters or the arrangement of numbers and symbols matches a specific word or calculation formula stored in the storage unit. When the card is recognized from the captured image, the image showing the characters written on the card recognized by the image recognition unit or the image showing the numbers and symbols is superimposed on the captured image taken by the camera and displayed on the display unit. After the display, when the judgment unit determines a match in the judgment process, the display on the display unit is replaced with an image in which the correct image that the word or calculation formula means is superimposed on the captured image taken by the camera. Including display processing.

According to the present invention, since the correct answer images corresponding to the words and the sequence of the arranged cards are superimposed and displayed, the practitioner of the card learning can understand the correct answer from the superimposed images, and is like word learning using the card. Various learning can be done by one person with high learning effect.

It is a figure (Example 1) which shows the execution example of the card game by one Embodiment of this invention. It is a figure (Example 2) which shows the execution example of the card game by one Embodiment of this invention. It is a block diagram which shows the hardware configuration example (example 1) of the card game apparatus by one Embodiment of this invention. It is a block diagram which shows the hardware configuration example (example 2) of the card game apparatus by one Embodiment of this invention. It is a functional block diagram of the card game apparatus according to one Embodiment of this invention. It is a flowchart which shows the flow of the process of the word learning by the card game apparatus by the example of one Embodiment of this invention. It is a figure which shows the display example (example 1) at the time of execution of the word learning by the example of one Embodiment of this invention. It is a figure which shows the display example (example 2) at the time of execution of the word learning by one Embodiment of this invention. It is a figure which shows the display example (Example 3) at the time of execution of the word learning by one Embodiment of this invention. It is a figure which shows the display example at the time of execution of the image combination learning by the example of one Embodiment of this invention. It is a flowchart which shows the flow of the process of the calculation play by the card game apparatus by the example of one Embodiment of this invention. It is a figure which shows the display example at the time of execution of the calculation learning by the example of one Embodiment of this invention. It is a figure which shows the example of the image of each card by the example of one Embodiment of this invention. It is a figure which shows the registration example of the image, word, and voice by one Embodiment of this invention.

Hereinafter, an example of an embodiment of the present invention (hereinafter referred to as “this example”) will be described with reference to the accompanying drawings.

[Example of learning with cards]
FIG. 1 shows an example (Example 1) of a learning state using a card in the system of this example.
In the example of FIG. 1, while the user (learner) holds the information processing terminal 100 called a tablet by hand, the learner rearranges a plurality of cards C1, C2, C3, ... On the table. , Words, etc. are learned. The information processing terminal 100 has a built-in camera and a display unit, and is equipped with software that realizes the learning system of this example.

A different character is written on the surface of each card C1, C2, C3, ... However, there may be a plurality of cards on which the same characters are written. Further, on the surface of each card C1, C2, C3, ..., An image necessary for recognizing each card is printed. That is, the learning system can identify the characters written on the surface of the cards C1, C2, C3, ... From the image written on the background of the characters on the card.

The learner performs an operation of rearranging the cards so that the characters become specific words while looking at the characters written on the surfaces of the plurality of cards C1, C2, C3, .... The rearranged plurality of cards are photographed by a camera built in the information processing terminal 100, and are recognized and processed by the information processing terminal 100.

FIG. 2 shows another example (Example 2) of the learning state by the card in the system of this example.
The example of FIG. 2 shows a case where a glasses-type information processing terminal 100'called AR glasses, smart glasses, or the like is used. The information processing terminal 100'has a built-in camera and a display unit, and is equipped with software that realizes the learning system of this example. The camera built into the glasses-type information processing terminal 100'photographs the front of the wearer of the terminal.
In the example of FIG. 2, the learner wears the information processing terminal 100'on his head and rearranges a plurality of cards C1, C2, C3, ... On the table to learn words and the like. Do.
Since the process of recognizing the cards C1, C2, C3, ... By the information processing terminal 100'is the same as that of the tablet-type information processing terminal 100 in the example of FIG. 1, the description thereof will be omitted.

When the glasses-type (AR glasses or smart glasses) information processing terminal 100'shown in FIG. 2 is used, the display unit is composed of a transmissive display. Therefore, the wearer (learner) can see the image in which information such as images and characters is superimposed on the surrounding state transmitted through the display panel. However, even the glasses-type information processing terminal 100'may be provided with a non-transparent display unit to display only an internally generated image such as a camera image.

In the following description, the configuration of the tablet-type information processing terminal 100 shown in FIG. 1 will be described, but the basic configuration of the glasses-type information processing terminal 100'shown in FIG. 2 is also the same as that of the tablet-type information processing terminal 100. It is the same.

[Configuration of information processing terminal]
FIG. 3 shows the hardware configuration of the information processing terminal 100 of this example.
The information processing terminal 100 includes a CPU (central processing unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage unit 104, a display unit 105, an audio input / output unit 106, a camera 107, and a network interface 108. Each of these parts is connected by a bus line so that data can be transferred.

The CPU 101 is an arithmetic processing unit that reads a program code of software (program) that realizes a function of performing learning processing from a ROM 102 or the like and executes it.
The ROM 102 stores program codes that execute various functions implemented in the information processing terminal 100. A program that executes a learning process using a card is also stored in the ROM 102.
The RAM 103 is a work memory used for reading programs and data stored in the ROM 102 and the storage unit 104.

The storage unit 104 is a large-capacity data storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 104 stores image data necessary for recognizing each card when executing a card game, data of a correct answer image, and the like, and reads them out under the control of the CPU 101. The data for a card game stored in the storage unit 104 is acquired from, for example, the card game server 200 described later.
Images taken by the camera 107 and various images generated in the information processing terminal 100 are displayed on the display unit 105. For example, when the learning process by the card game is executed, the image taken by the camera 107, the correct answer image, and the like are displayed on the display unit 105.

The voice input / output unit 106 includes a voice processing unit, a speaker, and a microphone, and the voice processing unit executes voice processing such as analog conversion of voice data instructed by the CPU 101, and the processed voice is output from the speaker. .. For example, when executing a learning process by a card game, a sound effect or the like is output from a speaker. Further, the voice input / output unit 106 also includes a microphone, and the voice processing unit converts the voice picked up by the microphone into voice data. The voice data picked up by the microphone is used when registering the voice when the answer is correct.
The camera 107 photographs the surroundings of the information processing terminal 100. In the case of the tablet-type information processing terminal 100 shown in FIG. 1, a camera 107 is arranged on the back surface side of the housing constituting the information processing terminal 100, and the camera 107 photographs the opposite side of the display unit 105.

The network interface 108 is a communication unit connected to the Internet N.
The network interface 108 communicates with a card game server 200 prepared in advance when executing a learning process by a card game.

It should be noted that it is an example that the network interface 108 shown in FIG. 3 advances the game while communicating with the card game server 200, and as shown in FIG. 4, the configuration without the network interface 108 or the network interface 108 is provided. It may be configured not to be used when the game is executed.

In the information processing terminal 100 shown in FIG. 4, the information processing terminal 100 acquires all the information necessary for the progress of the card game in advance and stores it in the storage unit 104.
Even when the information necessary for the progress of the card game is stored in the storage unit 104, the information processing terminal 100 is provided with the network interface 108 as shown in FIG. 3, and the card game program is updated at any time. It may be.

[Configuration as seen from the function of executing card games]
FIG. 5 is a functional block diagram showing a configuration seen from the function when the information processing terminal 100 of this example executes a card game program.
The image taken by the camera 107 is supplied to the image recognition unit 101a. The image recognition unit 101a captures the captured image, compares the captured captured image with the card image prepared in advance, and performs recognition processing for the type of card included in the captured image. The image recognition unit 101a is a processing unit formed by the CPU 101 executing a program together with the determination unit 101b and the image superimposition unit 101c described later.

The image recognition unit 101a performs a process (recognition process) of recognizing information of an image printed on the surface of all the cards used in this card game in advance. An example of the image printed on the surface of each card will be described later (FIG. 13). Here, the image recognition unit 101a can simultaneously recognize a plurality of cards from one captured image, and can also determine the orientation of each card and the arrangement status of each card. For example, the image recognition unit 101a can determine whether or not the three cards are arranged side by side even when there is almost no gap.
The information on the types of the plurality of cards recognized by the image recognition unit 101a and the information on the arrangement status of the cards are supplied to the determination unit 101b.

The determination unit 101b determines whether the type of the plurality of cards recognized by the image recognition unit 101a and the arrangement status of the cards are the correct answer stored in the storage unit 104 or a meaningful arrangement. Execute the judgment process. Here, when it is determined that the sequence of correct answers is stored in the storage unit 104, the determination unit 101b reads out the information of the correct answer image stored in the storage unit 104 and the voice information such as the sound effect, and the information of the correct answer image. Is supplied to the image superimposing unit 101c, and audio information is supplied to the audio input / output unit 106.
When registering the correct answer voice, which will be described later, the voice information input to the voice input / output unit 106 is stored in the storage unit 104.

Further, the image superimposing unit 101c superimposes the supplied correct image on the captured image supplied from the camera 107 and supplies it to the display unit 105. The correct image here is a 3D image in which an object, a character, or the like is made to appear three-dimensionally on the card by using AR technology, and is a moving image or a still image. It should be noted that the image superimposed on the captured image (or superimposed on the transparent image) by the image superimposing unit 101c is an example of a 3D image using the AR technique, and may be a general moving image or a still image.
The display unit 105 displays a captured image on which the correct answer image is superimposed. In the case of the glasses-type information processing terminal 100'shown in FIG. 2, the display unit 105 may superimpose and display only the correct answer image on the screen and not display the captured image.
Then, the voice input / output unit 106 outputs a sound effect corresponding to the correct answer image in conjunction with the display of the correct answer image on the display unit 105.

[Process flow when executing a card game]
FIG. 6 is a flowchart showing a processing example when learning a word (word) in a card game by the information processing terminal 100 (or 100'). In the following description, the card game of this example will be referred to as an AR card game.
Here, as shown in FIG. 1 or 2, the learner arranges a plurality of cards C1, C2, C3, ... On the table, and the plurality of cards C1, C2, C3, ... Is executed by the information processing terminal 100 while the AR card game is executed.

First, the learner starts the program of the AR card game (step S11).
When the program of the AR card game is started, the display unit 105 of the information processing terminal 100 displays the start of the AR card game. Then, the camera 107 starts shooting, and the display unit 105 displays the shot image (step S12). Here, the image recognition unit 101a performs a recognition process for the card included in the captured image.

Then, after the image recognition unit 101a starts the recognition process of the captured image in step S12, the image recognition unit 101a determines whether or not the card for the AR card game is recognized (step S13).
When it is determined in step S13 that the card for the AR card game has been recognized (YES in step S13), the image superimposing unit 101c uses the characters (3D image) written on the surface of the recognized card as the captured image. Superimpose (step S14). A specific example of the event in which the character images are superimposed will be described later (display form as shown in FIGS. 7A and 8A).
Next, the image recognition unit 101a determines whether or not a plurality of recognized cards are lined up (step S15). When the image recognition unit 101a determines in step S15 that a plurality of cards are lined up (YES in step S15), the determination unit 101b determines whether or not the card arrangement is registered in advance (step S16).

If the determination unit 101b determines in step S16 that the card arrangement is registered in advance (YES in step S16), the determination unit 101b stores the correct image of the meaning of the character string of the corresponding card arrangement in the storage unit 104. The correct answer image read from the image superimposing unit 101c and the captured image are superimposed and displayed on the display unit 105 (step S17). When the superimposed display of the correct image is completed, the process returns to the shooting and display process in step S12.

Further, in step S13, when it is determined that the card for the AR card game is not recognized (NO in step S13), and when it is determined in step S15 that the arrangement of a plurality of cards is not detected (NO in step S15). , And when it is determined that the sequence is not the sequence registered in step S16 (NO in step S16), the process returns to the shooting and display processing in step S12.

[Example of display when running an AR card game]
7 to 10 show a display example when the AR card game of this example is executed. 7 and 8 both show a state in which an image taken by the camera 107 of the information processing terminal 100 is displayed on the display unit 105.
FIG. 7 is an example of learning English words (words).
Here, three cards C11, C12, and C13 with the letters "C", "A", and "R" printed on the surface of each card are prepared. Actually, a large number of cards on which other characters are printed are prepared, but FIG. 7 shows only three cards taken out by the learner.

Then, as shown in FIG. 7A, the learner arranges the three cards C11, C12, and C13 side by side, and the letters "C", "A", and "A" printed on the surface of each of the cards C11, C12, and C13. It is assumed that "R" are lined up in a horizontal row.
Here, by recognizing each card C11, C12, C13, the letters "C", "A", and "R" printed on the surface of each card C11, C12, C13 are photographed as a stereoscopic image P11. It is displayed superimposed on the image.

In the case of the card arrangement shown in FIG. 7A, in the AR card game, the arrangement of three cards C11, C12, and C13 in a horizontal row is registered as the correct answer, and the process moves to the superimposition processing of the correct answer image. First, as shown in FIG. 7B, the transition screen P12 for displaying the correct answer image is superimposed and displayed on the captured image. Here, an example in which clouds and the like are displayed as the transition screen P12 is shown, but characters such as “seikai” may be displayed. Further, the sound effect "bone" indicating that the answer is correct may be output from the voice input / output unit 106.

Subsequently, as shown in FIG. 7C, the image P13 of the automobile, which is the correct answer image, is superimposed and displayed on the captured image. The car of this correct image is displayed three-dimensionally on the screen. Further, the displayed image may be a moving image of the car moving in the screen. Further, a sound effect such as "buboo" indicating that the vehicle is a car may be output from the voice input / output unit 106.

FIG. 8 is an example of learning hiragana words.
Here, two cards C21 and C22 in which the characters "U" and "" are printed on the surface of each card are prepared. Actually, a large number of cards on which other characters are printed are prepared, but FIG. 8 shows only two cards taken out by the learner.

Then, as shown in FIG. 8A, the learner arranged the two cards C21 and C22 side by side, and the letters "u" and "shi" printed on the surface of each of the cards C21 and C22 were arranged in a horizontal row. Suppose you are in a state.
Here, by recognizing the respective cards C21 and C22, the characters "u" and "" printed on the surfaces of the respective cards C21 and C22 are displayed as a stereoscopic image P21 superimposed on the captured image. ..

In the case of the card arrangement shown in FIG. 8A, in the AR card game, the arrangement of the two cards C21 and C22 in a horizontal row is registered as the correct answer, and the process moves to the superimposition processing of the correct answer image. Here, first, as shown in FIG. 8B, the transition screen P22 for displaying the correct answer image is superimposed and displayed on the captured image. Further, a sound effect "bone" indicating that the answer is correct is output from the voice input / output unit 106.

Subsequently, as shown in FIG. 8C, the image P23 of the cow, which is the correct image, is superimposed and displayed on the captured image. The cow in this correct image is displayed three-dimensionally on the screen. It may also be a video of a cow moving on the screen. Further, a sound effect such as "mo" indicating that the cow is a cow may be output from the voice input / output unit 106.

FIG. 9 shows an example of display when a word is printed on the surface of each card and the word and the image card are arranged side by side.
That is, when a card C31 printed with "CAR" and a card C32 printed with a picture of an automobile are prepared and these two cards C31 and C32 are arranged side by side, the answer is recognized as correct in the AR card game. The correct answer image P31 showing an automobile or the like is superimposed on the captured image.

FIG. 10 shows a display example when automobile parts can be printed on each card and assembled into the correct shape of the automobile.
That is, as shown in FIG. 10A, a card C41 on the upper part of the vehicle body, a door card C42, a bonnet card C43, a trunk card C44, and tire cards C45 and C46 are prepared. Then, as shown in FIG. 10A, when the cards C41 to C46 are arranged in the correct arrangement as an automobile, the correct answer image P41 showing the automobile or the like is superimposed on the captured image as shown in FIG. 10B.

[Process flow when executing a card game]
FIG. 11 is a flowchart showing a processing example when the information processing terminal 100 (or 100') executes calculation learning in an AR card game.

First, the learner starts the program of the AR card game (step S21).
When the program of the AR card game is started, the display unit 105 of the information processing terminal 100 displays the start of the AR card game. Then, the camera 107 takes a picture, and the display unit 105 executes the display of the shot image (step S22).

Then, the image recognition unit 101a determines whether or not the card for the AR card game is recognized from the image taken in step S22 (step S23).
If it is determined in step S23 that the card for the AR card game has been recognized (YES in step S23), the image recognition unit 101a determines whether or not a plurality of recognized cards are lined up (step S24). .. When the image recognition unit 101a determines in step S24 that a plurality of cards are lined up (YES in step S24), the determination unit 101b determines whether or not the cards are arranged in a pre-registered calculation formula (step S24). S25).

When the determination unit 101b determines in step S25 that the card arrangement is the card arrangement of the pre-registered calculation formula (YES in step S25), the determination unit 101b displays a correct image imagining the execution of the calculation of the corresponding card arrangement. The correct answer image read from the storage unit 104 is superimposed on the captured image by the image superimposing unit 101c and displayed on the display unit 105 (step S26). The correct image here is also a 3D image that is made to exist and appear three-dimensionally by using, for example, AR technology. When the superimposed display of the correct answer image is completed, the process returns to the card recognition process in the image recognition unit 101a in step S23.
Further, when it is determined in step S23 that the card for the AR card game is not recognized (NO in step S23), and when it is determined in step S24 that the arrangement of a plurality of cards is not detected (NO in step S24). And when it is determined that the array is not the array of the calculation formula registered in step S25 (NO in step S25), the process returns to the card recognition process in the image recognition unit 101a in step S23.

[Example of display of calculation when executing AR card game]
FIG. 12 shows a display example of the calculation at the time of executing the AR card game of this example.
Here, three cards C51, C52, and C53 having numbers or symbols "6", "-", and "3" printed on the surface of each card are prepared. Actually, a large number of cards on which other numbers and symbols (+, ÷, ×, etc.) are printed are prepared, but FIG. 12 shows only three cards taken out by the learner.

Then, as shown in FIG. 12A, the learner arranges three cards C51, C52, C53 side by side, and the numbers or symbols "6", "-" printed on the surface of each of the cards C51, C52, C53. , "3" are lined up in a horizontal row.
At this time, by recognizing the respective cards C51, C52, and C53, an image imagining the execution of the calculation formula of "6-3" is superimposed.
That is, first, as shown in FIG. 12B, the image P51 in which six objects (fruits and the like) are arranged is superimposed on the captured image.

Next, as shown in FIG. 12B, a moving image P52 in which a small bird eats three of the six objects is displayed, and finally, as shown in FIG. 11C, an image P53 in which only three objects are displayed. Is displayed.
By performing such a display, the image image on which the calculation of "6-3" is executed is superimposed and displayed on the captured image of the card.
The superimposed image as shown in FIG. 12 is also, for example, a 3D image, which is a moving image or a still image. However, the image superimposed on the captured image (or superimposed on the transparent image) by the image superimposing unit 101c is an example of a 3D image using the AR technique, and may be a general moving image or a still image.

[Example of image for card recognition]
FIG. 13 shows an example of an image printed on each card.
Here, as shown in FIG. 13A, an example of three cards C61, C62, and C63 is shown.
Different characters "c", "a", and "r" are printed in the center of each card, and a background image (pattern) peculiar to each card is printed around them.

By recognizing this background image (pattern), the image recognition unit 101a shown in FIG. 5 recognizes the type of each card, that is, which character is printed. The orientation of the card can also be determined from the background image (pattern). FIG. 13A shows a state in which the two characters “c” and “a” are recognized and the stereoscopic images P61 and P62 of the respective characters are displayed. Although not shown, a stereoscopic image of similar characters is displayed for the card C63 when the determination is completed.

In the case of the card arrangement shown in FIG. 13A, the correct answer image (automobile) P64 shown in FIG. 13C is superimposed and displayed on the captured image after the transition image P62 shown in FIG. 13B is displayed as in the example described in FIG. ..
As shown in FIG. 13D, when the three cards C61, C62, and C63 are not in the correct arrangement (here, the arrangement of "a", "c", and "r"), the characters on each card Only the stereoscopic images P71, P72, and P73 of the above are displayed, and the display of the correct answer image after that does not change.

As described above, by executing the AR card game on the information processing terminal 100 or 100'of this example, it is possible to effectively learn words (words) and calculations. That is, the learner who executes the card game simply rearranges the cards and captures the result with the camera 107 of the information processing terminal 100 or 100', and the correct answer image is automatically displayed on the screen and the word You will be able to easily perform learning and calculation learning by yourself.

[Example of registering images, characters, and sounds]
In the explanation so far, the correct image and the sound are prepared in advance as the program of the AR card game. On the other hand, the user (such as the guardian of the learner) may register the correct image or the like.
FIG. 14 shows an example of a screen at the time of processing for registration by the user.
First, as shown in FIG. 14A, the display unit 105 of the information processing terminal 100 displays a selection screen for an image (photograph) to be registered. Here, the selection button 301 of "shooting with a camera" and the selection button 302 of "select from a folder" are displayed, and the user selects one of them.

When the user selects the "shoot with camera" selection button 301, the image shot by the camera 107 is captured.
When the user selects the "select from folders" selection button 302, any image can be selected from the folder stored in the information processing terminal 100 or the folder prepared in the card game server 200. After selecting the image, move on to the character (word) input process.

FIG. 14B shows an example of a screen for inputting characters (words).
Here, the display unit 105 of the information processing terminal 100 displays the display area 303 of the selected image and the character input area 304. The image selected on the selection screen of FIG. 14A is displayed in the display area 303 of the selected image. The image displayed in the display area 303 of the selected image is registered as a correct image.
In the character input area 304, a word (word) associated with the correct image is input by a user operation. In the example of FIG. 14B, a state in which "car" is input is shown.
By registering the character string of "car" in this way, when the characters written on the three cards are lined up with "car", the image displayed in the display area 303 is superimposed and displayed as the correct answer image. ..
After inputting characters (words), the process moves to sound registration.

FIG. 14C shows an example of a screen for registering a sound.
Here, the display unit 105 of the information processing terminal 100 displays the selection button 305 for "recording" the sound to be registered.

When the user selects the "record" selection button 305, the sound captured by the voice input / output unit 106 is recorded and stored in the storage unit 104.
The sound recorded in this way is output as a sound effect when the correct image is displayed.

In this way, since the user can register arbitrary images, character strings, and sounds, the content that the user can freely learn in the AR card game can be customized, and various levels of learning become possible.
The contents registered in the processing on the screen shown in FIG. 14 are stored in the storage unit 104 of the information processing terminal 100 and used when the AR card game is executed on the information processing terminal 100. For example, FIG. The card game server 200 shown in 3 may hold the registered contents. The registered contents held by the card game server 200 are used not only when the user who performed the registration work is executed on the information processing terminal 100, but also when another user is executed on the information processing terminal 100. You may.

[Modification example]
The card execution screen described with reference to FIG. 7 or the like shows a suitable example, and may be displayed in other forms.
Further, in each execution screen, a display example is used on the tablet-type information processing terminal 100, but in the case of the glasses-type (AR glasses or smart glasses) information processing terminal 100', the camera image is not displayed and is actually The correct image or the like may be superimposed in a state where the card can be seen through.

Further, the card game of the present invention may be executed on various information processing terminals other than the tablet-type information processing terminal 100 and the glasses-type information processing terminal 100'. In this case, the program (software) constituting the card game of this example may be prepared and implemented on an existing tablet, smartphone, or terminal dedicated to the game.

Further, as a process of recognizing the type of the card from the image, as shown in FIG. 13, the background image (pattern) of each card is recognized from the image taken by the camera 107, but other processes are used. You may recognize the type and arrangement of cards. For example, the characters written on the surface of each card may be directly recognized from the captured image. The arrangement status (orientation) of the cards can also be determined from the recognized characters.
Alternatively, a special code for recognizing the type of card (QR code (registered trademark), barcode, etc.) may be printed on the surface of the card.

100, 100'... Information processing terminal, 101 ... CPU, 101a ... Image recognition unit, 101b ... Judgment unit, 101c ... Image superimposition unit, 104 ... Storage unit, 105 ... Display unit, 106 ... Voice input / output unit, 107 ... Camera

Claims (3)

Characters and a plurality of cards or the numbers and symbols have been described,
A card learning system consisting of a terminal equipped with a camera and a display unit.
The terminal
A storage unit that stores an image showing a word by an array of letters or an image showing a calculation formula by an array of numbers and symbols together with a correct answer image showing the meaning of each word or the calculation formula .
An image recognition unit that recognizes each type of a plurality of the cards taken by the camera based on the images taken by the camera of the plurality of cards on which characters , numbers and symbols are written.
A determination unit that determines whether the arrangement of characters or the arrangement of numbers and symbols on the plurality of cards recognized by the image recognition unit matches the words or calculation formulas stored in the storage unit.
An image superimposing unit that superimposes an image stored in the storage unit on a captured image taken by the camera by the camera is provided.
When the image recognition unit recognizes the card from the captured image, the captured image captured by the camera is an image showing the characters written on the card recognized by the image recognition unit , or numbers and symbols. When the determination unit determines the match after superimposing the image indicating the above on the display unit, the correct answer indicating the meaning of the word or the calculation formula on the photographed image taken by the camera. A card learning system that replaces the display of the display unit with the display of an image on which images are superimposed. The card learning system according to claim 1, wherein the replacement of the captured image obtained by the camera with the correct image superimposed on the captured image is performed after passing through the display of the transition screen. It is a card learning method performed by a plurality of cards on which letters , numbers and symbols are written, and a terminal provided with a camera and a display unit.
A recognition process in which the image recognition unit of the terminal recognizes each type of the plurality of captured cards from the captured images taken by the camera of a plurality of cards on which characters , numbers and symbols are described.
The determination unit of the terminal determines whether the arrangement of characters or the arrangement of numbers and symbols on the plurality of cards recognized by the image recognition unit matches a specific word or calculation formula stored in the storage unit. Judgment processing and
When the image recognition unit recognizes the card from the captured image in the recognition process, an image showing the characters written on the card recognized by the image recognition unit in the captured image captured by the camera. , or after displaying on the display unit superimposes an image indicating the numbers and symbols, in the case where the judgment unit in the determination process determines the match, the photographic image which the camera captured the card, said word Alternatively, a card learning method including a display process that replaces the display of the display unit with the display of an image on which the correct answer image means by the calculation formula is superimposed.