TWI789283B - Inputting system for children assisted teaching and teaching order inputting device thereof - Google Patents

Abstract

A teaching order inputting device includes a main body, a camera module, an image recognition module, an order processing module and a transmission module. The main body includes a base, a supporting bar and an inclined plate. The inclined plate is located above the base, and two opposite ends of the supporting bar are respectively connected to the base and the inclined plate. The camera module is located on the inclined plate. When the base is connected to the teaching pad, the camera module shoots the teaching pad to capture an object image which includes an image content. The image recognition module signal is electrically connected to the camera module to receive the object image and determine whether one of the plurality of buttons is triggered according to the image content. The order processing module is electrically connected to the image recognition module.

Description

Children's auxiliary teaching system and its teaching instruction input device

The invention relates to a children's auxiliary teaching system and its teaching instruction input device, in particular to a children's auxiliary teaching system and its teaching instruction input device which are convenient for children to operate.

In modern society, parents will use modern audio-visual interactive teaching equipment and cooperate with teaching assistant programs to educate children. General audio-visual interactive teaching equipment such as laptops or tablet computers, which can be used with keyboards, mice, external network cameras or built-in cameras to input text or video data, and the laptop or tablet computer that receives the data Start the teaching assistant program to play the corresponding audio-visual content for children to watch and learn.

However, it is often difficult for young children to operate the keyboard and mouse smoothly, so an adult is still needed to help operate the keyboard and mouse. In addition, for young children, when using an external webcam or the built-in camera of a laptop to take pictures of objects, it is necessary to hold the object steadily and place it in front of the lens. At this time, the front of the object will be facing away from the child , so it is difficult to know whether the front of the item is skewed or beyond the shooting range of the lens.

Therefore, it is necessary to provide an audio-visual interactive teaching device that is convenient for children to operate, so as to solve the above-mentioned problems.

The main purpose of the present invention is to provide a teaching instruction input device which is convenient for children to operate.

In order to achieve the above-mentioned purpose, a teaching instruction input device of the present invention can form a children's auxiliary teaching system with a teaching mat and a teaching module. The teaching pad includes plural buttons. The teaching instruction input device includes a main body, a camera module, an image recognition module, an instruction processing module and a transmission module. The main body includes a base, a support rod and an inclined plate. The base is detachably connected to the teaching mat, the inclined plate is located above the base, and the opposite ends of the support rod are respectively connected to the base and the inclined plate. The camera module is arranged on the inclined plate. When the base is connected with the teaching mat, the camera module photographs the teaching mat to obtain an object image, wherein the object image includes an image content. The image recognition module signal is connected to the camera module to receive the object image and judge whether one of the plurality of buttons is triggered according to the image content. The signal of the command processing module is connected to the image recognition module. When one of the plurality of buttons is touched, the command processing module generates a specific teaching mode command according to the touched button. The transmission module transmits specific teaching mode commands to the teaching module.

According to an embodiment of the present invention, the inclined plate has an inclination angle relative to a horizontal plane, and the inclination angle ranges from 35 degrees to 40 degrees.

According to an embodiment of the present invention, the inclination angle is 37 degrees.

According to an embodiment of the present invention, a vertical distance between the camera module and the teaching mat ranges from 16 to 20 centimeters.

According to an embodiment of the present invention, the vertical distance is 18.5 cm.

According to an embodiment of the present invention, the image content includes a teaching mat and an object. When the object is a human hand, the image recognition module determines whether one of the plurality of buttons is triggered by calculating the relative position between the human hand and the teaching mat in the image content.

According to an embodiment of the present invention, the objects include palms, fingers or learning objects.

According to an embodiment of the present invention, the image recognition module is a single type of neural network model or a combination of multiple types of neural network models, the image recognition module further includes an image correction module, and the image correction module uses the space transformation matrix Correct the image.

Another main purpose of the present invention is to provide a children's auxiliary teaching system which is convenient for children to operate.

In order to achieve the above-mentioned purpose, an auxiliary teaching system for children of the present invention includes a teaching mat, the teaching instruction input device as mentioned above and a teaching module. The teaching pad includes plural buttons. The teaching module signal is connected to the teaching command input device to receive a specific teaching mode command, and activates a corresponding teaching mode from the plurality of teaching modes according to the specific teaching mode command.

According to an embodiment of the present invention, the teaching mat further includes a place where the main body is placed, and the base is located at the place where the main body is placed.

According to an embodiment of the present invention, the teaching mat further includes a first placement place for learning items, and the first placement place for learning items is used for placing learning items.

According to an embodiment of the present invention, the teaching mat further includes a second place for learning items, and the second place for learning items is located in the first place for learning items.

According to an embodiment of the present invention, the plural teaching modes include a book reading mode, a card teaching mode and a writing viewing mode.

According to an embodiment of the present invention, when the teaching module activates the book reading mode from the multiple teaching modes, an external computer loaded into the teaching module will play the corresponding audio-visual file.

According to an embodiment of the present invention, when the teaching module activates the card teaching mode from the plurality of teaching modes, an external computer loaded into the teaching module will play the corresponding audio-visual files.

According to an embodiment of the present invention, when the teaching module starts the writing viewing mode from the multiple teaching mode, a screen of an external computer loaded with the teaching module will display a sign symbol to indicate that the handwriting is neat Text.

In order to better understand the technical content of the present invention, preferred specific embodiments are given as follows.

Please refer to FIG. 1 to FIG. 14 together below regarding the children's auxiliary teaching system and its teaching instruction input device according to an embodiment of the present invention. Fig. 1 is a system architecture diagram of a children's auxiliary teaching system according to an embodiment of the present invention; Fig. 2 is a schematic diagram of a children's auxiliary teaching system according to an embodiment of the present invention; Fig. 3 is a schematic diagram of a teaching mat according to an embodiment of the present invention Fig. 4 is a schematic diagram of the main body, camera module, image recognition module, command processing module, transmission module and memory of one embodiment of the present invention; Fig. 5 is a teaching mat and the main body of one embodiment of the present invention , the side view of the camera module; Fig. 6 is the original image taken by the camera module of one embodiment of the present invention; Fig. 7 is the corrected image of the image correction module of one embodiment of the present invention; Fig. 8 It is the cropped image of the corrected image in the image recognition module in one embodiment of the present invention; FIG. 9 is the child-assisted teaching system in one embodiment of the present invention and the learning materials placed in the first placement place of the learning items The schematic diagram of article; Fig. 10 is the schematic diagram of the children's auxiliary teaching system of one embodiment of the present invention and the learning article placed in the second place of learning articles; Fig. 11 is the children's auxiliary teaching system of one embodiment of the present invention and placed A schematic diagram of another learning item at the first place where the learning item is placed; FIG. 12 is a schematic diagram of a learning item and marking symbols displayed on a screen according to an embodiment of the present invention; FIG. 13 is a child auxiliary teaching input method according to an embodiment of the present invention Figure 14 is a flow chart of the steps of another part of the children's auxiliary teaching input method of an embodiment of the present invention.

As shown in FIG. 1, FIG. 2, FIG. 4, and FIG. 9 to FIG. 11, a children's auxiliary teaching system 900 and its teaching instruction input device 1 according to an embodiment of the present invention are convenient for children to operate to input object image data. The children's auxiliary teaching system 900 includes a teaching mat 10 , a teaching instruction input device 1 and a teaching module 230 .

The teaching module 230 is a software program or chip with a teaching function, and has multiple teaching modes built in. The multiple teaching modes include a book reading mode, a card teaching mode and a writing viewing mode. The teaching module 230 is signal-connected to the teaching instruction input device 1 to receive the instruction sent by the teaching instruction input device 1, and start a corresponding teaching mode from the plurality of teaching modes according to the instruction; the teaching module 230 can be loaded into the teaching instruction input device 1 signal connected to the external computer 200, and the external computer 200 executes the teaching steps of the teaching mode of the teaching module 230. The external computer 200 is such as a notebook computer, which includes a screen 210 and a speaker 220 . The screen 210 and the speaker 220 are used to play images and sounds for users to watch and listen to. The teaching module 230 is connected to the screen 210 and the speaker 220 with signals.

As shown in Figure 3, the teaching mat 10 is a mat made of soft plastic, cloth or paper, which includes a main body placement place 11, a first placement place 12 of a learning article, a second placement place 13 of a learning article and plural Buttons 14, 14a, 14b, 14c. The main body placement place 11 is a semicircular icon drawn on the edge (marked as a dotted area in FIG. 3 ), which is used to mark the position where the main body 20 is placed. The first place 12 for learning items is an approximately rectangular diagram (indicated by a diagonal line in FIG. 3 ), which is used to mark the position where relatively large learning items 100, 100b are placed. The second learning item storage place 13 is an approximately rectangular icon, located in the first learning item storage area 12, and used to mark the location for placing the smaller learning item 100a. Multiple buttons 14, 14a, 14b, 14c are circular icons drawn on the mat, which draw different patterns according to the functions to be enabled; buttons 14, 14a, 14b, 14c, 14d, 14e, 14f, 14g are and teaching Buttons related to functions, for example, button 14 is a reading function, button 14a is a card function, button 14b is a game function, and button 14c is a writing function. The actual application of the above-mentioned buttons related to the teaching function will be described in detail later. In addition, buttons 14d, 14e, 14f, and 14g are buttons related to operation functions. For example, button 14d is a function of returning to the home page, button 14e is a function of reducing volume, button 14f is a function of increasing volume, and button 14g is an event trigger function. Different needs trigger different events (for example: start button, confirm button, cancel button, next question in the game, prompt button, etc.). The actual application of the buttons related to the above operation functions will be described in detail later.

As shown in FIGS. 4 and 5 , the main body 20 includes a base 21 , a support rod 22 and an inclined plate 23 . The base 21 is detachably connected with the teaching mat 10 . The image recognition module 40 , the instruction processing module 50 , the transmission module 70 and the memory 80 are arranged on the base 21 . The inclined plate 23 is located above the base 21 , and opposite ends of the supporting rod 22 are respectively connected to the base 21 and the inclined plate 23 . The camera module 30 is disposed on the inclined board 23 and faces the teaching mat 10 . The inclined plate 23 has an inclination A relative to the horizontal plane, and the inclination A is 37 degrees, but the angle of the inclination A is not limited thereto, and the angle of the inclination A can be changed to any value ranging from 35 to 40 degrees.

The camera module 30 is a lens, which is located above the teaching mat 10 . When the base 21 is connected to the teaching mat 10, the camera module 30 photographs the teaching mat 10 to obtain an object image, wherein the object image includes an image content. The image content includes the teaching mat 10 and an object. Items include palms, fingers or learning items 100, 100a, 100b. Learning items 100, 100a, 100b are eg books, cards and paper.

A vertical distance H between the camera module 30 and the teaching mat 10 is 18.5 centimeters, but the length of the vertical distance H is not limited to this, and the length of the vertical distance H can be changed to any value ranging from 16 to 20 centimeters . Since the camera module 30 is located obliquely above the teaching mat 10 and placed obliquely to photograph the teaching mat 10, when the child operates the teaching mat 10 with his hand, the hand will not bump into the camera module 30 and affect the shooting.

As shown in FIGS. 9 to 11, the image recognition module 40 is a chip or software with an object detection engine function. The object detection engine has pre-input images of the teaching mat 10 and its components, and the learning objects 100, 100a, 100b Therefore, the image recognition module 40 can receive the object image and identify whether the object is used (for example, determine whether one of the plurality of buttons is triggered) and identify the content of the object according to the content of the image. For example, when the object is a human hand, the image recognition module 40 will detect the palm range in the image content through the hand model, and if the palm stays for more than a specific time (for example, 1 second), the image recognition module 40 will After image processing in the palm area, by calculating the position between the finger joints of the human hand and the teaching mat 10 in the image content, it can be known whether the hand and finger joints touch the teaching mat 10 . To identify whether the buttons 14, 14a, 14b, 14c on the teaching mat 10 are used, since the relative position of the camera module 30 and the teaching mat 10 is fixed, the relative positions of the buttons 14, 14a, 14b, 14c in the image content It is also fixed, so the image recognition module 40 can judge whether one of the plurality of buttons is triggered through the position of the finger joints of the human hand and the relative positions between the buttons 14, 14a, 14b, 14c; The identification module 40 can judge whether any button 14, 14a, 14b, 14c is touched from the image content of the teaching mat 10, and can also identify the learning items 100, 100a, A specific content of 100b.

The image recognition module 40 can be pre-loaded with different types of neural network models that can identify objects. This type of neural network model may be single or multiple, connected in series or in parallel. This type of neural network model can identify The characteristics and positions of objects in the image. The image recognition module 40 includes an image correction module 41. The image correction module 41 is a chip or software with image correction function, and corrects the image through the space transformation matrix. Since the camera module 30 is located obliquely above the teaching mat 10 and placed obliquely to shoot the teaching mat 10, the original image taken by the camera module 30 is oblique (as shown in Figure 6); therefore, the image correction module 41 will first calculate the space conversion Then, the image recognition module 40 will determine whether to crop according to the size of the object, and if cropping is required, the image corrected by the image correction module 41 will be cropped (as shown in FIG. 8) to increase the image area occupied by the object in the overall image, so that the content and effective features of the object on the teaching mat 10 can be presented more clearly.

The instruction processing module 50 is a chip or software with the function of generating teaching mode data, and is connected to the image recognition module 40 by signal. The instruction processing module 50 is used to generate a specific teaching mode according to the touched button 14, 14a, 14b, 14c when the image recognition module 40 judges that one of the buttons 14, 14a, 14b, 14c is touched. instruction.

As shown in FIG. 2 , FIG. 4 , and FIG. 9 to FIG. 11 , in this embodiment, the transmission module 70 is a USB interface, which is connected to an external computer 200 through a USB transmission cable. The transmission module 70 is used to obtain power from the external computer 200, and is used to transmit a specific teaching mode command to the teaching module 230 of the external computer 200, so that the teaching module 230 of the external computer 200 can learn from multiple teaching modes according to the specific teaching mode command. Mode starts a corresponding teaching mode, which is further used to transmit the specific content of the learning item 100, 100a, 100b to the external computer 200, so that the external computer 200 plays the corresponding learning item 100 according to the specific content of the learning item 100, 100a, 100b , 100a, 100b files. The multiple teaching modes include a book reading mode, a card teaching mode and a writing viewing mode. The memory 80 is used to store software and data required for implementing the input method for children's auxiliary teaching.

As shown in FIG. 1 and FIG. 13 , the children's auxiliary teaching input method is programmed as software and stored in the memory 80 and the external computer 200 . When children intend to use the children's auxiliary teaching system 1 to carry out interactive learning with learning items, the children's auxiliary teaching system 1 uses the step 101 of the children's auxiliary teaching input method: using the camera module to capture images.

The camera module 30 will continue to shoot images, which include the original images of the teaching mat 10 and any objects on the teaching mat 10 . The camera module 30 sends the captured images to the image correction module 41 .

Then, the children's auxiliary teaching system 1 will execute the step 102 of the children's auxiliary teaching input method: using the image correction module to correct the image.

After the image correction module 41 receives the image taken by the camera module 30, it will correct the image so that the oblique image will be straightened, and the image area occupied by the teaching mat 10 in the overall image will be increased. The content and valid features of the objects on the teaching mat 10 must be presented.

Next, the children's auxiliary teaching system 1 will execute step 103 of the children's auxiliary teaching input method: determine whether the teaching mode is activated.

The command processing module 50 will determine whether a specific teaching mode command has been generated and sent to the external computer 200 . If not, the children's auxiliary teaching system 1 will execute step 104 of the children's auxiliary teaching input method: use the image recognition module to determine whether one of the buttons is touched from the corrected object image.

After the image is calibrated, the image recognition module 40 will identify the content of the image according to the calibrated object image, for example, identify whether each button is touched by a hand, so that one of the buttons can be judged from the object image of the teaching mat 10 Whether it is touched, and the image recognition module 40 will send the data of the touched button to the command processing module 50 . If none of the buttons is touched, the child-assisted teaching input method returns to step 101 . If one of the buttons is touched, the child-assisted teaching system 1 will execute step 105 of the child-assisted teaching input method: generate a specific teaching mode command according to the touched one of the buttons through the command processing module.

After the instruction processing module 50 receives the image content of the touched button from the image recognition module 40, the instruction processing module 50 will generate a specific teaching mode instruction according to the image content of the touched button and send it to the transmission module. Group 70. If the button 14 is touched, the command processing module 50 will generate a specific teaching mode command for the reading function; if the button 14a is touched, the command processing module 50 will generate a specific teaching mode command for the card function; If the button 14b is pressed, the command processing module 50 will generate a specific teaching mode command for the game function; if the button 14c is touched, the command processing module 50 will generate a specific teaching mode command for the writing function.

Then, the children's auxiliary teaching system 1 will execute the step 106 of the children's auxiliary teaching input method: through the transmission module, the specific teaching mode instruction is sent to the teaching module, so that the teaching module can select from the plurality of teaching modes according to the specific teaching mode instruction. Start the corresponding teaching mode.

The transmission module 70 will send the received instruction of the specific teaching mode to the teaching module 230 of the external computer 200 . The teaching module 230 of the external computer 200 will start a corresponding teaching mode from the plurality of teaching modes according to the specific teaching mode instruction received; The group 230 will start the book reading mode; if the specific teaching mode instruction of the card function is received, the teaching module 230 of the external computer 200 will start the card teaching mode; if the specific teaching mode instruction of the game function is received, the external computer 200 The teaching module 230 of the external computer 200 will start the teaching mode of the game; if a specific teaching mode command of the writing function is received, the teaching module 230 of the external computer 200 will start the writing viewing mode.

At this time, children can put the learning items to be used on the teaching mat 10 according to the teaching mode they want to carry out; The learning item 100 is placed on the first placement place 12 of the learning item; as shown in Figure 3 and Figure 10, if the child wants to carry out the teaching mode of the card, the learning item 100a of the card can be placed on the second placement place 13 of the learning item; As shown in Fig. 3 and Fig. 11, if the child wants to write a teaching mode, the learning item 100b of the written paper can be placed on the first placement place 12 of the learning item. At the same time, the children's auxiliary teaching system 1 will return to the steps 101 to 102 of the children's auxiliary teaching input method, and let the camera module 30 take pictures of the learning objects on the teaching mat 10 and correct the images. Next, the children's auxiliary teaching system 1 will execute step 103 of the children's auxiliary teaching input method: determine whether the teaching mode is activated. Since the child-assistive teaching system 1 has previously activated the teaching mode in step 106, as shown in FIG. In the image, determine whether one of the buttons is touched.

The image recognition module 40 will recognize the content of the image according to the corrected object image, for example, identify whether each button is touched by hand. In this way, it can be judged from the object image of the teaching mat 10 whether one of the buttons is touched, and The image recognition module 40 transmits the data of the touched button to the command processing module 50 . If no button is touched, it will jump to step 110. If one of the buttons is touched, the children's assisted teaching system 1 will execute step 108 of the child assisted teaching input method: through the command processing module, a specific command is generated according to the touched one of the buttons.

The command processing module 50 will generate a specific command according to the touched button; for example, if the button 14d is touched, the command processing module 50 will generate a specific command to return to the home page; if the button 14e is touched, then The command processing module 50 will generate a specific command to lower the volume; if the button 14f is touched, the command processing module 50 will generate a specific command to increase the volume; if the button 14g is touched, the command processing module 50 will generate an event-triggered specific instructions.

Next, the child-assisted teaching system 1 will execute step 109 of the child-assisted teaching input method: through the transmission module, send a specific instruction to the teaching module, so that the teaching module can trigger volume adjustment, event trigger or return to the teaching module according to the specific instruction. front page.

The transmission module 70 will send the received specific instruction to the teaching module 230 of the external computer 200 . The teaching module 230 of the external computer 200 will perform corresponding actions according to the specific instructions received, such as allowing the external computer 200 to return to the homepage, making the speaker 220 lower the volume, making the speaker 220 increase the volume, or letting the event of the external computer 200 trigger a specific action. instruction.

Next, the children's auxiliary teaching system 1 executes the step 110 of the children's auxiliary teaching input method: using the teaching module to determine whether to crop and correct the image.

The image corrected by the image correction module 41 will be sent to the teaching module 230, and the teaching module 230 will judge whether to crop and correct the image according to the proportion of the teaching mat 10 in the corrected image. If there is no need to trim and correct the image, it will skip to step 112 . If the corrected image needs to be cropped, the child assisted teaching system 1 will execute step 111 of the child assisted teaching input method: use the image recognition module to crop the image corrected by the image correction module.

The image recognition module 40 will enlarge and crop the image corrected by the image correction module 41 to further increase the image area occupied by the teaching mat 10 and the learning items in the overall image, so as to more clearly present the content of the teaching mat 10 and the learning items and valid features.

Next, the children's auxiliary teaching system 1 will execute the step 112 of the children's auxiliary teaching input method: using the image recognition module to identify the characteristics and positions of the learning items from the object images of the learning items.

After the object image of the learning item is corrected, enlarged and cropped, the image recognition module 40 will identify the feature and position of the learning item and send it to the transmission module 70 . As shown in FIG. 9 , if the child places a book learning item 100 on the teaching mat 10, the image recognition module 40 will recognize the cover of the book learning item 100 or the text, page number or illustration on the inner page of the book, And judge that the type of learning item 100 is a book and its placement position; as shown in Figure 10, if the child puts the learning item 100a of the card on the teaching mat 10, the image recognition module 40 will recognize the learning item 100a of the card text or illustrations, and determine the type of learning item 100a is a card and its placement; The text on the learning item 100b of the written paper can be recognized, and the type of the learning item 100b is judged to be the written paper and its placement position.

Finally, the children's auxiliary teaching system 1 will execute the step 113 of the children's auxiliary teaching input method: transmit the type and location of the learning items to the external computer through the transmission module, so that the external computer can play the corresponding learning content according to the type and location of the learning items. The file of the item.

After the transmission module 70 receives the types and locations of the learning items, it will transmit them to the external computer 200 . The external computer 200 will play the file corresponding to the learning item according to the type and location of the received learning item. As shown in FIG. 9, if the external computer 200 receives the cover of the learning item 100 of the book or the text, page number or illustration on the inner page of the book, the external computer 200 will execute the book reading mode and play it through the screen 210 and the speaker 220. Corresponding to the audio-visual file of the book. As shown in FIG. 10 , if the external computer 200 receives the text or illustrations of the card learning item 100a, the external computer 200 will execute the card teaching mode, and play the audio-visual file corresponding to the card through the screen 210 and the speaker 220 . As shown in Figure 11, if the external computer 200 receives the text on the learning item 100b written on the paper, the external computer 200 will execute the writing viewing mode, play the written paper through the screen 210, and write on the neatly written text A circular marking symbol 211 is displayed so that children can know whether their handwriting is neat or not.

It should be noted that the content of the teaching mode and the files played by the external computer 200 of the present invention are not limited to the above. or illustrations, then the external computer 200 will execute the book reading mode for teaching. The external computer 200 can be designed to connect to the teaching webpage of the textbook, and then play the audio-visual files corresponding to the textbook on the webpage through the screen 210 and the speaker 220 . In addition, the button 14b of the teaching mat 10 can also provide a game function, which can be designed to allow the external computer 200 to execute software suitable for children to play.

With the aided teaching system 900 for children and the input method for aided teaching for children of the present invention, it is convenient for children to input image data of learning objects into an external computer with their fingers, without using a mouse and keyboard which are difficult to operate. In addition, the present invention can cooperate with different learning items to provide diversified teaching and item interaction methods, so that children can learn easily. The teaching mats of the present invention are clearly marked with places where items are placed, allowing children to place learning items for the camera module to take pictures, thus preventing the learning items from being skewed or out of the shooting range.

It should be noted that the above is only an example, but not limited to the example. For example, what does not depart from the basic structure of the present invention should be the scope of rights claimed by this patent, and the scope of patent application should be the criterion.

1: Teaching instruction input device 10:Teaching mat 11: The place where the main body is placed 12: The first placement of learning items 13: The second storage place for learning items 14, 14a, 14b, 14c, 14d, 14e, 14f, 14g: button 20: subject 21: base 22: support rod 23: Inclined board 30: Photography module 40: Image recognition module 41: Image correction module 50: Instruction processing module 70: Transmission module 80: memory 100, 100a, 100b: Learning Items 200: External computer 210: screen 211: Marking symbols 220: Horn 230:Teaching module 900: Children's auxiliary teaching system A: Angle H: vertical distance

Fig. 1 is a system architecture diagram of a children's auxiliary teaching system according to an embodiment of the present invention. Fig. 2 is a schematic diagram of a children's auxiliary teaching system according to an embodiment of the present invention. Fig. 3 is a schematic diagram of a teaching mat according to an embodiment of the present invention. 4 is a schematic diagram of a main body, a camera module, an image recognition module, an instruction processing module, a transmission module and a memory according to an embodiment of the present invention. Fig. 5 is a side view of a teaching mat, a main body, and a camera module according to an embodiment of the present invention. FIG. 6 is an original image captured by the camera module of an embodiment of the present invention. FIG. 7 is an image diagram after correction by the image correction module of an embodiment of the present invention. FIG. 8 is a cropped image of the corrected image in the image recognition module according to an embodiment of the present invention. Fig. 9 is a schematic diagram of a children's auxiliary teaching system and the learning items placed in the first placement place of the learning items according to an embodiment of the present invention. Fig. 10 is a schematic diagram of a children's auxiliary teaching system according to an embodiment of the present invention and the learning items placed in the second placement place of the learning items. Fig. 11 is a schematic diagram of a children's auxiliary teaching system and another learning item placed in the first placement place of the learning item according to an embodiment of the present invention. Fig. 12 is a schematic diagram of learning items and marking symbols displayed on a screen according to an embodiment of the present invention. Fig. 13 is a flow chart of the steps of the input method for children's auxiliary teaching according to an embodiment of the present invention. Fig. 14 is a flow chart of steps of another part of the input method for children's auxiliary teaching according to an embodiment of the present invention.

1: Teaching instruction input device

30: Photography module

40: Image recognition module

41: Image correction module

50: Instruction processing module

70: Transmission module

80: memory

200: External computer

210: screen

220: Horn

230:Teaching module

900: Children's auxiliary teaching system

Claims (16)

A teaching instruction input device, which can form a children's auxiliary teaching system with a teaching mat and a teaching module, the teaching mat includes a plurality of buttons, and the teaching instruction input device includes: A main body including a base, a support rod and an inclined plate, wherein the base is detachably connected to the teaching mat, the inclined plate is located above the base, and the opposite ends of the support rod are respectively connected to the base and the inclined plate; A camera module is installed on the inclined plate. When the base is connected to the teaching mat, the camera module shoots the teaching mat to obtain an object image, wherein the object image includes an image content; An image recognition module, signal connected to the camera module to receive the image of the object and judge whether one of the plurality of buttons is triggered according to the content of the image; A command processing module, the signal is connected to the image recognition module, when one of the plurality of buttons is touched, the command processing module generates a specific teaching mode command according to the touched button; and A transmission module is used to transmit the instruction of the specific teaching mode to the teaching module. The teaching instruction input device according to claim 1, wherein the inclined plate has an inclination angle relative to a horizontal plane, and the inclination angle ranges from 35 degrees to 40 degrees. The teaching instruction input device as described in claim 2, wherein the inclination angle is 37 degrees. The teaching instruction input device according to claim 1, wherein a vertical distance between the camera module and the teaching mat is in the range of 16 to 20 centimeters. The teaching instruction input device as described in Claim 4, wherein the vertical distance is 18.5 cm. The teaching instruction input device as described in claim 1, wherein the image content includes the teaching mat and an object, and when the object is a human hand, the image recognition module calculates the human hand in the image content The relative position between the part and the teaching pad is used to judge whether one of the plurality of buttons is triggered. The teaching instruction input device according to Claim 6, wherein the object includes a palm, a finger or a learning object. The teaching instruction input device as described in claim item 7, wherein the image recognition module is a combination of a single neural network model or a plurality of neural network models, and the image recognition module further includes an image correction module, the image The correction module corrects the image through the space transformation matrix. A children's auxiliary teaching system, comprising: a teaching mat including plural buttons; A teaching instruction input device as described in any one of claim 1 to claim 8; and A teaching module is signal-connected to the teaching command input device to receive the specific teaching mode command, and activates a corresponding teaching mode from the plurality of teaching modes according to the specific teaching mode command. The child auxiliary teaching input system as described in Claim 9, wherein the teaching mat further includes a main body placement place, and the base is located at the main body placement place. The children's auxiliary teaching input system as described in Claim 9, wherein the teaching mat further includes a first placement place for learning items, and the first placement place for learning items is used for placing the learning items. The input system for children's auxiliary teaching as described in Claim 9, wherein the teaching mat further includes a second place for learning items, and the second place for learning items is located in the first place for learning items. The child auxiliary teaching input system as described in Claim 9, wherein the plural teaching modes include a book reading mode, a card teaching mode and a writing viewing mode. The child auxiliary teaching input system as described in claim 13, wherein when the teaching module starts the book reading mode from the plurality of teaching modes, an external computer loaded into the teaching module will play the corresponding audio-visual file . The child auxiliary teaching input system as described in claim 13, wherein when the teaching module starts the card teaching mode from the plurality of teaching modes, an external computer loaded into the teaching module will play the corresponding audio-visual files. The child auxiliary teaching input system as described in claim 13, wherein when the teaching module starts the writing viewing mode from the plural teaching mode, a screen of an external computer loaded with the teaching module will display a sign Symbols to mark neatly written text.

Images