WO2022166039A1

WO2022166039A1 - Magnetic card-based chinese character combination interactive learning system and method

Info

Publication number: WO2022166039A1
Application number: PCT/CN2021/096215
Authority: WO
Inventors: 贺旭东
Original assignee: 杭州高低科技有限公司
Priority date: 2021-02-08
Filing date: 2021-05-27
Publication date: 2022-08-11
Also published as: CN113160623A

Abstract

A magnetic card-based Chinese character combination interactive learning system and method. The system comprises: a Chinese character card library and an interactive learning device. The Chinese character card library comprises a plurality of Chinese character magnetic cards (5); the Chinese character magnetic cards (5) are used for bearing patterns of Chinese character components; magnetic attraction strips (6) are arranged at edges of each Chinese character magnetic card (5), and any two Chinese character magnetic cards (5) are attracted and combined by means of the magnetic attraction strips (6); a Chinese character recognition terminal is provided on the interactive learning device; the Chinese character recognition terminal comprises an image acquisition device and a central processing unit; the image acquisition device is used for acquiring a Chinese character image obtained after the Chinese character magnetic cards (5) are attracted and combined; the central processing unit is used for recognizing a Chinese character in the acquired Chinese character image, and the central processing unit is further connected to a voice module and a screen display module. By combining Chinese character magnetic cards (5) to obtain a Chinese character, teaching is achieved through lively activities, children can freely and conveniently combine Chinese characters, the interactive learning device recognizes the Chinese characters for mutual assistance teaching, and the fun and effect of Chinese character learning are enhanced.

Description

An interactive learning system and method for Chinese character construction based on magnetic cards

technical field

The invention relates to the technical field of Chinese character learning electronic equipment, in particular to a magnetic card-based interactive learning system and method for building Chinese characters.

Background technique

With the rapid development of informatization, there are more and more occasions for people to input Chinese characters by tapping on the keyboard, and it is more and more convenient. combined product. In daily work and life, we use the keyboard to input pinyin to write, and the opportunity to write Chinese characters is decreasing. It is not alarmist that Chinese characters face a crisis.

For beginners of Chinese characters, simply learning from the pronunciation, spelling and interpretation cannot achieve the effect of learning Chinese characters well. Chinese characters are difficult characters to learn, mainly because they have many changes. The pronunciation of a Chinese character may be different in different contexts. Many units of Chinese characters will become many different Chinese characters due to different combinations. The shape is also very similar, and it will be confusing to use if you are not careful. Therefore, compared with other languages, the learning of Chinese characters is relatively difficult, and the learning process is extremely difficult. Therefore, many beginners are often trapped in this predicament, trying to learn Chinese characters well, but always get twice the result with half the effort. Therefore, a more comprehensive and effective learning method is needed to improve the user's learning efficiency. The patent document "Chinese character learning system based on intelligent building blocks" with the application number of 201911372618.X discloses an intelligent scheme for learning Chinese characters, but the biggest problem of that scheme is the cost problem, because Chinese character learning requires a lot of building blocks, and the main control panel module. If we want to popularize Chinese character education, we must reduce costs and let good teaching aids and teaching methods enter thousands of households. Therefore, how to provide users with more scientific, novel, flexible, interesting, and low-cost learning aids, so that users can master scientific and effective learning methods, has become a problem to be solved.

SUMMARY OF THE INVENTION

The purpose of the present invention is to provide an interactive learning system and method for building Chinese characters based on magnetic cards. The magnetic cards of Chinese characters are used to build Chinese characters, which is entertaining and convenient for children to freely and conveniently combine Chinese characters, and recognize Chinese characters through an interactive learning device. , by calling the corresponding courses to carry out interactive teaching, enhance the fun and effect of children's learning Chinese characters.

For achieving the above object, the present invention provides following scheme:

An interactive learning system for Chinese character construction based on magnetic cards, the system comprises: a Chinese character card library and an interactive learning device, the Chinese character card library includes a plurality of Chinese character magnetic cards, each of the Chinese character magnetic cards is used to carry Chinese character components. The graphics of each of the Chinese character magnetic cards are provided with a magnetic suction strip, and any two of the Chinese character magnetic cards are connected by the magnetic suction strips by pulling together and assembling;

The interactive learning device is provided with a Chinese character recognition terminal, and the Chinese character recognition terminal includes an image acquisition device and a central processing unit, and the image acquisition device is used to collect the Chinese character images formed by the magnetic cards of the Chinese characters. The image acquisition device is connected with the central processing unit, and the central processing unit is used to recognize the Chinese characters in the collected Chinese characters images, and the central processing unit is also connected with a voice module and a screen display module. The voice module and the screen display The module displays the recognized Chinese character information through voice and video respectively.

Further, the central processing unit includes an image processing module and a Chinese character recognition module, the image processing module is connected with the image acquisition device, and is used for preprocessing the collected Chinese character images, and the Chinese character recognition module is connected with the Chinese character recognition module. The image processing module is connected to identify the Chinese characters in the collected Chinese character images, and the voice module and the screen display module are respectively connected with the Chinese character recognition module; the Chinese character recognition module is also connected with a big data module and an intelligent curriculum module, The big data module is connected to the user learning path database, and the intelligent course module is connected to the online course library.

Further, the Chinese character recognition terminal is a mobile phone, the image acquisition device is a camera of the mobile phone, and the central processing unit is a Chinese character learning APP.

Further, the mobile phone is communicated and connected with the TV through a wireless network to realize screen projection.

Further, the interactive learning device also includes a base and a mobile phone bracket arranged on the base, the mobile phone bracket is used to fix the mobile phone, and a magnetic strip connecting the Chinese character magnetic card is arranged on the base, and the mobile phone bracket is adjusted. , so that the camera of the mobile phone is aimed at the Chinese character magnetic card.

Further, the base is also provided with a key control system, and the key control system includes a start key set on the base shell and a rechargeable battery, a power supply module, a main control module and a Bluetooth communication module set inside the base shell. , the rechargeable battery is connected to the power module, the main control module is electrically connected to the start button, the power module, and the Bluetooth communication module, respectively, and the base shell is also provided with a type-C connected to the power module. The main control module is wirelessly connected to the mobile phone through the Bluetooth communication module, and is used to turn on or off the camera of the mobile phone.

Further, the Chinese character magnetic card is a hollow plastic shell, using abs plastic, the four sides of the Chinese character magnetic card are provided with grooves, and the magnetic suction bars are embedded in the grooves.

Further, the Chinese character magnetic card has a double-sided structure, and the front and back sides of the Chinese character magnetic card are provided with graphics of Chinese character components.

The present invention also provides an interactive learning method for building Chinese characters based on magnetic cards, which is applied to the above-mentioned interactive learning system for building Chinese characters based on magnetic cards, including the following steps:

S1, put the mobile phone holder on the special mobile phone holder, run the app on the mobile phone, the app opens the camera, and starts the image processing module;

S2, from the Chinese character card library, take out two or more Chinese character magnetic cards to be assembled and assembled, put them in front of the mobile phone holder, and the assembled Chinese character magnetic cards are adsorbed on the base;

S3, the mobile phone app collects the Chinese character images formed by the magnetic cards of Chinese characters through the camera, and transmits the collected Chinese character images to the image processing module;

S4, the image processing module identifies the topological structure of the Chinese character in the Chinese character image, and transfers the identified topological structure of the Chinese character to the Chinese character recognition module, and the Chinese character recognition module identifies the Chinese character according to the information in the Chinese character topological structure database;

S5, the intelligent course module uses the recognized Chinese characters to retrieve the downloaded courses, and if there is no downloaded course, retrieves the courses corresponding to Chinese characters in the online course library through the network;

S6, according to the mode set by the app, the course is explained by voice through the voice module, or the video is put on the TV through the screen display module to explain the course.

Further, in the step S4, the image processing module identifies the topological structure of Chinese characters in the Chinese character image, which specifically includes:

Through graphic perspective transformation, the collected oblique Chinese character images are turned into top-down pictures;

Perform graphic segmentation, and split the overall picture into cards one by one;

Perform graphic pattern matching, and perform text recognition OCR on each card to turn into single characters and radicals in the Chinese character library to form the topology of Chinese characters.

According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects: the magnetic card-based interactive learning system and method for Chinese character construction provided by the present invention adopts a plurality of Chinese character magnetic cards to carry the components of Chinese characters, uses magnetic attraction The strip can realize the free construction of multiple Chinese character magnetic cards, which is convenient for children to learn and combine Chinese characters independently, and realize the recognition of Chinese characters through the central processing unit, and display them through voice or video; the central processing unit is also provided with intelligent curriculum modules and The big data module can call the courses corresponding to Chinese characters. While recognizing Chinese characters, the children can be further explained through the corresponding courses to realize online and offline interaction. The children's learning data can be directly uploaded to the database to record the children's learning path. Through machine learning, you can understand the child's current ability and intelligently match the most suitable online course for the child; in addition, the interactive learning device uses a mobile phone bracket and a mobile phone, and the use of mobile phones can reduce the cost of learning, without the need for additional electronic learning equipment, mobile phones The bracket can fix the mobile phone and adjust the angle of the camera, which is convenient for users to use.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative labor.

1 is a schematic structural diagram of an interactive learning system for Chinese character construction based on magnetic cards according to an embodiment of the present invention;

2 is a schematic structural diagram of an interactive learning device according to an embodiment of the present invention;

3 is a schematic structural diagram of a Chinese character magnetic card according to an embodiment of the present invention;

Fig. 4 is the working flow chart of the image processing module of the embodiment of the present invention;

5 is a schematic diagram of a Chinese character magnetic card splicing structure of the word "village" according to an embodiment of the present invention;

6 is a schematic diagram of a Chinese character card library according to an embodiment of the present invention;

7 is a schematic structural diagram of a key control system according to an embodiment of the present invention;

Description of the drawings: 1. Base; 2. Mobile phone bracket; 3. Mobile phone; 4. Magnetic stripe; 5. Chinese character magnetic card; 6. Magnetic suction strip;

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In order to make the above objects, features and advantages of the present invention more clearly understood, the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

As shown in FIG. 1, the magnetic card-based interactive learning system for Chinese character construction provided by the present invention includes: a Chinese character card library and an interactive learning device, the Chinese character card library includes a plurality of Chinese character magnetic cards 5, and each of the Chinese character magnetic cards The card 5 is used to carry the graphics of the Chinese character components, and the edge of each of the Chinese character magnetic cards 5 is provided with a magnetic suction strip 6, and any two of the Chinese character magnetic cards are connected through the magnetic suction strips 6 to be assembled and connected; such as As shown in Figure 6, a plurality of Chinese character magnetic cards 5 are arranged in the Chinese character card library, which can form a variety of Chinese characters;

The central processing unit includes an image processing module and a Chinese character recognition module, the image processing module is connected with the image acquisition device, and is used for preprocessing the collected Chinese character images, the Chinese character recognition module and the image processing module. connection, for identifying the Chinese characters in the collected Chinese character images, the phonetic module and the screen display module are respectively connected with the Chinese character recognition module; the Chinese character recognition module is also connected with a big data module and an intelligent curriculum module, the big data The data module is connected to the user learning path database, and the intelligent course module is connected to the online course library.

As shown in Figure 2, the Chinese character recognition terminal is a mobile phone 3, the image acquisition device is a camera of the mobile phone, and the central processing unit is a Chinese character learning APP. The mobile phone 3 is communicated and connected with the TV through a wireless network to realize screen projection. The mobile phone and the TV are connected to the same wireless local area network (wifi), through the screen projection protocol (DLNA protocol), after the mobile phone searches for the TV, the mobile phone sends a video address of the course to the TV, and the TV starts to play after receiving the address. The phone can control the progress of the TV, the volume and other commands.

The interactive learning device further comprises a base 1 and a mobile phone support 2 arranged on the base 1, the mobile phone support 2 is used to fix the mobile phone 3, and the base 2 is provided with a magnetic strip 4 connecting the Chinese character magnetic card 5, Adjust the mobile phone bracket 2 so that the camera of the mobile phone 3 is aligned with the Chinese character magnetic card 5 . The mobile phone holder 2 can be set in a cartoon structure, such as the deer structure in FIG. 2 , which is more convenient for children to accept and like.

As shown in FIG. 7 , the base 1 is also provided with a key control system, the key control system includes a start button 7 arranged on the shell of the base 1 and a rechargeable battery, a power module, The main control module and the bluetooth communication module, the rechargeable battery is connected to the power supply module, the main control module is electrically connected to the start button 7, the power supply module, and the bluetooth communication module, respectively, and the shell of the base 1 is also provided with The type-C port to which the power module is connected, the main control module is connected to the mobile phone 3 through wireless communication through the Bluetooth communication module, and is used to turn on or off the camera of the mobile phone 3 . The power module is responsible for charge and discharge management, charges the rechargeable battery through the USB type-C port, and is responsible for the power supply of the main control module, Bluetooth communication module, etc. The Bluetooth communication module is responsible for Bluetooth communication with the mobile phone, and notifies the mobile phone that the start button is pressed.

The main control module is responsible for controlling the Bluetooth communication module and has two functions:

1. Responsible for Bluetooth pairing with the mobile phone: Find the Bluetooth button on the mobile phone through the app, and realize the pairing.

2. When the start button is pressed, the main control module will notify the Bluetooth communication module, send a message to the mobile phone, notify the mobile app, and start a series of operations such as image recognition, Chinese character recognition, course query, and course playback.

The benefits of this design:

1. The child does not need to operate the mobile phone during the entire programming process, and only needs to press the start button to trigger the mobile app to perform operations. Because: first, the mobile phone has been used as a camera to aim at the programming blocks, and it can no longer be moved, making it inconvenient to operate the mobile phone; second, this product is aimed at young children, and try to avoid children using mobile phones

2. The start button is large and conspicuous, which is convenient for children to operate and has a good experience.

As shown in FIG. 3 , the Chinese character magnetic card 5 is a hollow plastic shell made of abs plastic, the four sides of the Chinese character magnetic card 5 are provided with grooves, and the magnetic suction strips 6 are embedded in the grooves.

The Chinese character magnetic card 5 is a double-sided structure, and the front and back sides of the Chinese character magnetic card 5 are provided with graphics of Chinese character components. Because the evolution of Chinese characters has gone through the stages of oracle bone script, golden script, seal script, clerical script, regular script, cursive script and running script, at present, regular script is generally used for writing, so the front can be the single character and radical of regular script. On the reverse side, the single characters and radicals of the seal script are written. The seal script is the oldest type of characters that can be assembled. It is very similar to the regular script in structure, but the shape is different. Visually understand the evolution of Chinese characters.

S2, from the Chinese character card library, take out two or more Chinese character magnetic cards to be assembled and assembled, put them in front of the mobile phone holder, and the assembled Chinese character magnetic cards will be adsorbed on the base; ” structure as an example, the two Chinese character magnetic cards of “wood” and “inch” are used to build left and right;

S4, the image processing module recognizes the topological structure of Chinese characters in the image, and the right side of "wood" is an "inch", and transmits the recognized topological structure of Chinese characters to the Chinese character recognition module, and the Chinese character recognition module, according to the information in the Chinese character topological structure database, Identify the Chinese character "village";

S5, the intelligent course module uses the word "village" to retrieve the downloaded courses. If there is no downloaded course, it will retrieve the courses with the word "village" from the online course library through the network;

S6, according to the mode set by the app, use the voice module to explain the course, or put the video on the TV through the screen display module to explain the course, and play the course explanation related to the word "village".

As shown in Figure 4, in the step S4, the image processing module identifies the Chinese character topology in the Chinese character image, which specifically includes:

Among them, the perspective transformation uses the OpenCV perspective transformation, and its calculation method is the product of the coordinate vector and the transformation matrix, in other words, the matrix operation. At the application level, perspective transformation is the transformation of the image based on 4 fixed vertices.

There are many methods for graphics segmentation, such as threshold segmentation, region segmentation, edge segmentation and histogram method. These are mature methods, and they will select the most suitable method for segmentation based on their own characteristics.

OCR (optical character recognition) optical character recognition, which uses electronic equipment to scan text on paper, determines its shape by detecting dark and bright patterns, and then uses character recognition to translate the shape into computer text. . OCR is a simple, efficient, fast and convenient technical means. Image pattern matching, because the number of single characters and radicals is not many, only a few hundred, so image pattern matching can be used to verify the correctness of OCR.

The magnetic card-based interactive learning system and method for Chinese character construction provided by the present invention can scan a wider range by setting a mobile phone holder to fix the mobile phone, and adjusting the placement height and camera angle of the mobile phone; Connect the mobile phone, so that the child can easily start the course; the mobile phone bracket is set with a card position, which can fix the range of the card building, so that the camera can not find the card; the camera can scan the building result of the card; the image recognition module, the camera The scanned pattern is recognized as the topological structure of Chinese characters; the Chinese character recognition module recognizes the topological structure of Chinese characters, if it cannot form a Chinese character, an error message will be prompted, if a Chinese character is formed, the Chinese character will be passed to the intelligent course module; the intelligent course module The Chinese characters recognized by the Chinese character recognition module are searched for courses that have been downloaded to the mobile phone. If no suitable courses are found, the corresponding courses can be found in the Chinese character course library through the Internet.

The present invention has the following advantages:

1. The price is low, because the mobile phone is an existing product, and there is no need to pay extra. The cost of the mobile phone holder and the magnetic card for Chinese characters is relatively low, which can promote the learning of Chinese characters into thousands of households;

2. Compared with the point-reading pen to learn Chinese characters, the building of Chinese characters is more interesting and interactive. It is children's active learning, while the point-reading pen is more passive, and they can learn whatever characters are in the book, and this system is for children to learn to spell them by themselves. The characters that come out let the children experience the feeling of Cangjie's creation of characters, which is a kind of active learning;

3. Interactive learning, compared with traditional spelling cards, will give feedback in real time, whether the spelled word exists, if so, there will be video tutorials to teach children what the word means and how it is composed. How it evolved, and guide the related words that can be spelled later. Such interactive teaching will be much better than silent traditional spelling cards;

4. The magnetic suction feels good, easy to build, and easy to fix;

5. Flexible, it can support the learning of single characters, the learning of phonetic and comprehensible characters, and the learning of words;

6. It can be expanded. If this system is to be expanded to English, pinyin, arithmetic, and programming, it is very convenient. You only need to buy the expansion card library. systematic learning;

7. Online and offline interaction, the child's learning data can be directly uploaded to the database, and the child's learning path can be recorded. Through machine learning, you can understand the child's current ability and intelligently match the child's most suitable online courses.

In this paper, specific examples are used to illustrate the principles and implementations of the present invention. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present invention; meanwhile, for those skilled in the art, according to the present invention There will be changes in the specific implementation and application scope. In conclusion, the contents of this specification should not be construed as limiting the present invention.

Claims

An interactive learning system for building Chinese characters based on magnetic cards, comprising: a Chinese character card library and an interactive learning device, wherein the Chinese character card library includes a plurality of Chinese character magnetic cards, each of which is used to carry Chinese characters The graphics of the component parts, the edge of each of the Chinese character magnetic cards is provided with a magnetic suction strip, and any two of the Chinese character magnetic cards are connected through the magnetic suction strips.

The interactive learning device is provided with a Chinese character recognition terminal, and the Chinese character recognition terminal includes an image acquisition device and a central processing unit, and the image acquisition device is used to collect the Chinese character images formed by the magnetic cards of the Chinese characters. The image acquisition device is connected with the central processing unit, and the central processing unit is used to recognize the Chinese characters in the collected Chinese characters images, and the central processing unit is also connected with a voice module and a screen display module. The voice module and the screen display The module displays the recognized Chinese character information through voice and video respectively.
The magnetic card-based interactive learning system for building Chinese characters according to claim 1, wherein the central processing unit comprises an image processing module and a Chinese character recognition module, the image processing module is connected to the image acquisition device, and uses For preprocessing the collected Chinese character images, the Chinese character recognition module is connected with the image processing module for recognizing the Chinese characters in the collected Chinese character images, and the voice module and the screen display module are respectively associated with the Chinese character recognition module. Module connection; the Chinese character recognition module is also connected with a big data module and an intelligent course module, the big data module is connected with the user learning path database, and the intelligent course module is connected with an online course library.
The magnetic card-based interactive learning system for building Chinese characters according to claim 1, wherein the Chinese character recognition terminal is a mobile phone, the image acquisition device is a camera of the mobile phone, and the central processing unit is a Chinese character learning APP.
The magnetic card-based interactive learning system for building Chinese characters according to claim 3, wherein the mobile phone communicates with the TV through a wireless network to realize screen projection.
The interactive learning system for building Chinese characters based on magnetic cards according to claim 3, wherein the interactive learning device further comprises a base and a mobile phone bracket arranged on the base, the mobile phone bracket is used to fix the mobile phone, the A magnetic strip connecting the Chinese character magnetic card is arranged on the base, and the mobile phone bracket is adjusted so that the camera of the mobile phone is aligned with the Chinese character magnetic card.
The magnetic card-based interactive learning system for building Chinese characters according to claim 5, wherein the base is further provided with a key control system, and the key control system comprises a start key set on the base shell and a set of A rechargeable battery, a power supply module, a main control module and a Bluetooth communication module inside the base shell, the rechargeable battery is connected to the power supply module, and the main control module is electrically connected to the start button, the power supply module, and the Bluetooth communication module, respectively, The base shell is also provided with a type-C port connected to the power module, and the main control module is wirelessly connected to the mobile phone through the bluetooth communication module to turn on or off the camera of the mobile phone.
The Chinese character building interactive learning system based on magnetic cards according to claim 1, wherein the Chinese character magnetic card is a hollow plastic shell made of abs plastic, and the four sides of the Chinese character magnetic card are provided with grooves, so The magnetic suction bar is embedded in the groove.
The magnetic card-based interactive learning system for Chinese character construction according to claim 1, wherein the Chinese character magnetic card is a double-sided structure, and the front and back sides of the Chinese character magnetic card are provided with graphics of Chinese character components.
A magnetic card-based Chinese character building interactive learning method, applied to the magnetic card-based Chinese character building interactive learning system described in any one of claims 1-8, characterized in that, comprising the following steps:

S1, put the mobile phone holder on the special mobile phone holder, run the app on the mobile phone, the app opens the camera, and starts the image processing module;

S2, from the Chinese character card library, take out two or more Chinese character magnetic cards to be assembled and assembled, put them in front of the mobile phone holder, and the assembled Chinese character magnetic cards are adsorbed on the base;

S3, the mobile phone app collects the Chinese character image formed by the magnetic cards of the Chinese character through the camera, and transmits the collected Chinese character image to the image processing module;

S4, the image processing module identifies the topological structure of the Chinese character in the Chinese character image, and transfers the identified topological structure of the Chinese character to the Chinese character recognition module, and the Chinese character recognition module identifies the Chinese character according to the information in the Chinese character topological structure database;

S5, the intelligent course module uses the recognized Chinese characters to retrieve the downloaded courses, and if there is no downloaded course, retrieves the courses corresponding to Chinese characters in the online course library through the network;

S6, according to the mode set by the app, the course is explained by voice through the voice module, or the video is put on the TV through the screen display module to explain the course.
The magnetic card-based interactive learning method for building Chinese characters according to claim 9, wherein in the step S4, the image processing module identifies the topological structure of Chinese characters in the Chinese character images, and specifically includes:

Through graphic perspective transformation, the collected oblique Chinese character images are turned into top-down pictures;

Perform graphic segmentation, and split the overall picture into cards one by one;

Perform graphic pattern matching, and perform text recognition OCR on each card to turn into single characters and radicals in the Chinese character library, forming the topological structure of Chinese characters.