WO2018223520A1

WO2018223520A1 - Child-oriented learning method and learning device, and storage medium

Info

Publication number: WO2018223520A1
Application number: PCT/CN2017/096637
Authority: WO
Inventors: 袁晖; 李凝华
Original assignee: 深圳市科迈爱康科技有限公司
Priority date: 2017-06-05
Filing date: 2017-08-09
Publication date: 2018-12-13
Also published as: CN107274731A

Abstract

A child-oriented learning method and learning device, and a storage medium. The method comprises: scanning a card identifier on a learning card having graphical and textual information to obtain identifier information of the card identifier, wherein a surface of the learning card is printed with graphical and textual information (S10); finding corresponding teaching audio according to the identifier information, and playing the found teaching audio (S20); obtaining listen-and-repeat audio of a child (S30); calculating a matching ratio between the listen-and-repeat audio and the teaching audio (S40); and if the matching ratio exceeds a predetermined value, performing a "correct answer" indication (S50). The learning device is portable, is easy to operate, and is a visual stimulus for a child and does not affect eye development of a child.

Description

Learning methods, learning devices and storage media for children

Technical field

The present invention relates to the field of learning device technologies, and in particular, to a child-oriented learning method, a learning device, and a storage medium.

Background technique

Existing child-oriented learning devices usually have learning wall charts, dot reading machines, children's story machines, learning flash cards, and the like. However, the audio wall chart usually has a large area and is not easy to carry. The dot reading machine needs a point pen, a dot reading machine and a special book. The system is cumbersome and difficult to operate. The children's story machine can only play audio and cannot be visually stimulated; flash card recognition The cooperation of the smart terminal APP is usually required, and the APP screen light of the smart terminal is detrimental to the child's eye development.

The above content is only used to assist in understanding the technical solutions of the present invention, and does not constitute an admission that the above is prior art.

Summary of the invention

The main object of the present invention is to provide a child-oriented learning method, a learning device, and a storage medium, which are aimed at solving the technical problems in the prior art that are difficult to carry, difficult to operate, unable to perform visual stimulation, and unfavorable for children's glasses development.

To achieve the above object, the present invention provides a child-oriented learning method, the method comprising the following steps:

Scanning a card identifier provided on the learning card to obtain identification information of the card identifier, and the surface of the learning card is printed with graphic information;

Searching for corresponding teaching audio according to the identification information, and playing the found teaching audio;

Get the children's follow-up audio;

Calculating a coincidence ratio between the follow-up audio and the teaching audio;

When the coincidence ratio exceeds a preset threshold, a correct prompt is made.

Preferably, the acquiring the audio of the child, including:

Obtaining ambient audio, determining whether there is a child's accompanying audio in the ambient audio;

When there is a child's accompanying audio in the ambient audio, the child's accompanying audio is extracted from the ambient audio.

Preferably, after the card identifiers on the learning card are scanned to obtain the identification information of the card identifiers, the method further includes:

Determining a corresponding card theme according to the identification information;

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.

Preferably, the type of the card theme is an expression theme;

Correspondingly, the determining whether the current image matches the card theme comprises:

Identifying the current image to obtain a current expression of the child;

Determining whether the current expression is the same as the card theme, and when the current expression is the same as the card theme, determining that the current image matches the card theme, and the current theme and the card theme are not When the same, it is determined that the current image does not match the card theme.

Preferably, the type of the card theme is an action theme;

Identifying the current image to obtain a current action of the child;

Determining whether the current action is the same as the card theme, and when the current action is the same as the card theme, determining that the current action matches the card theme, and the current action and the card theme are not When the same, it is determined that the current action does not match the card theme.

Preferably, the type of the card theme is an object theme;

Identifying the current image to determine a current simulated item held by the child;

Determining whether the current simulated item is the same as the card theme, and when the current simulated item is the same as the card theme, determining that the current simulated item matches the card theme, in the current simulated item and When the card themes are different, it is determined that the current simulated item does not match the card theme.

Preferably, the searching for the corresponding teaching audio according to the identification information, and playing the found teaching audio, specifically includes:

Searching for corresponding teaching audio and bonus audio according to the identification information, and playing the found teaching audio;

Correspondingly, after the correct prompting, the method further includes:

Play the bonus audio.

Preferably, the searching for the corresponding teaching audio and the bonus audio according to the identification information, and playing the found teaching audio, specifically includes:

Searching corresponding teaching audio, bonus audio and encouraging audio according to the identification information, and playing the found teaching audio;

Correspondingly, after the calculating the coincidence ratio between the following audio and the teaching audio, the method further includes:

The encouragement audio is played when the coincidence ratio does not exceed a preset threshold.

In addition, in order to achieve the above object, the present invention further provides a learning device, the learning device comprising: a memory, a processor, and a learning program stored on the memory and operable on the processor, the learning program configuration To implement the steps of the learning method described.

Moreover, in order to achieve the above object, the present invention also provides a computer readable storage medium having stored thereon a learning program, the step of implementing the learning method when the learning program is executed by a processor.

The invention scans the card identifier provided on the learning card with the graphic information, obtains the identification information of the card identification, searches for the corresponding teaching audio according to the identification information, and plays and retrieves the found teaching audio. The child's accompanying audio is calculated, and the coincidence ratio between the accompanying audio and the teaching audio is calculated. When the coincidence ratio exceeds a preset threshold, the correct prompt is provided, which is convenient to carry, the operation process is simple, and the child can be visualized. Stimulating and not affecting children's eye development.

DRAWINGS

1 is a schematic structural diagram of a learning device of a hardware operating environment according to an embodiment of the present invention;

2 is a schematic flow chart of a first embodiment of a child-oriented learning method according to the present invention;

3 is a schematic flow chart of a second embodiment of a child-oriented learning method according to the present invention;

4 is a schematic flow chart of a third embodiment of a child-oriented learning method according to the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1 is a schematic structural diagram of a learning device in a hardware operating environment according to an embodiment of the present invention.

As shown in FIG. 1, the learning device may include a processor 1001, such as a CPU, a communication bus 1002, an audio player 1003, a video capture device 1004, a memory 1005, and an identification reader 1006. Among them, the communication bus 1002 is used to implement connection communication between these components. The audio player 1003 is capable of playing audio under the control of the processor 1001. The video capture device 1004 can be two cameras for capturing images of children. Of course, one of the two cameras is used to collect facial images of children, and the other is used to collect body images of children. The memory 1005 may be a high speed RAM memory or a stable memory (non-volatile) Memory), such as disk storage. The memory 1005 can also optionally be a storage device independent of the aforementioned processor 1001. The identification reader 1006 can read the card identification on the learning card.

Those skilled in the art will appreciate that the learning device structure illustrated in FIG. 1 does not constitute a definition of a learning device, and may include more or fewer components than those illustrated, or some components may be combined, or different component arrangements.

As shown in FIG. 1, an operating system, a video capture module, an audio play module, and a learning program may be included in the memory 1005 as a computer storage medium.

In the learning device shown in FIG. 1, the network interface 1004 is mainly used for data communication with an audio server; the learning device calls the learning program stored in the memory 1005 through the processor 1001, and performs the following operations:

Get the children's follow-up audio;

Further, the processor 1001 can call the learning program stored in the memory 1005 and also perform the following operations:

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.

Further, the type of the card theme is an emoticon theme, and the processor 1001 may call the learning program stored in the memory 1005, and further perform the following operations:

Identifying the current image to obtain a current expression of the child;

Further, the type of the card theme is an action theme, and the processor 1001 may call the learning program stored in the memory 1005, and further perform the following operations:

Identifying the current image to obtain a current action of the child;

Further, the type of the card theme is an object theme, and the processor 1001 may call the learning program stored in the memory 1005, and further perform the following operations:

Play the bonus audio.

Based on the above hardware structure, an embodiment of the child-oriented learning method of the present invention is proposed.

Referring to FIG. 2, FIG. 2 is a schematic flowchart diagram of a first embodiment of a child-oriented learning method according to the present invention.

In a first embodiment, the child-oriented learning method comprises the following steps:

S10: Scan the card identifier provided on the learning card to obtain identification information of the card identifier, and the surface of the learning card is printed with graphic information;

It should be noted that the card identifier is a unique identifier of the learning card, and the card identifier may be an optical identification code (Optical) The identification, the OID, the barcode, the two-dimensional code, or the electronic label disposed inside the learning card, of course, may also be other identifiers, which is not limited in this embodiment.

It will be appreciated that the graphical information may include patterns and/or text that can cause visual stimuli to the child, making the child feel an impression, but not affecting the child's eye development.

S20: Find a corresponding teaching audio according to the identification information, and play the found teaching audio;

In a specific implementation, the identifier information may correspond to the teaching audio, and the correspondence between the identifier information and the teaching audio may be stored locally, that is, the corresponding teaching audio may be directly searched according to the identifier information;

Of course, the correspondence between the identification information and the teaching audio may also be stored in the server, that is, the identification information may be transmitted to the server, so that the server searches for the corresponding teaching according to the identification information. Audio and feedback to find the teaching audio.

S30: Obtaining a child's accompanying audio;

It should be noted that in the teaching audio playback, the child usually does not consciously follow the reading, and the audio is often different from the frequency of the teaching audio. In order to facilitate the audio of the child, in this embodiment, the environment can be obtained. Audio, determining whether there is a child's accompanying audio in the ambient audio, and extracting the child's accompanying audio from the ambient audio when there is a child's accompanying audio in the ambient audio.

In a specific implementation, in determining whether there is a child's accompanying audio in the ambient audio, the short-term energy E(n) of the ambient audio may be calculated, and a threshold threshold for obtaining the short-time energy E(n) is calculated. Г, finding a mapping relationship according to the threshold threshold Г, obtaining a vocal sound type corresponding to the threshold threshold Г, and determining whether there is a child's accompanying audio in the ambient audio, where the mapping relationship includes: a preset person Different values of the short-term energy threshold threshold δ of the sound and the corresponding vocal sound type.

S40: Calculate a coincidence ratio between the follow-up audio and the teaching audio;

It can be understood that since the children's accompanying audio is usually different from the teaching audio, the coincidence ratio between the accompanying audio and the teaching audio can be calculated.

S50: Perform correct prompt when the coincidence ratio exceeds a preset threshold.

In a specific implementation, the preset threshold may be set as needed, for example, a value of 50%, 60%, etc., and of course, may be set to other values, which is not limited in this embodiment.

In this embodiment, the card identifier set on the learning card having the graphic information is scanned, the identification information of the card identifier is obtained, the corresponding teaching audio is searched according to the identification information, and the found teaching audio is played, Obtaining a child's follow-up audio, calculating a coincidence ratio between the follow-up audio and the teaching audio, and performing correct prompting when the coincidence ratio exceeds a preset threshold, being convenient to carry, having a simple operation process, and capable of performing on a child Visual stimulation and does not affect the child's eye development.

Further, as shown in FIG. 3, a second embodiment of the child-oriented learning method of the present invention is proposed based on the first embodiment. In this embodiment, after the step S10, the method further includes:

S60: Determine a corresponding card theme according to the identifier information.

It should be noted that, in order to facilitate the determination of the corresponding card theme, the correspondence between the identification information and the card theme may be stored in the local area in advance, and may be stored in the server, which is not limited in this embodiment.

Of course, there is an association between the card theme and the graphic information. In other words, the theme reflected by the graphic information is the card theme.

S70: Acquire a current image of the child;

S80: Determine whether the current image matches the card theme;

It can be understood that, since the child instinctively responds to the theme of the card after seeing the graphic information, in order to determine whether the reaction is correct, whether the current image and the card theme are determined may be Matching, since the embodiment can promote children's learning from a plurality of dimensions, the child can have a deeper memory of the above-mentioned graphic information and improve the learning effect.

S90: Perform a correct prompt when the current image matches the card theme.

In a specific implementation, the types of the card theme may be divided into an emoticon theme, an action theme, and an object theme.

When the type of the card theme is an expression theme, the step S80 may specifically include: identifying the current image to obtain the current expression of the child; and determining whether the current expression is the same as the card theme. When the current expression is the same as the card theme, determining that the current image matches the card theme, and when the current theme is different from the card theme, determining the current image and the card theme Mismatch.

Assuming that the theme of the expression is a smile, at this time, when the current image is recognized, the face in the current image may be first identified, and after the face is determined, if the current face of the face exists If the smile is on the corners of the mouth, the glasses are slightly smeared, the current expression may be determined to be a smile, thereby determining that the current image matches the card theme.

When the type of the card theme is an action theme, the step S80 may specifically include: identifying the current image to obtain a current action of the child; and determining whether the current action is the same as the card theme. When the current action is the same as the card theme, determining that the current action matches the card theme, and when the current action is different from the card theme, determining the current action and the card theme Mismatch.

It is assumed that the action theme is a standing attention. At this time, when the current image is recognized, the human body in the current image may be first identified, and after determining the human body, if the human body is standing, the arms are naturally drooping, etc. If the feature is established, the current action can be determined to be upright, thereby determining that the current image matches the card theme.

When the type of the card theme is an object theme, the step S80 may specifically include: identifying the current image, determining a current simulated item held by the child; determining whether the current simulated item is related to the current The card theme is the same, when the current simulated item is the same as the card theme, the current simulated item is determined to match the card theme, and when the current simulated item is different from the card theme, the The current simulated item does not match the card theme.

Assuming that the item theme is an apple apple, at this time, when the current image is recognized, the human body in the current image may be first identified, and after determining the human body, if the current simulated item held by the human body is an apple The model determines that the current image matches the card theme.

Further, as shown in FIG. 4, a second embodiment of the child-oriented learning method of the present invention is proposed based on the first embodiment or the second embodiment, and FIG. 4 is based on the first embodiment;

In this embodiment, step S20 specifically includes:

S21: Searching for corresponding teaching audio and bonus audio according to the identification information, and playing the found teaching audio;

Correspondingly, step S50 specifically includes:

S51: When the coincidence ratio exceeds a preset threshold, perform a correct prompt to play the bonus audio.

In a specific implementation, the correct prompt may be prompted by a prompt sound such as “叮!”, and the prompt sound may be set locally or set on the server. Of course, the correct prompt may also be used in other manners, for example: vibration In other ways, this embodiment does not limit this.

It should be noted that, because the child may have problems such as inattention during the learning process, in order to attract the child to continue learning, in the embodiment, the reward audio is played after the correct prompt.

In addition, in order to ensure that the bonus audio is not monotonous and associated with the graphic information, the correspondence between the identification information, the teaching audio, and the bonus audio may be preset, that is, the bonus audio is According to the identification information, the card theme is a smile smile. At this time, the bonus audio may be a happy laugh of a child, and the card theme is an apple apple. At this time, the bonus audio may be about the apple. song.

Of course, when the coincidence ratio does not exceed the preset threshold, the child may be frustrated. In order to maintain the child's interest in learning, the step S21 may specifically include: searching for the corresponding teaching audio according to the identification information. , rewarding audio and encouraging audio, and playing the found teaching audio;

Correspondingly, after the step S40, the method further comprises: playing the encouraged audio when the coincidence ratio does not exceed a preset threshold.

In the specific implementation, the identity authentication link may also be set, that is, the identity of the child is recorded by using a password, fingerprint recognition, and the like.

In order to facilitate the recording of the historical information of the child, in this embodiment, the children's accompanying audio and current images may also be stored locally.

In order to facilitate the understanding of the child's learning situation, in this embodiment, statistics such as the child's learning time, learning type, follow-up situation, and action mimicry can also be counted.

In addition, an embodiment of the present invention further provides a computer readable storage medium, where the learning program is stored, and when the learning program is executed by the processor, the following operations are implemented:

Get the children's follow-up audio;

Further, when the learning program is executed by the processor, the following operations are also implemented:

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.

Further, the type of the card theme is an emoticon theme, and the learning program is further executed by the processor when:

Identifying the current image to obtain a current expression of the child;

Further, the type of the card theme is an action theme, and when the learning program is executed by the processor, the following operations are also implemented:

Identifying the current image to obtain a current action of the child;

Further, the type of the card theme is an object theme, and when the learning program is executed by the processor, the following operations are also implemented:

Play the bonus audio.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or Also includes other elements not explicitly listed, or Includes elements inherent to such a process, method, item, or system. In the absence of more restrictions, an element defined by the phrase "including one..." is not excluded from the process of including the element, There are additional identical elements in the method, item or system.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Those skilled in the art can clearly understand the above by the description of the above embodiments. The embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course Hardware, but in many cases the former is a better implementation. Based on such understanding, the technical solution of the present invention may be in the form of a software product in essence or in part contributing to the prior art. It is now apparent that the computer software product is stored in a storage medium (such as a ROM/RAM, a magnetic disk, an optical disk) as described above, and includes a plurality of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner) , or a network device, etc.) performs the methods described in various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims

A child-oriented learning method, characterized in that the method comprises the following steps:

Scanning a card identifier provided on the learning card to obtain identification information of the card identifier, and the surface of the learning card is printed with graphic information;

Searching for corresponding teaching audio according to the identification information, and playing the found teaching audio;

Get the children's follow-up audio;

Calculating a coincidence ratio between the follow-up audio and the teaching audio;

When the coincidence ratio exceeds a preset threshold, a correct prompt is made.
The method according to claim 1, wherein the obtaining the audio of the child's follow-up includes:

Obtaining ambient audio, determining whether there is a child's accompanying audio in the ambient audio;

When there is a child's accompanying audio in the ambient audio, the child's accompanying audio is extracted from the ambient audio.
The method of claim 1, wherein the method further comprises: after scanning the card identifier provided on the learning card to obtain the identification information of the card identifier, the method further comprising:

Determining a corresponding card theme according to the identification information;

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.
The method of claim 3, wherein the type of the card theme is an emoticon theme;

Correspondingly, the determining whether the current image matches the card theme comprises:

Identifying the current image to obtain a current expression of the child;

Determining whether the current expression is the same as the card theme, and when the current expression is the same as the card theme, determining that the current image matches the card theme, and the current theme and the card theme are not When the same, it is determined that the current image does not match the card theme.
The method of claim 3, wherein the type of the card theme is an action theme;

Correspondingly, the determining whether the current image matches the card theme comprises:

Identifying the current image to obtain a current action of the child;

Determining whether the current action is the same as the card theme, and when the current action is the same as the card theme, determining that the current action matches the card theme, and the current action and the card theme are not When the same, it is determined that the current action does not match the card theme.
The method of claim 3, wherein the type of the card theme is an object theme;

Correspondingly, the determining whether the current image matches the card theme comprises:

Identifying the current image to determine a current simulated item held by the child;

Determining whether the current simulated item is the same as the card theme, and when the current simulated item is the same as the card theme, determining that the current simulated item matches the card theme, in the current simulated item and When the card themes are different, it is determined that the current simulated item does not match the card theme.
The method according to claim 1, wherein the searching for the corresponding teaching audio according to the identification information and playing the found teaching audio comprises:

Searching for corresponding teaching audio and bonus audio according to the identification information, and playing the found teaching audio;

Correspondingly, after the correct prompting, the method further includes:

Play the bonus audio.
The method of claim 7, wherein the searching for the corresponding teaching audio and the bonus audio according to the identification information, and playing the found teaching audio, specifically includes:

Searching corresponding teaching audio, bonus audio and encouraging audio according to the identification information, and playing the found teaching audio;

Correspondingly, after the calculating the coincidence ratio between the following audio and the teaching audio, the method further includes:

The encouragement audio is played when the coincidence ratio does not exceed a preset threshold.
A learning device, comprising: a memory, a processor, and a learning program stored on the memory and operable on the processor, the learning program configured to implement the following steps:

Scanning a card identifier provided on the learning card to obtain identification information of the card identifier, and the surface of the learning card is printed with graphic information;

Searching for corresponding teaching audio according to the identification information, and playing the found teaching audio;

Get the children's follow-up audio;

Calculating a coincidence ratio between the follow-up audio and the teaching audio;

When the coincidence ratio exceeds a preset threshold, a correct prompt is made.
The learning device of claim 9, wherein the learning program is further configured to implement the following steps:

Obtaining ambient audio, determining whether there is a child's accompanying audio in the ambient audio;

When there is a child's accompanying audio in the ambient audio, the child's accompanying audio is extracted from the ambient audio.
The learning device of claim 9, wherein the learning program is further configured to implement the following steps:

Determining a corresponding card theme according to the identification information;

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.
The learning device according to claim 11, wherein the type of the card theme is an emoticon theme; and the learning program is further configured to implement the following steps:

Identifying the current image to obtain a current expression of the child;

Determining whether the current expression is the same as the card theme, and when the current expression is the same as the card theme, determining that the current image matches the card theme, and the current theme and the card theme are not When the same, it is determined that the current image does not match the card theme.
The learning device according to claim 11, wherein the type of the card theme is an action theme; and the learning program is further configured to implement the following steps:

Identifying the current image to obtain a current action of the child;

Determining whether the current action is the same as the card theme, and when the current action is the same as the card theme, determining that the current action matches the card theme, and the current action and the card theme are not When the same, it is determined that the current action does not match the card theme.
The learning device according to claim 11, wherein the type of the card theme is an object theme; and the learning program is further configured to implement the following steps:

Identifying the current image to determine a current simulated item held by the child;

Determining whether the current simulated item is the same as the card theme, and when the current simulated item is the same as the card theme, determining that the current simulated item matches the card theme, in the current simulated item and When the card themes are different, it is determined that the current simulated item does not match the card theme.
A computer readable storage medium, wherein the computer readable storage medium stores a learning program, and when the learning program is executed by the processor, the following steps are implemented:

Scanning a card identifier provided on the learning card to obtain identification information of the card identifier, and the surface of the learning card is printed with graphic information;

Searching for corresponding teaching audio according to the identification information, and playing the found teaching audio;

Get the children's follow-up audio;

Calculating a coincidence ratio between the follow-up audio and the teaching audio;

When the coincidence ratio exceeds a preset threshold, a correct prompt is made.
The computer readable storage medium of claim 15, wherein the learning program is further executed by the processor to:

Obtaining ambient audio, determining whether there is a child's accompanying audio in the ambient audio;

When there is a child's accompanying audio in the ambient audio, the child's accompanying audio is extracted from the ambient audio.
The computer readable storage medium of claim 15, wherein the learning program is further executed by the processor to:

Determining a corresponding card theme according to the identification information;

Obtaining a current image of the child;

Determining whether the current image matches the card theme;

When the current image matches the card theme, a correct prompt is made.
The computer readable storage medium of claim 17, wherein the learning program is further executed by the processor to:

Identifying the current image to obtain a current expression of the child;

Determining whether the current expression is the same as the card theme, and when the current expression is the same as the card theme, determining that the current image matches the card theme, and the current theme and the card theme are not When the same, it is determined that the current image does not match the card theme.
The computer readable storage medium of claim 17, wherein the learning program is further executed by the processor to:

Identifying the current image to obtain a current action of the child;

Determining whether the current action is the same as the card theme, and when the current action is the same as the card theme, determining that the current action matches the card theme, and the current action and the card theme are not When the same, it is determined that the current action does not match the card theme.
The computer readable storage medium according to claim 17, wherein the learning program is further executed by the processor to: identify the current image, and determine a current simulated item held by the child;

Determining whether the current simulated item is the same as the card theme, and when the current simulated item is the same as the card theme, determining that the current simulated item matches the card theme, in the current simulated item and When the card themes are different, it is determined that the current simulated item does not match the card theme.