CN111081227B - Recognition method of dictation content and electronic equipment - Google Patents

Recognition method of dictation content and electronic equipment Download PDF

Info

Publication number
CN111081227B
CN111081227B CN201910689394.9A CN201910689394A CN111081227B CN 111081227 B CN111081227 B CN 111081227B CN 201910689394 A CN201910689394 A CN 201910689394A CN 111081227 B CN111081227 B CN 111081227B
Authority
CN
China
Prior art keywords
dictation
user
content
electronic device
writing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910689394.9A
Other languages
Chinese (zh)
Other versions
CN111081227A (en
Inventor
周林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201910689394.9A priority Critical patent/CN111081227B/en
Publication of CN111081227A publication Critical patent/CN111081227A/en
Application granted granted Critical
Publication of CN111081227B publication Critical patent/CN111081227B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/32Digital ink
    • G06V30/36Matching; Classification
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • G10L2015/088Word spotting
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention relates to the technical field of education, and discloses a dictation content identification method and electronic equipment, wherein the method comprises the following steps: recognizing user intention according to voice input by a user; if the user intention is dictation starting, controlling the camera equipment to shoot so as to obtain a first shot image; detecting whether a first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image; if not, judging that the dictation content broadcasted by the dictation audio section is the user missing writing content. According to the embodiment of the invention, the accuracy rate of dictation detection can be improved.

Description

Recognition method of dictation content and electronic equipment
Technical Field
The invention relates to the technical field of education, in particular to a dictation content identification method and electronic equipment.
Background
Currently, most of electronic devices (such as a family education machine) on the market have a dictation function, and when the dictation content of a user is identified, the writing content of the user is mostly identified from a writing page through an optical character recognition technology. However, in practice, it is found that the optical character recognition technology has many limitations, so that the electronic device cannot detect the dictation content that is missed by the user, and further the accuracy of dictation detection is easily affected.
Disclosure of Invention
The embodiment of the invention discloses a dictation content identification method and electronic equipment, which can improve the accuracy of dictation detection.
The first aspect of the embodiments of the present invention discloses a method for identifying dictation content, where the method includes:
recognizing user intention according to voice input by a user;
if the user intention is dictation starting, controlling the camera equipment to shoot so as to obtain a first shot image;
detecting whether a first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image; if not, judging that the dictation content broadcasted by the dictation audio section is the user missing writing content.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, before recognizing the user intention according to the speech input by the user, the method further includes:
detecting whether the electronic equipment receives a dictation task notification; the dictation task notification is sent by a terminal device bound with the electronic device and at least comprises the dictation content and dictation time;
if so, setting a pushing time point of the dictation content according to the dictation time;
detecting whether the current time point meets the pushing time point; and if so, outputting first inquiry information, wherein the first inquiry information is used for inquiring whether the user starts dictation.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the outputting of the first counseling information and before the recognizing of the user's intention according to the voice input by the user, the method further includes:
controlling the image pickup apparatus to photograph the user to obtain a second photographed image containing the face image of the user;
identifying whether the current posture of the user is a correct dictation posture from the second shot image; and if not, controlling the electronic equipment to output first prompt information, wherein the first prompt information is used for prompting the user to adjust the current posture to the correct dictation posture.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the dictation content of the dictation audio broadcast is the content that is missed by the user, the method further includes:
controlling the electronic equipment to output second prompt information, wherein the second prompt information is used for prompting the user that the writing missing occurs in the dictation process;
outputting the second inquiry information; the second query information is used for querying whether the user needs to replay the dictation audio section corresponding to the missed-writing content;
and if the user needs to replay the dictation audio section corresponding to the missed content, controlling the electronic equipment to replay the dictation audio section corresponding to the missed content.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after controlling the electronic device to replay the dictation audio section corresponding to the missed content, the method further includes:
acquiring the actual writing stroke order of the second dictation handwriting written by the user according to the replayed dictation audio section;
detecting whether the actual writing order of the second dictation handwriting is matched with the standard writing order of the missed writing content; and if not, controlling the electronic equipment to play the writing video with the standard writing order of the missed writing content.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
a first recognition unit for recognizing a user's intention based on a voice input by a user;
the first control unit is used for controlling the camera equipment to shoot when the first identification unit identifies that the user intention is dictation starting so as to obtain a first shot image;
the first detection unit is used for detecting whether a first dictation handwriting written by the user according to the broadcasted dictation audio exists in the first shot image;
and the determining unit is used for judging that the dictation content broadcasted by the dictation audio is the neglected writing content of the user when the first detection unit detects that the first dictation handwriting written by the user according to the broadcasted dictation audio does not exist in the first shot image.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
a second detection unit for detecting whether the electronic device receives the dictation task notification before the first recognition unit recognizes the user's intention according to the voice input by the user; the dictation task notification is sent by a terminal device bound with the electronic device and at least comprises the dictation content and dictation time;
the setting unit is used for setting a pushing time point of the dictation content according to the dictation time when the second detection unit detects that the electronic equipment receives a dictation task notification;
a third detecting unit, configured to detect whether a current time point satisfies the push time point;
and the first output unit is used for outputting first inquiry information when the third detection unit detects that the current time point meets the pushing time point, wherein the first inquiry information is used for inquiring whether the user starts dictation.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the first control unit is further used for controlling the image pickup device to shoot the user to obtain a second shot image containing the facial image of the user after the first output unit outputs the first inquiry information and before the first recognition unit recognizes the user intention according to the voice input by the user;
a second recognition unit that recognizes whether the current posture of the user is a correct dictation posture from the second captured image;
and the second control unit is used for controlling the electronic equipment to output first prompt information when the second recognition unit recognizes that the current posture of the user is not the correct dictation posture from the second shot image, wherein the first prompt information is used for prompting the user to adjust the current posture to the correct dictation posture.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the second control unit is further configured to control the electronic device to output second prompt information after the determining unit determines that the dictation content broadcasted by the dictation audio is the missed-writing content of the user, where the second prompt information is used to prompt the user that the missed-writing occurs in the dictation process;
a second output unit for outputting the second inquiry information; the second query information is used for querying whether the user needs to replay the dictation audio section corresponding to the missed-writing content;
and the third control unit is used for controlling the electronic equipment to replay the dictation audio section corresponding to the missed writing content if the user needs to replay the dictation audio section corresponding to the missed writing content.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the obtaining unit is used for obtaining the actual writing order of the second dictation handwriting written by the user according to the replayed dictation audio section after the third control unit controls the electronic equipment to replay the dictation audio section corresponding to the missed-writing content;
a fourth detection unit, configured to detect whether an actual writing order of the second dictation handwriting matches the standard writing order of the missed writing content;
and the fourth control unit is used for controlling the electronic equipment to play the writing video of the standard writing order of the missed writing content when the fourth detection unit detects that the actual writing order of the second dictation handwriting is not matched with the standard writing order of the missed writing content.
A third aspect of an embodiment of the present invention discloses an electronic device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the dictation content identification method disclosed by the first aspect of the embodiment of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, which stores a computer program, where the computer program enables a computer to execute a method for identifying dictation content disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the electronic equipment can recognize the user intention according to the voice input by the user, when the user intention is dictation starting, the electronic equipment can control the camera equipment to shoot so as to obtain the first shot image, the electronic equipment can also detect whether the first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image, and if not, the electronic equipment can judge that the dictation content broadcasted by the dictation audio section is the neglected-writing content of the user. Therefore, the accuracy rate of dictation detection can be improved by the embodiment of the invention.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a dictation content identification method disclosed in an embodiment of the present invention;
fig. 2 is a schematic flow chart of another dictation content identification method disclosed in the embodiment of the present invention;
fig. 3 is a schematic flow chart of another dictation content identification method disclosed in the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 5 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
fig. 7 is a schematic structural diagram of another electronic device according to the embodiment of the disclosure.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
It should be noted that the terms "first", "second", "third", "fourth", and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a dictation content identification method which can improve the accuracy of dictation detection. The following detailed description is made with reference to the accompanying drawings.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a recognition method of dictation content according to an embodiment of the present invention. As shown in fig. 1, the method for identifying dictation content may include the following steps.
101. The electronic device recognizes the user's intention from the speech input by the user.
In the embodiment of the present invention, the electronic device may be an electronic device used by a student, such as a learning tablet, a learning machine, a family education machine, and a point reading machine, which is not limited in the embodiment of the present invention.
As an optional implementation manner, in the embodiment of the present invention, the electronic device may recognize whether a preset keyword related to a dictation start intention exists in the voice input by the user, for example, "i want to listen to write", or the like, and if so, determine that the user intention is dictation start.
For example, after the electronic device has currently entered the learning mode, the user may wake up the user intention recognition function of the electronic device by voice, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive the voice input by the user, and perform step 101.
For another example, after the electronic device has currently entered the learning mode, the user may manually wake up the user intention recognition function of the electronic device through a touch screen, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive the voice input by the user, and perform step 101.
For another example, after the electronic device has currently entered the learning mode, the user may wake up the user intention recognition function of the electronic device by manually turning on a physical key switch disposed on the electronic device, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive the voice input by the user, and execute step 101.
102. If the user intends to start the dictation, the electronic equipment controls the camera equipment to shoot so as to obtain a first shot image.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device obtains the first captured image, the electronic device may detect whether a writing page exists in the first captured image, and if not, the electronic device may control a mirror disposed above the electronic device to pop up, and may adjust an angle of the mirror with respect to a lens surface of the image capturing device, so that a user may have a writing page in a mirror image of the mirror no matter at what angle the user uses the electronic device.
103. The electronic equipment detects whether a first dictation handwriting written by a user according to the broadcasted dictation audio section exists in the first shot image, if not, step 104 is executed, and if so, the process is ended.
As an optional implementation manner, in an embodiment of the present invention, the dictation audio section may be a dictation audio section of any dictation content in the entire dictation audio file, for example, if the entire dictation audio file of the electronic device contains dictation audio sections corresponding to dictation contents such as "hello", "suppose", "family", "presence", and "study", when the electronic device needs to broadcast the dictation content such as "presence", the electronic device may only broadcast the dictation audio section containing the word "presence".
As an optional implementation manner, in the embodiment of the present invention, when the electronic device broadcasts the next dictation audio session, the electronic device may detect whether the first taken image is the first dictation handwriting written by the user according to the broadcasted dictation audio session, and if not, the electronic device may perform step 104.
As an optional implementation manner, in the embodiment of the present invention, if the electronic device detects that a first listening and writing handwriting written by the user according to the broadcasted listening and writing audio section exists in the first captured image, the electronic device may detect whether the first listening and writing handwriting is wrongly written;
and detecting the writing error of the first listening and writing handwriting on the electronic equipment, wherein the electronic equipment can output the correct writing content of the first listening and writing handwriting to a display screen of the electronic equipment and can store the first listening and writing handwriting into a listening and writing error record table of a user.
104. The electronic equipment judges that the dictation content broadcasted by the dictation audio program is the neglected writing content of the user.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device determines that the dictation content broadcasted by the dictation audio section is the neglected writing content of the user, the electronic device may immediately send a prompt message to prompt the user to finish writing the neglected writing content as soon as possible;
after the electronic equipment sends out the prompt message, the electronic equipment can broadcast the dictation audio section again and can detect whether the user finishes writing the dictation content again;
if the electronic equipment detects that the user does not write the dictation content within the specified time, the electronic equipment can judge that the user does not completely master the dictation content, and the electronic equipment can output the dictation content to a display screen of the electronic equipment;
after the electronic equipment outputs the dictation content to a display screen of the electronic equipment, the electronic equipment can also report the dictation content and the identity information of the user to a teacher terminal corresponding to the user, so that a teacher belonging to the teacher terminal can learn which words are strange or not mastered for the user, and the teacher can give a guide to the user in a targeted manner;
after the electronic device outputs the dictation content to a display screen of the electronic device, the electronic device can also send the dictation content to a friend account selected by the user through an intermediate server (such as a social server) so as to increase the communication between the user and friends in learning, so that the learning enthusiasm of the user is improved;
and after the electronic equipment outputs the dictation content to the display screen of the electronic equipment, the user can deepen the mastering degree of the dictation content in a game mode so as to improve the learning enthusiasm of the user.
It can be seen that the accuracy of dictation detection can be improved by implementing the dictation content identification method described in fig. 1.
In addition, the method for recognizing dictation described in fig. 1 is implemented, so that the electronic device can acquire the writing page of the user no matter what angle the user uses the electronic device.
In addition, by implementing the dictation content identification method described in fig. 1, a teacher to which the user belongs can be informed of which words are unknown or not known to the user, so that the teacher can give targeted guidance to the user.
In addition, by implementing the method for identifying dictation content described in fig. 1, the user can deepen the mastery degree of the dictation content in a game mode, and the learning enthusiasm of the user can be improved.
Example two
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating another dictation content identification method disclosed in the embodiment of the present invention. As shown in fig. 2, the method for identifying dictation content may include the following steps.
201. The electronic device detects whether the electronic device receives the dictation task notification, if so, executes step 202 to step 203, and if not, ends the process.
In this embodiment of the present invention, the dictation task notification may be sent by a terminal device bound to the electronic device, and at least includes the dictation content and dictation time.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device is bound with the terminal device, the electronic device may be supervised by the terminal device;
and in the process of establishing the connection between the terminal equipment and the electronic equipment for the first time, the electronic equipment can preset the identity information of the terminal equipment and the authority of the terminal equipment for monitoring the electronic equipment.
For example, the identity information of the terminal device may be a guardian, a teacher, a relative, a friend, a stranger, and the like, and the electronic device may set different authorities for monitoring the electronic device for different identity information, for example, the authority for monitoring the electronic device by the guardian may be a first authority level, the authority for monitoring the electronic device by the teacher may be a second authority level, the authority for monitoring the electronic device by the relative may be a third authority level, the authority for monitoring the electronic device may be a fourth authority level, and the authority for monitoring the electronic device may be a fifth authority level. The authority of the first authority level can be the highest, the authority of the fifth authority level can be the lowest, the higher the authority is, the higher the allowable frequency of supervision on the electronic equipment is, and the lower the authority is, the lower the allowable frequency of supervision on the electronic equipment is.
As an optional implementation manner, in the embodiment of the present invention, the dictation content may be some words and sentences that require the user to complete dictation, which are collected and sorted by the teacher; and/or the dictation content can be used for summarizing and sorting out new words and sentences except the new words and sentences which must be finished in the lesson for the teacher, and the like;
the dictation content can also be new words and sentences arranged by parents according to the learning condition of the user, and/or the dictation content can be new words and sentences arranged by the parents according to the learning requirement of a teacher.
202. The electronic equipment sets a pushing time point of the dictation content according to the dictation time.
As an optional implementation manner, in an embodiment of the present invention, the dictation task notification may further include dictation times of the dictation content, and the electronic device may set the push time point and may also set the dictation times of the dictation content, that is, the user needs to repeat dictation for the dictation content by the times corresponding to the dictation times. For example, if the dictation number is 3, the user needs to re-dictating the dictation three times.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device sets the push time point of the dictation content according to the dictation time, the electronic device may output the set push time point to the user;
and after the electronic device outputs the set push time point to the user, the electronic device may send query information to the user to query whether the user needs to change the push time point, if so, the electronic device may output a display frame for adjusting the push time point, and after the user confirms the changed push time point, the electronic device may perform step 203.
203. The electronic device detects whether the current time point meets the push time point, if so, step 204 is executed, and if not, the process is ended.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device detects that the current time point meets the push time point, the electronic device may detect whether a current location environment of the user meets a preset dictation environment, if yes, the electronic device may execute step 204, and if not, the electronic device may delay the push time point for a certain time duration;
and after the electronic device delays the pushing time point for a certain time, the electronic device may detect again whether the current location environment of the user meets the preset dictation environment, if so, the electronic device may execute step 204, and if not, the electronic device may send a prompt message to prompt the user to arrive at the preset dictation environment for dictation as soon as possible.
204. The electronic device outputs first query information, where the first query information is used to determine whether the user starts dictation, if so, step 205-step 206 are executed, and if not, the process is ended.
As an optional implementation manner, in the embodiment of the present invention, when the electronic device obtains that the user does not start dictation, the electronic device may output query information again to query whether the user needs to change the push time point of the dictation content, if yes, the electronic device may output a display frame for adjusting the push time point, and after the user confirms the changed push time point, the electronic device may perform step 203 again;
if the user does not need to change the pushing time point of the dictation content, the electronic equipment can output a display frame to the user, and the user can input the reason why the user does not perform dictation operation on the dictation content into the display frame;
and after the user inputs the reason why the user does not perform the dictation operation on the dictation content into the display frame, the electronic device may send the reason to the terminal device bound with the electronic device, and may ask whether the terminal device needs to cancel the dictation operation of the dictation content, and if so, the electronic device may need to cancel the dictation of the dictation content.
205. The electronic apparatus controls the image pickup apparatus to photograph the user to obtain a second photographed image containing an image of the face of the user.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device acquires the second captured image containing the face image of the user, the electronic device may analyze the second captured image containing the face image of the user, so as to obtain the current emotion type of the user;
after the electronic equipment obtains the current emotion type of the user, the electronic equipment can judge whether the current emotion type is a low falling emotion, if so, the electronic equipment can stop the current dictation operation on the dictation content, can detect whether the current position environment of the user is suitable for movement (such as walking) for improving the low falling emotion or not, and if so, sends prompt information to the user so that the user can improve the low falling emotion.
206. The electronic device identifies whether the current posture of the user is a correct dictation posture from the second captured image, if not, performs step 207 to step 210, and if so, performs step 208 to step 210.
As an optional implementation manner, in the embodiment of the present invention, when the electronic device determines that the current time point satisfies the push time point, and the user sits up in front of the screen of the family education device in a correct posture, that is, the user is ready to listen and write, step 208 to step 210 are performed.
207. The electronic equipment controls the electronic equipment to output first prompt information, and the first prompt information is used for prompting the user to adjust the current posture to a correct dictation posture.
As an optional implementation manner, in an embodiment of the present invention, the first prompt information output by the electronic device includes:
displaying information prompt on a display screen of the electronic equipment;
and/or a voice message prompt sent by the electronic equipment.
208. The electronic device recognizes the user's intention from the speech input by the user.
209. If the user intends to start dictation, the electronic equipment controls the camera equipment to shoot so as to obtain a first shot image.
210. The electronic equipment detects whether a first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image, if not, step 211 is executed, and if yes, the process is ended.
211. The electronic equipment judges that the dictation content broadcasted by the dictation audio program is the neglected writing content of the user.
As an optional implementation manner, in the embodiment of the present invention, the electronic device may obtain facial features of the user from the second captured image, and may obtain identity information of the user from portrait information pre-stored in the electronic device according to the facial features;
after the electronic equipment acquires the identity information of the user from the portrait information prestored in the electronic equipment, the electronic equipment can acquire a friend list of the user according to the identity information of the user and acquire friends in the same dictation time as the user from the friend list;
and after the electronic equipment acquires the friend who is in the same dictation time as the user from the friend list, the electronic equipment can push the friend to a display screen of the electronic equipment so that the user can learn about the friend who is in the same dictation time as the user at present, and therefore the communication between the user and the friend in learning is increased, and the enthusiasm of the user in learning is improved.
It can be seen that the accuracy of dictation detection can be improved by implementing the dictation content identification method described in fig. 2.
In addition, by implementing the method for identifying dictation content described in fig. 2, a mode for improving the low emotion of the user can be obtained in time, and the influence on the attention of the user in the dictation process can be avoided.
In addition, by implementing the recognition method of dictation content described in fig. 2, the user can learn the friends who are currently in the same dictation time as the user, so as to increase the interaction between the user and the friends in learning, so as to improve the enthusiasm of the user in learning.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic flowchart illustrating another dictation content identification method according to an embodiment of the present invention. As shown in fig. 3, the method for identifying dictation content may include the following steps.
301. The electronic equipment detects whether the electronic equipment receives the dictation task notification, if so, the steps 302 to 303 are executed, and if not, the process is ended.
In the embodiment of the present invention, the dictation task notification is sent by a terminal device bound to an electronic device, and at least includes the dictation content and dictation time.
302. The electronic equipment sets a pushing time point of the dictation content according to the dictation time.
303. The electronic device detects whether the current time point meets the push time point, if so, step 304 is executed, and if not, the process is ended.
304. The electronic device outputs first query information, where the first query information is used to consult whether the user starts dictation, if so, step 305 to step 306 are executed, and if not, the process is ended.
305. The electronic apparatus controls the image pickup apparatus to photograph the user to obtain a second photographed image containing an image of the face of the user.
306. The electronic device identifies whether the current posture of the user is the correct dictation posture from the second shot image, if not, the step 307 to the step 310 are executed, and if so, the step 308 to the step 310 are executed.
307. The electronic equipment controls the electronic equipment to output first prompt information, and the first prompt information is used for prompting the user to adjust the current posture to a correct dictation posture.
308. The electronic device recognizes the user's intention from the speech input by the user.
309. If the user intends to start dictation, the electronic equipment controls the camera equipment to shoot so as to obtain a first shot image.
310. The electronic equipment detects whether a first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image, if not, step 311 is executed, and if so, the process is ended.
311. The electronic equipment judges that the dictation content broadcasted by the dictation audio program is the neglected writing content of the user.
312. And the electronic equipment controls the electronic equipment to output second prompt information, wherein the second prompt information is used for prompting a user that the writing is missed in the dictation process.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device has played all dictation audio sections, the electronic device may output the second prompt information to the user; and/or the electronic device may output the second prompt information to the user immediately after the electronic device finishes playing the current dictation audio program and judges that the dictation content broadcasted by the dictation audio program is the neglected writing content of the user.
313. The electronic equipment outputs second inquiry information; and the second inquiry information is used for inquiring whether the user needs to replay the dictation audio section corresponding to the missed-writing content.
As an optional implementation manner, in the embodiment of the present invention, if the user does not need to replay the dictation audio section corresponding to the missed content, the electronic device may determine that the missed content of the user is content that the user has not yet mastered, and the electronic device may output the dictation content corresponding to the missed content to a display screen of the electronic device;
after the electronic device outputs the dictation content corresponding to the missed dictation content to the display screen of the electronic device, the electronic device can also report the dictation content corresponding to the missed dictation content and the identity information of the user to a teacher terminal corresponding to the user, so that a teacher belonging to the teacher terminal can learn which words are unknown or not known to the user, and the teacher can give a guide to the user in a targeted manner.
314. And if the user needs to replay the dictation audio sections corresponding to the missed writing contents, the electronic equipment controls the electronic equipment to replay the dictation audio sections corresponding to the missed writing contents.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device replays the dictation audio section corresponding to the missed-writing content, the electronic device may detect whether the user has written the dictation content corresponding to the missed-writing content within a preset time period, and if not, the electronic device may output a prompt message of the dictation content corresponding to the missed-writing content to prompt the user how to write the dictation content.
315. The electronic equipment acquires the actual writing order of the second dictation handwriting written by the user according to the replayed dictation audio section.
316. The electronic device detects whether the actual writing order of the second dictation handwriting matches the standard writing order of the missed writing content, if not, step 317 is executed, and if yes, the process is ended.
As an optional implementation manner, in the embodiment of the present invention, the obtained actual writing order of the second dictation writing, which is obtained by the electronic device, at least includes an actual relative position of the second dictation writing, a writing vector direction of the second dictation writing, and a cross point of first and second chinese character strokes of the second dictation writing;
after the electronic equipment acquires the actual writing stroke order of the second dictation handwriting, the electronic equipment can detect whether the relative position of the second dictation handwriting, the writing vector direction of the second dictation handwriting and the intersection point of the first Chinese character stroke and the second Chinese character stroke of the second dictation handwriting are consistent with the stroke writing in the target Chinese character or not, and the electronic equipment can sequentially detect and can also synchronously detect;
and when the electronic equipment detects, the user can determine that the user wrote by mistake as long as any one of the items does not conform to the stroke writing in the target Chinese character, so that the detection efficiency of inputting strokes by the user can be effectively improved.
317. And the electronic equipment controls the electronic equipment to play the writing video with the standard writing order of the missed writing content.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device controls the electronic device to play a standard writing stroke order writing video of the missed writing content, the electronic device may further report the dictation content corresponding to the missed writing content and the identity information of the user to a teacher terminal corresponding to the user, so that a teacher to which the teacher terminal belongs may learn which words are unknown or not yet mastered for the user, so that the teacher may give a guidance to the user;
after the electronic equipment controls the electronic equipment to play the writing video with the standard writing order of the missed writing content, the electronic equipment can also send the dictation content corresponding to the missed writing content to a friend account selected by the user through an intermediate server (such as a social server) so as to increase the communication between the user and friends in learning and improve the enthusiasm of the user in learning;
and after the electronic equipment controls the electronic equipment to play the writing video with the standard writing order of the missed writing content, the user can deepen the mastering degree of the dictation content corresponding to the missed writing content in a game mode so as to improve the learning enthusiasm of the user.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device finishes dictation operation, the electronic device may acquire a dictation score obtained when the user completes the dictation content, and may output the dictation score to a display screen of the electronic device;
and after the electronic equipment acquires the dictation score obtained by the user completing the dictation content, counting the number of times of the user dictating the dictation content, if the number of times meets the set dictation number, ending the dictation process, and if the number of times does not meet the set dictation number, executing the step of broadcasting the dictation audio section corresponding to the dictation content by the electronic equipment so as to assist the user to complete the dictation of the dictation content again.
It can be seen that the accuracy of dictation detection can be improved by implementing the dictation content identification method described in fig. 3.
In addition, by implementing the method for identifying dictation content described in fig. 3, the user can deepen the mastery degree of the dictation content corresponding to the missed dictation content in a game mode, and the learning enthusiasm of the user can be improved.
In addition, by implementing the recognition method of dictation content described in fig. 3, the interaction between the user and the friend in learning can be increased, so as to improve the learning enthusiasm of the user.
In addition, the recognition method of dictation content described in fig. 3 can effectively improve the detection efficiency of strokes input by the user.
Example four
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 4, the electronic device may include:
a first recognition unit 401 for recognizing a user's intention according to a voice input by a user.
A first control unit 402, configured to control the image pickup apparatus to perform shooting to obtain a first shot image if the user intends to be dictation-enabled.
The first detecting unit 403 is configured to detect whether a first dictation handwriting written by the user according to the broadcasted dictation audio program exists in the first captured image.
The determining unit 404 is configured to determine that the dictation content broadcasted by the dictation audio section is missed writing content of the user when the first detecting unit 403 detects that the first handwriting written by the user according to the broadcasted dictation audio section does not exist in the first captured image.
In the embodiment of the present invention, the electronic device may be an electronic device used by a student, such as a learning tablet, a learning machine, a family education machine, and a point reading machine, which is not limited in the embodiment of the present invention.
As an alternative implementation manner, in the embodiment of the present invention, the first identification unit 401 may identify whether a preset keyword related to a dictation starting intention exists in the voice input by the user, for example, "i want to dictation" or the like, and if so, determine that the user intention is dictation starting.
For example, after the electronic device has currently entered the learning mode, the user may wake up the user intention recognition function of the electronic device by voice, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive the voice input by the user and may recognize the user intention according to the voice input by the user.
For another example, after the electronic device has currently entered the learning mode, the user may manually wake up the user intention recognition function of the electronic device through a touch screen, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive the voice input by the user and may recognize the user intention according to the voice input by the user.
For another example, after the electronic device has currently entered the learning mode, the user may wake up the user intention recognition function of the electronic device by manually turning on a physical key switch disposed on the electronic device, and after the user intention recognition function of the electronic device is woken up, the electronic device may receive a voice input by the user and may recognize the user intention according to the voice input by the user.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device obtains the first captured image, the electronic device may detect whether a writing page exists in the first captured image, and if not, the first control unit 402 may control the mirror disposed above the electronic device to pop up, and may adjust an angle of the mirror with respect to a lens surface of the image capturing device, so that no matter at what angle the user uses the electronic device, a writing page exists in a mirror image in the mirror.
As an optional implementation manner, in the embodiment of the present invention, when the electronic device broadcasts the next dictation audio session, the first detecting unit 403 may detect whether a user writes a first dictation trace written by the broadcasted dictation audio session in the first captured image, and if not, the determining unit 404 may determine that the dictation content broadcasted by the dictation audio session is the missed-writing content of the user.
As an optional implementation manner, in the embodiment of the present invention, if the first detecting unit 403 detects that a first listening and writing handwriting written by the user according to the broadcasted listening and writing audio section exists in the first captured image, the electronic device may detect whether the first listening and writing handwriting is wrongly written;
and when the electronic equipment detects that the first handwriting is wrongly written, the electronic equipment can output the correct writing content of the first handwriting to a display screen of the electronic equipment, and can store the first handwriting into a handwriting error recording list of a user.
As an optional implementation manner, in the embodiment of the present invention, after the determining unit 404 determines that the dictation content broadcasted by the dictation audio section is the neglected writing content of the user, the electronic device may immediately send a prompt message to prompt the user to finish writing the neglected writing content as soon as possible;
after the electronic equipment sends out the prompt message, the electronic equipment can broadcast the dictation audio section again and can detect whether the user finishes writing the dictation content again;
if the electronic equipment detects that the user does not finish writing the dictation content within the specified duration, the electronic equipment can judge that the user does not completely master the dictation content, and the electronic equipment can output the dictation content to a display screen of the electronic equipment;
after the electronic equipment outputs the dictation content to a display screen of the electronic equipment, the electronic equipment can report the dictation content and identity information of the user to a teacher terminal corresponding to the user, so that a teacher belonging to the teacher terminal can learn which words are unknown or not mastered for the user, and the teacher can guide the user in a targeted manner;
after the electronic device outputs the dictation content to a display screen of the electronic device, the electronic device can also send the dictation content to a friend account selected by the user through an intermediate server (such as a social server) so as to increase the communication between the user and friends in learning, so that the learning enthusiasm of the user is improved;
and after the electronic equipment outputs the dictation content to the display screen of the electronic equipment, the user can deepen the mastery degree of the dictation content in a game mode so as to improve the learning enthusiasm of the user.
It can be seen that implementing the electronic device described in fig. 4 can improve the accuracy of dictation detection.
In addition, the electronic device described in fig. 4 is implemented to enable the user to obtain the writing page of the user no matter what angle the user uses the electronic device.
In addition, the electronic device described in fig. 4 is implemented to enable a teacher to whom the user belongs to learn which words are unknown or not known to the user, so that the teacher can specifically tutor the user.
In addition, with the electronic device described in fig. 4, the user can deepen the mastery degree of the dictation content in a game mode, and the enthusiasm of the user for learning can be improved.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 5 is optimized from the electronic device shown in fig. 4. Compared to the electronic device shown in fig. 4, the electronic device shown in fig. 5 may further include:
a second detection unit 405 for detecting whether the electronic device receives the dictation task notification before the first recognition unit 401 recognizes the user's intention from the voice input by the user. The dictation task notification is sent by a terminal device bound with the electronic device and at least comprises the dictation content and dictation time.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device is bound with the terminal device, the electronic device may be supervised by the terminal device;
and in the process of establishing the connection between the terminal equipment and the electronic equipment for the first time, the electronic equipment can preset the identity information of the terminal equipment and the authority of the terminal equipment for supervising the electronic equipment.
For example, the identity information of the terminal device may be a guardian, a teacher, a relative, a friend, a stranger, and the like, and the electronic device may set different authorities for monitoring the electronic device for different identity information, for example, the authority for monitoring the electronic device by the guardian may be a first authority level, the authority for monitoring the electronic device by the teacher may be a second authority level, the authority for monitoring the electronic device by the relative may be a third authority level, the authority for monitoring the electronic device may be a fourth authority level, and the authority for monitoring the electronic device may be a fifth authority level. The authority of the first authority level may be the highest, the authority of the fifth authority level may be the lowest, the higher the authority is, the higher the allowable frequency of supervising the electronic device is, and the lower the authority is, the lower the allowable frequency of supervising the electronic device is.
As an optional implementation manner, in the embodiment of the present invention, the dictation content may be some words and sentences that require the user to complete dictation, which are collected and sorted by the teacher; and/or the dictation content can be used for summarizing and sorting out new words and sentences except the new words and sentences which must be finished in the lesson for the teacher, and the like;
the dictation content can also be new words and sentences arranged by parents according to the learning condition of the user, and/or the dictation content can be new words and sentences arranged by the parents according to the learning requirement of a teacher.
A setting unit 406, configured to set a push time point of the dictation content according to the dictation time when the second detecting unit 405 detects that the electronic device receives the dictation task notification.
As an optional implementation manner, in this embodiment of the present invention, the dictation task notification may further include dictation times of the dictation content, and the setting unit 406 may set, in addition to the push time point, the dictation times of the dictation content, that is, the user needs to repeatedly dictating the dictation contents by the times corresponding to the dictation times. For example, if the number of dictations is 3, the user needs to re-dictating the dictation three times.
As an optional implementation manner, in an embodiment of the present invention, after the setting unit 406 sets a push time point of the dictation content according to the dictation time, the electronic device may output the set push time point to the user;
and after the setting unit 406 outputs the set push time point to the user, the electronic device may send query information to the user to query whether the user needs to change the push time point, and if so, the electronic device may output a display frame for adjusting the push time point.
A third detecting unit 407, configured to detect whether the current time point meets the pushing time point.
As an optional implementation manner, in the embodiment of the present invention, after the third detecting unit 407 detects that the current time point meets the pushing time point, the electronic device may detect whether a current location environment of the user meets a preset dictation environment, if yes, the electronic device may output the first inquiry information, and if not, the electronic device may delay the pushing time point for a certain time;
and after the electronic equipment delays the pushing time point for a certain time, the electronic equipment can detect whether the current position environment of the user meets the preset dictation environment again, if so, the electronic equipment can output first inquiry information, and if not, the electronic equipment can send prompt information to prompt the user to arrive at the preset dictation environment for dictation as soon as possible.
A first output unit 408, configured to output first query information when the third detecting unit 407 detects that the current time point meets the push time point, where the first query information is used to inquire whether the user starts dictation.
As an optional implementation manner, in the embodiment of the present invention, when the electronic device obtains that the user does not start dictation, the first output unit 408 may output query information again to query whether the user needs to change the push time point of the dictation content, and if so, the first output unit 408 may output a display frame for adjusting the push time point;
and if the user does not need to change the push time point of the dictation content, the first output unit 408 may output a display frame to the user, and the user may input, to the display frame, a reason why the user does not perform the dictation operation on the dictation content;
and after the user inputs the reason why the user does not perform the dictation operation on the dictation content into the display frame, the electronic device may send the reason to the terminal device bound with the electronic device, and may ask whether the terminal device needs to cancel the dictation operation of the dictation content, and if so, the electronic device may need to cancel the dictation of the dictation content.
As an alternative embodiment, in the electronic apparatus shown in fig. 5, the first control unit 402 is further configured to control the image pickup apparatus to photograph the user to obtain the second photographed image containing the image of the face of the user after the second control unit 408 outputs the first query information and before the first recognition unit 401 recognizes the user's intention from the voice input by the user. Accordingly, compared to the electronic device shown in fig. 4, the electronic device shown in fig. 5 further includes:
a second recognition unit 409 for recognizing whether the current posture of the user is the correct posture from the second captured image.
As an optional implementation manner, in the embodiment of the present invention, after the first control unit 402 acquires the second captured image containing the face image of the user, the electronic device may analyze the second captured image containing the face image of the user, so as to obtain the current emotion type of the user;
after the electronic device obtains the current emotion type of the user, the electronic device can judge whether the current emotion type is the low-falling emotion, if so, the electronic device can stop the current dictation operation on the dictation content, can detect whether the current position environment of the user is suitable for exercise (such as walking) for improving the low-falling emotion or not, and if so, sends prompt information to the user so as to improve the low-falling emotion.
As an optional implementation manner, in the embodiment of the present invention, when the electronic device determines that the current time point satisfies the push time point, and the user sits up in front of the screen of the family education device in a correct posture, that is, the user is ready for dictation, the dictation operation is performed.
A second control unit 410, configured to control the electronic device to output first prompt information when the second recognition unit 409 recognizes that the current posture of the user is not the correct posture from the second captured image, where the first prompt information is used to prompt the user to adjust the current posture to the correct dictation posture.
As an optional implementation manner, in an embodiment of the present invention, the first prompt information output by the electronic device includes:
displaying information prompt on a display screen of the electronic equipment;
and/or a voice message prompt sent by the electronic equipment.
As an alternative implementation manner, in the embodiment of the present invention, the first control unit 402 may obtain facial features of the user from the second captured image, and may obtain identity information of the user from portrait information pre-stored in the electronic device according to the facial features;
after the electronic equipment acquires the identity information of the user from the portrait information prestored in the electronic equipment, the electronic equipment can acquire a friend list of the user according to the identity information of the user and acquire friends in the same dictation time as the user from the friend list;
and after the electronic equipment acquires the friend who is in the same dictation time as the user from the friend list, the electronic equipment can push the friend to a display screen of the electronic equipment so that the user can learn about the friend who is in the same dictation time as the user at present, and therefore the communication between the user and the friend in learning is increased, and the enthusiasm of the user in learning is improved.
It can be seen that implementing another electronic device as described in fig. 5 can improve the accuracy of dictation detection.
In addition, with the implementation of another electronic device described in fig. 5, a manner of improving the low mood of the user can be obtained in time, and the influence on the attention of the user in the dictation process can be avoided.
In addition, with the implementation of another electronic device described in fig. 5, the user can learn the friends who are currently in the same dictation time as the user, so as to increase the interaction between the user and the friends in learning, so as to increase the enthusiasm of the user in learning.
EXAMPLE six
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 6 is optimized from the electronic device shown in fig. 5. The second control unit 408 shown in fig. 6 is further configured to control the electronic device to output second prompt information after the determining unit 404 determines that the dictation content of the dictation audio broadcast is missed dictation content of the user, where the second prompt information is used to prompt the user that missed dictation occurs during the dictation process. Compared to the electronic device shown in fig. 5, the electronic device shown in fig. 6 may further include:
a second output unit 411 for outputting the second inquiry information; the second query information is used for querying whether the user needs to replay the dictation audio section corresponding to the missed-writing content.
As an optional implementation manner, in this embodiment of the present invention, the second control unit 408 may output the second prompt message to the user after the electronic device has played all the dictation audio programs; and/or the second control unit 408 may output the second prompt message to the user immediately after the electronic device finishes playing the current dictation audio program and determines that the dictation content broadcasted by the dictation audio program is the missing-written content of the user.
As an optional implementation manner, in the embodiment of the present invention, if the user does not need to replay the dictation audio section corresponding to the missed content, the electronic device may determine that the missed content of the user is a content that has not been mastered by the user, and the second output unit 411 may output the dictation content corresponding to the missed content to a display screen of the electronic device;
after the second output unit 411 outputs the dictation content corresponding to the missed dictation content to the display screen of the electronic device, the electronic device may also report the dictation content corresponding to the missed dictation content and the identity information of the user to a teacher terminal corresponding to the user, so that a teacher belonging to the teacher terminal can learn which words are unknown or not known to the user, so that the teacher can give a targeted tutoring to the user.
And a third control unit 412, configured to control the electronic device to replay the dictation audio section corresponding to the missed content if the user needs to replay the dictation audio section corresponding to the missed content.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device replays the dictation audio section corresponding to the missed-writing content, the electronic device may detect whether the user has written the dictation content corresponding to the missed-writing content within a preset time period, and if not, the electronic device may output a prompt message of the dictation content corresponding to the missed-writing content to prompt the user how to write the dictation content.
Accordingly, compared to the electronic device shown in fig. 5, the electronic device shown in fig. 6 further includes:
the obtaining unit 413 is configured to obtain an actual writing order of the second dictation handwriting written by the user according to the replayed dictation audio section after the third control unit 412 controls the electronic device to replay the dictation audio section corresponding to the missed-writing content.
A fourth detecting unit 414, configured to detect whether the actual writing order of the second dictation writing is matched with the standard writing order of the missed writing content.
As an optional implementation manner, in the embodiment of the present invention, the actual writing order of the second dictation writing obtained by the obtaining unit 413 at least includes an actual relative position of the second dictation writing, a writing vector direction of the second dictation writing, and a crossing point of first and second chinese character strokes of the second dictation writing;
and after the obtaining unit 413 obtains the actual writing stroke order of the second dictation writing, the fourth detecting unit 414 may detect whether the obtained relative position of the second dictation writing, the writing vector direction of the second dictation writing and the intersection of the first and second Chinese character strokes of the second dictation writing coincide with the stroke writing in the target Chinese character, and the fourth detecting unit 414 may sequentially detect or may synchronously detect;
and when the fourth detection unit 414 detects, it can be determined that the user wrote the strokes as long as any one of the above items does not conform to the stroke writing in the target Chinese character, so that the detection efficiency of the user inputting the strokes can be effectively improved.
A fourth control unit 415, configured to control the electronic device to play a writing video of the standard writing order of the missed writing content when the fourth detection unit 414 detects that the actual writing order of the second dictation is not matched with the standard writing order of the missed writing content.
As an optional implementation manner, in the embodiment of the present invention, after the fourth control unit 415 controls the electronic device to play a writing video with standard writing orders of missed writing contents, the electronic device may further report the dictation contents corresponding to the missed writing contents and the identity information of the user to a teacher terminal corresponding to the user, so that a teacher to which the teacher terminal belongs may learn which words are unknown or not known to the user, so that the teacher may give a targeted guidance to the user;
after the fourth control unit 415 controls the electronic device to play the writing video with the standard writing order of the missed writing content, the electronic device may further send the dictation content corresponding to the missed writing content to the friend account selected by the user through an intermediate server (such as a social server), so as to increase the communication between the user and the friend in learning, so as to improve the enthusiasm of the user in learning;
and after the fourth control unit 415 controls the electronic device to play the writing video with the standard writing order of the missed writing content, the user can deepen the mastering level of the dictation content corresponding to the missed writing content in a game mode, so as to improve the learning enthusiasm of the user.
As an optional implementation manner, in the embodiment of the present invention, after the electronic device finishes dictation operation, the electronic device may acquire a dictation score obtained when the user completes the dictation content, and may output the dictation score to a display screen of the electronic device;
and after the electronic equipment acquires the dictation score obtained by the user completing the dictation content, counting the number of times of the user dictating the dictation content, if the number of times meets the set dictation number, ending the dictation process, and if the number of times does not meet the set dictation number, executing the step of broadcasting the dictation audio section corresponding to the dictation content by the electronic equipment so as to assist the user to complete the dictation of the dictation content again.
It can be seen that implementing another electronic device as described in fig. 6 can improve the accuracy of dictation detection.
In addition, with the electronic device described in fig. 6, the user can deepen the mastery degree of the dictation content corresponding to the missed content in a game manner, and the enthusiasm of the user for learning can be improved.
In addition, another electronic device described in fig. 6 is implemented, which can increase the interaction between the user and the friend in learning so as to increase the learning enthusiasm of the user.
In addition, the implementation of another electronic device described in fig. 6 can effectively improve the detection efficiency of the user input strokes.
EXAMPLE seven
Referring to fig. 7, fig. 7 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. As shown in fig. 7, the electronic device may include:
a memory 701 in which executable program code is stored;
a processor 702 coupled to the memory 701;
the processor 702 calls the executable program code stored in the memory 701 to execute any one of the methods for identifying dictation contents in fig. 1 to 3.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the identification methods of dictation contents in figures 1-3.
Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.
It will be understood by those skilled in the art that all or part of the steps of the methods of the embodiments described above may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, including Read-Only Memory (ROM), random Access Memory (RAM), programmable Read-Only Memory (PROM), erasable Programmable Read-Only Memory (EPROM), one-time Programmable Read-Only Memory (OTPROM), electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc-Read-Only Memory (CD-ROM) or other Memory capable of storing data, a magnetic tape, or any other computer-readable medium capable of storing data.
The method for identifying dictation content and the electronic device disclosed in the embodiments of the present invention are described in detail above, and specific examples are applied herein to explain the principles and embodiments of the present invention, and the description of the embodiments is only used to help understanding the method and its core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (8)

1. A method for identifying dictation content, the method comprising:
detecting whether the electronic equipment receives a dictation task notification; the dictation task notification is sent by a terminal device bound with the electronic device and at least comprises the dictation content and dictation time; if so, setting a pushing time point of the dictation content according to the dictation time;
detecting whether the current time point meets the pushing time point; if yes, detecting whether the current position environment of the user meets a preset dictation environment or not; if yes, outputting first inquiry information, wherein the first inquiry information is used for inquiring whether the user starts dictation, and if not, delaying the pushing time point for a preset time length;
recognizing user intention according to the voice input by the user; if the user intention is dictation starting, controlling the camera equipment to shoot so as to obtain a first shot image; detecting whether a first dictation handwriting written by the user according to the broadcasted dictation audio section exists in the first shot image; if not, judging that the dictation contents broadcasted by the dictation audio section are the missed-writing contents of the user;
after outputting the first query information and before recognizing the user's intention from the speech input by the user, the method further comprises:
controlling the image pickup apparatus to photograph the user to obtain a second photographed image containing the face image of the user;
analyzing the second shot image to obtain the current emotion type of the user; judging whether the current emotion type is a low falling emotion; if yes, detecting whether the current position environment of the user is suitable for exercise for improving the low-falling mood; if the user is suitable, sending prompt information to the user;
the method further comprises the following steps:
the facial features of the user are obtained from the second shot image, the identity information of the user is obtained from pre-stored portrait information according to the facial features, a friend list of the user is obtained according to the identity information, and friends who are in the same dictation time as the user are obtained from the friend list and pushed to a display screen of the electronic equipment.
2. The method for identifying dictation content as claimed in claim 1, characterized in that the method further comprises:
identifying whether the current posture of the user is a correct dictation posture from the second shot image; and if not, controlling the electronic equipment to output first prompt information, wherein the first prompt information is used for prompting the user to adjust the current posture to the correct dictation posture.
3. The method for identifying dictation contents as claimed in claim 1 or 2, wherein after determining that the dictation contents broadcasted by the dictation audio program are missed-written contents of the user, the method further comprises:
controlling the electronic equipment to output second prompt information, wherein the second prompt information is used for prompting that the user has missed writing in the dictation process;
outputting the second inquiry information; the second query information is used for querying whether the user needs to replay the dictation audio section corresponding to the missed-writing content;
and if the user needs to replay the dictation audio section corresponding to the missed content, controlling the electronic equipment to replay the dictation audio section corresponding to the missed content.
4. The dictation content recognition method of claim 3, wherein after controlling the electronic device to replay the dictation audio section corresponding to the missed dictation content, the method further comprises:
acquiring the actual writing stroke order of the second dictation handwriting written by the user according to the replayed dictation audio section;
detecting whether the actual writing order of the second dictation handwriting is matched with the standard writing order of the missed writing content; and if not, controlling the electronic equipment to play the writing video with the standard writing order of the missed writing content.
5. An electronic device, characterized in that the electronic device comprises:
a first recognition unit for recognizing a user's intention based on a voice input by a user;
the first control unit is used for controlling the camera equipment to shoot to obtain a first shot image if the user intends to start dictation;
the first detection unit is used for detecting whether a first dictation handwriting written by the user according to the broadcasted dictation audio program exists in the first shot image;
the determining unit is used for judging that the dictation content broadcasted by the dictation audio section is the neglected writing content of the user when the first detecting unit detects that the first dictation handwriting written by the user according to the broadcasted dictation audio section does not exist in the first shot image;
a second detection unit for detecting whether the electronic device receives the dictation task notification before the first recognition unit recognizes the user's intention according to the voice input by the user; the dictation task notification is sent by a terminal device bound with the electronic device and at least comprises the dictation content and dictation time;
the setting unit is used for setting a pushing time point of the dictation content according to the dictation time when the second detection unit detects that the electronic equipment receives a dictation task notification;
a third detecting unit, configured to detect whether a current time point satisfies the push time point; if yes, detecting whether the current position environment of the user meets a preset dictation environment, and if not, delaying the pushing time point for a preset time length;
the first output unit is used for outputting first inquiry information when the third detection unit detects that the current position of the user meets the preset dictation environment, wherein the first inquiry information is used for inquiring whether the user starts dictation or not;
the first control unit is further used for controlling the image pickup device to shoot the user so as to obtain a second shot image containing the face image of the user; analyzing the second shot image to obtain the current emotion type of the user; judging whether the current emotion type is a low falling emotion; if yes, detecting whether the current position environment of the user is suitable for exercise for improving the low mood; if the user is suitable, sending prompt information to the user; and acquiring the facial features of the user from the second shot image, acquiring the identity information of the user from pre-stored portrait information according to the facial features, acquiring a friend list of the user according to the identity information, acquiring friends in the same dictation time as the user from the friend list, and pushing the friends to a display screen of the electronic equipment.
6. The electronic device of claim 5, further comprising:
a second recognition unit that recognizes whether the current posture of the user is a correct dictation posture from the second photographed image;
and the second control unit is used for controlling the electronic equipment to output first prompt information when the second recognition unit recognizes that the current posture of the user is not the correct dictation posture from the second shot image, wherein the first prompt information is used for prompting the user to adjust the current posture to the correct dictation posture.
7. An electronic device, comprising:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the dictation content identification method of any one of claims 1 to 4.
8. A computer-readable storage medium characterized in that it stores a computer program, wherein the computer program causes a computer to execute the method for recognizing dictation content as claimed in any one of claims 1 to 4.
CN201910689394.9A 2019-07-29 2019-07-29 Recognition method of dictation content and electronic equipment Active CN111081227B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910689394.9A CN111081227B (en) 2019-07-29 2019-07-29 Recognition method of dictation content and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910689394.9A CN111081227B (en) 2019-07-29 2019-07-29 Recognition method of dictation content and electronic equipment

Publications (2)

Publication Number Publication Date
CN111081227A CN111081227A (en) 2020-04-28
CN111081227B true CN111081227B (en) 2022-12-27

Family

ID=70310129

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910689394.9A Active CN111081227B (en) 2019-07-29 2019-07-29 Recognition method of dictation content and electronic equipment

Country Status (1)

Country Link
CN (1) CN111081227B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112712737A (en) * 2021-01-13 2021-04-27 百度在线网络技术(北京)有限公司 Interaction method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660619A (en) * 2018-12-20 2019-04-19 广东小天才科技有限公司 A kind of method for pushing and electronic equipment of compostion topic
CN109669661A (en) * 2018-12-20 2019-04-23 广东小天才科技有限公司 A kind of control method and electronic equipment of dictation progress

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9691385B2 (en) * 2014-06-19 2017-06-27 Nuance Communications, Inc. Methods and apparatus for associating dictation with an electronic record
CN105679119A (en) * 2016-01-20 2016-06-15 潘爱松 Scanning dictation method
CN109558511A (en) * 2018-12-12 2019-04-02 广东小天才科技有限公司 A kind of dictation enters for method and device
CN109300347B (en) * 2018-12-12 2021-01-26 广东小天才科技有限公司 Dictation auxiliary method based on image recognition and family education equipment
CN109599108A (en) * 2018-12-17 2019-04-09 广东小天才科技有限公司 A kind of dictation householder method and dictation auxiliary device
CN109887349B (en) * 2019-04-12 2021-05-11 广东小天才科技有限公司 Dictation auxiliary method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660619A (en) * 2018-12-20 2019-04-19 广东小天才科技有限公司 A kind of method for pushing and electronic equipment of compostion topic
CN109669661A (en) * 2018-12-20 2019-04-23 广东小天才科技有限公司 A kind of control method and electronic equipment of dictation progress

Also Published As

Publication number Publication date
CN111081227A (en) 2020-04-28

Similar Documents

Publication Publication Date Title
EP3611895B1 (en) Method and device for user registration, and electronic device
CN109960809B (en) Dictation content generation method and electronic equipment
CN109460209B (en) Control method for dictation and reading progress and electronic equipment
CN109446315B (en) Question solving auxiliary method and question solving auxiliary client
CN109410664B (en) Pronunciation correction method and electronic equipment
CN111077996B (en) Information recommendation method and learning device based on click-to-read
CN109165336B (en) Information output control method and family education equipment
CN111081080B (en) Voice detection method and learning device
CN111081084B (en) Method for broadcasting dictation content and electronic equipment
CN111026949A (en) Question searching method and system based on electronic equipment
CN113657509B (en) Teaching training lifting method, device, terminal and storage medium
CN111081227B (en) Recognition method of dictation content and electronic equipment
CN111026786A (en) Dictation list generation method and family education equipment
CN111079501B (en) Character recognition method and electronic equipment
CN111079504A (en) Character recognition method and electronic equipment
CN111028591B (en) Dictation control method and learning equipment
CN109271480B (en) Voice question searching method and electronic equipment
CN111078890B (en) Raw word collection method and electronic equipment
CN111078992B (en) Dictation content generation method and electronic equipment
CN111028590B (en) Method for guiding user to write in dictation process and learning device
CN111026839B (en) Method for detecting mastering degree of dictation word and electronic equipment
CN111091008B (en) Dictation prompt content determining method and electronic equipment
CN110415688B (en) Information interaction method and robot
CN111027794B (en) Correction method and learning equipment for dictation operation
CN111079414A (en) Dictation detection method, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant