CN111081105B - Dictation detection method in black screen standby state and electronic equipment - Google Patents

Dictation detection method in black screen standby state and electronic equipment Download PDF

Info

Publication number
CN111081105B
CN111081105B CN201910643175.7A CN201910643175A CN111081105B CN 111081105 B CN111081105 B CN 111081105B CN 201910643175 A CN201910643175 A CN 201910643175A CN 111081105 B CN111081105 B CN 111081105B
Authority
CN
China
Prior art keywords
writing
content
user
picture
electronic equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910643175.7A
Other languages
Chinese (zh)
Other versions
CN111081105A (en
Inventor
郑洲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201910643175.7A priority Critical patent/CN111081105B/en
Publication of CN111081105A publication Critical patent/CN111081105A/en
Application granted granted Critical
Publication of CN111081105B publication Critical patent/CN111081105B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the invention discloses a dictation detection method and electronic equipment in a black screen standby state, wherein the method comprises the following steps: when the electronic equipment is in a black screen standby state, acquiring a writing picture by using a shooting module; wherein, the writing content contained in the writing picture is obtained by handwriting according to the reading content of the electronic equipment by a user; identifying the acquired writing picture to obtain identification content; modifying the identification content according to the reading content to obtain a modification result aiming at the writing content contained in the writing picture; and when the termination of the writing action of the user is detected, controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction result. By implementing the embodiment of the invention, the process of dictation detection in a black screen standby state can be simplified.

Description

Dictation detection method in black screen standby state and electronic equipment
Technical Field
The invention relates to the technical field of education, in particular to a dictation detection method in a black screen standby state and electronic equipment.
Background
At present, most of the family education equipment on the market has the dictation function, and can realize the automatic reading of the contents to be dictated by students and the automatic correction of dictation results. In practice, it is found that when the home education device is in a black screen standby state, the mode that the user starts the dictation function of the home education device is generally as follows: lighting the touch screen of the family education device, unlocking the screen, searching an application program for realizing the dictation function, starting the application program, and controlling a reading process and a correcting process in the application program. Therefore, the process of performing dictation detection by the user based on the family education equipment in the black screen standby state is complicated.
Disclosure of Invention
The embodiment of the invention discloses a dictation detection method in a black screen standby state and electronic equipment, which can simplify the dictation detection process in the black screen standby state.
The first aspect of the embodiments of the present invention discloses a dictation detection method in a black screen standby state, comprising:
when the electronic equipment is in a black screen standby state, acquiring a writing picture by using a shooting module; writing contents contained in the writing picture are obtained by handwriting of a user according to the reading contents of the electronic equipment;
performing content identification on the writing picture to obtain identification content;
correcting the identification content according to the reading content to obtain a correction result aiming at the writing content contained in the writing picture;
and when the termination of the writing action of the user is detected, controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state, and then outputting the correction result.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, when the electronic device is in a black screen standby state, acquiring a writing picture by using a shooting module includes:
when the electronic equipment is in a black screen standby state, monitoring the handwriting process of a user by using a shooting module;
and when the fact that the moving distance of the hand of the user in the handwriting process is larger than the preset distance is detected, shooting the current writing page by utilizing the shooting module to obtain a writing picture.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the performing content recognition on the writing picture to obtain a recognition content includes:
judging whether a previous writing picture corresponding to the writing picture exists or not;
if so, cutting the writing picture according to the previous writing picture to obtain a target writing picture; and performing content identification on the target writing picture to obtain identification content; writing contents contained in the target writing picture are obtained by a user through handwriting according to current reading contents of the electronic equipment;
if not, determining the writing picture as the target writing picture; and performing content identification on the target writing picture to obtain identification content;
the modifying the identification content according to the reading content to obtain a modifying result aiming at the writing content comprises:
and modifying the identification content according to the current reading content of the electronic equipment to obtain a modification result aiming at the writing content contained in the target writing picture.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, when it is detected that the writing action of the user is terminated, the controlling the display screen of the electronic device to be switched from a black screen state to a bright screen state and then outputting the correction result includes:
when the termination of the writing action of the user is detected, integrating all the correction results to generate a correction report;
and controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction report.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the integrating all the correction results and generating the correction report when the termination of the writing action of the user is detected, the method further includes:
detecting whether the electronic equipment is associated with terminal equipment;
and when the electronic equipment is associated with the terminal equipment, the correction report is sent to the terminal equipment.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
the acquisition unit is used for acquiring a writing picture by utilizing the shooting module when the electronic equipment is in a black screen standby state; writing contents contained in the writing picture are obtained by handwriting of a user according to the reading contents of the electronic equipment;
the recognition unit is used for carrying out content recognition on the writing picture to obtain recognition content;
the correction unit is used for correcting the identification content according to the reading content to obtain a correction result aiming at the writing content contained in the writing picture;
and the display unit is used for controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction result when the termination of the writing action of the user is detected.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the acquisition unit includes:
the monitoring subunit is used for monitoring the handwriting process of the user by utilizing the shooting module when the electronic equipment is in a black screen standby state;
and the shooting subunit is used for shooting the current writing page by utilizing the shooting module to obtain a writing picture when detecting that the moving distance of the hand of the user in the handwriting process is greater than the preset distance.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the identification unit includes:
the judging subunit is used for judging whether a previous writing picture corresponding to the writing picture exists or not;
the recognition subunit is used for cutting the writing picture according to the previous writing picture to obtain a target writing picture and recognizing the content of the target writing picture to obtain recognized content when the previous writing picture exists; writing content contained in the target writing picture is obtained by a user through handwriting according to current reading content of the electronic equipment; when the previous writing picture does not exist, determining the writing picture as the target writing picture, and performing content identification on the target writing picture to obtain an identification content;
the modifying unit is configured to modify the identification content according to the reading content, and a manner of obtaining a modifying result for the writing content included in the writing picture is specifically as follows:
and the correcting unit is used for correcting the identification content according to the current reading content of the electronic equipment to obtain a correcting result aiming at the writing content contained in the target writing picture.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, when it is detected that the writing action of the user is terminated, the manner of controlling the display screen of the electronic device to switch from the black screen state to the bright screen state and then outputting the correction result is specifically:
and the display unit is used for integrating all the correction results to generate a correction report when the termination of the writing action of the user is detected, and controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction report.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the detection unit is used for integrating all the correction results when the display unit detects that the writing action of the user is terminated, generating a correction report and then detecting whether the electronic equipment is associated with terminal equipment;
and the sending unit is used for sending the correction report to the terminal equipment when the electronic equipment is associated with the terminal equipment.
A third aspect of an embodiment of the present invention discloses an electronic device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to perform part or all of the steps of any one of the methods of the first aspect of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program comprising a program for performing some or all of the steps of any one of the methods of the first aspect of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application distribution system, configured to distribute a computer program product, where the computer program product, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, when the electronic equipment is in a black screen standby state, a shooting module is used for collecting a writing picture; wherein, the writing content contained in the writing picture is obtained by handwriting according to the reading content of the electronic equipment by a user; performing content identification on the acquired writing picture to obtain identification content; correcting the identification content according to the reading content to obtain a correction result aiming at the writing content contained in the writing picture; and when the termination of the writing action of the user is detected, controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction result. By implementing the embodiment of the invention, the recognition and correction of the writing picture and the pushing of the correction result can be realized in the standby state of the black screen of the electronic equipment, the dictation detection process in the standby state of the black screen is simplified, and the improvement of user experience is facilitated.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without making a creative effort.
Fig. 1 is a schematic flow chart of a dictation detection method in a black screen standby state according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of another dictation detection method in a black screen standby state according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a dictation detection method in a black screen standby state according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 5 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
fig. 7 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises," "comprising," "includes," "including," and any variations thereof in the embodiments and drawings hereof are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a dictation detection method in a black screen standby state and electronic equipment, which can simplify the dictation detection process in the black screen standby state. In the embodiment of the present invention, the dictation detection method in the black screen standby state may be applied to various electronic devices such as a smart phone, a smart watch, and a tablet, and the embodiment of the present invention is not limited. The operating systems of various electronic devices may include, but are not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a Black Berry operating system, a Windows Phone8 operating system, and the like, which is not limited in the embodiment of the present invention.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of a dictation detection method in a black screen standby state according to an embodiment of the present invention. The dictation detection method in the black screen standby state shown in fig. 1 may specifically include the following steps:
101. when the electronic equipment is in a black screen standby state, acquiring a writing picture by using a shooting module; the writing content contained in the writing picture is obtained by handwriting according to the reading content of the electronic equipment by a user.
In the embodiment of the present invention, the shooting module mentioned in step 101 may be built in the electronic device, or may be independent of the electronic device, and the embodiment of the present invention is not limited thereto, and if the shooting module is independent of the electronic device, the shooting module may have a bluetooth or WIFI module, and perform bluetooth or WIFI connection with the electronic device, so that the electronic device may utilize the shooting module to acquire the written image. By implementing the method, the acquisition of the writing picture is given charge by the shooting module independent of the electronic equipment, so that the equipment power consumption of the electronic equipment can be effectively reduced, and the standby time can be prolonged.
It should be noted that, in the embodiment of the present invention, the shooting module may be a rotary type or a non-rotary type, if the shooting module is a rotary type, the user may manually rotate the shooting module to enable the shooting module to shoot the writing page of the user, and if the shooting module is a non-rotary type, the shooting module may include a reflective mirror, so that the shooting unit of the shooting module may shoot the writing page of the user by means of the reflective mirror. The specific implementation manner of acquiring the writing picture by using the shooting module will be described in the following method embodiments, which are not described in detail herein.
102. And performing content identification on the writing picture to obtain identification content.
As an optional implementation manner, in the embodiment of the present invention, before performing step 102, the following steps may also be performed:
judging whether the writing picture meets the identification condition;
when the recognition condition is satisfied, the content recognition of the writing picture is executed to obtain the recognition content.
The writing page of the user can be a paper page containing a frame, the writing picture meeting the identification condition can mean that the writing picture contains the frame, and the integrity of the collected writing picture can be ensured by implementing the method.
Further optionally, in the embodiment of the present invention, when the above identification condition is not satisfied, the following steps may be further performed:
detecting whether an area indication request input by a user is received;
if receiving the area indication request, projecting the indication area to the horizontal plane on which the writing page of the user is placed so that the user can place the writing page in a standard way, thereby further ensuring the integrity of the writing picture
By implementing the method, the integrity of the writing picture can be effectively ensured by setting the identification condition.
103. And modifying the identification content according to the reading content to obtain a modification result aiming at the writing content contained in the writing picture.
104. And when the termination of the writing action of the user is detected, controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction result.
In the embodiment of the present invention, a specific implementation manner of detecting whether the writing action of the user is terminated may be:
detecting whether a writing pen of a user is in a placing state;
if the writing pen is in the placing state, judging whether the duration of the placing state of the writing pen is longer than the preset duration;
and if the time length is longer than the preset time length, determining that the writing action of the user is terminated.
By implementing the method, the intelligent detection of whether the writing action is terminated or not is realized without the intervention of the user, and the use experience of the user can be improved.
By implementing the method, the dictation detection process in the black screen standby state can be simplified, the equipment power consumption of the electronic equipment can be effectively reduced, the standby time can be prolonged, the integrity of a writing picture can be effectively ensured, and the use experience of a user can be improved by intelligently detecting whether the writing action is terminated or not.
Example two
Referring to fig. 2, fig. 2 is a schematic flow chart of another dictation detection method in a black screen standby state according to an embodiment of the present invention. The dictation detection method in the black screen standby state shown in fig. 2 may specifically include the following steps:
201. when the electronic equipment is in a black screen standby state, the handwriting process of the user is monitored by using the shooting module.
As an optional implementation manner, when the electronic device is in a black screen standby state, monitoring the handwriting process of the user by using the shooting module includes:
when the electronic equipment is in a black screen standby state, detecting whether the environmental parameters of the area where the electronic equipment is located are within a legal parameter range; wherein the environment parameters at least comprise environment noise and environment brightness;
and when the environmental parameters are in the legal parameter range, monitoring the handwriting process of the user by using the shooting module.
By implementing the method, before monitoring the handwriting process of the user, the user is ensured to be in a good learning environment (the environment is noisy and the environment is proper in brightness) by detecting the environmental parameters of the area where the electronic equipment is located, and the method is beneficial to improving the learning efficiency of the user and protecting the vision of the user.
202. And when the fact that the moving distance of the hand of the user in the handwriting process is larger than the preset distance is detected, shooting the current writing page by utilizing the shooting module to obtain a writing picture.
203. Judging whether a previous writing picture corresponding to the writing picture exists or not; if yes, executing the step 204, the step 206 to the step 208; if not, step 205 to step 208 are executed.
204. Cutting the writing picture according to the previous writing picture to obtain a target writing picture; performing content identification on the target writing picture to obtain identification content; the writing content contained in the target writing picture is obtained by handwriting by a user according to the current reading content of the electronic equipment.
205. Determining the writing picture as a target writing picture; and performing content identification on the target writing picture to obtain identification content.
206. And modifying the identification content according to the current reading content of the electronic equipment to obtain a modification result aiming at the writing content contained in the target writing picture.
207. And when the termination of the writing action of the user is detected, integrating all the correction results to generate a correction report.
As an optional implementation manner, in the embodiment of the present invention, after the step 207 is executed, the following steps may also be executed:
obtaining the content to be consolidated according to the correction report;
synthesizing historical learning records of a user, and setting a consolidation time period of the content to be consolidated;
and storing the content to be consolidated and the consolidation time interval corresponding to the content to be consolidated into a consolidation content library in a correlated manner.
By implementing the method, the contents to be consolidated are automatically recorded without manual excerpting by a user, and the recording efficiency can be improved.
208. And controlling the display screen of the electronic equipment to be switched from the black screen state to the bright screen state and then outputting the batch change report.
In the embodiment of the invention, the step 202 to the step 206 are executed, the shooting module can shoot a plurality of writing pictures at intervals on the writing page of the user in the process of monitoring the handwriting process of the user, and the electronic equipment immediately performs identification and correction operation (as shown in the step 202 to the step 206) when acquiring one writing picture, so that the generation efficiency of the correction report can be effectively improved by the interval acquisition, identification and correction method.
By implementing the method, the dictation detection process in the black screen standby state can be simplified, the equipment power consumption of the electronic equipment can be effectively reduced, the standby time can be prolonged, the integrity of a writing picture can be effectively ensured, the use experience of a user can be improved by intelligently detecting whether the writing action is terminated or not, the learning efficiency of the user can be improved, the eyesight of the user can be protected, and the generation efficiency of a correction report can be effectively improved.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic flow chart of another dictation detection method in a black screen standby state according to an embodiment of the present invention. The dictation detection method in the black screen standby state shown in fig. 3 may specifically include the following steps:
for detailed description of step 301 to step 307, please refer to the description of step 201 to step 207 in the second embodiment, and the detailed description of the embodiment of the present invention is omitted.
308. Detecting whether the electronic equipment is associated with terminal equipment, if so, executing step 309; if not, the flow is ended.
309. And sending the correction report to the terminal equipment.
310. And controlling the display screen of the electronic equipment to be switched from the black screen state to the bright screen state and then outputting the batch change report.
It should be noted that step 310 and step 308 occur after step 307.
In the embodiment of the present invention, the electronic device may be a family education device bound with a user study number, the terminal device may be a teacher end, and the teacher may send the content to be dictating to the electronic device through the terminal device, so that the student can use the electronic device to implement autonomous dictation of the content to be dictating, that is, the reading content of the electronic device is the content to be dictating sent by the terminal device.
Optionally, after the electronic device sends the correction report to the terminal device, the terminal device may comprehensively analyze the correction report sent by each electronic device to obtain an overall learning effect of the student on the content to be subjected to dictation, which is beneficial for a teacher to reasonably plan a subsequent teaching task.
Furthermore, the terminal device can also obtain dictation ranking records aiming at the content to be dictated according to the correction report sent by each electronic device, and send the dictation ranking records to the electronic devices so as to show the dictation ranking records to students through the electronic devices, wherein the dictation ranking records can contain the information of the student's academic number, name, ranking serial number and the like, and the implementation of the method is favorable for exciting the learning annals of the students.
Still further, the terminal device may further determine a dictation star record from the dictation ranking records, and send a virtual gift to a target electronic device indicated by the dictation star record to play a role in motivating students.
By implementing the method, the dictation detection process in the black screen standby state can be simplified, the equipment power consumption of the electronic equipment can be effectively reduced, the standby time can be prolonged, the integrity of a writing picture can be effectively ensured, the intelligent detection on whether the writing action is terminated can be realized, the use experience of a user is improved, the learning efficiency of the user can be improved, the eyesight of the user can be protected, the subsequent teaching task can be reasonably planned by a teacher, the learning struggle of students can be stimulated, and the effect of stimulating the students can be played.
Example four
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 4, the electronic device may include:
the acquisition unit 401 is configured to acquire a writing picture by using a shooting module when the electronic device is in a black screen standby state; the writing content contained in the writing picture is obtained by handwriting according to the reading content of the electronic equipment by a user.
In the embodiment of the present invention, for detailed description of the shooting module, please refer to the description in the method embodiment, which is not repeated herein.
A recognition unit 402, configured to perform content recognition on the writing picture to obtain a recognition content.
As an optional implementation manner, in the embodiment of the present invention, the acquisition unit 401 may be further configured to determine whether the writing picture meets the identification condition after the shooting module is used to acquire the writing picture; and when the recognition condition is satisfied, triggering the recognition unit 402 to perform the above-mentioned content recognition on the writing picture to obtain the operation of recognizing the content. The writing page of the user can be a paper page comprising a frame, the writing picture meeting the recognition condition can be that the writing picture comprises the frame, and the completeness of the collected writing picture can be ensured by implementing the mode.
Further optionally, in this embodiment of the present invention, the acquisition unit 401 may be further configured to detect whether an area indication request input by a user is received when the writing picture does not satisfy the identification condition; and when the area indication request is received, projecting an indication area to a horizontal plane on which the writing page of the user is placed so that the user can place the writing page in a standard manner, thereby further ensuring the integrity of the writing picture.
And an modifying unit 403, configured to modify the identification content according to the reading content, so as to obtain a modifying result for the writing content included in the writing picture.
And the display unit 404 is configured to control the display screen of the electronic device to switch from a black screen state to a bright screen state and output the correction result when the termination of the writing action of the user is detected.
In this embodiment of the present invention, the display unit 404 may be further configured to detect whether the writing action of the user is terminated, and optionally, the manner that the display unit 404 is configured to detect whether the writing action of the user is terminated may specifically be:
a display unit 404 for detecting whether a writing pen of a user is in a set state; when the writing pen is in the placing state, judging whether the duration of the placing state of the writing pen is longer than the preset duration; and determining that the writing action of the user is terminated when the writing action is longer than the preset duration. By implementing the method, the intelligent detection of whether the writing action is terminated or not is realized under the condition of no need of user intervention, and the use experience of the user can be improved.
Through implementing above-mentioned electronic equipment, can simplify the dictation testing process under the black screen standby state, can also effectively reduce electronic equipment's equipment consumption, be favorable to prolonging standby time, can also effectively guarantee to write the integrality of picture, can also improve user's use and experience the sense through the intellectual detection system whether the action of writing stops.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 5 is optimized from the electronic device shown in fig. 4, and as shown in fig. 5, the acquisition unit 401 in the electronic device may include:
and the monitoring sub-unit 4011 is configured to monitor a handwriting process of the user by using the shooting module when the electronic device is in a black screen standby state.
As an optional implementation manner, the monitoring sub-unit 4011 is configured to, when the electronic device is in a black screen standby state, specifically, monitor a handwriting process of the user by using the shooting module in a manner that:
the monitoring sub-unit 4011 is configured to detect whether an environmental parameter of an area where the electronic device is located is within a legal parameter range when the electronic device is in a black screen standby state; wherein the environment parameters at least comprise environment noise and environment brightness; and when the environmental parameters are in the legal parameter range, monitoring the handwriting process of the user by using the shooting module. By implementing the method, before monitoring the handwriting process of the user, the environment parameters of the area where the electronic equipment is located are detected to ensure that the user is in a good learning environment (the environment is noisy and the environment is appropriate in brightness), so that the learning efficiency of the user is improved, and the eyesight of the user is protected.
And the shooting sub-unit 4012 is configured to shoot the current writing page by using the shooting module to obtain a writing picture when it is detected that the moving distance of the hand of the user in the handwriting process is greater than a preset distance.
Optionally, in this embodiment of the present invention, the identifying unit 402 may include:
the determining subunit 4021 is configured to determine whether a previous writing picture corresponding to the writing picture exists.
The recognition subunit 4022 is configured to, when a previous writing picture exists, cut the writing picture according to the previous writing picture to obtain a target writing picture, and perform content recognition on the target writing picture to obtain a recognition content; writing contents contained in the target writing picture are obtained by handwriting of a user according to current reading contents of the electronic equipment; and when the previous writing picture does not exist, determining the writing picture as a target writing picture, and performing content recognition on the target writing picture to obtain recognition content.
The modifying unit 403 is configured to modify the identification content according to the reading content, and a manner of obtaining a modifying result for the writing content included in the writing screen may specifically be:
the correcting unit 403 is configured to correct the identified content according to the current reading content of the electronic device, so as to obtain a correcting result for the writing content included in the target writing picture.
Further optionally, in an embodiment of the present invention, when it is detected that the writing action of the user is terminated, a mode of controlling the display screen of the electronic device to be switched from a black screen state to a bright screen state and then outputting the batch change result may specifically be:
the display unit 404 is configured to synthesize all the correction results when it is detected that the writing action of the user is terminated, generate a correction report, and control the display screen of the electronic device to switch from a black screen state to a bright screen state, and then output the correction report.
As an optional implementation manner, in an embodiment of the present invention, the display unit 404 may be further configured to, when it is detected that the writing action of the user is terminated, synthesize all the correction results, generate a correction report, and then obtain the content to be consolidated according to the correction report; and setting a consolidation time period of the content to be consolidated by integrating the historical learning records of the user; and storing the content to be consolidated and the consolidation time interval corresponding to the content to be consolidated into a consolidation content library in a correlated manner. By implementing the method, the contents to be consolidated are automatically recorded, the user does not need to manually extract, and the recording efficiency can be improved.
In the embodiment of the present invention, in the process of monitoring the handwriting process of the user by the monitoring sub-unit 4011, the shooting sub-unit 4012 performs interval shooting on the writing page of the user to obtain a plurality of writing pictures, and each time a writing picture is obtained by acquisition, the recognition unit 402 immediately recognizes the writing picture, and the correction unit 403 corrects the writing picture.
Through implementing above-mentioned electronic equipment, can simplify the dictation testing process under the black screen standby state, can also effectively reduce electronic equipment's equipment consumption, be favorable to prolonging the standby duration, can also effectively guarantee to write the integrality of picture, can also improve user's use experience through the intellectual detection system whether the action of writing terminates, still help improving user's learning efficiency and protection user's eyesight, can also effectively improve the generation efficiency of wholesale report.
EXAMPLE six
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 6 is optimized from the electronic device shown in fig. 5, and the electronic device shown in fig. 6 may further include:
a detecting unit 405, configured to detect whether the electronic device is associated with a terminal device after the display unit 404 integrates all the correction results and generates a correction report when detecting that the writing action of the user is terminated.
A sending unit 406, configured to send the correction report to a terminal device when the terminal device is associated with the electronic device.
In the embodiment of the present invention, the electronic device may be a family education device bound with a student number, the terminal device may be a teacher end, and the teacher may send the content to be dictating to the electronic device through the terminal device, so that the student can use the electronic device to implement autonomous dictation of the content to be dictating, that is, the reading content of the electronic device is the content to be dictating sent by the terminal device.
Optionally, after the electronic device sends the correction report to the terminal device, the terminal device may comprehensively analyze the correction report sent by each electronic device to obtain an overall learning effect of the student for the content to be dictating, which is beneficial for a teacher to reasonably plan a subsequent teaching task.
Furthermore, the terminal device can also obtain dictation ranking records aiming at the content to be dictated according to the correction report sent by each electronic device, and send the dictation ranking records to the electronic devices so as to show the dictation ranking records to students through the electronic devices, wherein the dictation ranking records can contain the information of the student's academic number, name, ranking serial number and the like, and the implementation of the method is favorable for exciting the learning annals of the students.
Still further, the terminal device may further determine a dictation star record from the dictation ranking records, and send a virtual gift to a target electronic device indicated by the dictation star record to play a role in motivating students.
Through implementing above-mentioned electronic equipment, can simplify the dictation testing process under the black screen standby state, can also effectively reduce electronic equipment's equipment consumption, be favorable to prolonging the standby time, can also effectively guarantee the integrality of writing the picture, can also terminate the intellectual detection system whether through writing the action, improve user's use and experience the sense, still help improving user's learning efficiency and protection user's eyesight, can also be favorable to the subsequent teaching task of teacher rational planning, still be favorable to arousing student's study annals, can also play the effect of motivating the student.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 7, the electronic device may include:
a memory 701 in which executable program code is stored;
a processor 702 coupled to the memory 701;
the processor 702 calls the executable program code stored in the memory 701 to execute the dictation detection method in the black screen standby state shown in any one of fig. 1 to 3.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute a dictation detection method in a black screen standby state shown in any one of figures 1 to 3.
The embodiment of the invention discloses a computer program product, which enables a computer to execute a dictation detection method in any one of the black screen standby states in figures 1-3 when the computer program product runs on the computer.
The embodiment of the invention discloses an application issuing system, which is used for issuing a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute a dictation detection method in any one of the black screen standby states in figures 1 to 3.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The dictation detection method and the electronic device in the black screen standby state disclosed in the embodiments of the present invention are described in detail above, and specific examples are applied herein to explain the principles and implementations of the present invention, and the step numbers in the specific examples do not mean that the execution sequence is necessarily sequential, and the execution sequence of each process should be determined by its function and internal logic, but should not be limited in any way to the implementation process of the embodiments of the present invention. The units described as separate parts may or may not be physically separate, and some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
The character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship. In the embodiments provided herein, it should be understood that "B corresponding to A" means that B is associated with A from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. If the integrated unit is implemented as a software functional unit and sold or used as a separate product, it may be stored in a memory accessible to a computer. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
The above description of the embodiments is only intended to facilitate the understanding of the method of the invention and its core ideas; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (6)

1. A dictation detection method in a black screen standby state is characterized by comprising the following steps:
when the electronic equipment is in a black screen standby state, monitoring the handwriting process of a user by using a shooting module;
when the fact that the moving distance of the hand of the user in the handwriting process is larger than the preset distance is detected, shooting a current writing page by using the shooting module to obtain a writing picture; writing contents contained in the writing picture are obtained by handwriting of a user according to the reading contents of the electronic equipment;
judging whether a previous writing picture corresponding to the writing picture exists or not;
if so, cutting the writing picture according to the previous writing picture to obtain a target writing picture; performing content identification on the target writing picture to obtain identification content; writing contents contained in the target writing picture are obtained by a user through handwriting according to current reading contents of the electronic equipment;
if not, determining the writing picture as the target writing picture; and performing content identification on the target writing picture to obtain identification content;
according to the current reading content of the electronic equipment, modifying the identification content to obtain a modification result aiming at the writing content contained in the target writing picture;
and when the termination of the writing action of the user is detected, controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state, and then outputting the correction result.
2. The method according to claim 1, wherein the controlling the display screen of the electronic device to be switched from a black screen state to a bright screen state and then outputting the correction result when detecting that the writing action of the user is terminated comprises:
when the termination of the writing action of the user is detected, integrating all the correction results to generate a correction report;
and controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction report.
3. The method of claim 2, wherein after integrating all the correction results and generating a correction report upon detecting termination of the writing action of the user, the method further comprises:
detecting whether the electronic equipment is associated with terminal equipment;
and when the electronic equipment is associated with the terminal equipment, the correction report is sent to the terminal equipment.
4. An electronic device, comprising:
the acquisition unit is used for acquiring a writing picture by utilizing the shooting module when the electronic equipment is in a black screen standby state; writing contents contained in the writing picture are obtained by handwriting of a user according to the reading contents of the electronic equipment;
the recognition unit is used for carrying out content recognition on the writing picture to obtain recognition content;
the correction unit is used for correcting the identification content according to the reading content to obtain a correction result aiming at the writing content contained in the writing picture;
the display unit is used for controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction result when the termination of the writing action of the user is detected;
the acquisition unit includes:
the monitoring subunit is used for monitoring the handwriting process of the user by utilizing the shooting module when the electronic equipment is in a black screen standby state;
the shooting subunit is used for shooting the current writing page by using the shooting module to obtain a writing picture when detecting that the moving distance of the hand of the user in the handwriting process is greater than the preset distance;
the identification unit includes:
the judging subunit is used for judging whether a previous writing picture corresponding to the writing picture exists or not;
the recognition subunit is used for cutting the writing picture according to the previous writing picture to obtain a target writing picture and recognizing the content of the target writing picture to obtain recognized content when the previous writing picture exists; writing content contained in the target writing picture is obtained by a user through handwriting according to current reading content of the electronic equipment; when the previous writing picture does not exist, determining the writing picture as the target writing picture, and performing content identification on the target writing picture to obtain an identification content;
the correcting unit is specifically configured to correct the identification content according to the current reading content of the electronic device, so as to obtain a correcting result for the writing content included in the target writing picture.
5. The electronic device according to claim 4, wherein the manner of controlling the display screen of the electronic device to switch from the black screen state to the bright screen state and then outputting the correction result when the display unit is configured to detect that the writing action of the user is terminated is specifically:
and the display unit is used for integrating all the correction results to generate a correction report when the termination of the writing action of the user is detected, and controlling the display screen of the electronic equipment to be switched from a black screen state to a bright screen state and then outputting the correction report.
6. The electronic device of claim 5, further comprising:
the detection unit is used for integrating all the correction results when the display unit detects that the writing action of the user is terminated, generating a correction report and then detecting whether the electronic equipment is associated with terminal equipment;
and the sending unit is used for sending the correction report to the terminal equipment when the electronic equipment is associated with the terminal equipment.
CN201910643175.7A 2019-07-17 2019-07-17 Dictation detection method in black screen standby state and electronic equipment Active CN111081105B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910643175.7A CN111081105B (en) 2019-07-17 2019-07-17 Dictation detection method in black screen standby state and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910643175.7A CN111081105B (en) 2019-07-17 2019-07-17 Dictation detection method in black screen standby state and electronic equipment

Publications (2)

Publication Number Publication Date
CN111081105A CN111081105A (en) 2020-04-28
CN111081105B true CN111081105B (en) 2022-07-08

Family

ID=70310090

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910643175.7A Active CN111081105B (en) 2019-07-17 2019-07-17 Dictation detection method in black screen standby state and electronic equipment

Country Status (1)

Country Link
CN (1) CN111081105B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103646582A (en) * 2013-12-04 2014-03-19 广东小天才科技有限公司 Method and device for prompting writing errors
CN106570360A (en) * 2016-10-14 2017-04-19 龙旗电子(惠州)有限公司 Cellphone screen unlocking method
KR20180028186A (en) * 2016-09-08 2018-03-16 국민대학교산학협력단 Method for Learning Management for Handwriting with Immediate Feedback using Multi-sensory and the Recorded Media of the Handwriting Learning Management Program read by Computer
CN108536858A (en) * 2018-04-18 2018-09-14 北京小米移动软件有限公司 The method and apparatus write
CN109409066A (en) * 2018-10-17 2019-03-01 北京壹人壹本信息科技有限公司 Signature unlocking method, mobile terminal and storage medium
CN109634552A (en) * 2018-12-17 2019-04-16 广东小天才科技有限公司 It is a kind of to enter for control method and terminal device applied to dictation

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105956078B (en) * 2016-04-29 2020-04-21 广东小天才科技有限公司 Question searching method and device of intelligent equipment
CN105975560B (en) * 2016-04-29 2020-01-03 广东小天才科技有限公司 Question searching method and device of intelligent equipment
CN106293403B (en) * 2016-08-23 2020-02-18 广东小天才科技有限公司 Learning control method and device in black screen standby state and mobile terminal
CN106446884A (en) * 2016-09-19 2017-02-22 广东小天才科技有限公司 Method and device for rapidly capturing images
CN107483721B (en) * 2017-07-28 2019-10-25 Oppo广东移动通信有限公司 Control method, device, storage medium and mobile terminal based on blank screen gesture
CN108280171A (en) * 2018-01-19 2018-07-13 广东小天才科技有限公司 It is a kind of that topic method and system are searched based on hand-held photographing device
CN108197299B (en) * 2018-01-24 2020-07-24 广东小天才科技有限公司 Photographing and question searching method and system based on handheld photographing equipment
CN109327657A (en) * 2018-07-16 2019-02-12 广东小天才科技有限公司 A kind of taking pictures based on camera searches topic method and private tutor's equipment
CN108984742A (en) * 2018-07-16 2018-12-11 广东小天才科技有限公司 Man-machine interaction method and private tutor's equipment under a kind of black state
CN109068150A (en) * 2018-08-07 2018-12-21 深圳市创梦天地科技有限公司 A kind of excellent picture extracting method, terminal and the computer-readable medium of video
CN109274898B (en) * 2018-08-08 2019-11-19 深圳市智像科技有限公司 File and picture intelligent acquisition methods, devices and systems
CN109413470B (en) * 2018-10-22 2021-06-01 海信视像科技股份有限公司 Method for determining image frame to be detected and terminal equipment
CN109583443B (en) * 2018-11-15 2022-10-18 四川长虹电器股份有限公司 Video content judgment method based on character recognition
CN109756676B (en) * 2019-01-16 2021-06-25 广东小天才科技有限公司 Image processing method and electronic equipment
CN109766412B (en) * 2019-01-16 2021-03-30 广东小天才科技有限公司 Learning content acquisition method based on image recognition and electronic equipment
CN109783613B (en) * 2019-01-23 2021-08-24 广东小天才科技有限公司 Question searching method and system
CN109817046B (en) * 2019-01-23 2021-08-24 广东小天才科技有限公司 Learning auxiliary method based on family education equipment and family education equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103646582A (en) * 2013-12-04 2014-03-19 广东小天才科技有限公司 Method and device for prompting writing errors
KR20180028186A (en) * 2016-09-08 2018-03-16 국민대학교산학협력단 Method for Learning Management for Handwriting with Immediate Feedback using Multi-sensory and the Recorded Media of the Handwriting Learning Management Program read by Computer
CN106570360A (en) * 2016-10-14 2017-04-19 龙旗电子(惠州)有限公司 Cellphone screen unlocking method
CN108536858A (en) * 2018-04-18 2018-09-14 北京小米移动软件有限公司 The method and apparatus write
CN109409066A (en) * 2018-10-17 2019-03-01 北京壹人壹本信息科技有限公司 Signature unlocking method, mobile terminal and storage medium
CN109634552A (en) * 2018-12-17 2019-04-16 广东小天才科技有限公司 It is a kind of to enter for control method and terminal device applied to dictation

Also Published As

Publication number Publication date
CN111081105A (en) 2020-04-28

Similar Documents

Publication Publication Date Title
CN108665742B (en) Method and device for reading through reading device
CN109634552A (en) It is a kind of to enter for control method and terminal device applied to dictation
RU2012114925A (en) SYSTEM AND METHOD FOR REMOVING COMMUNICATIONS
CN105915831A (en) Audio recording apparatus and audio recording method
CN111726689B (en) Video playing control method and device
CN111077996B (en) Information recommendation method and learning device based on click-to-read
CN107786549A (en) Adding method, device, system and the computer-readable medium of audio file
CN107870999B (en) Multimedia playing method, device, storage medium and electronic equipment
CN115176456A (en) Content operation method, device, terminal and storage medium
CN109597943A (en) A kind of learning Content recommended method and facility for study based on scene
CN109993999B (en) Intelligent reading method based on writing progress and electronic equipment
CN111353475A (en) Self-service transaction equipment abnormality identification method and self-service transaction equipment
CN111081105B (en) Dictation detection method in black screen standby state and electronic equipment
WO2019015411A1 (en) Screen recording method and apparatus, and electronic device
CN111081088A (en) Dictation word receiving and recording method and electronic equipment
CN111639158A (en) Learning content display method and electronic equipment
CN111479079A (en) UI list operation method and device, smart screen and readable storage medium
CN111081089B (en) Dictation control method and device based on facial feature information
CN111698444B (en) Classroom-oriented data processing method, device, terminal and system
CN111079868B (en) Dictation control method based on electronic equipment and electronic equipment
CN111083383B (en) Dictation detection method and electronic equipment
CN111083600B (en) Screen projection display method for dictation content and intelligent sound box
CN111078098B (en) Dictation control method and device
CN111081090B (en) Information output method and learning device in point-to-read scene
CN111026839B (en) Method for detecting mastering degree of dictation word and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant