CN111078100A - Point reading method and electronic equipment - Google Patents

Point reading method and electronic equipment Download PDF

Info

Publication number
CN111078100A
CN111078100A CN201910477572.1A CN201910477572A CN111078100A CN 111078100 A CN111078100 A CN 111078100A CN 201910477572 A CN201910477572 A CN 201910477572A CN 111078100 A CN111078100 A CN 111078100A
Authority
CN
China
Prior art keywords
read
determining
user
content
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910477572.1A
Other languages
Chinese (zh)
Other versions
CN111078100B (en
Inventor
崔颖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL China Star Optoelectronics Technology Co Ltd
Original Assignee
Shenzhen China Star Optoelectronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen China Star Optoelectronics Technology Co Ltd filed Critical Shenzhen China Star Optoelectronics Technology Co Ltd
Priority to CN201910477572.1A priority Critical patent/CN111078100B/en
Publication of CN111078100A publication Critical patent/CN111078100A/en
Application granted granted Critical
Publication of CN111078100B publication Critical patent/CN111078100B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/04Electrically-operated educational appliances with audible presentation of the material to be studied

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a point reading method and electronic equipment, wherein the method comprises the following steps: when the electronic equipment is in a point reading mode, judging whether a finger or a pen point of a user contacting with a learning page is in a motion state; if the pen is in a moving state, acquiring a moving track of a finger or a pen point of a user; determining the contents to be reported and read on the learning page according to the motion track; and executing the reading operation on the content to be read. By implementing the embodiment of the invention, the identification efficiency of the contents to be read and reported can be effectively improved, and the click-to-read effect is favorably improved.

Description

Point reading method and electronic equipment
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a point reading method and electronic equipment.
Background
At present, most family education equipment on the market mostly has a reading function, and when a student encounters an unknown literary composition in the learning process, the student can read the unknown literary composition by using the family education equipment with the reading function. Frequently, the family education device can detect the clicking action of the user for the new word, and recognize the new word to read the new word. In practice, it is found that students may have words and sentences besides the new words unknown in the learning process, and if the students need to click on the words or sentences one by one, the students often need to click on the new words contained in the words or sentences one by one, so that the efficiency of recognizing the words or sentences by the family education equipment is poor, and the click-reading effect is affected.
Disclosure of Invention
The embodiment of the invention discloses a point reading method and electronic equipment, which can improve the identification efficiency of contents to be read in a newspaper mode.
The first aspect of the embodiments of the present invention discloses a point reading method, including:
when the electronic equipment is in a point reading mode, judging whether a finger or a pen point of a user contacting with a learning page is in a motion state;
if the pen point is in the motion state, obtaining a motion track of the user finger or the pen point;
determining the content to be reported and read on the learning page according to the motion track;
and performing reading operation on the content to be read.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after acquiring the motion trajectory of the user's finger or the pen tip, and before determining, according to the motion trajectory, that the content to be read on the learning page is located, the method further includes:
judging whether the motion track is a legal track or not;
and if so, executing the operation of determining the contents to be reported and read in the learning page according to the motion trail.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the determining, according to the motion trajectory, content to be reported on the learning page includes:
when the learning page is a paper page, searching an electronic page corresponding to the learning page;
determining a delineation area in the electronic page according to the motion track;
and determining the text content in the delineating area as the content to be read.
As an alternative implementation manner, in the first aspect of the embodiment of the present invention, the acquiring a motion trajectory of the user's finger or the pen tip includes:
when the motion state is detected to be terminated, terminating the image acquisition process;
screening effective images from the page images acquired by the image acquisition process;
acquiring touch point coordinates of the user finger or the pen point from the effective image;
and determining the motion track of the user finger or the pen point according to the contact point coordinates.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the performing a reading operation on the content to be read includes:
detecting the ambient noise of the area where the electronic equipment is located;
when the environment noise degree is larger than the preset noise degree, outputting indicating information for indicating a user to wear an earphone;
and when detecting that the earphone is successfully connected with the electronic equipment, performing reading operation on the content to be read with preset volume.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
the judging unit is used for judging whether a finger or a pen point of a user contacting the learning page is in a motion state or not when the electronic equipment is in a point reading mode;
the acquisition unit is used for acquiring the motion track of the user finger or the pen point when the pen point is in the motion state;
the determining unit is used for determining the content to be reported and read on the learning page according to the motion track;
and the reading unit is used for executing reading operation on the content to be read.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit is further configured to determine whether the motion trajectory is a legal trajectory after the obtaining unit obtains the motion trajectory of the finger or the pen tip of the user, and when the motion trajectory is the legal trajectory, trigger the determining unit to execute the operation of determining the content to be read and submitted on the learning page according to the motion trajectory.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the determining unit is configured to determine, according to the motion trajectory, a manner of the content to be reported on the learning page specifically:
the determining unit is used for searching an electronic page corresponding to the learning page when the learning page is a paper page; determining a delineation area in the electronic page according to the motion track; and determining the text content in the delineating area as the content to be read.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the obtaining unit includes:
the processing subunit is used for terminating the image acquisition process when detecting that the motion state is terminated, and screening out an effective image from the page image acquired by the image acquisition process;
and the determining subunit is used for acquiring the contact point coordinates of the user finger or the pen point from the effective image and determining the motion track of the user finger or the pen point according to the contact point coordinates.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the reading unit includes:
the detection subunit is used for detecting the environment noise of the area where the electronic equipment is located;
the indication subunit is used for outputting indication information for indicating a user to wear an earphone when the ambient noise degree is greater than a preset noise degree;
and the reading sub-unit is used for executing reading operation on the content to be read in a preset volume when detecting that the earphone is successfully connected with the electronic equipment.
A third aspect of an embodiment of the present invention discloses an electronic device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to perform part or all of the steps of any one of the methods of the first aspect of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program comprising a program for performing some or all of the steps of any one of the methods of the first aspect of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application distribution system, configured to distribute a computer program product, where the computer program product, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, when the electronic equipment is in a point reading mode, whether the finger or the pen point of a user contacting with a learning page is in a motion state is judged; if the pen is in a moving state, acquiring a moving track of a finger or a pen point of a user; determining the contents to be reported and read on the learning page according to the motion track; and executing the reading operation on the content to be read. By implementing the embodiment of the invention, the content to be read is determined based on the motion track of the finger or the pen point of the user on the book surface, and compared with the confirmation by clicking word by word, the method and the device effectively improve the identification efficiency of the content to be read and are beneficial to improving the click-to-read effect.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without making a creative effort.
Fig. 1 is a schematic flow chart of a point reading method disclosed in the embodiment of the present invention;
FIG. 2 is a flow chart of another touch reading method disclosed in the embodiment of the present invention;
FIG. 3 is a schematic flow chart of another touch-and-talk method disclosed in the embodiments of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 5 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
fig. 7 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is noted that the terms "comprises," "comprising," and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a point reading method and electronic equipment, which can effectively improve the identification efficiency of contents to be read and are beneficial to improving the point reading effect. In the embodiment of the present invention, the touch reading method disclosed in the embodiment of the present invention may be applied to various electronic devices such as a smart phone, a smart watch, and a tablet, and the embodiment of the present invention is not limited. The operating system of each electronic device may include, but is not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a blackberry operating system, a Windows Phone8 operating system, and the like.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of a touch reading method according to an embodiment of the present invention. The point-reading method shown in fig. 1 may specifically include the following steps:
101. when the electronic equipment is in a point reading mode, judging whether a finger or a pen point of a user contacting with a learning page is in a motion state, if so, executing the step 102 to the step 104; if not, the flow is ended.
In this embodiment of the present invention, the click-to-read mode of the electronic device may be divided into two types, one type is click-to-read of an electronic page displayed on a display screen of the electronic device, and the other type is click-to-read of a paper page, and accordingly, the learning page mentioned in step 101 may be an electronic page or a paper page, which is not limited in the embodiment of the present invention.
As an optional implementation manner, an electronic version of the student outline textbook is stored in the electronic device, and correspondingly before the step 101 is executed, the electronic device may further detect a current electric quantity of the electronic device, and when the current electric quantity is detected to be smaller than a preset electric quantity, output a prompt message for instructing the user to read on the basis of an electronic page, display the electronic page selected by the user as a learning page on a display screen of the electronic device, and start an image acquisition process; or when the current electric quantity is detected to be larger than or equal to the preset electric quantity, the electronic equipment can also output prompt information for instructing a user to read on the basis of a paper page, and an image acquisition process is started. At this time, the electronic device determining whether the user's finger or the pen tip contacting the learning page is in a motion state may include:
and when a plurality of different touch point coordinates exist in the touch point coordinate set, determining that the finger or the pen point of the user contacting the learning page is in a motion state, otherwise, determining that the finger or the pen point of the user contacting the learning page is not in the motion state. By implementing the method, the recommendation information aiming at the point reading type can be output to the user reference based on the current electric quantity of the electronic equipment, so that the condition that the point reading is suddenly stopped due to insufficient electric quantity is avoided.
Further optionally, after the image acquisition process is started, the vertical distance between the eyes of the user and the learning page can be acquired, and when the vertical distance is greater than the preset distance, the warning information is output.
102. And acquiring the motion track of the finger or the pen point of the user.
In the embodiment of the present invention, a specific implementation manner of how to obtain the motion trajectory of the finger or the pen tip of the user will be described in the following method embodiment, which is not described again in the embodiment of the present invention.
As an optional implementation manner, in the embodiment of the present invention, after the step 102 is completed, it may be further determined whether the motion trajectory is a legal trajectory, and if so, the step 103 is continuously performed.
In this embodiment of the present invention, the legal track may be a line segment, a rectangle, an ellipse, or the like, and specifically, the determining whether the motion track is a legal track may include: and analyzing the similarity between the motion track and the legal track, determining that the motion track is the legal track when the similarity is greater than a preset value, and determining that the motion track is not the legal track when the similarity is less than or equal to the preset value. By implementing the method, misoperation of the response user can be avoided.
103. And determining the contents to be reported and read on the learning page according to the motion trail.
In an embodiment of the present invention, the determining, according to the motion trajectory, content to be reported and read on the learning page may include: when the learning page is a paper page, searching an electronic page corresponding to the learning page; determining a delineation area in the electronic page according to the motion track; and determining the text content in the delineation area as the content to be read. By implementing the method, the contents to be read can be rapidly determined, and the click-to-read effect is further improved.
104. And executing the reading operation on the content to be read.
Optionally, in this embodiment of the present invention, after step 104 is completed, it may further be detected whether the electronic device is associated with a wearable device (for example, a wearable device), and when the electronic device is associated with the wearable device, a reading audio corresponding to the content to be read is sent to the wearable device, so that the wearable device stores the received reading audio. By implementing the method, the consolidation requirements of the user at any time and any place can be met.
By implementing the method, the identification efficiency of the contents to be reported and read can be effectively improved, the improvement of the point reading effect is facilitated, the recommendation information aiming at the point reading type can be output to a user for reference based on the current electric quantity of the electronic equipment, the condition that the point reading is stopped suddenly due to insufficient electric quantity is avoided, the response to the misoperation of the user can be avoided, the eyesight of the user can be protected, the quick determination of the contents to be reported and read can be realized, the point reading effect is further improved, and the consolidation requirement of the user at any time and any place can be met.
Example two
Referring to fig. 2, fig. 2 is a schematic flow chart of another touch reading method according to the embodiment of the present invention. The point-reading method shown in fig. 2 may specifically include the following steps:
201. when the electronic equipment is in a point reading mode, judging whether a finger or a pen point of a user contacting with a learning page is in a motion state, if so, executing the step 202 to the step 207; if not, the flow is ended.
For a detailed description of step 201, please refer to the description of step 101 in the first embodiment, which is not repeated herein.
Optionally, if the learning page is an electronic page, in the embodiment of the present invention, in addition to starting the image acquisition process to determine whether the finger or the pen tip of the user moves, the touch point detection process may also be started to determine whether the finger or the pen tip of the user moves. The embodiment of the present invention mainly introduces the specific case of using the image acquisition process, and the details are shown in the following steps.
202. And when the motion state is detected to be terminated, terminating the image acquisition process.
In an embodiment of the present invention, the motion state is determined to be terminated when it is detected that the user's finger or pen tip is off the learning page.
203. And screening effective images from the page images acquired by the image acquisition process.
204. And acquiring the touch point coordinates of the finger or the pen point of the user from the effective image.
205. And determining the motion track of the finger or the pen point of the user according to the contact point coordinates.
In the embodiment of the invention, the image acquisition process is utilized to obtain the motion video of the finger or the pen point of the user, the page image acquired by the image acquisition process mentioned in the step 203 is the frame picture of the motion video, the effective image can be the key frame picture in the motion video, and by implementing the method, the image quality can be ensured, and the determination efficiency of the motion track can be improved.
206. And determining the contents to be reported and read on the learning page according to the motion track.
207. And executing the reading operation on the content to be read.
For detailed description of steps 206 to 207, please refer to the description in the first embodiment, and the embodiments of the present invention are not described again.
By implementing the method, the identification efficiency of the contents to be read can be effectively improved, the improvement of the click-to-read effect is facilitated, the suggestion information aiming at the click-to-read type can be output to a user for reference based on the current electric quantity of the electronic equipment, the condition that the click-to-read is stopped suddenly due to insufficient electric quantity is avoided, the response of the misoperation of the user can be avoided, the eyesight of the user can be protected, the quick determination of the contents to be read can be realized, the click-to-read effect is further improved, the consolidation requirements of the user at any time and any place can be met, the judgment efficiency of the movement of the finger or the pen point of the user can be improved, the power consumption of the electronic equipment can be reduced, the image quality can be ensured, and the determination efficiency.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic flow chart of another touch reading method according to the embodiment of the invention. The point-reading method shown in fig. 3 may specifically include the following steps:
for detailed description of step 301 to step 306, please refer to the description of step 201 to step 206 in the second embodiment, which is not repeated herein.
307. Detecting the ambient noise level of the area where the electronic device is located.
As an alternative implementation, the way for the electronic device to detect the ambient noise level of the area where the electronic device is located may be:
the electronic equipment detects whether a certain wireless access point is accessed currently, and if the certain wireless access point is accessed currently, the electronic equipment identifies whether the identification information of the currently accessed wireless access point is matched with the identification information of the wireless access point on a certain school bus, which is recorded in advance by the electronic equipment;
if the information is matched with the information, the electronic equipment can think that the electronic equipment is currently located on the school bus, correspondingly, the electronic equipment can acquire the identity information of the service equipment transferred on the school bus, and sends a request message to the service equipment of the school bus through the wireless access point according to the identity information of the service equipment on the school bus, wherein the request message carries the identity information of the electronic equipment and a request field, and the request field is used for requesting the service equipment of the school bus to detect the environment noise degree in the school bus;
and the electronic equipment acquires the environment noise degree in the school bus, which is sent by the service equipment of the school bus in response to the request message, and takes the environment noise degree in the school bus as the environment noise degree of the area where the electronic equipment is located.
The implementation of the embodiment can avoid power consumption caused when the electronic equipment detects the noisy environment of the region where the electronic equipment is located by starting the sensor of the electronic equipment, and reduces the heat productivity of the electronic equipment caused by aggravation of the power consumption.
Furthermore, after receiving the request message sent by the electronic device to the service device of the school bus via the wireless access point, the service device of the school bus may further perform the following operations:
the service device of the school bus can identify the user attribute of the electronic device according to the identity information of the electronic device carried by the request message, wherein the user attribute can comprise the user name of the user (such as a student) to which the electronic device belongs and a curriculum schedule corresponding to the user grade, and the curriculum schedule can comprise the class time (including the date and time) of each subject and the class place of each subject;
the service equipment of the school bus determines the class-taking place of the target subject from the curriculum schedule, wherein the class-taking time of the target subject is closest to the current system time of the service equipment of the school bus;
and when detecting that the school bus runs to the getting-off station corresponding to the class point of the target department, the service equipment of the school bus sends a station arrival notification message to the electronic equipment through the wireless access point, wherein the notification message comprises the class time and the class point of the target department.
By implementing the embodiment, the user can be prevented from missing the place of class in the process of taking the school bus and listening to the contents to be reported.
308. When the ambient noise level is greater than the preset noise level, outputting indication information for indicating the user to wear the earphone.
309. And when detecting that the earphone is successfully connected with the electronic equipment, executing reading operation on the content to be read with preset volume.
Optionally, in this embodiment of the present invention, the earphone mentioned in step 309 may be a wireless earphone matching with the electronic device, and after step 308 is completed, a state detection instruction may be further sent to the earphone, so that when the earphone receives the state detection instruction, whether the earphone is in a wearing state is detected, and when the earphone is in the wearing state, an indication information of successful connection is fed back to the electronic device. The electronic device and the headset may interact with each other through bluetooth or WIFI, which is not limited in the embodiments of the present invention.
In the embodiment of the present invention, by executing step 307 to step 309, the reading effect of the content to be read can be effectively ensured by detecting the noise level of the environment where the electronic device is located.
By implementing the method, the identification efficiency of the contents to be reported and read can be effectively improved, the improvement of the point reading effect is facilitated, the suggestion information aiming at the point reading type can be output to a user for reference based on the current electric quantity of the electronic equipment, the condition that the point reading is suddenly stopped due to insufficient electric quantity can be avoided, the response of the misoperation of the user can be avoided, the eyesight of the user can be protected, the quick determination of the contents to be reported and read can be realized, the point reading effect can be further improved, the consolidation requirement of the user at any time and any place can be met, the judgment efficiency of whether the finger or the pen point of the user moves can be improved, the power consumption of the electronic equipment can be reduced, the image quality can be ensured, the determination efficiency of the motion track can be improved, the reporting effect of the contents to be reported and read can be effectively ensured, and the heating value of the electronic, and the user can be prevented from missing the class in the process of taking the school bus and listening to the contents to be reported and read.
Example four
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 4, the electronic device may include:
the determining unit 401 is configured to determine whether a finger or a pen tip of a user touching the learning page is in a moving state when the electronic device is in the point reading mode.
In the embodiment of the present invention, the reading mode of the electronic device may be divided into two types, one type is reading of an electronic page displayed on a display screen of the electronic device, and the other type is reading of a paper page.
As an optional implementation manner, the electronic device stores an electronic edition of a student outline teaching material, and the determining unit 401 may be further configured to detect a current electric quantity of the electronic device, output a prompt message for instructing a user to perform point reading based on an electronic page when the current electric quantity is detected to be smaller than a preset electric quantity, display the electronic page selected by the user on a display screen of the electronic device as a learning page, and start an image acquisition process; or when the current electric quantity is detected to be larger than or equal to the preset electric quantity, outputting prompt information for instructing a user to read on the basis of a paper page, and starting an image acquisition process. At this time, the manner of the determination unit 401 for determining whether or not the user's finger or pen tip touching the learning page is in a moving state may specifically be: the determining unit 401 is configured to obtain a plurality of page images acquired in the image acquisition process, obtain a touch point coordinate set of a user finger or a pen tip from the plurality of page images, determine that the user finger or the pen tip touching the learning page is in a motion state when a plurality of different touch point coordinates exist in the touch point coordinate set, and otherwise determine that the user finger or the pen tip touching the learning page is not in the motion state. By implementing the method, the recommendation information for the point reading type can be output to the user reference based on the current electric quantity of the electronic equipment, so that the situation that the point reading is suddenly stopped due to insufficient electric quantity is avoided.
Further optionally, the determining unit 401 may be further configured to obtain a vertical distance between the eyes of the user and the learning page after the image acquisition process is started, and output the warning information when the vertical distance is greater than a preset distance.
An obtaining unit 402, configured to obtain a motion trajectory of the user's finger or pen tip when the user's finger or pen tip is in a motion state.
The determining unit 403 is configured to determine, according to the motion trajectory, content to be read in a learning page.
As an optional implementation manner, in the embodiment of the present invention, the determining unit 401 may be further configured to determine whether the movement track of the finger or the pen tip of the user is a legal track after the obtaining unit 402 obtains the movement track, and when the movement track is the legal track, the trigger determining unit 403 executes the operation of determining the content to be read and written on the learning page according to the movement track. In this optional embodiment, the legal trajectory may be a line segment, a rectangle, an ellipse, or the like, and specifically, the manner that the determining unit 401 is configured to determine whether the motion trajectory is a legal trajectory may specifically be: the determining unit 401 is configured to analyze a similarity between the motion trajectory and the legal trajectory, determine that the motion trajectory is the legal trajectory when the similarity is greater than a preset value, and determine that the motion trajectory is not the legal trajectory when the similarity is less than or equal to the preset value. By implementing the method, response to misoperation of the user can be avoided.
Further optionally, the manner that the determining unit 403 is configured to determine, according to the motion trajectory, the content to be read on the learning page may specifically be: the determining unit 403 is configured to, when the learning page is a paper page, search for an electronic page corresponding to the learning page; determining a delineation area in the electronic page according to the motion track; and determining the text content in the delineating area as the content to be read. By implementing the method, the contents to be read can be rapidly determined, and the click-to-read effect is further improved.
A reading unit 404, configured to perform a reading operation on the content to be read.
Optionally, in this embodiment of the present invention, the reading unit 404 may be further configured to detect whether the electronic device is associated with a wearable device (e.g., a wearable device) after performing a reading operation on the content to be read, and send, when the wearable device is associated with the electronic device, a reading audio corresponding to the content to be read to the wearable device, so that the wearable device stores the received reading audio. By implementing the method, the consolidation requirements of the user at any time and any place can be met.
Through implementing above-mentioned electronic equipment, can effectively improve the recognition efficiency of waiting to report and read the content, be favorable to the improvement of click-to-read effect, can also be based on electronic equipment's current electric quantity, the suggestion information of output to the type of click-to-read gives the user reference, in order to avoid taking place to suspend the condition of click-to-read suddenly because of the electric quantity is not enough, can also avoid responding to user's maloperation, still be favorable to protecting user's eyesight, can also realize waiting to report and read the quick definite of content, further improve click-to-read effect, can also satisfy the consolidation demand of user anytime and anywhere.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 5 is optimized from the electronic device shown in fig. 4, and as shown in fig. 5, the obtaining unit 402 in the electronic device may include:
the processing subunit 4021 is configured to terminate the image capturing process and screen out an effective image from the page image captured by the image capturing process when it is detected that the motion state is terminated.
The determining subunit 4022 is configured to acquire the touch point coordinates of the user's finger or pen tip from the effective image, and determine the motion trajectory of the user's finger or pen tip according to the touch point coordinates.
Optionally, if the learning page is an electronic page, in the embodiment of the present invention, the determining unit 401 may start an image capturing process to determine whether the finger or the pen tip of the user moves or not, and may also start a contact detecting process to determine whether the finger or the pen tip of the user moves or not.
In the embodiment of the invention, the motion video of the finger or the pen point of the user can be obtained by utilizing the image acquisition process, the page image acquired by the image acquisition process is the frame picture of the motion video, the effective image can be the key frame picture in the motion video, and based on the processing subunit 4021, the image quality can be ensured, and the determination efficiency of the motion track can be improved.
Through implementing above-mentioned electronic equipment, can effectively improve the recognition efficiency of waiting to report and read the content, be favorable to the improvement of click-to-read effect, can also be based on electronic equipment's current electric quantity, the suggestion information of output to the type of click-to-read gives the user reference, in order to avoid taking place because of the electric quantity not enough condition of suspending the click-to-read suddenly, can also avoid responding to user's maloperation, still be favorable to protecting user's eyesight, can also realize waiting to report and read the quick definite of content, further improve click-to-read effect, can also satisfy the consolidated demand of user anytime and anywhere, can also improve the judgement efficiency whether to the motion of user's finger or nib, can also reduce electronic equipment's consumption, can also guarantee image quality, be favorable to improving the definite.
EXAMPLE six
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 6 is optimized from the electronic device shown in fig. 5, and as shown in fig. 6, the reading unit 404 in the electronic device may include:
the detecting sub-unit 4041 is configured to detect the ambient noise level of the area where the electronic device is located.
As an alternative embodiment, the manner for the detecting sub-unit 4041 to detect the noise level of the environment in the area where the electronic device is located may be:
a detecting subunit 4041, configured to detect whether a certain wireless access point is currently accessed, if a certain wireless access point is currently accessed, identify whether identification information of the currently accessed wireless access point matches identification information of a wireless access point on a certain school bus that is pre-recorded by an electronic device, and when the identification information matches the identification information, consider that the electronic device is currently located on the school bus, and obtain identity information of a service device that is transferred on the school bus, and send a request message to the service device of the school bus via the wireless access point according to the identity information of the service device on the school bus, where the request message carries the identity information of the electronic device and a request field, and the request field is used to request the service device of the school bus to detect an environmental noise level in the school bus; and acquiring the environment noise degree in the school bus, which is sent by the service equipment of the school bus in response to the request message, and taking the environment noise degree in the school bus as the environment noise degree of the area where the electronic equipment is located. By implementing the implementation mode, the power consumption caused when the electronic equipment detects the noisy environment in the area by starting the sensor of the electronic equipment can be avoided, and the heat productivity of the electronic equipment caused by the aggravation of the power consumption is reduced.
Further, after receiving the request message sent by the detection subunit 4041 to the service device of the school bus via the wireless access point, the service device of the school bus may further perform the following operations:
the service device of the school bus can identify the user attribute of the electronic device according to the identity information of the electronic device carried by the request message, wherein the user attribute can comprise the user name of the user (such as a student) to which the electronic device belongs and a curriculum schedule corresponding to the user grade, and the curriculum schedule can comprise the class time (including the date and time) of each subject and the class place of each subject;
the service equipment of the school bus determines the class-taking place of the target subject from the curriculum schedule, wherein the class-taking time of the target subject is closest to the current system time of the service equipment of the school bus;
and when detecting that the school bus runs to the getting-off station corresponding to the class point of the target department, the service equipment of the school bus sends a station arrival notification message to the electronic equipment through the wireless access point, wherein the notification message comprises the class time and the class point of the target department.
By implementing the embodiment, the user can be prevented from missing the place of class in the process of taking the school bus and listening to the contents to be reported.
And the indicating subunit 4042, configured to output, when the above-mentioned ambient noise level is greater than the preset noise level, indicating information for indicating the user to wear the earphone.
The reading sub-unit 4043 is configured to, when it is detected that the earphone is successfully connected to the electronic device, perform reading operation on the content to be read at a preset volume.
Optionally, in this embodiment of the present invention, the earphone may be a wireless earphone matched with the electronic device, and the indicating subunit 4042 may be further configured to send a state detection instruction to the earphone after outputting indication information for indicating that the user wears the earphone, so that when the earphone receives the state detection instruction, whether the earphone is in a worn state is detected, and when the earphone is in the worn state, indication information of successful connection is fed back to the electronic device. The electronic device and the headset may interact with each other through bluetooth or WIFI, which is not limited in the embodiments of the present invention.
In the embodiment of the present invention, by executing step 307 to step 309, the reading effect of the content to be read can be effectively ensured by detecting the noise level of the environment where the electronic device is located.
By implementing the electronic equipment, the identification efficiency of the contents to be read and reported can be effectively improved, the improvement of the click-to-read effect is facilitated, the suggested information aiming at the click-to-read type can be output to a user for reference based on the current electric quantity of the electronic equipment, the condition that the click-to-read is suddenly stopped due to insufficient electric quantity can be avoided, the response of the misoperation of the user can be avoided, the eyesight of the user can be protected, the quick determination of the contents to be read and the click-to-read effect can be further improved, the consolidation requirements of the user at any time and any place can be met, the judgment efficiency of whether the finger or the pen point of the user moves can be improved, the power consumption of the electronic equipment can be reduced, the image quality can be ensured, the determination efficiency of the movement track can be improved, the reading effect of the contents to be effectively ensured, and the heating value of, and the user can be prevented from missing the class in the process of taking the school bus and listening to the contents to be reported and read.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 7, the electronic device may include:
a memory 701 in which executable program code is stored;
a processor 702 coupled to the memory 701;
the processor 702 calls the executable program code stored in the memory 701 to execute any one of the click-to-read methods in fig. 1 to 3.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the point reading methods in figures 1-3.
The embodiment of the invention discloses a computer program product, which enables a computer to execute any one of the point reading methods in the figures 1-3 when the computer program product runs on the computer.
The embodiment of the invention discloses an application issuing system, which is used for issuing a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute any one of the point reading methods in the figures 1 to 3.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The above-mentioned detailed description is made on the click-to-read method and the electronic device disclosed in the embodiments of the present invention, and the principle and the implementation manner of the present invention are explained by applying specific examples, and the size of the step sequence number in the specific examples does not mean that the execution sequence is necessarily sequential, and the execution sequence of each process should be determined by the function and the internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The units described as separate parts may or may not be physically separate, and some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
The character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship. In the embodiments provided herein, it should be understood that "B corresponding to A" means that B is associated with A from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. If the integrated unit is implemented as a software functional unit and sold or used as a stand-alone product, it may be stored in a memory accessible to a computer. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
The above description of the embodiments is only intended to facilitate the understanding of the method of the invention and its core ideas; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A method of point reading, comprising:
when the electronic equipment is in a point reading mode, judging whether a finger or a pen point of a user contacting with a learning page is in a motion state;
if the pen point is in the motion state, obtaining a motion track of the user finger or the pen point;
determining the content to be reported and read on the learning page according to the motion track;
and performing reading operation on the content to be read.
2. The method of claim 1, wherein after the obtaining of the motion trajectory of the user's finger or the pen tip and before the determining of the content to be read back on the learning page according to the motion trajectory, the method further comprises:
judging whether the motion track is a legal track or not;
and if so, executing the operation of determining the contents to be reported and read in the learning page according to the motion trail.
3. The method according to claim 1 or 2, wherein the determining the content to be reported on the learning page according to the motion trajectory comprises:
when the learning page is a paper page, searching an electronic page corresponding to the learning page;
determining a delineation area in the electronic page according to the motion track;
and determining the text content in the delineating area as the content to be read.
4. The method according to any one of claims 1 to 3, wherein the acquiring of the motion track of the user finger or the pen tip comprises:
when the motion state is detected to be terminated, terminating the image acquisition process;
screening effective images from the page images acquired by the image acquisition process;
acquiring touch point coordinates of the user finger or the pen point from the effective image;
and determining the motion track of the user finger or the pen point according to the contact point coordinates.
5. The method of claim 1, wherein performing a read-back operation on the content to be read-backed comprises:
detecting the ambient noise of the area where the electronic equipment is located;
when the environment noise degree is larger than the preset noise degree, outputting indicating information for indicating a user to wear an earphone;
and when detecting that the earphone is successfully connected with the electronic equipment, performing reading operation on the content to be read with preset volume.
6. An electronic device, comprising:
the judging unit is used for judging whether a finger or a pen point of a user contacting the learning page is in a motion state or not when the electronic equipment is in a point reading mode;
the acquisition unit is used for acquiring the motion track of the user finger or the pen point when the pen point is in the motion state;
the determining unit is used for determining the content to be reported and read on the learning page according to the motion track;
and the reading unit is used for executing reading operation on the content to be read.
7. The electronic device according to claim 6, wherein the determining unit is further configured to determine whether the movement track is a legal track after the obtaining unit obtains the movement track of the user's finger or the pen tip, and when the movement track is the legal track, trigger the determining unit to perform the operation of determining the content to be reported and read on the learning page according to the movement track.
8. The electronic device according to claim 6 or 7, wherein the determining unit is configured to determine, according to the motion trajectory, a manner of determining the content to be reported on the learning page specifically as follows:
the determining unit is used for searching an electronic page corresponding to the learning page when the learning page is a paper page; determining a delineation area in the electronic page according to the motion track; and determining the text content in the delineating area as the content to be read.
9. The electronic device according to any one of claims 6 to 8, wherein the acquisition unit includes:
the processing subunit is used for terminating the image acquisition process when detecting that the motion state is terminated, and screening out an effective image from the page image acquired by the image acquisition process;
and the determining subunit is used for acquiring the contact point coordinates of the user finger or the pen point from the effective image and determining the motion track of the user finger or the pen point according to the contact point coordinates.
10. The electronic device of claim 6, wherein the reading unit comprises:
the detection subunit is used for detecting the environment noise of the area where the electronic equipment is located;
the indication subunit is used for outputting indication information for indicating a user to wear an earphone when the ambient noise degree is greater than a preset noise degree;
and the reading sub-unit is used for executing reading operation on the content to be read in a preset volume when detecting that the earphone is successfully connected with the electronic equipment.
CN201910477572.1A 2019-06-03 2019-06-03 Point reading method and electronic equipment Active CN111078100B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910477572.1A CN111078100B (en) 2019-06-03 2019-06-03 Point reading method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910477572.1A CN111078100B (en) 2019-06-03 2019-06-03 Point reading method and electronic equipment

Publications (2)

Publication Number Publication Date
CN111078100A true CN111078100A (en) 2020-04-28
CN111078100B CN111078100B (en) 2022-03-01

Family

ID=70310369

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910477572.1A Active CN111078100B (en) 2019-06-03 2019-06-03 Point reading method and electronic equipment

Country Status (1)

Country Link
CN (1) CN111078100B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104010040A (en) * 2014-06-06 2014-08-27 广东小天才科技有限公司 Intelligent terminal pointing-reading positioning method, intelligent terminal and pointing-reading positioning device
US20150169045A1 (en) * 2012-07-23 2015-06-18 Zte Corporation 3D human-machine interaction method and system
CN204965792U (en) * 2015-07-24 2016-01-13 深圳市维冠视界科技股份有限公司 Machine is read to point that carries on LED liquid crystal display
US20160351068A1 (en) * 2014-08-27 2016-12-01 South China University Of Technology Finger reading method and device based on visual gestures
CN108037882A (en) * 2017-11-29 2018-05-15 佛山市因诺威特科技有限公司 A kind of reading method and system
CN108399813A (en) * 2018-05-04 2018-08-14 广东小天才科技有限公司 Study coach method and system, robot and handwriting equipment based on robot
CN109035914A (en) * 2018-08-20 2018-12-18 广东小天才科技有限公司 A kind of learning method and intelligent desk lamp based on intelligent desk lamp
CN109240582A (en) * 2018-08-30 2019-01-18 广东小天才科技有限公司 A kind of put reads control method and smart machine
CN109255989A (en) * 2018-08-30 2019-01-22 广东小天才科技有限公司 A kind of intelligent point-reading method and point read equipment
WO2019033664A1 (en) * 2017-08-18 2019-02-21 广州视源电子科技股份有限公司 Information display control method and apparatus, and intelligent teaching device and storage medium
CN109522835A (en) * 2018-11-13 2019-03-26 北京光年无限科技有限公司 Children's book based on intelligent robot is read and exchange method and system

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150169045A1 (en) * 2012-07-23 2015-06-18 Zte Corporation 3D human-machine interaction method and system
CN104010040A (en) * 2014-06-06 2014-08-27 广东小天才科技有限公司 Intelligent terminal pointing-reading positioning method, intelligent terminal and pointing-reading positioning device
US20160351068A1 (en) * 2014-08-27 2016-12-01 South China University Of Technology Finger reading method and device based on visual gestures
CN204965792U (en) * 2015-07-24 2016-01-13 深圳市维冠视界科技股份有限公司 Machine is read to point that carries on LED liquid crystal display
WO2019033664A1 (en) * 2017-08-18 2019-02-21 广州视源电子科技股份有限公司 Information display control method and apparatus, and intelligent teaching device and storage medium
CN108037882A (en) * 2017-11-29 2018-05-15 佛山市因诺威特科技有限公司 A kind of reading method and system
CN108399813A (en) * 2018-05-04 2018-08-14 广东小天才科技有限公司 Study coach method and system, robot and handwriting equipment based on robot
CN109035914A (en) * 2018-08-20 2018-12-18 广东小天才科技有限公司 A kind of learning method and intelligent desk lamp based on intelligent desk lamp
CN109240582A (en) * 2018-08-30 2019-01-18 广东小天才科技有限公司 A kind of put reads control method and smart machine
CN109255989A (en) * 2018-08-30 2019-01-22 广东小天才科技有限公司 A kind of intelligent point-reading method and point read equipment
CN109522835A (en) * 2018-11-13 2019-03-26 北京光年无限科技有限公司 Children's book based on intelligent robot is read and exchange method and system

Also Published As

Publication number Publication date
CN111078100B (en) 2022-03-01

Similar Documents

Publication Publication Date Title
WO2014159612A1 (en) Providing help information based on emotion detection
CN111078083A (en) Method for determining click-to-read content and electronic equipment
CN111077996B (en) Information recommendation method and learning device based on click-to-read
CN108881979B (en) Information processing method and device, mobile terminal and storage medium
CN111078102B (en) Method for determining point reading area through projection and terminal equipment
CN107992872B (en) Method for carrying out text recognition on picture and mobile terminal
WO2019201109A1 (en) Word processing method and apparatus, and mobile terminal and storage medium
CN109032465B (en) Data processing method and device and mobile terminal
CN111639158B (en) Learning content display method and electronic equipment
CN111078100B (en) Point reading method and electronic equipment
CN111079726B (en) Image processing method and electronic equipment
CN110209280B (en) Response method, response device and storage medium
CN111462548A (en) Paragraph point reading method, device, equipment and readable medium
CN108958578B (en) File control method and device and electronic device
CN111142656A (en) Content positioning method, electronic equipment and storage medium
CN111079503B (en) Character recognition method and electronic equipment
CN111078082A (en) Point reading method based on image recognition and electronic equipment
CN111091531B (en) Click recognition method and electronic equipment
CN110765326A (en) Recommendation method, device, equipment and computer readable storage medium
CN111079492B (en) Method for determining click-to-read area and terminal equipment
CN111090383A (en) Instruction identification method and electronic equipment
US20190272087A1 (en) Interface filtering method and system
CN111461095A (en) Voice point reading method, device, equipment and readable medium
CN111079727A (en) Point reading control method and electronic equipment
CN111083383B (en) Dictation detection method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant