CN111079492B - Method for determining click-to-read area and terminal equipment - Google Patents
Method for determining click-to-read area and terminal equipment Download PDFInfo
- Publication number
- CN111079492B CN111079492B CN201910483903.2A CN201910483903A CN111079492B CN 111079492 B CN111079492 B CN 111079492B CN 201910483903 A CN201910483903 A CN 201910483903A CN 111079492 B CN111079492 B CN 111079492B
- Authority
- CN
- China
- Prior art keywords
- area
- included angle
- page
- user
- click
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 230000007613 environmental effect Effects 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000010438 heat treatment Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
Abstract
The embodiment of the invention discloses a method for determining a click-to-read area and terminal equipment, which are applied to the technical field of terminal equipment and can be used for solving the problem that the terminal equipment cannot identify the actual click-to-read area of a user or the identified click-to-read area has errors. The method comprises the following steps: in a click-to-read mode, acquiring a first image comprising a learning page; acquiring a first included angle and a second included angle from the first image, wherein the first included angle is an included angle between a finger tip and a learning page, and the second included angle is an included angle between a pen tip and the learning page; judging whether the first included angle is larger than the second included angle; if yes, determining a first area touched by the finger tip on the learning page, and taking the first area as a user click area; if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area. The method is applied to the point-and-read scene.
Description
Technical Field
The embodiment of the invention relates to the technical field of terminal equipment, in particular to a method for determining a click-to-read area and terminal equipment.
Background
At present, most home teaching equipment on the market has a click-to-read function, and when students encounter unrecognized raw words in the learning process, the home teaching equipment with the click-to-read function can be used for clicking the unrecognized raw words. Commonly, home education equipment can detect the clicking action of a user aiming at the new word, and recognize the new word so as to report and read the new word. In the process of actually using the home teaching equipment, the condition that a pen point and a finger touch different click-to-read areas simultaneously is possibly found when the pen is held in the hand of a user, and the current home teaching equipment cannot identify the area which the user wants to click to read is the area, so that the home teaching equipment cannot identify the actual click-to-read area of the user or the identified click-to-read area is wrong.
Disclosure of Invention
The embodiment of the invention provides a method and terminal equipment for determining a click-to-read area, which are used for solving the problems that home education equipment in the prior art cannot identify an actual click-to-read area or the identified click-to-read area is wrong. In order to solve the technical problems, the embodiment of the invention is realized as follows:
in a first aspect, there is provided a method of determining a click-through region, the method comprising:
in a click-to-read mode, acquiring a first image comprising a learning page;
acquiring a first included angle and a second included angle from a first image, wherein the first included angle is an included angle between a finger tip and the learning page, and the second included angle is an included angle between a pen point and the learning page;
judging whether the first included angle is larger than the second included angle;
if yes, determining a first area touched by the fingertip on the learning page, and taking the first area as a user click area;
if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area.
In an optional implementation manner, in the first aspect of the embodiment of the present invention, the learning page is a paper page, after the first area is taken as a user click-to-read area, or after the second area is taken as a user click-to-read area, the method further includes:
identifying first content in the user click-through area;
and displaying the first content and reporting and reading the first content.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the reading the first content includes:
detecting the environmental noise degree of the area where the terminal equipment is located;
when the environmental noisy degree is larger than the preset noisy degree, outputting first prompt information, wherein the first prompt information is used for prompting a user to wear the earphone;
and when the terminal equipment is detected to be successfully connected with the earphone, executing a newspaper reading operation on the first content at a preset volume.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the displaying the first content includes:
searching an electronic page corresponding to the learning page;
determining the first content in the electronic page according to the user click-through area;
and displaying the electronic page, and highlighting the first content in the electronic page.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the acquiring the first image including the first learning page, the method further includes:
acquiring the vertical distance between eyes of a user and the learning page;
and if the vertical distance is smaller than the distance threshold, outputting second prompt information, wherein the second prompt information is used for prompting a user to adjust the distance between eyes and the learning page.
In a second aspect, there is provided a terminal device comprising: the acquisition module is used for acquiring a first image comprising a learning page in a point-reading mode;
the included angle acquisition module is used for acquiring a first included angle and a second included angle from the first image, wherein the first included angle is an included angle between a finger tip and the learning page, and the second included angle is an included angle between a pen point and the learning page;
the judging module is used for judging whether the first included angle is larger than the second included angle or not; if yes, determining a first area touched by the fingertip on the learning page, and taking the first area as a user click area; if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area.
In a second aspect of the embodiment of the present invention, the learning page is a paper page, and the terminal device further includes:
the identification module is used for identifying the first content in the user click-to-read area after the judgment module takes the first area as the user click-to-read area or takes the second area as the user click-to-read area;
the display module is used for displaying the first content;
and the newspaper reading module is used for newspaper reading the first content.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the newspaper reading module includes:
the detection submodule is used for detecting the environmental noisy degree of the area where the terminal equipment is located; the output sub-module is used for outputting first prompt information when the environmental noisy degree is larger than the preset noisy degree, and the first prompt information is used for prompting a user to wear the earphone;
and the newspaper reading sub-module is used for executing newspaper reading operation on the first content at a preset volume when the terminal equipment is detected to be successfully connected with the earphone.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the display module includes:
the searching sub-module is used for searching the electronic page corresponding to the learning page;
the determining submodule is used for determining the first content in the electronic page according to the user click-through area;
and the display sub-module is used for displaying the electronic page and highlighting the first content in the electronic page.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the terminal device further includes:
the distance acquisition module is used for acquiring the vertical distance between the eyes of the user and the learning page after the acquisition module acquires the first image comprising the learning page;
and the output module is used for outputting second prompt information if the vertical distance is smaller than a distance threshold value, wherein the second prompt information is used for prompting a user to adjust the distance between eyes and the learning page.
In a third aspect, there is provided a terminal device comprising:
a memory storing executable program code;
a processor coupled to the memory;
the processor invokes the executable program code stored in the memory to perform the method for determining a click-to-read region in the first aspect of the embodiment of the present invention.
In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program that causes a computer to execute the method of determining a point-read area in the first aspect of the embodiment of the present invention. The computer readable storage medium includes ROM/RAM, magnetic disk or optical disk, etc.
In a fifth aspect, there is provided a computer program product for causing a computer to carry out some or all of the steps of any one of the methods of the first aspect when the computer program product is run on the computer.
In a sixth aspect, an application publishing platform is provided for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the terminal equipment can acquire a first included angle between the finger tip and the learning page and a second included angle between the pen tip and the learning page from the image by acquiring the image comprising the learning page, and when the first included angle is larger, the first area touched by the finger tip on the learning page is determined to be the area touched by the user, and when the second included angle is larger, the second area touched by the pen tip on the learning page is determined to be the area touched by the user. When the pen point and the finger tip touch different click-to-read areas of the learning page at the same time, the terminal equipment can determine the user click-to-read area according to the first included angle and the second included angle, so that the situation that the terminal equipment cannot identify the actual click-to-read area of the user or the identified click-to-read area is wrong is avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart illustrating a method for determining a click-to-read region according to an embodiment of the present invention;
FIG. 2 is a second flow chart of a method for determining a click-to-read region according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for determining a click-to-read region according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram II of a terminal device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram III of a terminal device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terms first and second and the like in the description and in the claims, are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order of the objects. For example, a first included angle and a second included angle, etc., are used to distinguish between different included angles, and are not used to describe a particular order of included angles.
The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
The embodiment of the invention provides a method for determining a click-to-read area and terminal equipment, which can avoid the problem that the terminal equipment cannot identify the actual click-to-read area of a user or the identified click-to-read area is wrong.
The terminal device related to the embodiment of the invention can be electronic devices with a click-to-read function, such as a mobile phone, a tablet computer, a click-to-read machine, a home teaching machine, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA) and the like. The execution main body of the method for determining the point-to-read area provided by the embodiment of the invention can be the terminal equipment, or can be a functional module and/or a functional entity which can realize the method for determining the point-to-read area in the terminal equipment, and the method can be specifically determined according to actual use requirements, and the embodiment of the invention is not limited. The method for determining the point-to-read area provided by the embodiment of the invention is exemplified by a terminal device.
The method for determining the point-reading area provided by the embodiment of the invention can be applied to the point-reading scene.
Example 1
As shown in fig. 1, an embodiment of the present invention provides a method for determining a click-to-read area, which may include the following steps:
101. and the terminal equipment acquires a first image comprising the learning page in the point-and-read mode.
Optionally, the terminal device may be provided with a capturing module for capturing an image, and the capturing module is used to capture the first image.
In the embodiment of the present invention, the click-to-read mode of the terminal device may be divided into two types, one type is to click-to-read an electronic page displayed on the display screen of the terminal device, and one type is to click-to-read a paper page, and accordingly, in the embodiment of the present invention, the learning page may be a paper page or an electronic page, and the embodiment of the present invention is not limited.
The power consumption of the terminal device when the user clicks on the paper page is generally larger than that when the user clicks on the electronic page, so that the user can be prompted to select a clicking mode based on the current electric quantity of the terminal device.
As an optional implementation manner, the terminal device stores an electronic version of the outline teaching material of the student, correspondingly, before executing step 101, in a click-to-read mode, the terminal device can also detect the current electric quantity of the terminal device, and when detecting that the current electric quantity is smaller than the preset electric quantity, output prompt information for instructing a user to click-read based on the electronic page, display the electronic page selected by the user as a learning page on a display screen of the terminal device, and start an image acquisition process; or when the current electric quantity is detected to be greater than or equal to the preset electric quantity, the terminal equipment can also output prompt information for indicating the user to click on the paper page, and start the image acquisition process.
Through the optional implementation manner, the suggested information aiming at the point reading type can be output to the user for reference based on the current electric quantity of the terminal equipment, so that the point reading mode is more flexible and humanized.
As an optional implementation manner, before executing step 101, the terminal device may further detect a current power of the terminal device, and output a prompt message for indicating that the user is connected to the power supply when the current power is detected to be less than the preset power.
Through the above optional implementation manner, when the current electric quantity of the terminal device is smaller than the preset electric quantity, the user can be prompted to charge, so that the terminal device is prevented from being interrupted to be used due to too low electric quantity in the use process of the user, and the use experience of the user is improved.
102. The terminal equipment acquires a first included angle and a second included angle from the first image.
The first included angle is an included angle between the finger tip and the learning page, and the second included angle is an included angle between the pen tip and the learning page.
Optionally, the terminal device may extract first image information of the region where the fingertip is located from the first image, and obtain the first included angle according to analysis of the first image information; the terminal device may also extract image information of the area where the pen point is located from the first image, and obtain the second included angle according to analysis of the second image information.
103. The terminal equipment judges whether the first included angle is larger than the second included angle.
If yes, the following is executed 104, and if not, the following is executed 105.
104. The terminal equipment determines a first area touched by the finger tip on the learning page, and takes the first area as a user click-reading area.
105. And the terminal equipment determines a second area touched by the pen point on the learning page, and takes the second area as a user click area.
When a user clicks the content on the learning page by using the finger tip or the pen tip, the finger tip or the pen tip is always clicked as perpendicular to the learning page as possible, at this time, the included angle between the finger tip or the pen tip and the learning page is larger and is close to 90 degrees, and when the user touches the learning page by mistake, the included angle between the finger tip or the pen tip and the learning page is usually smaller, so that the clicking region corresponding to the included angle with the larger angle is determined as the clicking region of the user, and the clicking region accords with the clicking habit of the user.
The embodiment of the invention provides a method for determining a click-to-read area, which is characterized in that terminal equipment can acquire a first included angle between a finger tip and a learning page and a second included angle between a pen tip and the learning page from an image by acquiring the image comprising the learning page, and when the first included angle is larger, the first area touched by the finger tip on the learning page is determined to be the area for the user to click and read, and when the second included angle is larger, the second area touched by the pen tip on the learning page is determined to be the area for the user to click and read. When the pen point and the finger tip touch different click-to-read areas of the learning page at the same time, the terminal equipment can determine the user click-to-read area according to the first included angle and the second included angle, so that the situation that the terminal equipment cannot identify the actual click-to-read area of the user or the identified click-to-read area is wrong is avoided.
As an alternative implementation manner, the foregoing 104 may be specifically implemented by the following steps:
104a, the terminal device determines a first area touched by the fingertip on the learning page.
104b, the terminal device determines a first duration of time for which the tip of the finger touches the first area.
104c, the terminal device takes the first area as a user click-to-read area under the condition that the first time length is longer than the preset time length.
As an alternative implementation manner, the foregoing 105 may be specifically implemented by the following steps:
105a, the terminal device determines a second area touched by the pen tip on the learning page.
105b, the terminal device determines a second duration of time for which the nib touches the second area.
105c, taking the second area as a user click-to-read area when the second time length is longer than the preset time length.
The preset duration may be set according to actual situations, which is not limited in the embodiments of the present invention.
Because the contact time between the finger tip or the pen point and the learning page is generally shorter when the user touches by mistake, based on the two optional embodiments, the terminal device comprehensively judges the user click-reading area according to the first included angle and the second included angle and the touch duration of the finger tip and the pen point on the learning page, so that the accuracy of determining the user click-reading area can be improved.
Example two
As shown in fig. 2, an embodiment of the present invention provides a method for determining a click-to-read area, which includes the following steps:
201. and the terminal equipment acquires a first image comprising the learning page in the point-and-read mode.
The learning page is a paper page.
202. The terminal equipment acquires a first included angle and a second included angle from the first image.
203. The terminal equipment judges whether the first included angle is larger than the second included angle.
204. The terminal equipment determines a first area touched by the finger tip on the learning page, and takes the first area as a user click-reading area.
205. And the terminal equipment determines a second area touched by the pen point on the learning page, and takes the second area as a user click area.
For the descriptions of 201 to 205, reference may be made to descriptions of 101 to 105 in the first embodiment, and the descriptions are omitted here.
206. The terminal device identifies a first content in the user click-through area.
In the embodiment of the present invention, the first content may be content located in the user click-through area on the learning page.
207. The terminal device displays the first content.
208. The terminal device reads the first content.
In the embodiment of the present invention, the execution sequence of 207 and 208 is not limited, and 207 and 208 may be executed first, 208 and 207 may be executed first, or 207 and 208 may be executed simultaneously.
In the above embodiment, the terminal device may identify the first content in the user click-to-read area, display the first content, and report and read the first content, so that the user may not only hear the first content, but also see the first content on the terminal device, thereby improving the user experience when the user clicks to read the content.
Alternatively, the above 208 may be specifically implemented by the following steps:
208a, the terminal device detects the ambient noise of the area where the terminal device is located.
208b, when the environmental noisy degree is larger than the preset noisy degree, the terminal equipment outputs first prompt information.
The first prompt message is used for prompting a user to wear the earphone.
208c, when the terminal equipment detects that the terminal equipment is successfully connected with the earphone, executing a newspaper reading operation on the first content at a preset volume.
By the method provided by the embodiment, the user can be prompted to wear the earphone by detecting the noisy degree of the environment where the terminal equipment is located, so that the newspaper reading effect is ensured.
As an optional implementation manner, the manner in which the terminal device detects the environmental noise level of the area where the terminal device is located may be:
the terminal equipment detects whether a certain wireless access point is accessed currently, and if the certain wireless access point is accessed currently, the terminal equipment identifies whether the identification information of the wireless access point accessed currently is matched with the identification information of the wireless access point on a certain school bus recorded in advance by the terminal equipment.
If the terminal equipment is matched, the terminal equipment can consider that the terminal equipment is currently positioned on the school bus, correspondingly, the terminal equipment can acquire the identity information of the service equipment reloaded on the school bus, and according to the identity information of the service equipment on the school bus, a request message is sent to the service equipment of the school bus through the wireless access point, the request message carries the identity information of the terminal equipment and a request field, and the request field is used for requesting the service equipment of the school bus to detect the environmental noisy degree in the school bus.
And the terminal equipment acquires the environmental noisy degree in the school bus, which is sent by the service equipment of the school bus in response to the request message, and takes the environmental noisy degree in the school bus as the environmental noisy degree of the area where the terminal equipment is located.
By implementing the embodiment, the power consumption caused by the fact that the terminal equipment detects the environmental noise degree of the area can be avoided by starting the sensor of the terminal equipment, and the heating value of the terminal equipment caused by the aggravation of the power consumption is reduced.
Alternatively, the step 207 may be specifically implemented by the following steps:
207a, the terminal device searches the electronic page corresponding to the learning page.
207b, the terminal device determines the first content in the electronic page according to the user click-through area.
207c, the terminal device displays the electronic page and highlights the first content in the electronic page.
In the implementation manner, the terminal equipment can display the electronic page corresponding to the learning page, display the electronic page in the terminal equipment and highlight the first content in the electronic page, so that a user can clearly and intuitively see the first content in the process of clicking and reading the first content, and can see the electronic page where the first content is located, and user experience is improved.
As an alternative implementation, after 207a above, the terminal device may further receive a click-through input from the user to the second content on the electronic page, and in response to the click-through input, report the second content. The second content may be content other than the first content on the electronic page.
Through the optional implementation mode, after the user clicks on the paper page once, the terminal equipment can display the corresponding electronic page, and the user can continue to click on the electronic page when clicking on the next time, so that the switching between the paper page clicking and the electronic page clicking is realized, and the clicking mode is more flexible.
Example III
As shown in fig. 3, an embodiment of the present invention provides a method for determining a click-to-read area, which includes the following steps:
301. and the terminal equipment acquires a first image comprising the learning page in the point-and-read mode.
The learning page is a paper page.
The description of 301 may refer to the description of 101 in embodiment one, and in order to avoid repetition, a description is omitted here.
302. The terminal equipment acquires the vertical distance between the eyes of the user and the learning page.
Alternatively, the terminal device may acquire the vertical distance between the eyes of the user and the learning page from the first image, or may acquire the second image including the learning page and the eyes of the user from the new image, and acquire the vertical distance between the eyes of the user and the learning page from the second image.
303. If the vertical distance is smaller than the distance threshold, the terminal equipment outputs second prompt information.
The second prompt information is used for prompting the user to adjust the distance between the eyes and the learning page.
Alternatively, the distance threshold may be determined according to practical situations, which is not limited by the embodiment of the present invention.
304. The terminal equipment acquires a first included angle and a second included angle from the first image.
305. The terminal equipment judges whether the first included angle is larger than the second included angle.
306. The terminal equipment determines a first area touched by the finger tip on the learning page, and takes the first area as a user click-reading area.
307. And the terminal equipment determines a second area touched by the pen point on the learning page, and takes the second area as a user click area.
For the description of 304 to 307, reference may be made to the descriptions of 102 to 105 in embodiment one, and in order to avoid repetition, the description will not be repeated here.
It should be noted that, in the embodiment of the present invention, the execution sequence of 302 to 303 and 304 to 307 is not limited, i.e. 304 to 307 may be executed first and 302 to 303 may be executed later; 302 to 303 may be performed first and 304 to 307 may be performed later, or 302 to 303 and 304 to 307 may be performed simultaneously.
Based on the method of the embodiment, the terminal device can prompt the user to adjust the distance between the eyes and the learning page under the condition that the vertical distance between the eyes of the user and the learning page is smaller than the distance threshold, so that the eyesight of the user can be protected.
Example IV
As shown in fig. 4, an embodiment of the present invention provides a terminal device, including:
the acquisition module 401 is configured to acquire a first image including a learning page in a point-and-read mode.
The included angle obtaining module 402 is configured to obtain a first included angle and a second included angle from the first image, where the first included angle is an included angle between the fingertip and the learning page, and the second included angle is an included angle between the nib and the learning page.
A judging module 403, configured to judge whether the first included angle is greater than the second included angle; if yes, determining a first area touched by the finger tip on the learning page, and taking the first area as a user click area; if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area.
The embodiment of the invention provides terminal equipment, which can acquire a first included angle between a finger tip and a learning page and a second included angle between a pen tip and the learning page from an image by acquiring the image comprising the learning page, and when the first included angle is larger, the terminal equipment determines that a first area touched by the finger tip on the learning page is a user click-reading area, and when the second included angle is larger, the terminal equipment determines that a second area touched by the pen tip on the learning page is a user click-reading area. When the pen point and the finger tip touch different click-to-read areas of the learning page at the same time, the terminal equipment can determine the user click-to-read area according to the first included angle and the second included angle, so that the situation that the terminal equipment cannot identify the actual click-to-read area of the user or the identified click-to-read area is wrong is avoided.
As an alternative implementation manner, the terminal device stores an electronic version of the outline textbook of the student, and the terminal device may further include the following modules not shown:
and the electric quantity detection module is used for detecting the current electric quantity of the terminal equipment before the acquisition module 401 acquires the first image comprising the learning page in the point-reading mode.
The information output module is used for outputting prompt information for indicating a user to click on the basis of the electronic page when the current electric quantity is detected to be smaller than the preset electric quantity, and displaying the electronic page selected by the user on a display screen of the terminal device as a learning page, or outputting prompt information for indicating the user to click on the basis of the paper page when the current electric quantity is detected to be larger than or equal to the preset electric quantity.
And the image acquisition module is used for starting an image acquisition process.
Through the optional implementation manner, the suggested information aiming at the point reading type can be output to the user for reference based on the current electric quantity of the terminal equipment, so that the point reading mode is more flexible and humanized.
As an optional implementation manner, the power detection module is further configured to detect, in a point-to-read mode, a current power of the terminal device before the acquisition module 401 acquires the first image including the learning page.
The information output module is further used for outputting prompt information for indicating that the user is connected with the power supply when the current electric quantity is detected to be smaller than the preset electric quantity.
Through the above optional implementation manner, when the current electric quantity of the terminal device is smaller than the preset electric quantity, the user can be prompted to charge, so that the terminal device is prevented from being interrupted to be used due to too low electric quantity in the use process of the user, and the use experience of the user is improved.
As an optional implementation manner, the terminal device stores an electronic version of the outline textbook of the student, and the above-mentioned judging module may further include the following modules not shown:
the region determination submodule is used for determining a first region touched by a finger tip on the learning page.
The duration determination submodule is used for determining a first duration that the finger tip touches the first area.
And the judging sub-module is used for taking the first area as a user click-reading area under the condition that the first time length is longer than the preset time length.
Optionally, the above region determining submodule is further configured to determine a second region touched by the pen tip on the learning page.
The time determining submodule is further used for determining a second time when the pen point touches the second area.
The judging sub-module is further configured to take the second area as the user click-to-read area when the second time length is longer than the preset time length.
Because the contact time between the finger tip or the pen point and the learning page is generally shorter when the user touches by mistake, based on the two optional embodiments, the terminal device comprehensively judges the user click-reading area according to the first included angle and the second included angle and the touch duration of the finger tip and the pen point on the learning page, so that the accuracy of determining the user click-reading area can be improved.
Optionally, in combination with fig. 4, as shown in fig. 5, the learning page is a paper page, and the terminal device further includes:
the identifying module 404 is configured to identify the first content in the user click-through area after the judging module takes the first area as the user click-through area or takes the second area as the user click-through area.
And a display module 405 for displaying the first content.
And the newspaper reading module 406 is configured to newspaper and read the first content.
In the embodiment shown in fig. 5, the terminal device may identify the first content in the user click-to-read area, display the first content, and report and read the first content, so that the user may not only hear the first content, but also see the first content on the terminal device, thereby improving the user experience when the user clicks to read the content.
Optionally, the report-reading module 406 in fig. 5 includes:
a detection sub-module 4061, configured to detect an environmental noise level of an area where the terminal device is located; and the output sub-module is used for outputting first prompt information when the environmental noisy degree is greater than the preset noisy degree, and the first prompt information is used for prompting a user to wear the earphone.
And the newspaper reading sub-module 4062 is configured to perform newspaper reading operation on the first content at a preset volume when it is detected that the terminal device is successfully connected to the earphone.
As an alternative implementation manner, the detection submodule 4061 may further include the following units not illustrated in the existing figures:
and the wireless detection unit is used for detecting whether the terminal equipment is accessed to a certain wireless access point currently.
The terminal equipment is used for judging whether the identification information of the wireless access point which is accessed currently is matched with the identification information of the wireless access point on a certain school bus which is recorded in advance by the terminal equipment or not if the identification information of the wireless access point which is accessed currently, and if the identification information of the wireless access point is matched with the identification information of the wireless access point on the school bus, the terminal equipment can consider that the terminal equipment is positioned on the school bus currently.
And the identity acquisition unit is used for acquiring the identity information of the service equipment transferred on the school bus.
And the message sending unit is used for sending a request message to the service equipment of the school bus through the wireless access point according to the identity information of the service equipment on the school bus, wherein the request message carries the identity information of the terminal equipment and a request field, and the request field is used for requesting the service equipment of the school bus to detect the environmental noisy degree in the school bus.
And the message receiving unit is used for acquiring the environmental noisy degree in the school bus, which is sent by the service equipment of the school bus in response to the request message, and taking the environmental noisy degree in the school bus as the environmental noisy degree of the area where the terminal equipment is located.
And acquiring the environmental noisy degree of the service equipment of the school bus in response to the request message, and taking the environmental noisy degree of the school bus as the environmental noisy degree of the area where the terminal equipment is located.
The implementation of the optional implementation mode can avoid the power consumption caused by the fact that the terminal equipment detects the environmental noisy degree of the area by starting the sensor of the terminal equipment, and reduce the heating value of the terminal equipment caused by the aggravation of the power consumption.
Optionally, the display module 405 in fig. 5 includes:
the searching sub-module 4051 is configured to search an electronic page corresponding to the learning page.
A determining submodule 4052 is configured to determine the first content in the electronic page based on the user click-through area.
The display submodule 4053 is configured to display an electronic page and highlight the first content in the electronic page.
As an alternative implementation, the terminal device may further comprise the following units not illustrated in the existing figures:
and a receiving module, configured to display the electronic page on the display sub-module 4053, and after the first content is highlighted in the electronic page, receive a click-to-read input of the user on the second content on the electronic page.
The newspaper reading module 406 is further configured to receive a click-to-read input of the second content from the user on the electronic page.
Through the optional implementation mode, after the user clicks on the paper page once, the terminal equipment can display the corresponding electronic page, and the user can continue to click on the electronic page when clicking on the next time, so that the switching between the paper page clicking and the electronic page clicking is realized, and the clicking mode is more flexible.
Optionally, in conjunction with fig. 4, the terminal device as shown in fig. 6 further includes:
the distance acquiring module 407 is configured to acquire a vertical distance between the eyes of the user and the learning page after the acquiring module acquires the first image including the learning page.
The output module 408 is configured to output a second prompt if the vertical distance is less than the distance threshold, where the second prompt is configured to prompt the user to adjust the distance between the eyes and the learning page.
As shown in fig. 7, an embodiment of the present invention further provides a terminal device, where the terminal device may include:
a memory 501 in which executable program code is stored.
A processor 502 coupled to the memory 501.
The processor 502 invokes executable program codes stored in the memory 501 to execute the method for determining the point-read area performed by the terminal device in the above method embodiments.
It should be noted that, the terminal device shown in fig. 7 may further include a battery, an input key, a speaker, a microphone, a screen, an RF circuit, a Wi-Fi module, a bluetooth module, a sensor, and other components not shown, which are not described in detail in this embodiment.
The present invention provides a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute some or all of the steps of the method as in the above method embodiments.
Embodiments of the present invention also provide a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of the method as in the method embodiments above.
The embodiment of the invention also provides an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and the computer program product, when running on a computer, causes the computer to execute part or all of the steps of the method as in the above method embodiments.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art will also appreciate that the embodiments described in the specification are alternative embodiments and that the acts and modules referred to are not necessarily required for the present invention.
The terminal device provided by the embodiment of the present invention can implement each process shown in the foregoing method embodiment, and in order to avoid repetition, details are not repeated here.
In various embodiments of the present invention, it should be understood that the sequence numbers of the foregoing processes do not imply that the execution sequences of the processes should be determined by the functions and internal logic of the processes, and should not be construed as limiting the implementation of the embodiments of the present invention.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the above-mentioned method of the various embodiments of the present invention.
Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the above embodiments may be implemented by a program that instructs associated hardware, the program may be stored in a computer readable storage medium including Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium that can be used for carrying or storing data that is readable by a computer.
Claims (10)
1. A method of determining a click-through region, the method comprising:
in a click-to-read mode, acquiring a first image comprising a learning page;
extracting first image information of a region where a finger tip is located from the first image, analyzing according to the first image information to obtain a first included angle, wherein the first included angle is an included angle between the finger tip and the learning page, extracting second image information of the region where the finger tip is located from the first image, analyzing according to the second image information to obtain a second included angle, and the second included angle is an included angle between the finger tip and the learning page;
judging whether the first included angle is larger than the second included angle;
if yes, determining a first area touched by the fingertip on the learning page, and taking the first area as a user click area;
if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area.
2. The method of claim 1, wherein the learning page is a paper page, wherein the first area is after the user click-through area or the second area is after the user click-through area, further comprising:
identifying first content in the user click-through area;
and displaying the first content and reporting and reading the first content.
3. The method according to claim 2, applied to a terminal device, wherein said newspaper reading said first content comprises:
detecting the environmental noise degree of the area where the terminal equipment is located;
when the environmental noisy degree is larger than the preset noisy degree, outputting first prompt information, wherein the first prompt information is used for prompting a user to wear the earphone;
and when the terminal equipment is detected to be successfully connected with the earphone, executing a newspaper reading operation on the first content at a preset volume.
4. The method of claim 2, wherein the displaying the first content comprises:
searching an electronic page corresponding to the learning page;
determining the first content in the electronic page according to the user click-through area;
and displaying the electronic page, and highlighting the first content in the electronic page.
5. The method of any one of claims 1 to 4, wherein after the capturing the first image comprising the first learning page, the method further comprises:
acquiring the vertical distance between eyes of a user and the learning page;
and if the vertical distance is smaller than the distance threshold, outputting second prompt information, wherein the second prompt information is used for prompting a user to adjust the distance between eyes and the learning page.
6. A terminal device, comprising:
the acquisition module is used for acquiring a first image comprising a learning page in a point-reading mode;
the included angle acquisition module is used for extracting first image information of an area where a finger tip is located from the first image, analyzing and obtaining a first included angle according to the first image information, wherein the first included angle is an included angle between the finger tip and the learning page, extracting second image information of the area where the pen tip is located from the first image, analyzing and obtaining a second included angle according to the second image information, and the second included angle is an included angle between the pen tip and the learning page;
the judging module is used for judging whether the first included angle is larger than the second included angle or not; if yes, determining a first area touched by the fingertip on the learning page, and taking the first area as a user click area; if not, determining a second area touched by the pen point on the learning page, and taking the second area as a user click area.
7. The terminal device of claim 6, wherein the learning page is a paper page, the terminal device further comprising:
the identification module is used for identifying the first content in the user click-to-read area after the judgment module takes the first area as the user click-to-read area or takes the second area as the user click-to-read area;
the display module is used for displaying the first content;
and the newspaper reading module is used for newspaper reading the first content.
8. The terminal device of claim 7, wherein the reading module comprises:
the detection submodule is used for detecting the environmental noisy degree of the area where the terminal equipment is located; the output sub-module is used for outputting first prompt information when the environmental noisy degree is larger than the preset noisy degree, and the first prompt information is used for prompting a user to wear the earphone;
and the newspaper reading sub-module is used for executing newspaper reading operation on the first content at a preset volume when the terminal equipment is detected to be successfully connected with the earphone.
9. The terminal device of claim 7, wherein the display module comprises:
the searching sub-module is used for searching the electronic page corresponding to the learning page;
the determining submodule is used for determining the first content in the electronic page according to the user click-through area;
and the display sub-module is used for displaying the electronic page and highlighting the first content in the electronic page.
10. The terminal device according to any of the claims 6 to 9, characterized in that the terminal device further comprises:
the distance acquisition module is used for acquiring the vertical distance between eyes of a user and the learning page after the acquisition module acquires the first image comprising the learning page;
and the output module is used for outputting second prompt information if the vertical distance is smaller than a distance threshold value, wherein the second prompt information is used for prompting a user to adjust the distance between eyes and the learning page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910483903.2A CN111079492B (en) | 2019-06-03 | 2019-06-03 | Method for determining click-to-read area and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910483903.2A CN111079492B (en) | 2019-06-03 | 2019-06-03 | Method for determining click-to-read area and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111079492A CN111079492A (en) | 2020-04-28 |
| CN111079492B true CN111079492B (en) | 2023-10-31 |
Family
ID=70310371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910483903.2A Active CN111079492B (en) | 2019-06-03 | 2019-06-03 | Method for determining click-to-read area and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079492B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104978576A (en) * | 2014-04-02 | 2015-10-14 | 阿里巴巴集团控股有限公司 | Character identification method and device thereof |
| CN106471450A (en) * | 2014-06-26 | 2017-03-01 | 索尼公司 | Messaging device, information processing method and program |
| CN109003476A (en) * | 2018-07-18 | 2018-12-14 | 深圳市本牛科技有限责任公司 | A kind of finger point-of-reading system and its operating method and device using the system |
| CN109240582A (en) * | 2018-08-30 | 2019-01-18 | 广东小天才科技有限公司 | A kind of put reads control method and smart machine |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9134849B2 (en) * | 2011-10-25 | 2015-09-15 | Nook Digital, Llc | Pen interface for a touch screen device |
| US9785275B2 (en) * | 2015-03-30 | 2017-10-10 | Wacom Co., Ltd. | Contact discrimination using a tilt angle of a touch-sensitive surface |
| US11150749B2 (en) * | 2017-03-16 | 2021-10-19 | Microsoft Technology Licensing, Llc | Control module for stylus with whiteboard-style erasure |
-
2019
- 2019-06-03 CN CN201910483903.2A patent/CN111079492B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104978576A (en) * | 2014-04-02 | 2015-10-14 | 阿里巴巴集团控股有限公司 | Character identification method and device thereof |
| CN106471450A (en) * | 2014-06-26 | 2017-03-01 | 索尼公司 | Messaging device, information processing method and program |
| CN109003476A (en) * | 2018-07-18 | 2018-12-14 | 深圳市本牛科技有限责任公司 | A kind of finger point-of-reading system and its operating method and device using the system |
| CN109240582A (en) * | 2018-08-30 | 2019-01-18 | 广东小天才科技有限公司 | A kind of put reads control method and smart machine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111079492A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170193992A1 (en) | Voice control method and apparatus | |
| CN111077996B (en) | Information recommendation method and learning device based on click-to-read | |
| CN111078829B (en) | Click-to-read control method and system | |
| CN111078102B (en) | Method for determining point reading area through projection and terminal equipment | |
| CN108958576B (en) | Content identification method and device and mobile terminal | |
| CN110597450A (en) | False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof | |
| CN108733718B (en) | Search result display method and device and display device for search results | |
| CN105550643A (en) | Medical term recognition method and device | |
| CN103970841A (en) | Label management method and device | |
| CN105871696B (en) | Information sending and receiving method and mobile terminal | |
| CN109032491A (en) | Data processing method, device and mobile terminal | |
| CN108803972B (en) | Information display method, device, mobile terminal and storage medium | |
| CN105160236A (en) | Method and device for inputting verification code | |
| CN108803961B (en) | Data processing method and device and mobile terminal | |
| KR102192157B1 (en) | Apparatas and method for offering a information about search location in an electronic device | |
| CN106326260A (en) | Webpage access method and device | |
| CN109062648B (en) | Information processing method and device, mobile terminal and storage medium | |
| CN109032465B (en) | Data processing method and device and mobile terminal | |
| WO2019201109A1 (en) | Word processing method and apparatus, and mobile terminal and storage medium | |
| CN110244848B (en) | Reading control method and related equipment | |
| CN108958578B (en) | File control method and device and electronic device | |
| CN111079492B (en) | Method for determining click-to-read area and terminal equipment | |
| CN104202482B (en) | A kind of communications records treatment facility, method and mobile terminal | |
| CN107203325B (en) | Searching method and device, computer device and readable storage medium | |
| CN111078084B (en) | Point reading control method and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |