CN110597450A - False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof - Google Patents
False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof Download PDFInfo
- Publication number
- CN110597450A CN110597450A CN201910870116.3A CN201910870116A CN110597450A CN 110597450 A CN110597450 A CN 110597450A CN 201910870116 A CN201910870116 A CN 201910870116A CN 110597450 A CN110597450 A CN 110597450A
- Authority
- CN
- China
- Prior art keywords
- gesture
- user
- reading
- book
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
The invention discloses a false touch prevention identification method and device, a touch reading device and a touch reading identification method thereof. The false touch prevention identification method comprises the following steps: acquiring a gesture image frame of a user for reading a book in a designated visual area; identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; when the gesture is recognized to be an effective gesture, further acquiring the position coordinates of a contact point of the book pointed by the user; detecting whether the position coordinates of the contact points are in an effective reading area of the book; when the position coordinates of the contact points are detected to be in the effective reading area of the book, judging the gesture operation of the user to be the reading operation; and when the position coordinates of the touch points are not detected to be in the effective touch and reading area of the book, or the gesture of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation. According to the invention, the click-to-read caused by the false touch is greatly reduced, the user experience is improved, and the problems of high concurrency and extra cost consumption of the server caused by the false touch are reduced.
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a false touch prevention identification method and device, a touch and read device and a touch and read identification method thereof.
Background
The family education machine is an Android flat plate for providing high-quality education resources, and a camera is arranged on the family education machine. When a user points at the content on the paper book, the family education machine can identify and take out the text and multimedia data corresponding to the click position of the user, and the function of displaying and playing the corresponding position information at the point is realized. However, the touch is easy to be mistakenly touched during use, so that the following problems are caused:
1. the non-click operation of the user is also identified as click, so that the use experience of the user is seriously influenced by the no-click response;
2. miscontact increases concurrency of the server, resulting in additional cost consumption.
Disclosure of Invention
The invention provides a false touch prevention identification method and device, a touch reading device and a touch reading identification method thereof, which are used for solving the technical problems that in the prior art, due to the fact that a user touches by mistake, touch reading is caused, user experience is influenced, and power consumption of the device is increased. Specifically, the technical scheme of the invention is as follows:
in a first aspect, the present invention provides a false touch prevention identification method, including: acquiring a gesture image frame of a user for reading a book in a designated visual area; identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; when the gesture is recognized to be an effective gesture, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame; detecting whether the position coordinates of the contact points are in an effective point reading area of the book; when the position coordinates of the contact points are detected to be in the effective reading area of the book, judging the gesture operation of the user to be a reading operation; and when the position coordinates of the contact points are not detected to be in the effective touch and reading area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation.
Preferably, the recognizing, according to the gesture image frame, whether the gesture within the preset time of the user is a valid gesture includes: identifying a finger of the user in the gesture image frame; judging whether the fingers of the user are positioned at the same position for a preset time or not according to the gesture image frame; when the fingers of the user are positioned at the same position for a preset time, recognizing the gesture of the user; and judging whether the gesture of the user is an effective gesture or not according to a preset click-read gesture.
Preferably, after determining that the position coordinates of the touch point are in the effective reading area of the book, the method further comprises: identifying whether the user is currently turning pages of the book according to the gesture image frame; and when the fact that the user is currently performing page turning operation on the book is recognized, judging that the gesture operation of the user is a non-point reading operation.
Preferably, before acquiring the designated visual area, the method further includes, before the user clicks and reads the gesture image frame of the book: collecting voice information of the user; analyzing the voice information and judging whether the user needs to click to read currently; and when the current required key point of the user is judged to be read, acquiring a gesture image frame of the user for reading the book in a specified visual area.
In a second aspect, the present invention provides a false touch prevention identification device, including: the image acquisition module is used for acquiring a gesture image frame of a user reading a book in a specified visual area; the recognition detection module is used for recognizing whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; the coordinate acquisition module is used for acquiring the position coordinates of the contact points of the book pointed by the user according to the gesture image frame when the gesture is recognized to be an effective gesture; the coordinate judgment module is used for detecting whether the position coordinates of the contact points are in the effective reading area of the book; the operation judgment module is used for judging the gesture operation of the user to be a point reading operation when the position coordinate of the contact is detected to be in the effective point reading area of the book; and when the position coordinates of the contact points are not detected to be in the effective touch and reading area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation.
Preferably, the identification detection module includes: a finger recognition submodule for recognizing the user's finger in the gesture image frame; the stability detection submodule is used for judging whether the fingers of the user are positioned at the same position for preset time or not according to the gesture image frame; the gesture recognition sub-module is used for recognizing the gesture of the user when the situation that the fingers of the user are positioned at the same position for preset time is judged; and judging whether the gesture of the user is an effective gesture or not according to a preset click-read gesture.
Preferably, the false touch prevention recognition device further includes: the page turning detection module is used for identifying whether the user is currently performing page turning operation on the book according to the gesture image frame; when the fact that the user is currently performing page turning operation on the book is recognized, the operation judgment module judges that the gesture operation of the user is non-point reading operation.
Preferably, the false touch prevention recognition device further includes: the voice acquisition module is used for acquiring voice information of a user; the voice analysis module is used for analyzing the voice information and judging whether the user needs to read at present; when the current required key point of the user is judged to be read, the image acquisition module acquires the gesture image frame of the user for reading the book in the specified visual area.
In a third aspect, the present invention further provides a point reading device, including: the invention relates to a false touch prevention identification device and a touch and read response device; the point reading response device comprises: the reading database is used for storing reading book information and corresponding reading data information; the characteristic extraction module is used for acquiring image characteristic information of a current click-to-read page according to the gesture image frame when the gesture operation of the user is judged to be click-to-read operation; the data searching module is used for searching the corresponding read-on book and page number in a pre-stored read-on database according to the image characteristic information of the current read-on page; the data extraction module is used for extracting corresponding reading data information according to the searched reading books and page numbers and by combining the position coordinates of the contacts; and the playing and displaying module is used for responding to the reading operation of the user and playing the reading data information.
In a fourth aspect, the present invention further provides a reading identification method for a reading device, which is applied to the reading device of the present invention, and the reading method includes: acquiring a gesture image frame of a user for reading a book in a designated visual area; identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; when the gesture is recognized to be an effective gesture, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame; detecting whether the position coordinates of the contact points are in an effective point reading area of the book; when the position coordinates of the contact points are detected to be in the effective reading area of the book, judging the gesture operation of the user to be a reading operation; when the position coordinates of the contact points are not detected to be in an effective touch and talk area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and talk operation; when the gesture operation of the user is judged to be the touch reading operation, acquiring image characteristic information of a current touch reading page according to the gesture image frame; according to the image characteristic information of the current click-to-read page, searching a corresponding click-to-read book and page number in a pre-stored click-to-read database; extracting corresponding reading data information according to the searched reading book and page number and by combining the position coordinates of the contact; and responding to the reading operation of the user, and playing the reading data information.
The invention at least comprises the following technical effects:
(1) by adopting the false touch prevention identification method, the gesture operation of the user on the book is correspondingly identified and detected, specifically, the gesture within the preset time of the user is required to be an effective gesture, and the position of the contact point of the user pointing to the book is positioned in the effective reading area of the book, so that the gesture operation of the user can be considered as the reading operation instead of the false touch, thereby greatly reducing the false touch caused by the user outside the book or some non-standard gestures, and improving the user experience; meanwhile, the problems of high concurrency and extra cost consumption caused by false triggering of the server are reduced.
(2) In the false touch recognition method, particularly, the stability and recognition detection are carried out on the gesture operation of the user, specifically, the fingers of the user are required to be positioned at the same position for a period of time (stability detection), if the stability detection is qualified, the gesture action of the user is compared with the pre-stored click-to-read gesture action, whether the gesture action of the user is an effective gesture or not is judged, a common false touch cannot be kept for a certain time, and the gesture operation is not necessarily the pre-stored click-to-read gesture operation, so that a large number of false touch operations can be detected through the stability and gesture recognition mode, and unnecessary click-to-read is reduced.
(3) In the false touch recognition method, page turning operation detection is added, page turning operation is further eliminated, and accuracy of touch and read gesture recognition judgment is greatly improved.
(4) In the invention, before triggering the false touch recognition, the voice information of the user is required to be collected, and the false touch recognition is triggered when the voice information of the user is analyzed to be that the user needs to be subjected to point reading at present, so that the false touch recognition can be started only when the user sends a voice instruction to be subjected to point reading, thereby greatly reducing the workload of the false touch recognition and saving the power consumption of equipment.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flow chart of an embodiment of a false touch prevention method of the present invention;
FIG. 2 is a flowchart illustrating a method for false touch detection according to another embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for false touch detection according to another embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for false touch detection according to another embodiment of the present invention;
FIG. 5 is a block diagram of an embodiment of a false touch prevention device according to the present invention;
FIG. 6 is a block diagram of another embodiment of a false touch detection device according to the present invention;
FIG. 7 is a block diagram of an embodiment of a point-to-read device of the present invention;
fig. 8 is a flowchart of an embodiment of a touch reading identification method of a touch reading device according to the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically depicted, or only one of them is labeled. In this document, "one" means not only "only one" but also a case of "more than one".
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In particular implementations, the terminal devices described in embodiments of the present application include, but are not limited to, other portable devices such as mobile phones, laptop computers, family computers, or tablet computers having touch sensitive surfaces (e.g., touch screen displays and/or touch pads). It should also be understood that in some embodiments the terminal device is not a portable communication device, but is a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or touchpad).
In the discussion that follows, a terminal device that includes a display and a touch-sensitive surface is described. However, it should be understood that the terminal device may include one or more other physical user interface devices such as a physical keyboard, mouse, and/or joystick.
The terminal device supports various applications, such as one or more of the following: a drawing application, a presentation application, a network creation application, a word processing application, a disc burning application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, an exercise support application, a photo management application, a digital camera application, a digital video camera application, a Web browsing application, a digital music player application, and/or a digital video player application.
Various applications that may be executed on the terminal device may use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal can be adjusted and/or changed between applications and/or within respective applications. In this way, a common physical architecture (e.g., touch-sensitive surface) of the terminal can support various applications with user interfaces that are intuitive and transparent to the user.
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
Fig. 1 shows an embodiment of a false touch prevention identification method provided by the present invention, which specifically includes:
s101, acquiring a gesture image frame of a user for reading a book in a specified visual area;
specifically, for example, a video in a visible area may be captured by a camera, and a gesture image frame pointing to a book by a finger of a user is obtained from the video, where the gesture image frame may be a key frame image or a multi-frame image.
S102, identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; if yes, go to step S103; otherwise, go to step S106;
specifically, if the gesture a within the preset time is made and at least 3S is stuck, the gesture a within 3S is the gesture within the preset time, and then it is determined whether the gesture a stuck at least 3S is a valid gesture. For example, if the effective gesture is pointing downwards to the book for at least 3S, and if the user insists that the gesture a of at least 3S is pointing upwards, it is obvious that the gesture a is not an effective gesture, and certainly does not trigger click-to-read.
S103, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
specifically, if the previous step determines that the gesture within the preset time of the user is an effective gesture, the position of a contact point where the finger of the user points to the book, that is, the position point where the fingertip of the user contacts the book, which is called a contact point, is obtained, and through the gesture image frame, the position where the contact point is located on the current page can be identified.
S104, detecting whether the position coordinates of the contact points are in an effective reading area of the book or not; if yes, go to step S105; otherwise, go to step S106;
specifically, no place in the book is a touch and read area, such as a blank area, for example, a page position area, and the like, so that touch and read cannot be triggered if the place pointed by the user does not belong to the touch and read area, and therefore, after the gesture of the user is determined to be an effective gesture, it is also necessary to determine whether the touch point position coordinate pointed by the user belongs to the touch and read area. The setting of the reading area and the non-reading area on the book can be set in advance, for example, the blank area and the page position area of the pages are set as the non-reading area, and the rest positions are set as the reading areas. Of course, preferably, the book and the current page number of the book currently being viewed by the user are identified, the reading area included in the current page number is obtained through searching, then whether the touch point is located in the reading area or not is judged according to the position of the touch point, and whether the gesture operation of the user is the reading operation or not is further judged.
S105, judging that the gesture operation of the user is a point-reading operation;
and S106, judging that the gesture operation of the user is a non-point-reading operation.
Specifically, if the gesture operation of the user is judged to be the touch-and-read operation, the touch-and-read machine gives a touch-and-read response, and if the gesture operation is the non-touch-and-read operation, it is indicated that the user may touch the touch-and-read machine by mistake, the touch-and-read machine does not give a response, so that the triggering of the touch-and-read machine is reduced, the power consumption of the touch-and-read machine is reduced, and the user experience is improved.
Another embodiment of the false touch prevention identification method of the present invention, as shown in fig. 2, includes:
s201, acquiring a gesture image frame of a user for reading a book in a specified visual area;
s202, recognizing the finger of the user in the gesture image frame;
specifically, after acquiring a gesture image frame of a book clicked and read by a user, image recognition processing is performed on the image frame, and a finger of the user in the gesture image frame is recognized.
S203, judging whether the fingers of the user are positioned at the same position for a preset time or not according to the gesture image frame;
specifically, after the finger of the user is recognized, the gesture image frame is taken according to the captured gesture image frame, where the gesture image frame generally includes more than one frame of image, such as a plurality of gesture image key frames extracted from the captured visual area video, and then the time for the gesture to be maintained can be obtained from the time interval between the gesture image key frames. And then judging whether the time for positioning the finger of the user to the same position reaches the preset time.
S204, when the fingers of the user are positioned at the same position for a preset time, recognizing the gesture of the user;
specifically, if it is determined that the fingers of the user are located at the same position for the preset time, for example, the user points at a certain position of the book, the fingers are kept pointing at the certain position of the book for 4S, and if the preset time is 3S, it is obvious that the keeping time of the fingers of the user pointing at the certain position of the book meets the preset time, the gesture can be further recognized, and whether the gesture is an effective gesture for touch reading or not is determined.
S205, judging whether the gesture of the user is an effective gesture according to a preset click-to-read gesture; if yes, go to step S206; otherwise, go to step S209;
s206, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
s207, detecting whether the position coordinates of the contact points are in an effective reading area of the book; if yes, go to step S208; otherwise, go to step S209;
s208, judging that the gesture operation of the user is a point-reading operation;
s209, judging that the gesture operation of the user is a non-point-reading operation.
In this embodiment, carry out stability and discernment detection to user's gesture operation, it is specific, require user's finger to fix a position same position for a period of time (stability detects), if stability detects under the qualified circumstances, again with user's gesture action with the point that prestores read the gesture action and compare, judge whether user's this time gesture action is effective gesture, general mistake is touched and then can not keep for a certain time, and its gesture operation also must not be the point that prestores and read the gesture operation, consequently through this stability and gesture recognition mode, alright detect out a large amount of mistake touch operations, thereby reduce and initiate unnecessary point and read.
On the basis of any of the above embodiments of the false touch prevention identification method, as shown in fig. 3, another embodiment of the false touch prevention identification method of the present invention includes:
s301, acquiring a gesture image frame of a user for reading a book in a specified visual area;
s302, identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; if yes, go to step S303; otherwise, go to step S307;
s303, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
s304, detecting whether the position coordinates of the contact points are in an effective reading area of the book; if yes, go to step S305; otherwise, go to step S307;
s305, identifying whether the user is currently turning pages of the book according to the gesture image frame; if yes, go to step S307; otherwise, go to step S306;
specifically, when the user turns the page, it is possible that the finger may touch a certain click reading area, and it is also possible that the time for the finger to touch the certain click reading area reaches the preset time, so after the above steps are performed, it is further necessary to detect whether the gesture of the user is the page turning operation, and further eliminate the possibility of the user turning the page, thereby more accurately determining whether the current gesture operation of the user is the click reading operation.
S306, judging the gesture operation of the user to be a point-reading operation;
and S307, judging that the gesture operation of the user is a non-point-reading operation.
According to the method and the device, the technologies of book reading area detection (whether a user finger points to the reading area), book page turning detection (whether a user gesture is a page turning operation), stability detection, invalid gesture filtering (whether the user gesture keeps the preset time or not and is an effective gesture) and the like are combined, so that the false touch caused by a non-standard gesture when a user hand is out of a book and turns pages is greatly reduced, the user experience is improved, and the problems of high concurrency and extra cost consumption of a server caused by the false touch are solved.
In another embodiment of the false touch detection preventing method according to the present invention, on the basis of any one of the above embodiments of the false touch detection preventing method, a step of voice acquisition and analysis is added, and specifically, as shown in fig. 4, the method includes:
s401, collecting voice information of the user;
specifically, for example, if the user wants to read a certain content on a book, the user can say to the family education machine or the reading machine that: the "how to read" or "how to read here" and the like only need to be voice information expressing the current will of the user to read.
S402, analyzing the voice information, and judging whether the user needs to read at present; if yes, go to step S403;
specifically, after the voice information of the user is collected, the voice information can be analyzed to obtain the semantics of the voice information, and then whether the user needs to click to read at present is judged according to the semantics, and if the user needs to click to read at present, the subsequent image obtaining and identifying steps are carried out. Certainly, when the analyzed voice information is not the message which needs to be read by the user at present, the subsequent image acquisition and identification steps are not carried out, so that the power consumption of the equipment is greatly saved, and the accuracy of reading operation identification is also improved.
S403, acquiring a gesture image frame of a user for reading a book in a specified visual area;
s404, identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; if yes, go to step S405; otherwise, go to step S408;
s405, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
s406, detecting whether the position coordinates of the contact points are in an effective reading area of the book; if yes, go to step S407; otherwise, go to step S408;
s407, judging that the gesture operation of the user is a point-reading operation;
s408, judging that the gesture operation of the user is a non-point-reading operation.
Based on the same technical concept, the invention also discloses a false touch prevention identification device which can identify whether the gesture operation of the user is a touch and read operation by adopting the false touch prevention identification method, so that the touch and read play caused by the false touch of the user is avoided, and the user experience is not influenced. Specifically, as shown in fig. 5, an embodiment of the false touch prevention recognition device of the present invention includes:
the image acquisition module 10 is configured to acquire a gesture image frame of a user reading a book in a specified visual area; specifically, the image acquisition module may be implemented by a camera, for example, a camera is arranged on the point reading machine/the family education machine, and the camera is used to shoot and acquire a video image in the designated visible area.
The recognition detection module 20 is configured to recognize whether a gesture within a preset time of the user is a valid gesture according to the gesture image frame; specifically, after the image acquisition module 10 acquires the gesture image frame, the recognition and detection module 20 performs image processing on the gesture image frame to recognize whether a gesture in which the user holding time reaches a preset time is an effective gesture, where the effective gesture is a preset gesture operation for click-to-read. For example, the preset time period is 500 milliseconds, if the user makes the gesture a and holds for at least 500 milliseconds, the gesture a within 500 milliseconds is a gesture within the preset time period, and then it is determined whether the gesture a holding for at least 500 milliseconds is a valid gesture. For example, a valid gesture is a gesture in which the finger points downward to the book for at least 500 milliseconds, and if the user insists that the gesture a for at least 500 milliseconds is a gesture in which the finger points upward, it is obvious that the gesture a is not a valid gesture, and certainly does not trigger a click-to-read.
The coordinate acquisition module 30 is configured to, when the gesture is identified as a valid gesture, acquire, according to the gesture image frame, position coordinates of a contact point of the book pointed by the user; specifically, if the recognition and detection module 20 in the previous step determines that the gesture within the preset time of the user is an effective gesture, the coordinate acquisition module 30 then acquires a position of a contact point where the finger of the user points to the book, that is, a position point where the fingertip of the user contacts with the book, where the position point is called a contact point, and through the gesture image frame, the position where the contact point is located on the current page can be recognized and acquired.
The coordinate judgment module 40 is used for detecting whether the position coordinates of the contact points are in an effective reading area of the book; specifically, no place in the book is a touch-reading area, such as a blank area, for example, a page position area, and the like, and therefore, if the place pointed by the user does not belong to the touch-reading area, touch-reading is not triggered, and therefore, after the recognition detection module 20 determines that the gesture of the user is a valid gesture, the coordinate determination module is further required to determine whether the touch point position coordinate pointed by the user belongs to the touch-reading area. The setting of the reading area and the non-reading area on the book can be set in advance, for example, the blank area and the page position area of the pages are set as the non-reading area, and the rest positions are set as the reading areas. Of course, preferably, the book and the current page number of the book currently being viewed by the user are identified, the reading area included in the current page number is obtained through searching, then whether the touch point is located in the reading area or not is judged according to the position of the touch point, and whether the gesture operation of the user is the reading operation or not is further judged.
An operation judging module 50, configured to, when it is detected that the position coordinate of the contact is in the effective reading area of the book, judge that the gesture operation of the user is a reading operation; and when the position coordinates of the contact points are not detected to be in the effective touch and reading area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation. Specifically, if the operation determining module 50 determines that the gesture operation of the user is the touch-and-talk operation, the touch-and-talk machine will give a touch-and-talk response, and if the gesture operation is the non-touch-and-talk operation, it indicates that the user may touch by mistake, and the touch-and-talk machine will not give a response, so that the triggering of the touch-and-talk machine is reduced, the power consumption of the touch-and-talk machine is reduced, and the user experience is improved.
In another embodiment of the apparatus of the present invention, as shown in fig. 6, on the basis of the above embodiment of the apparatus, the identification detection module 20 includes:
a finger recognition submodule 21 configured to recognize a finger of the user in the gesture image frame; specifically, after acquiring a gesture image frame of a book clicked and read by a user, image recognition processing is performed on the image frame, and a finger of the user in the gesture image frame is recognized.
Preferably, if the valid gesture of the setup click operation requires the use of a designated finger, such as an index finger or a middle finger, the index finger or the middle finger of the user needs to be recognized in the gesture image frame, and then the subsequent detection and judgment are performed on the designated finger.
The stability detection submodule 22 is configured to determine whether the fingers of the user are positioned at the same position for a preset time according to the gesture image frame; specifically, after the finger of the user is recognized, the gesture image frame is taken according to the captured gesture image frame, and of course, the gesture image frame generally includes more than one frame of image, such as a plurality of gesture image key frames extracted from the captured visual area video, and then the time for the gesture to be maintained can be obtained from the time interval between the gesture image key frames. And then judging whether the time for positioning the finger of the user to the same position reaches the preset time.
The gesture recognition submodule 23 is configured to recognize a gesture of the user when it is determined that the fingers of the user are located at the same position for a preset time; and judging whether the gesture of the user is an effective gesture or not according to a preset click-read gesture. Specifically, if the stability detection submodule 22 determines that the fingers of the user are located at the same position for a preset time, for example, if the user points at a certain position of the book, the fingers point at the certain position of the book and are kept for 3S, and if the preset time is 3S, it is obvious that the keeping time of the fingers of the user pointing at the certain position of the book meets the preset time, the gesture recognition submodule 23 may further recognize the gesture, and determine whether the gesture is an effective gesture for touch reading.
In this embodiment, the stability detection submodule 22 and the gesture recognition submodule 23 respectively perform stability and recognition detection on the gesture operation of the user, specifically, the stability detection submodule 22 requires the finger of the user to be positioned at the same position for a period of time (stability detection), if the stability detection is qualified, the gesture recognition submodule 23 compares the gesture action of the user with the pre-stored click-to-read gesture action, and determines whether the gesture action of the user is an effective gesture, a general false touch will not be maintained for a certain period of time, and the gesture operation is not necessarily the pre-stored click-to-read gesture operation, so that a large number of false touch operations can be detected through the stability and gesture recognition mode, thereby reducing the occurrence of unnecessary click-to-read operations.
In another embodiment of the device of the present invention, based on any of the above embodiments of the device, the false touch prevention recognition device further includes:
a page turning detection module 60, configured to identify whether the user is currently performing a page turning operation on the book according to the gesture image frame; when it is recognized that the user is currently performing a page turning operation on the book, the operation determining module 50 determines that the gesture operation of the user is a non-point reading operation.
Specifically, when the user turns the page, it is possible that the finger may touch a certain touch area, and it is also possible that the time for the finger to touch the certain touch area reaches the preset time, so that the page turning detection module 60 is further required to detect whether the gesture is the page turning operation, and further eliminate the possibility of the user's page turning operation, thereby more accurately determining whether the current gesture operation of the user is the touch reading operation.
According to the embodiment of the device, the identification detection module 20 is used for performing stability detection and filtering invalid gestures (whether the user gestures are kept for the preset time and are valid gestures), the page turning detection module 60 is used for performing page turning detection on the book (whether the user gestures are page turning operations), the coordinate judgment module 40 is used for detecting whether the fingers point to the book reading area, and the like, so that false touch caused by non-standard gestures when the user hands are out of the book and turn pages is greatly reduced, user experience is improved, and the problems of high concurrence and extra cost consumption of the reading machine due to the false touch are solved.
In another embodiment of the device of the present invention, based on any of the above embodiments, the false touch prevention recognition device further includes:
a voice collecting module 70 for collecting voice information of the user; specifically, the voice collecting module 70 may be implemented by a microphone. The microphone collects voice information of the user, for example, if the user wants to click and read a certain content on a book, then the user can speak to the family education machine or the click-to-read machine: the "how to read" or "how to read here" and the like only need to be voice information expressing the current will of the user to read.
A voice analyzing module 80, configured to analyze the voice information and determine whether the user needs to click to read currently; when it is determined that the user needs to read the current essential, the image acquisition module 10 acquires the gesture image frame of the user reading the book in the specified visible area.
Specifically, after the voice collecting module 70 collects the voice information of the user, the voice analyzing module 80 may analyze the voice information to obtain the semantics of the voice information, and further determine whether the user needs to click to read at present according to the semantics, and if it is determined that the user needs to click to read at present, perform the subsequent image obtaining and recognizing steps. Certainly, when the analyzed voice information is not the message which needs to be read by the user at present, the subsequent image acquisition and identification steps are not carried out, so that the power consumption of the equipment is greatly saved, and the accuracy of reading operation identification is also improved.
The invention also discloses a touch and read device, as shown in fig. 7, the touch and read device comprises the false touch prevention identification device 100 and the touch and read response device 200 according to any one of the above device embodiments of the invention; the read-click response device 200 includes:
the reading database 210 is used for storing reading book information and corresponding reading data information;
the feature extraction module 220 is configured to, when it is determined that the gesture operation of the user is a touch-and-read operation, obtain image feature information of a current touch-and-read page according to the gesture image frame;
the data searching module 230 is configured to search, according to the image feature information of the current click-to-read page, a corresponding click-to-read book and page number in a pre-stored click-to-read database;
the data extraction module 240 is configured to extract corresponding click-to-read data information according to the searched click-to-read book and page number in combination with the position coordinates of the contact;
and a playing and displaying module 250, configured to respond to the click-to-read operation of the user, and play the click-to-read data information.
Specifically, the anti-false-touch recognition device 100 is disposed on the reading device in this embodiment, for example, a user is learning and reading by using the reading machine, a camera is disposed on the reading machine, preferably, a reflective mirror is further disposed on a front camera of the reading machine, the reading plate is placed on the support in a standing manner, a book is placed in front of the reading plate (an appointed visible area), the top of the reading plate is aligned with the support, and contents (video images of the visible area) in the book can be captured and acquired through the front camera and the reflective mirror on the reading machine. If the user needs to click and read, the user can point to the position of the content to be clicked and read on the book by using the fingers, and then the mistaken touch prevention recognition device of the click and read equipment can recognize and detect the gesture action of the user and judge whether the gesture operation is the click and read operation.
Specifically, the specific method for identifying and detecting the gesture of the user by the false touch prevention identification device and determining whether the gesture is a touch and read operation can be referred to any embodiment of the foregoing false touch prevention identification method, and details are not repeated here.
If the error touch prevention recognition device recognizes that the gesture operation of the user is the non-touch-and-read operation, no response is given, and if the gesture operation of the user is recognized as the touch-and-read operation, corresponding correspondence is given through the touch-and-read response device. Specifically, the image of the current page and the position of the user finger pointing to the book are obtained through the shot gesture image frame of the user, and then the data base is read by combining the point, searching the current book read by the user and the page number of the current book page read by the user in the reading database, calling the current reading page of the reading book according to the position area pointed by the finger of the user, the click-to-read data file corresponding to the click-to-read position pointed by the current user is played and displayed to the user, the reading device realizes the function of displaying and playing the reading data information at the corresponding position where the data is read, the gesture of the user for page turning or other non-point reading operation can be identified in time through the false touch prevention identification device, and the click-to-read response can not be given, so that the power consumption of the equipment can be greatly saved, the extra resource waste is reduced, and the experience degree of the user is greatly improved.
Similarly, the present invention further provides a reading identification method of a reading device, where the reading identification method is applied to the reading device according to the foregoing embodiment of the present invention, and specifically, as shown in fig. 8, the reading identification method of the reading device includes:
s801, acquiring a gesture image frame of a user for reading a book in a specified visual area;
s802, identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame; if yes, go to step S803, otherwise go to step S806;
s803, acquiring the position coordinates of the touch point of the book pointed by the user according to the gesture image frame;
s804, detecting whether the position coordinates of the contact points are in an effective reading area of the book or not; if yes, go to step S805, otherwise go to step S806;
s805, judging the gesture operation of the user to be a point-reading operation;
s806, judging that the gesture operation of the user is a non-point-and-read operation;
s807, acquiring image characteristic information of a current click-to-read page according to the gesture image frame;
s808, searching a corresponding read-on book and page number in a pre-stored read-on database according to the image characteristic information of the current read-on page;
s809, extracting corresponding reading data information according to the searched reading books and page numbers and combining the position coordinates of the contacts;
and S810, responding to the reading operation of the user, and playing the reading data information.
Specifically, when the touch reading device provided by the invention is used for touch reading operation, the gesture action of the user is firstly identified and judged so as to prevent touch reading caused by mistaken touch and influence on user experience.
Preferably, the identification and determination of the gesture action of the user mainly includes the following determinations:
and (3) stable finger detection: detecting whether the finger tip of a finger in a visible area is positioned at the same position for a period of time (for example, 200 milliseconds) in real time by opening the preview of the flat-panel camera and a fingertip identification technology;
judging whether the gesture is effective: after the fingers are stable, judging whether the current gesture is a supported gesture, if not, not responding, and if yes, entering the next step;
judging whether the coordinates are valid: judging whether the fingertip coordinates are on the book or in the process of turning pages when the current fingers are stable, if so, not responding, and if so, entering the next step;
triggering search: and triggering search in response to the finger stabilization message. Specifically, for example, after the gesture image frame of the user is acquired, a book image currently read by the user is extracted from the gesture image frame, and the book, page and coordinate positions clicked by the user are confirmed in the picture data set in the point reading database through image search and coordinate position mapping, so that text and multimedia data corresponding to the clicked position of the user are taken out, and the function of displaying and playing corresponding position information where the point is located is realized.
According to the invention, by combining the technologies of book detection, book page turning detection, touch screen operation detection, invalid gesture filtering and the like, the false touch caused by a non-standard gesture when a user turns pages or hands out of a book is greatly reduced, so that the false touch is greatly reduced, and the user experience in the using process of the user is improved; in addition, only effective gestures respond, and extra cost consumption caused by concurrent reading of the device is reduced.
The embodiment of the false touch prevention identification method, the embodiment of the false touch prevention identification device, the embodiment of the touch reading equipment and the embodiment of the identification method of the touch reading equipment all have the same technical conception, so the technical details of the embodiment of the false touch prevention identification method are also suitable for the embodiment of the false touch prevention identification device, the touch reading equipment and the touch reading identification method thereof, and are not repeated for reducing the repetition.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A false touch prevention identification method is characterized by comprising the following steps:
acquiring a gesture image frame of a user for reading a book in a designated visual area;
identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame;
when the gesture is recognized to be an effective gesture, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
detecting whether the position coordinates of the contact points are in an effective point reading area of the book;
when the position coordinates of the contact points are detected to be in the effective reading area of the book, judging the gesture operation of the user to be a reading operation;
and when the position coordinates of the contact points are not detected to be in the effective touch and reading area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation.
2. The false touch prevention recognition method of claim 1, wherein the recognizing whether the gesture within the preset time of the user is a valid gesture according to the gesture image frame comprises:
identifying a finger of the user in the gesture image frame;
judging whether the fingers of the user are positioned at the same position for a preset time or not according to the gesture image frame;
when the fingers of the user are positioned at the same position for a preset time, recognizing the gesture of the user;
and judging whether the gesture of the user is an effective gesture or not according to a preset click-read gesture.
3. The method for identifying false touches according to claim 1, further comprising, after determining that the position coordinates of the touch point are in the effective reading area of the book:
identifying whether the user is currently turning pages of the book according to the gesture image frame;
and when the fact that the user is currently performing page turning operation on the book is recognized, judging that the gesture operation of the user is a non-point reading operation.
4. The false touch prevention recognition method of any one of claims 1-3, wherein before acquiring the designated visual area, the user clicks and reads the gesture image frame of the book, the method further comprises:
collecting voice information of the user;
analyzing the voice information and judging whether the user needs to click to read currently;
and when the current required key point of the user is judged to be read, acquiring a gesture image frame of the user for reading the book in a specified visual area.
5. A false touch prevention recognition device, comprising:
the image acquisition module is used for acquiring a gesture image frame of a user reading a book in a specified visual area;
the recognition detection module is used for recognizing whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame;
the coordinate acquisition module is used for acquiring the position coordinates of the contact points of the book pointed by the user according to the gesture image frame when the gesture is recognized to be an effective gesture;
the coordinate judgment module is used for detecting whether the position coordinates of the contact points are in the effective reading area of the book;
the operation judgment module is used for judging the gesture operation of the user to be a point reading operation when the position coordinate of the contact is detected to be in the effective point reading area of the book; and when the position coordinates of the contact points are not detected to be in the effective touch and reading area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and reading operation.
6. The false touch prevention identification device according to claim 5, wherein the identification detection module comprises:
a finger recognition submodule for recognizing the user's finger in the gesture image frame;
the stability detection submodule is used for judging whether the fingers of the user are positioned at the same position for preset time or not according to the gesture image frame;
the gesture recognition sub-module is used for recognizing the gesture of the user when the situation that the fingers of the user are positioned at the same position for preset time is judged; and judging whether the gesture of the user is an effective gesture or not according to a preset click-read gesture.
7. The false touch prevention identification device according to claim 5, further comprising:
the page turning detection module is used for identifying whether the user is currently performing page turning operation on the book according to the gesture image frame;
when the fact that the user is currently performing page turning operation on the book is recognized, the operation judgment module judges that the gesture operation of the user is non-point reading operation.
8. The false touch prevention identification device according to any one of claims 5-7, further comprising:
the voice acquisition module is used for acquiring voice information of a user;
the voice analysis module is used for analyzing the voice information and judging whether the user needs to read at present; when the current required key point of the user is judged to be read, the image acquisition module acquires the gesture image frame of the user for reading the book in the specified visual area.
9. A point-reading apparatus, comprising: the false touch prevention recognition device and the click-to-read response device as claimed in any one of claims 5 to 7; the point reading response device comprises:
the reading database is used for storing reading book information and corresponding reading data information;
the characteristic extraction module is used for acquiring image characteristic information of a current click-to-read page according to the gesture image frame when the gesture operation of the user is judged to be click-to-read operation;
the data searching module is used for searching the corresponding read-on book and page number in a pre-stored read-on database according to the image characteristic information of the current read-on page;
the data extraction module is used for extracting corresponding reading data information according to the searched reading books and page numbers and by combining the position coordinates of the contacts;
and the playing and displaying module is used for responding to the reading operation of the user and playing the reading data information.
10. A reading identification method of a reading device, which is applied to the reading device of claim 9, the reading method comprising:
acquiring a gesture image frame of a user for reading a book in a designated visual area;
identifying whether the gesture within the preset time of the user is an effective gesture according to the gesture image frame;
when the gesture is recognized to be an effective gesture, acquiring position coordinates of a contact point of the user pointing to the book according to the gesture image frame;
detecting whether the position coordinates of the contact points are in an effective point reading area of the book;
when the position coordinates of the contact points are detected to be in the effective reading area of the book, judging the gesture operation of the user to be a reading operation;
when the position coordinates of the contact points are not detected to be in an effective touch and talk area of the book, or the gesture within the preset time of the user is not an effective gesture, judging that the gesture operation of the user is a non-touch and talk operation;
when the gesture operation of the user is judged to be the touch reading operation, acquiring image characteristic information of a current touch reading page according to the gesture image frame;
according to the image characteristic information of the current click-to-read page, searching a corresponding click-to-read book and page number in a pre-stored click-to-read database;
extracting corresponding reading data information according to the searched reading book and page number and by combining the position coordinates of the contact;
and responding to the reading operation of the user, and playing the reading data information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910870116.3A CN110597450A (en) | 2019-09-16 | 2019-09-16 | False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910870116.3A CN110597450A (en) | 2019-09-16 | 2019-09-16 | False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110597450A true CN110597450A (en) | 2019-12-20 |
Family
ID=68859739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910870116.3A Pending CN110597450A (en) | 2019-09-16 | 2019-09-16 | False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110597450A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111432131A (en) * | 2020-04-30 | 2020-07-17 | 广东小天才科技有限公司 | Photographing frame selection method and device, electronic equipment and storage medium |
| CN111612006A (en) * | 2020-05-07 | 2020-09-01 | 北京网梯科技发展有限公司 | Method and device for improving reliability of book drawing point reading recognition result |
| CN111625157A (en) * | 2020-05-20 | 2020-09-04 | 北京百度网讯科技有限公司 | Fingertip key point detection method, device, equipment and readable storage medium |
| CN111723653A (en) * | 2020-05-12 | 2020-09-29 | 北京光年无限科技有限公司 | Drawing book reading method and device based on artificial intelligence |
| CN112163513A (en) * | 2020-09-26 | 2021-01-01 | 深圳市快易典教育科技有限公司 | Information selection method, system, device, electronic equipment and storage medium |
| CN112307865A (en) * | 2020-02-12 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Interaction method and device based on image recognition |
| WO2023272608A1 (en) * | 2021-06-30 | 2023-01-05 | 东莞市小精灵教育软件有限公司 | Picture book assisted reading method, and electronic device |
| CN116225881A (en) * | 2023-05-06 | 2023-06-06 | 深圳数鉴科技有限公司 | Monitoring system and method without response by application click |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050022108A1 (en) * | 2003-04-18 | 2005-01-27 | International Business Machines Corporation | System and method to enable blind people to have access to information printed on a physical document |
| CN105224073A (en) * | 2015-08-27 | 2016-01-06 | 华南理工大学 | A kind of based on voice-operated reading wrist-watch and reading method thereof |
| CN106980459A (en) * | 2017-03-31 | 2017-07-25 | 广州华多网络科技有限公司 | Reading method and device based on touch-screen equipment |
| CN109063583A (en) * | 2018-07-10 | 2018-12-21 | 广东小天才科技有限公司 | A kind of learning method and electronic equipment based on read operation |
| CN109255346A (en) * | 2018-08-31 | 2019-01-22 | 深圳闳宸科技有限公司 | Reading method, device and electronic equipment |
-
2019
- 2019-09-16 CN CN201910870116.3A patent/CN110597450A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050022108A1 (en) * | 2003-04-18 | 2005-01-27 | International Business Machines Corporation | System and method to enable blind people to have access to information printed on a physical document |
| CN105224073A (en) * | 2015-08-27 | 2016-01-06 | 华南理工大学 | A kind of based on voice-operated reading wrist-watch and reading method thereof |
| CN106980459A (en) * | 2017-03-31 | 2017-07-25 | 广州华多网络科技有限公司 | Reading method and device based on touch-screen equipment |
| CN109063583A (en) * | 2018-07-10 | 2018-12-21 | 广东小天才科技有限公司 | A kind of learning method and electronic equipment based on read operation |
| CN109255346A (en) * | 2018-08-31 | 2019-01-22 | 深圳闳宸科技有限公司 | Reading method, device and electronic equipment |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112307865A (en) * | 2020-02-12 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Interaction method and device based on image recognition |
| CN111432131A (en) * | 2020-04-30 | 2020-07-17 | 广东小天才科技有限公司 | Photographing frame selection method and device, electronic equipment and storage medium |
| CN111612006A (en) * | 2020-05-07 | 2020-09-01 | 北京网梯科技发展有限公司 | Method and device for improving reliability of book drawing point reading recognition result |
| CN111723653A (en) * | 2020-05-12 | 2020-09-29 | 北京光年无限科技有限公司 | Drawing book reading method and device based on artificial intelligence |
| CN111723653B (en) * | 2020-05-12 | 2023-09-26 | 北京光年无限科技有限公司 | Method and device for reading drawing book based on artificial intelligence |
| CN111625157A (en) * | 2020-05-20 | 2020-09-04 | 北京百度网讯科技有限公司 | Fingertip key point detection method, device, equipment and readable storage medium |
| CN111625157B (en) * | 2020-05-20 | 2021-09-17 | 北京百度网讯科技有限公司 | Fingertip key point detection method, device, equipment and readable storage medium |
| CN112163513A (en) * | 2020-09-26 | 2021-01-01 | 深圳市快易典教育科技有限公司 | Information selection method, system, device, electronic equipment and storage medium |
| WO2023272608A1 (en) * | 2021-06-30 | 2023-01-05 | 东莞市小精灵教育软件有限公司 | Picture book assisted reading method, and electronic device |
| CN116225881A (en) * | 2023-05-06 | 2023-06-06 | 深圳数鉴科技有限公司 | Monitoring system and method without response by application click |
| CN116225881B (en) * | 2023-05-06 | 2024-01-26 | 深圳数鉴科技有限公司 | Monitoring system and method without response by application click |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110597450A (en) | False touch prevention identification method and device, touch reading equipment and touch reading identification method thereof | |
| US20210103386A1 (en) | Identification of candidate characters for text input | |
| US9678659B2 (en) | Text entry for a touch screen | |
| US8908973B2 (en) | Handwritten character recognition interface | |
| US8633909B2 (en) | Information processing apparatus, input operation determination method, and input operation determination program | |
| CN102119376B (en) | Multidimensional navigation for touch-sensitive display | |
| WO2016095689A1 (en) | Recognition and searching method and system based on repeated touch-control operations on terminal interface | |
| US9251428B2 (en) | Entering information through an OCR-enabled viewfinder | |
| TWI611338B (en) | Method for zooming screen and electronic apparatus and computer program product using the same | |
| WO2016101717A1 (en) | Touch interaction-based search method and device | |
| CN106991179B (en) | Data deleting method and device and mobile terminal | |
| CN103635873A (en) | Touch operation processing method and terminal device | |
| US20090196468A1 (en) | Method of switching operation modes of fingerprint sensor, electronic apparatus using the same and fingerprint sensor thereof | |
| US11196932B2 (en) | Method and apparatus for controlling terminal, and mobile terminal for determining whether camera assembly supported functionality is required | |
| US10671795B2 (en) | Handwriting preview window | |
| CN107122686B (en) | Method and device for sharing screen content and mobile terminal | |
| US20190114065A1 (en) | Method for creating partial screenshot | |
| CN111078102B (en) | Method for determining point reading area through projection and terminal equipment | |
| CN107291367B (en) | Use method and device of eraser | |
| CN106845190B (en) | Display control system and method | |
| CN103809794B (en) | A kind of information processing method and electronic equipment | |
| CN111090382B (en) | Character content input method and terminal equipment | |
| US10061438B2 (en) | Information processing apparatus, information processing method, and program | |
| CN114089868A (en) | Touch operation method and device and electronic equipment | |
| CN111062377A (en) | Question number detection method, system, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191220 |