CN111652182B - Method and device for identifying suspension gesture, electronic equipment and storage medium - Google Patents
Method and device for identifying suspension gesture, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111652182B CN111652182B CN202010555991.5A CN202010555991A CN111652182B CN 111652182 B CN111652182 B CN 111652182B CN 202010555991 A CN202010555991 A CN 202010555991A CN 111652182 B CN111652182 B CN 111652182B
- Authority
- CN
- China
- Prior art keywords
- fingertip
- image
- coordinates
- carrier
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 239000000725 suspension Substances 0.000 title abstract description 25
- 230000009466 transformation Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 13
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 12
- 238000010801 machine learning Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 7
- 230000011218 segmentation Effects 0.000 claims description 6
- 230000001131 transforming effect Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 10
- 238000001514 detection method Methods 0.000 description 6
- 238000007667 floating Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000002775 capsule Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for identifying a suspension gesture. The method comprises the following steps: receiving an instruction for triggering photographing, and photographing the carrier through a first image acquisition device and a second image acquisition device to obtain a first image and a second image respectively; identifying fingers in the first image and the second image; detecting whether coordinates of a first fingertip and coordinates of a second fingertip are located at the same position of the carrier image when the first image and the second image respectively identify the first fingertip and the second fingertip; when the first image and/or the second image are/is located at the same position, the first image or/and the second image are/is reserved; and deleting the first image and the second image when the first image and the second image are positioned at different positions. By implementing the embodiment of the invention, whether the gesture is a suspension gesture or not can be confirmed through the positions of the gestures acquired by two or more cameras on the carrier in a click-reading scene, false touch caused by invalid gestures can be effectively reduced, and user experience is further improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and apparatus for recognizing a suspension gesture, an electronic device, and a storage medium.
Background
At present, many electronic teaching auxiliary equipment mostly has a click-to-read scene, and when the click-to-read scene means that a user points to a supporting body such as a book, an exercise book or a test paper through fingers, the teaching auxiliary equipment can shoot the supporting body through an image acquisition device and identify the position of the fingers, so that the intention of the user is determined according to the position of the fingers, and further an image corresponding to the intention of the user is obtained and is used for displaying, searching questions or recording questions and the like, wherein the searching questions can be searching answers, searching readings or semantics and the like. Because the existing teaching and auxiliary equipment is used for identifying the positions of fingers, when the fingers of a user are suspended, the fingers and the carrier are overlapped by the photographed image, so that the fingers can be considered to be on the carrier, and the identification process can still be completed.
Disclosure of Invention
Aiming at the defects, the embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for identifying a suspension gesture, which can identify the suspension gesture and reduce false touch caused by invalid gestures.
The first aspect of the embodiment of the invention discloses a method for identifying a suspension gesture, which comprises the following steps:
Receiving an instruction for triggering photographing, and photographing the carrier through a first image acquisition device and a second image acquisition device to obtain a first image and a second image respectively;
identifying fingers in the first image and the second image;
detecting whether coordinates of a first fingertip and coordinates of a second fingertip are positioned at the same position of a carrier image or not when the first image and the second image respectively identify the first fingertip and the second fingertip;
when the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image, reserving the first image or/and the second image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, identifying the finger in the first image and the second image includes:
the fingertips in the first image and the second image are identified using a skin tone segmentation method or a machine learning based fingertip identification model.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, when the first image and the second image respectively identify the first fingertip and the second fingertip, detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image includes:
Acquiring coordinates of a first fingertip and a second fingertip;
and calculating the distance between the first fingertip coordinate and the second fingertip coordinate, wherein the first fingertip coordinate and the second fingertip coordinate are positioned at the same position of the carrier image when the distance is smaller than or equal to a first preset threshold value.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, calculating the distance between the first fingertip coordinate and the second fingertip coordinate includes:
converting coordinates of the first fingertip and the second fingertip into the same coordinate system by utilizing an affine transformation mode;
and calculating Euclidean distance or Manhattan distance between the first fingertip coordinate and the second fingertip coordinate under the same coordinate system.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the second image capturing devices are multiple;
when the first image and the second image respectively identify the first fingertip and the second fingertip, detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are positioned at the same position of the carrier image comprises the following steps:
acquiring coordinates of a first fingertip and a plurality of second fingertips;
and calculating the distance between the first fingertip coordinates and each second fingertip coordinate, wherein the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image when the distance is smaller than or equal to a first preset threshold value or the average value of the distances is smaller than or equal to the first preset threshold value.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
and deleting the first image and the second image when one of the first image and the second image cannot identify the fingertip coordinates.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the second image capturing devices are multiple;
the method further comprises the steps of:
and deleting the first image and the second image when one or more of the second image acquisition devices cannot identify the second fingertip.
In a first aspect of the embodiment of the present invention, the number of the second image capturing devices is plural, the first image is identified to obtain a first fingertip coordinate, and part of the second image is identified to obtain a second fingertip coordinate;
the detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image includes:
calculating the distance between the first fingertip coordinates and each second fingertip coordinate, and acquiring the number of the distances which is smaller than or equal to a first preset threshold value;
and calculating the proportion of the number to the total number of the second image acquisition devices, wherein when the proportion is larger than or equal to a second preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
The second aspect of the embodiment of the invention discloses a device for identifying a suspension gesture, which comprises:
the photographing unit is used for receiving an instruction for triggering photographing, photographing the carrier through the first image acquisition device and the second image acquisition device, and respectively obtaining a first image and a second image;
the identification unit is used for identifying the fingers in the first image and the second image;
a judging unit, configured to detect whether coordinates of a first fingertip and coordinates of a second fingertip are located at the same position of a carrier image when the first image and the second image respectively identify the first fingertip and the second fingertip;
the processing unit is used for reserving the first image or/and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image.
In a second aspect of the embodiment of the present invention, as an optional implementation manner, the determining unit includes:
a coordinate acquisition subunit for acquiring coordinates of the first fingertip and the second fingertip;
and the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and the second fingertip coordinates, and when the distance is smaller than or equal to a first preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the distance calculating subunit includes:
a coordinate transformation grandchild unit for transforming the coordinates of the first fingertip and the second fingertip into the same coordinate system by using an affine transformation manner;
and the distance acquisition grandchild unit is used for calculating Euclidean distance or Manhattan distance between the first fingertip coordinate and the second fingertip coordinate under the same coordinate system.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the second image capturing devices are plural;
the judging unit includes:
a coordinate acquisition subunit for acquiring coordinates of the first fingertip and the plurality of second fingertips;
and the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and each second fingertip coordinate, and when the distance is smaller than or equal to a first preset threshold value or the average value of the distances is smaller than or equal to the first preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
In a second aspect of the embodiment of the present invention, the plurality of second image capturing devices are used, the first image is identified to obtain a first fingertip coordinate, and part of the second image is identified to obtain a second fingertip coordinate;
The judging unit includes:
the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and each second fingertip coordinate and acquiring the number smaller than or equal to a first preset threshold value in the distance;
and the proportion calculating subunit is used for calculating the proportion of the number to the total number of the second image acquisition devices, and when the proportion is greater than or equal to a second preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
A third aspect of an embodiment of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled to the memory; the processor invokes the executable program code stored in the memory to perform some or all of the steps of a method for hover gesture recognition disclosed in the first aspect of the embodiments of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program causes a computer to execute some or all of the steps of a method for recognition of a hover gesture disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product which, when run on a computer, causes the computer to perform some or all of the steps of a method of hover gesture recognition as disclosed in the first aspect of the embodiments of the present invention.
A sixth aspect of the embodiments of the present invention discloses an application publishing platform, which is configured to publish a computer program product, where the computer program product, when running on the computer, causes the computer to execute part or all of the steps of a method for recognizing a hover gesture disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, a shooting triggering instruction is received, and a first image and a second image are respectively obtained by shooting a carrier through a first image acquisition device and a second image acquisition device; identifying fingers in the first image and the second image; detecting whether coordinates of a first fingertip and coordinates of a second fingertip are positioned at the same position of a carrier image or not when the first image and the second image respectively identify the first fingertip and the second fingertip; when the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image, reserving the first image or/and the second image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image. Therefore, by implementing the embodiment of the invention, whether the gesture is a suspended gesture or not can be confirmed by whether the positions of the gestures acquired by the two cameras on the carrier are overlapped or not under a click-reading scene, and further whether the subsequent operation is carried out or not is determined, so that false touch caused by invalid gestures can be effectively reduced, and the user experience is further improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for hanging gesture recognition according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a position coordinate of a finger tip of a hover gesture according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a finger tip position coordinate of a touch carrier gesture according to an embodiment of the present invention;
FIG. 4 is a flow chart of another method for hover gesture recognition according to an embodiment of the present invention;
FIG. 5 is a flow chart of another method for hover gesture recognition according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a device for recognizing a hover gesture according to an embodiment of the present invention;
FIG. 7 is a schematic diagram illustrating another apparatus for hanging gesture recognition according to an embodiment of the present invention;
FIG. 8 is a schematic diagram illustrating a device for recognizing a hover gesture according to an embodiment of the present invention;
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present invention are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order. The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.
The embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for identifying a suspension gesture, which can accurately analyze the question hierarchy, judge the size questions and output the questions under the scenes of text teaching and assisting materials such as test papers, exercise books and the like, have better compatibility for various typesetting and formats, can flexibly adjust the output range according to business requirements, and have good applicability, and are described in detail below with reference to the accompanying drawings.
Example 1
Referring to fig. 1, fig. 1 is a flowchart of a method for recognizing a hover gesture according to an embodiment of the invention. As shown in fig. 1, the method for recognizing the floating gesture includes the following steps:
110. and receiving an instruction for triggering photographing, and photographing the carrier through the first image acquisition device and the second image acquisition device to obtain a first image and a second image respectively.
The supporting body is a paper book, exercise book or test paper, and under the click-to-read scene, the user touches the supporting body by hand and triggers a corresponding photographing instruction, so that photographing of the supporting body is realized, and the intention of the user is further identified. The instruction for triggering photographing is various, and may be implemented, for example, by a voice manner, for example, "please photograph" or "how to read the word (what meaning of the word)", where the former voice manner triggers only the photographing operation, and the subsequent user intends to require a new instruction, and the latter voice manner triggers the photographing operation, and then implements the corresponding user intent. The corresponding photographing instruction can be triggered by a key (such as a mechanical key or a touch key), and the photographing instruction can be triggered by an electronic device (mainly referred to as a family education machine, a learning machine, a click-to-read machine and other education auxiliary devices) under a click-to-read scene such as a click-to-read app.
The image acquisition device is a device for executing a photographing function, and can be integrated on an electronic device, for example, a front camera of the electronic device is used for photographing a carrier placed in front of the electronic device, or the image acquisition device can be a discrete device, communication connection is established with the electronic device in a wired or wireless mode, a photographing instruction sent by the electronic device is executed, and a photographing obtained image is sent to the electronic device.
In the embodiment of the invention, two image acquisition devices, namely a first image acquisition device and a second image acquisition device, are used for photographing a carrier, namely the directions of the two image acquisition devices are the carrier. The first image and the second image may be obtained by photographing, including but not limited to image enhancement and shape correction, which mainly corrects the first image and the second image into a rectangle by hough transform or the like, before performing the next operation.
120. And identifying the fingers in the first image and the second image.
The user is thus a user intention determined by the finger, and thus needs to recognize the finger, on the one hand, the user determines the user intention and, on the other hand, whether a hover gesture is present.
For example, fingers in the first image and the second image may be identified by skin tone segmentation. Firstly, converting a first image and a second image from an RGB color space to a YCbCr color space or an HSV color space, wherein the conversion aim is that the skin color of the RGB color space is easily influenced by illumination and is not easily separated; then, the finger outline is determined through a skin color detection model, and further the fingertip position is determined, wherein the skin color detection model can be a threshold value limiting method or a single Gaussian model method.
Finger recognition can be realized based on a machine learning mode, finger positions are manually marked through a large number of pictures with fingers, a machine learning model is trained to obtain a finger tip recognition model, a first image and a second image are input into the finger tip recognition model, and the finger tip positions in the first image and the second image can be determined. The machine learning model includes, but is not limited to, a fully connected neural network model, a convolutional neural network model, a recurrent neural network model, a capsule network model, and the like.
130. When the first image and the second image respectively identify the first fingertip and the second fingertip, detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are positioned at the same position of the carrier image.
When the first image and the second image both recognize the fingertips, they are respectively recorded as the first fingertip and the second fingertip, and the coordinates of the first fingertip and the second fingertip in the corresponding images are determined, then it is detected whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image, that is, whether they are coincident on the paper surface of the carrier, if so, step 140 is executed, otherwise, step 150 is executed.
Because the first image acquisition device and the second image acquisition device are not positioned at the same position, the angles of photographing the bearing body by the first image and the second image obtained by the first image acquisition device and the second image acquisition device are different to a certain extent, and if the first fingertip coordinates and the second fingertip coordinates are directly compared, a certain error can be caused. Meanwhile, in the preferred embodiment of the invention, in order to better detect the hanging gesture, the first image acquisition device and the second image acquisition device are preferably fixedly arranged and have a longer distance, and the first image acquisition device and the second image acquisition device can clearly shoot all or most of the content of the carrier.
Under the above circumstances, a reference needs to be found, and the first fingertip coordinate and the second fingertip coordinate are converted into the reference coordinate system, where the carrier image is an image under the reference coordinate system, and may be a real image or a virtual image, and the coordinate conversion mode may be implemented by an affine transformation mode, and the affine transformation matrix may be obtained by selecting a plurality of corresponding coordinate points to form a coordinate point set, and then solving by a least square method or an SVD decomposition method, so as to obtain the affine transformation matrix.
In addition, one of the first image or the second image is taken as a carrier image, and the fingertip coordinates of the other image are converted into the carrier image in an affine transformation mode, so that the first fingertip coordinates and the second fingertip coordinates are in the same coordinate system.
Theoretically, if the first fingertip coordinates and the second fingertip coordinates coincide under the same coordinate system, it is explained that the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image. However, in actual operation, because the detection error of the skin color detection model or the recognition error of the fingertip recognition model may cause the fingertip position to deviate from the actual position to a certain extent, in the embodiment of the present invention, the judgment is performed by a threshold mode, specifically, if the distance between the first fingertip coordinate and the second fingertip coordinate is less than or equal to the first preset threshold under the same coordinate system, the coordinates of the first fingertip and the coordinates of the second fingertip are considered to be located at the same position of the carrier image (or the first fingertip coordinate and the second fingertip coordinate coincide). The first preset threshold value is set according to needs, and may also be determined through a limited number of experiments, for example, when the carrier image is determined and the first image acquisition device and the second image acquisition device are fixed, the finger may be suspended for a plurality of times and contacted with the carrier for a plurality of times to calculate the distance between the first fingertip coordinates and the second fingertip coordinates, so that in the operation of contacting with the carrier for a plurality of times, the maximum distance between the two fingertip coordinates is determined as the first preset threshold value, and of course, the sum of the minimum distance between the two fingertip coordinates and the set value determined through the suspension operation for a plurality of times may also be determined as the first preset threshold value.
140. And reserving the first image or/and the second image.
When the image acquisition device shoots the carrier, if the finger is suspended and shot by the image acquisition device, the finger image is overlapped into the image acquisition device, and the fingertip coordinates obtained by recognition are the intersection point of the extension line of the connecting line between the center of the image acquisition device and the suspended point and the carrier image. If the finger is not hung in the air, the fingertip falls on the carrier, and the fingertip coordinate identified in the image acquired by the image acquisition device is the true position of the fingertip.
Referring to fig. 2, if the fingertip coordinates obtained by the two image capturing devices are not at the same position of the carrier image, for example, the position of the fingertip 25 on the carrier 26 obtained by the image capturing device 21 is the fingertip coordinate point 22, and the position of the fingertip 25 on the carrier 26 obtained by the image capturing device 23 is the fingertip coordinate point 24, it is indicated that the finger is suspended, and neither the fingertip coordinate point 22 nor the fingertip coordinate point 24 are the true coordinates of the fingertip 25. Referring to fig. 3, if a finger is placed on the carrier 20, the position coordinates of the fingertip 29 obtained by the image capturing device 27 or the image capturing device 28 are the actual position of the fingertip 29 on the carrier.
Based on the above, when the coordinates of the first fingertip and the coordinates of the second fingertip are positioned at the same position of the carrier image, the finger is positioned on the carrier, and is not a hanging gesture, the gesture is effective, and the first image or/and the second image is reserved; for example, the first image acquisition device can be placed in an optimal position similar to the prior art, so that the first image is reserved, and the subsequent user intention recognition is facilitated.
150. And deleting the first image and the second image.
If the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image, the gesture is a hanging gesture, the gesture is invalid, and the first image and the second image are deleted.
By implementing the embodiment of the invention, whether the gesture acquired by the two cameras is the suspended gesture or not can be confirmed under the click-to-read scene, and further whether the subsequent operation is carried out or not is determined, so that the false touch caused by invalid gestures can be effectively reduced, and the user experience is further improved.
Example two
Referring to fig. 4, fig. 4 is a flowchart illustrating another method for gesture recognition in the air according to an embodiment of the invention. As shown in fig. 4, the method for recognizing the floating gesture includes the following steps:
310. And receiving an instruction for triggering photographing, and photographing the carrier through the first image acquisition device and the second image acquisition device to obtain a first image and a second image respectively.
320. And identifying the fingers in the first image and the second image.
330. And deleting the first image and the second image when the fingertip cannot be identified in one of the first image and the second image.
Steps 310 and 320 may be the same as steps 110 and 120 of the first embodiment, and will not be described again.
In the embodiment of the invention, if the first image and the second image do not contain fingertips, the user is not required to operate the first image and the second image, and in this case, the first image and the second image have no practical meaning in the hanging gesture recognition. For the hanging gesture, the fingertip exists in one of the first image and the second image, and preferably the first image acquisition device is the same as the existing teaching auxiliary equipment in position, so that the first image with the fingertip can be acquired.
The second image has two possibilities of not containing the fingertip, one is that the second image acquisition device is lower, for example, the second image acquisition device is positioned at a lower position of the teaching auxiliary equipment, and the finger is not in contact with the carrier, so that the finger cannot be identified, and the other is that the second image acquisition device can identify the finger, but the finger is separated from the image of the carrier, namely, the finger is positioned outside the image of the carrier, and the connecting line and the extension line of the center of the second image acquisition device and the fingertip are not intersected with the image of the carrier.
No matter which way the fingertip is not contained in the second image, the condition that the floating gesture is possible occurs only occurs, so the gesture is invalid, and the first image and the second image are deleted.
By implementing the embodiment of the invention, whether the gesture is a suspension gesture or not can be judged through the images acquired by the two cameras under the click-reading scene, further whether the subsequent operation is carried out or not is determined, false touch caused by invalid gestures can be effectively reduced, and the user experience is further improved.
Example III
Referring to fig. 5, fig. 5 is a flowchart illustrating a method for recognizing a hover gesture according to an embodiment of the invention. As shown in fig. 5, the method for recognizing the floating gesture includes the following steps:
410. and receiving an instruction for triggering photographing, and photographing the carrier through the first image acquisition device and the plurality of second image acquisition devices to obtain a first image and a plurality of second images respectively.
420. And identifying the fingers in the first image and the second image.
430. When the first image and the second image respectively identify the first fingertip and the second fingertip, detecting whether the coordinates of the first fingertip and the coordinates of the plurality of second fingertips are located at the same position of the carrier image, if so, executing step 440, otherwise executing step 450.
440. And reserving the first image or/and the second image.
450. And deleting the first image and all the second images.
Steps 410 and 420 and steps 440 and 450 may be similar to steps 110 and 120 and steps 140 and 150 of the first embodiment, and will not be described again.
In order to ensure accuracy of the suspension gesture recognition, the suspension gesture recognition can also be judged by setting more image acquisition devices, wherein the first image is still defined to be the same as or similar to the image obtained by photographing the existing teaching auxiliary equipment, and the first image is reserved in step 440. The plurality of second image acquisition devices are arranged and can be distributed on each part of the teaching auxiliary equipment or around the first image acquisition devices. And judging that the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image, namely calculating the distance between the first fingertip coordinates and each second fingertip coordinate, and when the distance is smaller than or equal to a first preset threshold value or the average value of the distances is smaller than or equal to the first preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image. Similarly, the distance calculation of the first fingertip coordinates and the plurality of second fingertip coordinates is also realized by affine transformation under the same coordinate system.
By implementing the embodiment of the invention, whether the gesture is a suspension gesture or not can be judged through the images acquired by the cameras under the click-reading scene, further whether the subsequent operation is carried out or not is determined, false touch caused by invalid gestures can be effectively reduced, and the user experience is further improved.
When there are a plurality of second image capturing devices, in other embodiments, there may be some second images that do not contain a fingertip, which is the case, indicating that the first fingertip coordinates and the second fingertip coordinates are located at different positions of the carrier image, deleting the first image and all the second images.
In order to avoid detection errors caused by skin color detection models or recognition errors of fingertip recognition models, in other embodiments, whether the first fingertip coordinates and the second fingertip coordinates are located at the same position of the carrier image may be determined according to a ratio, in this case, a plurality of second image acquisition devices are needed to be more accurate, specifically, the second image acquisition devices are provided, the first fingertip coordinates are obtained through first image recognition, and under the condition that the second fingertip coordinates are obtained through recognition in part of the second images (the second fingertip coordinates are not obtained in the second images of the rest), the distances between the first fingertip coordinates and each second fingertip coordinate are calculated, and the number of the distances smaller than or equal to a first preset threshold value is obtained; and calculating the proportion of the number to the total number of the second image acquisition devices, wherein when the proportion is larger than or equal to a second preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image. The method is also applicable to the case that the second pointer coordinates can be recognized in all the second images.
Example IV
Referring to fig. 6, fig. 6 is a schematic structural diagram of a device for hanging gesture recognition according to an embodiment of the invention. As shown in fig. 6, the apparatus for hover gesture recognition may include:
the photographing unit 510 is configured to receive an instruction for triggering photographing, photograph the carrier through the first image capturing device and the second image capturing device, and obtain a first image and a second image respectively;
an identifying unit 520, configured to identify fingers in the first image and the second image;
a judging unit 530, configured to detect whether coordinates of a first fingertip and coordinates of a second fingertip are located at the same position of the carrier image when the first image and the second image respectively identify the first fingertip and the second fingertip;
a processing unit 540 that retains the first image or/and the second image when the first fingertip coordinates and the second fingertip coordinates are located at the same position of the carrier image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image.
As an alternative embodiment, the identifying unit 520 may include:
the fingertips in the first image and the second image are identified using a skin tone segmentation method or a machine learning based fingertip identification model.
As an alternative embodiment, the determining unit 530 may include:
a coordinate acquiring subunit 531 configured to acquire coordinates of the first fingertip and the second fingertip;
the distance calculating subunit 532 is configured to calculate a distance between the first fingertip coordinate and the second fingertip coordinate, where the first fingertip coordinate and the second fingertip coordinate are located at the same position of the carrier image when the distance is less than or equal to a first preset threshold value.
As an alternative embodiment, the distance calculating subunit 532 may include:
a coordinate transformation grandchild unit 5321 for transforming the coordinates of the first fingertip and the second fingertip into the same coordinate system by affine transformation;
the distance acquiring grandchild unit 5322 is configured to calculate, in the same coordinate system, the euclidean distance or the manhattan distance between the first fingertip coordinate and the second fingertip coordinate.
As an alternative embodiment, the apparatus may further include:
and a deleting unit 550 for deleting the first image and the second image when one of the first image and the second image does not recognize the fingertip coordinates.
The device for identifying the suspension gesture shown in fig. 6 can confirm whether the suspension gesture is performed by determining whether the positions of the gestures acquired by the two cameras on the carrier coincide or not under the touch-and-talk scene, so as to determine whether the subsequent operation is performed, thereby effectively reducing the false touch caused by the invalid gesture and further improving the user experience.
Example five
Referring to fig. 7, fig. 7 is a schematic structural diagram of another apparatus for hanging gesture recognition according to an embodiment of the present invention. As shown in fig. 7, the apparatus for hover gesture recognition may include:
the photographing unit 610 is configured to receive an instruction for triggering photographing, photograph the carrier through the first image capturing device and the second image capturing device, and obtain a first image and a second image respectively;
an identifying unit 620, configured to identify fingers in the first image and the second image;
a judging unit 630, configured to detect, when the first image and the second image respectively identify the first fingertip and the second fingertip, whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image;
a processing unit 640 that retains the first image or/and the second image when the first fingertip coordinates and the second fingertip coordinates are located at the same position of the carrier image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image.
As an alternative embodiment, the identifying unit 620 may include:
the fingertips in the first image and the second image are identified using a skin tone segmentation method or a machine learning based fingertip identification model.
As an optional implementation manner, the second image acquisition device is a plurality of second image acquisition devices; the judging unit 630 may include:
a coordinate acquiring subunit 631 for acquiring coordinates of the first fingertip and the plurality of second fingertips;
the distance calculating subunit 632 is configured to calculate a distance between the first fingertip coordinate and each second fingertip coordinate, and when the distances are all less than or equal to a first preset threshold value, or an average value of the distances is less than or equal to the first preset threshold value, the first fingertip coordinate and the second fingertip coordinate are located at the same position of the carrier image.
As an alternative embodiment, the distance calculating subunit 632 may include:
a coordinate transformation grandchild unit 6321 for transforming the coordinates of the first and second fingertips into the same coordinate system by affine transformation;
the distance obtaining grand unit 6322 is configured to calculate, in the same coordinate system, an euclidean distance or a manhattan distance between the first fingertip coordinate and the second fingertip coordinate.
As an alternative embodiment, the apparatus may further include: and a deleting unit 650 configured to delete the first image and the second image when one or more of the second image capturing devices cannot identify the second fingertip.
The device for identifying the suspension gesture shown in fig. 7 can judge whether the suspension gesture is performed or not through images acquired by a plurality of cameras in a click-to-read scene, further determine whether subsequent operations are performed, and effectively reduce false touch caused by invalid gestures, thereby further improving user experience.
Example six
Referring to fig. 8, fig. 8 is a schematic structural diagram of another apparatus for hanging gesture recognition according to an embodiment of the present invention. As shown in fig. 8, the apparatus for hover gesture recognition may include:
the photographing unit 710 is configured to receive an instruction for triggering photographing, and photograph the carrier through the first image capturing device and the second image capturing device, so as to obtain a first image and a second image respectively;
an identifying unit 720, configured to identify a finger in the first image and the second image;
a judging unit 730, configured to detect, when the first image and the second image respectively identify the first fingertip and the second fingertip, whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image;
a processing unit 740 that retains the first image or/and the second image when the first fingertip coordinates and the second fingertip coordinates are located at the same position of the carrier image; and deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image.
As an alternative embodiment, the identifying unit 720 may include:
the fingertips in the first image and the second image are identified using a skin tone segmentation method or a machine learning based fingertip identification model.
As an optional implementation manner, the plurality of second image acquisition devices are provided, the first image is identified to obtain a first fingertip coordinate, and part of the second image is identified to obtain a second fingertip coordinate;
the judging unit 730 includes:
a distance calculating subunit 731, configured to calculate a distance between the first fingertip coordinate and each second fingertip coordinate, and obtain a number of distances less than or equal to a first preset threshold;
the proportion calculating subunit 732 is configured to calculate a proportion of the number to the total number of the second image capturing devices, and when the proportion is greater than or equal to a second preset threshold, the first fingertip coordinate and the second fingertip coordinate are located at the same position of the carrier image.
As an alternative embodiment, the distance calculating subunit 731 may include:
a coordinate transformation grand unit 7311 for transforming the coordinates of the first fingertip and the second fingertip into the same coordinate system by affine transformation;
The distance acquisition grand unit 7312 is configured to calculate the euclidean distance or the manhattan distance between the first fingertip coordinate and the second fingertip coordinate in the same coordinate system.
The device for identifying the suspension gesture shown in fig. 8 can judge whether the suspension gesture is performed or not through images acquired by a plurality of cameras in a click-to-read scene, further determine whether subsequent operations are performed, and effectively reduce false touch caused by invalid gestures, thereby further improving user experience.
Example seven
Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the invention. As shown in fig. 9, the electronic device may include:
a memory 810 storing executable program code;
a processor 820 coupled to the memory 810;
wherein processor 820 invokes executable program code stored in memory 810 to perform some or all of the steps in the method of identifying a hover gesture in accordance with the first embodiment.
The embodiment of the invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute part or all of the steps in the method for identifying the suspension gesture in the first to third embodiments.
The embodiment of the invention also discloses a computer program product, wherein the computer program product enables the computer to execute part or all of the steps in the method for identifying the suspension gesture in the first embodiment to the third embodiment when running on the computer.
The embodiment of the invention also discloses an application release platform, wherein the application release platform is used for releasing a computer program product, and the computer program product enables the computer to execute part or all of the steps in the method for identifying the suspension gesture in the first embodiment to the third embodiment when running on the computer.
In various embodiments of the present invention, it should be understood that the size of the sequence numbers of the processes does not mean that the execution sequence of the processes is necessarily sequential, and the execution sequence of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the method according to the embodiments of the present invention.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a, from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.
Those of ordinary skill in the art will appreciate that some or all of the steps of the various methods of the described embodiments may be implemented by hardware associated with a program that may be stored in a computer-readable storage medium, including Read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM), or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium capable of being used to carry or store data that is readable by a computer.
The above describes in detail a method, apparatus, electronic device and storage medium for recognizing a suspension gesture disclosed in the embodiments of the present invention, and specific examples are applied to describe the principles and implementations of the present invention, where the description of the above embodiments is only for helping to understand the method and core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (13)
1. A method of hover gesture recognition, comprising:
receiving an instruction for triggering photographing, and photographing the carrier through a first image acquisition device and a second image acquisition device to obtain a first image and a second image respectively;
identifying fingers in the first image and the second image;
detecting whether coordinates of a first fingertip and coordinates of a second fingertip are positioned at the same position of a carrier image or not when the first image and the second image respectively identify the first fingertip and the second fingertip;
when the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image, reserving the first image or/and the second image; deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image;
The plurality of second image acquisition devices are used for identifying the first image to obtain first fingertip coordinates, and identifying part of the second images to obtain second fingertip coordinates;
the detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are located at the same position of the carrier image includes:
calculating the distance between the first fingertip coordinates and each second fingertip coordinate, and acquiring the number of the distances which is smaller than or equal to a first preset threshold value;
and calculating the proportion of the number to the total number of the second image acquisition devices, wherein when the proportion is larger than or equal to a second preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
2. The method of claim 1, wherein identifying the finger in the first and second images comprises:
the fingertips in the first image and the second image are identified using a skin tone segmentation method or a machine learning based fingertip identification model.
3. The method of claim 1, wherein detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are at the same location of the carrier image when the first image and the second image respectively identify the first fingertip and the second fingertip comprises:
Acquiring coordinates of a first fingertip and a second fingertip;
and calculating the distance between the first fingertip coordinate and the second fingertip coordinate, wherein the first fingertip coordinate and the second fingertip coordinate are positioned at the same position of the carrier image when the distance is smaller than or equal to a first preset threshold value.
4. A method according to claim 3, wherein calculating the distance of the first and second fingertip coordinates comprises:
converting coordinates of the first fingertip and the second fingertip into the same coordinate system by utilizing an affine transformation mode;
and calculating Euclidean distance or Manhattan distance between the first fingertip coordinate and the second fingertip coordinate under the same coordinate system.
5. The method of claim 1, wherein the second image acquisition device is a plurality of;
when the first image and the second image respectively identify the first fingertip and the second fingertip, detecting whether the coordinates of the first fingertip and the coordinates of the second fingertip are positioned at the same position of the carrier image comprises the following steps:
acquiring coordinates of a first fingertip and a plurality of second fingertips;
and calculating the distance between the first fingertip coordinates and each second fingertip coordinate, wherein the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image when the distance is smaller than or equal to a first preset threshold value or the average value of the distances is smaller than or equal to the first preset threshold value.
6. The method according to claim 1, characterized in that the method further comprises:
and deleting the first image and the second image when one of the first image and the second image cannot identify the fingertip coordinates.
7. The method of claim 1, wherein the second image acquisition device is a plurality of;
the method further comprises the steps of:
and deleting the first image and the second image when one or more of the second image acquisition devices cannot identify the second fingertip.
8. An apparatus for hover gesture recognition, the apparatus comprising:
the photographing unit is used for receiving an instruction for triggering photographing, photographing the carrier through the first image acquisition device and the second image acquisition device, and respectively obtaining a first image and a second image;
the identification unit is used for identifying the fingers in the first image and the second image;
a judging unit, configured to detect whether coordinates of a first fingertip and coordinates of a second fingertip are located at the same position of a carrier image when the first image and the second image respectively identify the first fingertip and the second fingertip;
the processing unit is used for reserving the first image or/and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image; deleting the first image and the second image when the first fingertip coordinates and the second fingertip coordinates are positioned at different positions of the carrier image;
The plurality of second image acquisition devices are used for identifying the first image to obtain first fingertip coordinates, and identifying part of the second images to obtain second fingertip coordinates;
the judging unit includes:
the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and each second fingertip coordinate and acquiring the number smaller than or equal to a first preset threshold value in the distance;
and the proportion calculating subunit is used for calculating the proportion of the number to the total number of the second image acquisition devices, and when the proportion is greater than or equal to a second preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
9. The apparatus according to claim 8, wherein the judging unit includes:
a coordinate acquisition subunit for acquiring coordinates of the first fingertip and the second fingertip;
and the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and the second fingertip coordinates, and when the distance is smaller than or equal to a first preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
10. The apparatus of claim 9, wherein the distance calculation subunit comprises:
A coordinate transformation grandchild unit for transforming the coordinates of the first fingertip and the second fingertip into the same coordinate system by using an affine transformation manner;
and the distance acquisition grandchild unit is used for calculating Euclidean distance or Manhattan distance between the first fingertip coordinate and the second fingertip coordinate under the same coordinate system.
11. The apparatus of claim 8, wherein the second image acquisition means is a plurality of;
the judging unit includes:
a coordinate acquisition subunit for acquiring coordinates of the first fingertip and the plurality of second fingertips;
and the distance calculating subunit is used for calculating the distance between the first fingertip coordinates and each second fingertip coordinate, and when the distance is smaller than or equal to a first preset threshold value or the average value of the distances is smaller than or equal to the first preset threshold value, the first fingertip coordinates and the second fingertip coordinates are positioned at the same position of the carrier image.
12. An electronic device, comprising: a memory storing executable program code; a processor coupled to the memory; the processor invokes the executable program code stored in the memory for performing a method of hover gesture recognition according to any of claims 1-7.
13. A computer readable storage medium storing a computer program, wherein the computer program causes a computer to perform a method of hover gesture recognition according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010555991.5A CN111652182B (en) | 2020-06-17 | 2020-06-17 | Method and device for identifying suspension gesture, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010555991.5A CN111652182B (en) | 2020-06-17 | 2020-06-17 | Method and device for identifying suspension gesture, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111652182A CN111652182A (en) | 2020-09-11 |
| CN111652182B true CN111652182B (en) | 2023-09-19 |
Family
ID=72342618
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010555991.5A Active CN111652182B (en) | 2020-06-17 | 2020-06-17 | Method and device for identifying suspension gesture, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111652182B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101013349A (en) * | 2007-02-09 | 2007-08-08 | 山西大学 | Electronic plane display positioning system and positioning method |
| CN104850215A (en) * | 2014-02-18 | 2015-08-19 | 联想(北京)有限公司 | Information processing method and system, and electronic equipment |
| JP2017004438A (en) * | 2015-06-15 | 2017-01-05 | 富士通株式会社 | Input device, finger-tip position detection method, and computer program for finger-tip position detection |
| JP2018032055A (en) * | 2015-01-13 | 2018-03-01 | 三菱電機株式会社 | Gesture recognition device and method, and program and recording medium |
| CN111027533A (en) * | 2019-12-12 | 2020-04-17 | 广东小天才科技有限公司 | Conversion method and system of point-to-read coordinates, terminal device and storage medium |
| CN111078002A (en) * | 2019-11-20 | 2020-04-28 | 维沃移动通信有限公司 | Suspended gesture recognition method and terminal equipment |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SE0000850D0 (en) * | 2000-03-13 | 2000-03-13 | Pink Solution Ab | Recognition arrangement |
| TWI471815B (en) * | 2012-12-07 | 2015-02-01 | Chunghwa Picture Tubes Ltd | Gesture recognition device and method |
| JP2016177491A (en) * | 2015-03-19 | 2016-10-06 | 富士通株式会社 | Input device, fingertip position detection method, and fingertip position detection computer program |
| TWI662482B (en) * | 2017-06-28 | 2019-06-11 | 緯創資通股份有限公司 | Method and Module of Gesture Recognition |
| CN107515714B (en) * | 2017-07-27 | 2020-08-28 | 歌尔股份有限公司 | Finger touch identification method and device and touch projection equipment |
| CN111078083A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Method for determining click-to-read content and electronic equipment |
-
2020
- 2020-06-17 CN CN202010555991.5A patent/CN111652182B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101013349A (en) * | 2007-02-09 | 2007-08-08 | 山西大学 | Electronic plane display positioning system and positioning method |
| CN104850215A (en) * | 2014-02-18 | 2015-08-19 | 联想(北京)有限公司 | Information processing method and system, and electronic equipment |
| JP2018032055A (en) * | 2015-01-13 | 2018-03-01 | 三菱電機株式会社 | Gesture recognition device and method, and program and recording medium |
| JP2017004438A (en) * | 2015-06-15 | 2017-01-05 | 富士通株式会社 | Input device, finger-tip position detection method, and computer program for finger-tip position detection |
| CN111078002A (en) * | 2019-11-20 | 2020-04-28 | 维沃移动通信有限公司 | Suspended gesture recognition method and terminal equipment |
| CN111027533A (en) * | 2019-12-12 | 2020-04-17 | 广东小天才科技有限公司 | Conversion method and system of point-to-read coordinates, terminal device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 高晨 ; 张亚军 ; .基于Kinect深度图像的指尖检测与手势识别.计算机系统应用.2017,(04),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111652182A (en) | 2020-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109635772B (en) | Dictation content correcting method and electronic equipment | |
| CN110532984B (en) | Key point detection method, gesture recognition method, device and system | |
| CN107609489B (en) | Handwriting writing path evaluation device and method and electronic equipment | |
| CN111078083A (en) | Method for determining click-to-read content and electronic equipment | |
| CN111353501A (en) | Book point-reading method and system based on deep learning | |
| CN111711757B (en) | Test question shooting method and device capable of preventing finger from being blocked, electronic equipment and storage medium | |
| CN111027537A (en) | Question searching method and electronic equipment | |
| CN110941992B (en) | Smile expression detection method and device, computer equipment and storage medium | |
| CN111753715B (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium | |
| CN111079483A (en) | Writing standard judgment method and electronic equipment | |
| CN111091034B (en) | Question searching method based on multi-finger recognition and home teaching equipment | |
| CN111753168A (en) | Method and device for searching questions, electronic equipment and storage medium | |
| CN111722711B (en) | Augmented reality scene output method, electronic device and computer readable storage medium | |
| CN111026924A (en) | Method for acquiring content to be searched and electronic equipment | |
| CN111027533B (en) | Click-to-read coordinate transformation method, system, terminal equipment and storage medium | |
| CN111078983B (en) | Method for determining page to be identified and learning equipment | |
| CN111652182B (en) | Method and device for identifying suspension gesture, electronic equipment and storage medium | |
| CN110991371B (en) | Intelligent reading learning method based on coordinate recognition | |
| CN111079486B (en) | Method for starting dictation detection and electronic equipment | |
| CN111432131B (en) | Photographing frame selection method and device, electronic equipment and storage medium | |
| CN111077993A (en) | Learning scene switching method, electronic equipment and storage medium | |
| CN111027353A (en) | Search content extraction method and electronic equipment | |
| CN111711758B (en) | Multi-pointing test question shooting method and device, electronic equipment and storage medium | |
| CN111652204B (en) | Method, device, electronic equipment and storage medium for selecting target text region | |
| CN109084750B (en) | Navigation method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |