CN109753554B - Searching method based on three-dimensional space positioning and family education equipment - Google Patents
Searching method based on three-dimensional space positioning and family education equipment Download PDFInfo
- Publication number
- CN109753554B CN109753554B CN201910030731.3A CN201910030731A CN109753554B CN 109753554 B CN109753554 B CN 109753554B CN 201910030731 A CN201910030731 A CN 201910030731A CN 109753554 B CN109753554 B CN 109753554B
- Authority
- CN
- China
- Prior art keywords
- hand
- teaching material
- current page
- camera
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000005540 biological transmission Effects 0.000 claims abstract description 44
- 238000006073 displacement reaction Methods 0.000 claims abstract description 40
- 238000000605 extraction Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 13
- 238000001514 detection method Methods 0.000 claims description 10
- 230000004807 localization Effects 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 10
- 238000005260 corrosion Methods 0.000 description 2
- 230000007797 corrosion Effects 0.000 description 2
- 235000013559 Schnittsellerie Nutrition 0.000 description 1
- 244000169997 Schnittsellerie Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the invention discloses a searching method based on three-dimensional space positioning and family education equipment, wherein the method comprises the following steps: when the home education equipment operates the hands of the user on the current page of the exercise teaching material, detecting human infrared rays by using a human infrared ray transmitting device of the camera to obtain original image data of the hands; performing three-dimensional modeling based on the original hand image data to generate hand three-dimensional displacement data, and positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data; when the human infrared ray transmission device of the camera is not used for detecting the human infrared ray, controlling the camera to shoot a current page of the practice teaching material to obtain a current page image; identifying teaching material content corresponding to the operation position from the current page image; searching on the basis of the content of the teaching materials to obtain a reference answer; the content to be searched can be intelligently positioned, and the content to be searched can be accurately identified, so that the searching accuracy is improved.
Description
Technical Field
The invention relates to the technical field of family education equipment, in particular to a searching method based on three-dimensional space positioning and family education equipment.
Background
Most of the existing family education equipment has the function of photographing and searching for the questions, namely, a user can photograph the contents needing to be searched by starting a camera on the family education equipment to obtain corresponding images, then identify the contents from the images, and search the contents to obtain corresponding reference answers. However, the operation flow of such photographing and searching is relatively complicated, and it is impossible for a user with a small age to prepare to photograph a content to be searched, thereby affecting the search rate.
Disclosure of Invention
The embodiment of the invention discloses a searching method based on three-dimensional space positioning and family education equipment, which can intelligently position contents to be searched and accurately identify the contents to be searched so as to improve the searching accuracy.
The invention discloses a searching method based on three-dimensional space positioning, which is applied to home teaching equipment, wherein two cameras are arranged on the same side surface of the home teaching equipment, the distance between the cameras meets a preset distance, the cameras are provided with human body infrared light transmission devices, when the home teaching equipment is placed in a preset mode, the cameras correspond to a specified shooting area, and the specified shooting area is used for placing exercise teaching materials, and the method comprises the following steps:
when the hands of the user operate on the current page of the exercise teaching material, the family education equipment detects human infrared rays by using the human infrared ray transmitting device of the camera to obtain original image data of the hands;
the family education equipment performs three-dimensional modeling by taking the hand original image data as a basis to generate hand three-dimensional displacement data, and positions the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data;
when the human infrared ray is not detected by the human infrared ray transmitting device of the camera, the family education equipment controls the camera to shoot the current page of the practice teaching material to obtain a current page image;
the family education equipment identifies the teaching material content corresponding to the operation position from the current page image;
and the family education equipment searches on the basis of the teaching material content to obtain a reference answer.
As an optional implementation manner, in the first aspect of the present invention, after the family education device performs three-dimensional modeling based on the hand original image data, generates hand three-dimensional displacement data, and positions an operation position of the user hand on a current page of the exercise book according to the hand three-dimensional displacement data, the method further includes:
the family education equipment outputs a reminding message, and the reminding message is used for reminding the user to move the hand away from the exercise textbook;
the family education equipment determines that the hands of the user are removed from the exercise teaching material when the human infrared ray transmitting device of the camera does not detect the human infrared ray.
As an optional implementation manner, in the first aspect of the present invention, when the user's hand operates on the current page of the practice teaching material, the family education apparatus detects the human infrared ray by using the human infrared ray transmission device of the camera to obtain the hand original image data, including:
when the hands of a user operate on the current page of the exercise teaching material, the family education equipment utilizes the human body infrared ray transmitting device of one camera to detect human body infrared rays so as to obtain first hand original image data, and utilizes the human body infrared ray transmitting device of the other camera to detect human body infrared rays so as to obtain second hand original image data;
the family education equipment performs three-dimensional modeling by taking the hand original image data as a basis, generates hand three-dimensional displacement data, and positions the operation position of the hand of the user on the current page of the exercise textbook according to the hand three-dimensional displacement data, and the method comprises the following steps:
the family education equipment performs image binarization processing on the first hand original image data to obtain a first gesture image, and performs image binarization processing on the second hand original image data to obtain a second gesture image;
the family education equipment performs edge extraction processing on the first gesture image to obtain a first edge image, and performs edge extraction processing on the second gesture image to obtain a second edge image;
the family education equipment carries out two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material by taking the first edge image and the second edge image as a basis to obtain two-dimensional finger positioning coordinates of the hand of the user;
and the family education equipment converts the two-dimensional finger positioning coordinates into three-dimensional finger positioning coordinates, and obtains the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinates.
As an optional implementation manner, in the first aspect of the present invention, before the family education apparatus detects the human infrared ray by using the human infrared ray transmission device of the camera to obtain the hand original image data when the user's hand operates on the current page of the exercise book, the method further includes:
the family education equipment detects whether a search question starting instruction is received or not;
after receiving the search question starting instruction, the family education equipment detects whether question inquiry voice is received or not;
the family education equipment is receiving when the question asks pronunciation, then affirms the user's hand is in practice the present page of textbook is operated, family education equipment carries out and utilizes the human infrared ray printing opacity device of camera detects the step of human infrared ray in order to obtain the original image data of hand.
As an optional implementation manner, in the first aspect of the present invention, the home education device performs a search based on the teaching material content to obtain a reference answer, including:
the family education equipment generates a target question aiming at the teaching material content according to the teaching material content and the question inquiry voice, and searches a reference answer matched with the target question;
and the family education equipment acquires the output type of the reference answer and outputs the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type.
The invention discloses a second aspect of family education equipment, wherein two cameras are arranged on the same side face of the family education equipment, the distance between the cameras meets a preset distance, the cameras are provided with human body infrared ray transmission devices, when the family education equipment is placed in a preset mode, the cameras are correspondingly provided with appointed shooting areas, the appointed shooting areas are used for placing exercise teaching materials, and the family education equipment comprises:
the shooting unit is used for detecting human infrared rays by using the human infrared ray transmitting device of the camera to obtain original image data of the hands when the hands of a user operate on the current page of the exercise teaching material;
the positioning unit is used for carrying out three-dimensional modeling by taking the hand original image data as a basis, generating hand three-dimensional displacement data and positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data;
the shooting unit is further used for controlling the camera to shoot a current page of the practice teaching material to obtain a current page image when the shooting unit does not detect the human infrared rays by using the human infrared ray transmitting device of the camera;
the searching unit is used for identifying teaching material contents corresponding to the operation positions from the current page image; and searching based on the teaching material content to obtain a reference answer.
As an alternative embodiment, in the second aspect of the present invention, the family education device further includes:
the reminding unit is used for performing three-dimensional modeling by the positioning unit according to the original hand image data to generate hand three-dimensional displacement data, positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data, and then outputting a reminding message, wherein the reminding message is used for reminding the user to move the hand away from the exercise teaching material; and when the shooting unit does not detect the human infrared rays by using the human infrared ray transmitting device of the camera, determining that the hand of the user is removed from the exercise teaching material.
As an optional implementation manner, in the second aspect of the present invention, when the user's hand operates on the current page of the practice teaching material, the manner of detecting the human infrared ray by using the human infrared ray transmission device of the camera to obtain the original image data of the hand is specifically:
the shooting unit is used for detecting human infrared rays by using the human infrared ray transmitting device of one camera to obtain first hand original image data and detecting the human infrared rays by using the human infrared ray transmitting device of the other camera to obtain second hand original image data when the hands of a user operate on the current page of the exercise teaching material;
the mode that the positioning unit is used for performing three-dimensional modeling by taking the hand original image data as a basis, generating hand three-dimensional displacement data, and positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data is specifically as follows:
the positioning unit is used for carrying out image binarization processing on the first hand original image data to obtain a first hand image and carrying out image binarization processing on the second hand original image data to obtain a second hand image; performing edge extraction processing on the first gesture image to obtain a first edge image, and performing edge extraction processing on the second gesture image to obtain a second edge image; and performing two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material by taking the first edge image and the second edge image as a basis to obtain two-dimensional finger positioning coordinates of the hand of the user; and converting the two-dimensional finger positioning coordinates into three-dimensional finger positioning coordinates, and obtaining the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinates.
As an alternative embodiment, in the second aspect of the present invention, the family education device further includes:
the starting detection unit is used for detecting whether a question searching starting instruction is received or not before the shooting unit detects human infrared rays by using the human infrared ray transmitting device of the camera to obtain the original image data of the hands when the hands of the user operate on the current page of the exercise teaching material; after receiving the search question starting instruction, detecting whether question inquiry voice is received or not;
the shooting unit is used for utilizing the human infrared ray transmission device of the camera to detect human infrared rays so as to obtain the original image data of the hand when the hand of a user operates on the current page of the exercise teaching material, and the mode specifically comprises the following steps:
the shooting unit is used for identifying the hand of the user to operate on the current page of the exercise teaching material when the starting detection unit receives the question inquiry voice, and detecting the human infrared rays by using the human infrared ray transmitting device of the camera so as to obtain the original image data of the hand.
As an optional implementation manner, in the second aspect of the present invention, the searching unit is configured to search based on the textbook content to obtain the reference answer, specifically:
the searching unit is used for generating a target question aiming at the teaching material content according to the teaching material content and the question inquiry voice and searching a reference answer matched with the target question; and acquiring an output type of the reference answer, and outputting the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type.
A third aspect of the present invention discloses a family education apparatus, which may include:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the searching method based on the three-dimensional space positioning disclosed by the first aspect of the invention.
In a fourth aspect of the present invention, a computer-readable storage medium is disclosed, which stores a computer program, wherein the computer program enables a computer to execute a search method based on three-dimensional space positioning disclosed in the first aspect of the present invention.
A fifth aspect of the invention discloses a computer program product for causing a computer to perform some or all of the steps of any one of the methods of the first aspect when the computer program product is run on the computer.
A sixth aspect of the present invention discloses an application publishing platform for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
the family education equipment provided by the embodiment of the invention is provided with two cameras on the same side, the distance between the two cameras meets the preset distance, the cameras are provided with human infrared ray transmission devices, the cameras are correspondingly provided with the appointed shooting areas when the family education equipment is placed in the preset mode, the appointed shooting areas are used for placing the practice teaching materials, based on the appointed shooting areas, when the hands of a user operate on the current page of the practice teaching materials, the family education equipment can detect the human infrared rays by using the human infrared ray transmission devices of the cameras to obtain the original image data of the hands, further carries out three-dimensional modeling by using the original image data of the hands as the basis to generate the three-dimensional hand displacement data, positions the operation position of the hands of the user on the current page of the practice teaching materials according to the three-dimensional hand displacement data, and further carries out the three-dimensional modeling by using the human infrared ray transmission devices of the cameras when the human infrared rays are not detected, controlling a camera to shoot a current page of an exercise teaching material to obtain a current page image, identifying teaching material content corresponding to the operation position from the current page image, and further searching and obtaining a reference answer on the basis of the identified teaching material content, wherein the embodiment of the invention can detect through a human body infrared ray transmission device arranged on a camera lens to obtain the operation position of a hand of a user on the current page of the exercise teaching material, and then when the human body infrared ray is not detected, namely the hand of the user is moved away from the current page of the exercise teaching material and does not shield the current page any more, shooting the current page through the camera, and then matching the operation position on the current page to obtain corresponding teaching material content, thereby comprehensively identifying the teaching material content which the user wants to search, and realizing intelligent positioning and identification of the teaching material content, the search accuracy and the use experience of the user are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of an application of a family education device disclosed in an embodiment of the present invention;
FIG. 2 is a schematic flowchart of a searching method based on three-dimensional spatial localization according to an embodiment of the present invention;
FIG. 3 is a schematic flowchart of a searching method based on three-dimensional spatial localization according to another embodiment of the disclosure;
FIG. 4 is a schematic structural diagram of a family education device according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a family education device according to another embodiment of the present invention;
fig. 6 is a schematic structural diagram of a family education device disclosed in yet another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a searching method based on three-dimensional space positioning and family education equipment, which can intelligently position contents to be searched and accurately identify the contents to be searched so as to improve the searching accuracy.
Referring to fig. 1, fig. 1 is an application schematic diagram of a family education device disclosed in the embodiment of the present invention, and it can be understood that fig. 1 is only an application schematic diagram of the family education device disclosed in the embodiment of the present invention, and other application schematic diagrams obtained by performing optimization or transformation on the basis of fig. 1 and can be used for implementing the technical solution of the present invention all belong to the protection scope of the present invention, which is not specifically limited. In fig. 1, the family education device 10 is placed on the base support 20, two cameras are disposed on the same side of the family education device 10, such as the camera 31 and the camera 32 shown in fig. 1, the side can be the side where the display screen is located, and the distance between the camera 31 and the camera 32 needs to satisfy a preset distance (generally, the horizontal distance can be 6cm, and the reasonable placement range conforming to general binocular vision as much as possible), and a human infrared ray transmission device (can be an infrared ray transmission sheet, only allowing human infrared ray to transmit, and is not shown in fig. 1) is disposed on the lens of each camera, and when the family education device 10 is placed in a preset manner, the camera should have a designated shooting area (as shown in fig. 1) for placing the practice teaching materials, if the frame area of the horizontal plane in front of the family education device 10, wherein the designated shooting area is not fixed, the area where the visual angles of the camera 31 and the camera 32 intersect changes with the placement of the family education device 10, and gesture operations performed in the area can be recognized by the family education device 10. In order to clearly photograph a designated photographing region, the family education device 10 may be placed on the base support 20 such that the family education device 10 is at an angle of 75 ° with respect to the horizontal plane, thereby enabling a better photographing angle.
It can be further understood that the family education device 10 may be correspondingly provided with an intelligent learning mode, in fig. 1, a circular icon is used as an interface for starting the intelligent learning mode, the intelligent learning mode can be started by clicking the circular icon, the technical solution of the present invention can be implemented in the intelligent learning mode, and details will not be described herein.
The operating system of the above-described family education device may include, but is not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a Black Berry operating system, a windows phone8 operating system, and the like, and the embodiment of the present invention is not limited thereto. The technical solution of the present invention will be described in detail in the following with reference to specific embodiments from the perspective of a family education device.
Example one
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a searching method based on three-dimensional spatial localization according to an embodiment of the present invention; as shown in fig. 2, the searching method based on three-dimensional space positioning is applied to the family education device shown in fig. 1, and may include:
201. when the family education equipment is operated at the current page of the exercise teaching material by the hands of a user, the human infrared ray transmitting device of the camera is utilized to detect the human infrared ray so as to obtain the original image data of the hands.
The human body infrared ray transmission device can be an infrared ray transmission piece arranged on a lens of the camera, and the infrared ray transmission piece can only transmit human body infrared rays, so that when a user hand operates in a designated shooting area, the human body infrared ray transmission device can detect the human body infrared ray.
With reference to fig. 1, when detecting a touch operation (including a click operation or a press operation) of a user on a circular icon (smart learning mode), the family education device starts the smart learning mode, and then performs detection of human infrared rays by using a human infrared ray transmission device of a camera to obtain original image data of a hand.
Further, with reference to fig. 1, in the embodiment of the present invention, a human infrared transmission device may be flexibly set, when the family education device detects a touch operation (including a click operation or a press operation) of a user on a circular icon (an intelligent learning mode), the intelligent learning mode is turned on, and the human infrared transmission device is controlled to move to a lens corresponding to a camera so as to be set on the lens of the camera, and then the human infrared transmission device of the camera is used to detect human infrared rays so as to obtain original image data of a hand.
202. The home education equipment carries out three-dimensional modeling by taking the original hand image data as the basis, generates hand three-dimensional displacement data and positions the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data.
203. When the human infrared ray transmission device utilizing the camera does not detect human infrared rays, the family education equipment controls the camera to shoot the current page of the practice teaching material to obtain a current page image.
Wherein, when the human infrared ray light transmission device who utilizes the camera does not detect human infrared ray, explain that the user is after fixing a position out the operating position from the current page of exercise teaching material, move away from the exercise teaching material on appointed shooting area the hand, at this moment, the user hand can not shelter from the current page of exercise teaching material, can clearly shoot the current page of exercise teaching material, obtain the content on the current page, implement this step and compare the operating position of direct through camera location hand, its advantage is that there can not exist the condition that the hand sheltered from current page content, and then can not influence the discernment of image content, can improve the rate of accuracy of image content discernment promptly, improve the search accuracy.
As an optional implementation manner, when the human infrared ray is not detected by the human infrared ray transmission devices of the cameras, the family education equipment controls the human infrared ray transmission devices on the lenses of the cameras to move away from the lenses, so that the current page of the exercise teaching material is shot by the cameras without the human infrared ray transmission devices, and a colorful current page image is obtained.
204. And the family education equipment identifies the teaching material content corresponding to the operation position from the current page image.
The family education device can directly match the previously positioned operation position on the current page image, and then recognize the teaching material content corresponding to the operation position.
205. The family education equipment searches on the basis of the teaching material content to obtain a reference answer.
It is understood that the searching based on the textbook content to obtain the reference answer may include: directly searching the reference answer matched with the teaching material content; or after the teaching material content is identified, detecting a voice search question input by a user aiming at the teaching material, then generating a target question according to the voice search question and the teaching material content, and further searching for a reference answer matched with the target question. For example, the recognized teaching material content is "want to be in the order of thousands of miles, the first floor higher", the voice search question input by the user is "what meaning this poem is", then, in combination with "want to be in the order of thousands of miles, the first floor higher" and "what meaning this poem is", the target question is generated as "what meaning this poem is"? ".
As an alternative implementation, step 205 may include: after searching the reference answer, the family education device acquires the output type of the reference answer and outputs the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type. In this embodiment, the reference answers searched by the family education device may be output in a voice manner, may be output in a text manner, may be output in a video manner, or may be output in an image manner.
Through implementing above-mentioned embodiment, go to detect in order to obtain the operating position of user's hand on the current page of exercise teaching material through the human infrared ray printing opacity device that sets up on the camera lens, then when can't detect human infrared ray, namely when user's hand removes from this exercise teaching material current page and no longer shelters from current page, go to shoot current page through the camera, then go to match this operating position through going on current page, obtain corresponding teaching material content, thereby can discern the teaching material content that the user wanted to search for comprehensively, realize intelligent location and the discernment of teaching material content, improve search accuracy and user's use experience.
Example two
Referring to fig. 3, fig. 3 is a schematic flowchart illustrating a searching method based on three-dimensional positioning according to another embodiment of the present invention; as shown in fig. 3, the searching method based on three-dimensional space positioning is applied to the family education device shown in fig. 1, and the method may include:
301. and the family education equipment detects whether a search question starting instruction is received.
When receiving the command for starting the search question, the process goes to step 302, and when not receiving the command for starting the search question, the process is ended.
As an optional implementation manner, with reference to fig. 1, detecting, by the family education device, whether the search question starting instruction is received specifically may include: the family education equipment detects whether touch operation (including click operation or press operation) of a user on the circular icon (in the intelligent learning mode) is received, and when the touch operation of the user on the circular icon is detected, the family education equipment considers that a search question starting instruction is received.
302. After receiving a search question starting instruction, the family education equipment detects whether question inquiry voice is received.
When the question asking voice is received, the process goes to step 303, and when the question asking voice is not received, the process is ended.
It should be noted that, after inputting the instruction for starting the search question, the user will locate the content of the teaching material to be searched on the current page of the practice teaching material by hand (e.g. finger), and will also input the question to be asked by voice, for example, the user points to "want for thousands of miles" on the current page of the practice teaching material by hand (finger), and "ask" what the poem means "on the upper floor. The family education device also performs step 303 after detecting the question asking voice.
303. When the family education equipment receives the question inquiry voice, the human infrared ray transmitting device of the camera is used for detecting the human infrared ray to obtain the original image data of the hand.
304. The home education equipment carries out three-dimensional modeling by taking the original hand image data as the basis, generates hand three-dimensional displacement data and positions the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data.
As an optional embodiment, when the user's hand is operating on the current page of the practice teaching material, the family education device detects the human infrared ray by using the human infrared ray transmission device of the camera to obtain the original image data of the hand, comprising: when the hands of the user operate on the current page of the training teaching material, the family education equipment utilizes the human body infrared ray transmitting device of one camera to detect the human body infrared ray so as to obtain first hand original image data, and utilizes the human body infrared ray transmitting device of the other camera to detect the human body infrared ray so as to obtain second hand original image data. The family education equipment detects human infrared rays by using the human infrared ray transmitting device of each camera to respectively obtain first hand original image data and second hand original image data.
Furthermore, the family education device performs three-dimensional modeling based on the original hand image data to generate three-dimensional hand displacement data, and positions the operation position of the hand of the user on the current page of the exercise book according to the three-dimensional hand displacement data, and the method comprises the following steps:
the family education equipment performs image binarization processing on the first hand original image data to obtain a first gesture image, and performs image binarization processing on the second hand original image data to obtain a second gesture image; the family education equipment performs edge extraction processing on the first gesture image to obtain a first edge image, and performs edge extraction processing on the second gesture image to obtain a second edge image; the family education equipment carries out two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material according to the first edge image and the second edge image to obtain two-dimensional finger positioning coordinates of the hand of the user; and converting the two-dimensional finger positioning coordinate into a three-dimensional finger positioning coordinate by the family education equipment, and acquiring the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinate. The binarization processing can be realized by adopting a common threshold segmentation algorithm. And during the edge extraction processing, an edge extraction algorithm is adopted, wherein the edge extraction algorithm firstly adopts a corrosion algorithm of a 7x7 template to remove stray points, then uses a 7x7 template to expand and recover the original image, and then adopts the recovered original image to subtract a picture of the recovered original image after the 3x3 corrosion algorithm to obtain an edge image. Through this embodiment, can improve the discernment of user's hand to pinpoint the operating position.
305. The family education device outputs a reminding message for reminding the user to remove the hand from the exercise textbook.
306. When the human infrared ray transmission device utilizing the camera does not detect human infrared rays, the family education equipment controls the camera to shoot the current page of the practice teaching material to obtain a current page image.
307. And the family education equipment identifies the teaching material content corresponding to the operation position from the current page image.
308. The home education equipment generates a target question aiming at the teaching material content based on the teaching material content and the question inquiry voice, and searches for a reference answer matched with the target question.
It is understood that the home education apparatus asks the question involved in the voice in conjunction with the question, and then generates a target question for the contents of the teaching material, for example, for the contents of the teaching material "want to be in the next lower floor", and asks the question "what the poem means", and generates "? "
By implementing the embodiment, the home teaching equipment can indicate the teaching material content to be searched by hands and simultaneously input the question input aiming at the teaching material content by question inquiry voice, when the user indicates the teaching material content to be searched by hands, the home teaching equipment can detect through a human body infrared ray transmission device arranged on a camera lens to obtain the operation position of the hands of the user on the current page of the practice teaching material, then when the human body infrared ray is not detected, namely the hands of the user are removed from the current page of the practice teaching material and do not shield the current page any more, the current page is shot through the camera, then the corresponding teaching material content is obtained by matching the operation position on the current page, the target question is generated by combining with the question inquiry voice, then the reference answer matched with the target question is searched, and it can be seen that the teaching material content which the user wants to search can be comprehensively identified, the intelligent positioning and identification of the teaching material content are realized, and the searching accuracy and the use experience of the user are improved.
EXAMPLE III
Referring to fig. 4, fig. 4 is a schematic structural diagram of a family education device according to an embodiment of the present invention; as shown in fig. 4, this family education equipment is provided with two cameras on the same side, and distance between this camera satisfies preset distance, and the camera is provided with human infrared ray printing opacity device, and the camera should have appointed shooting region when family education equipment places with the preset mode, and this appointed shooting region is used for placing the exercise teaching material, and further, this family education equipment can include:
and a shooting unit 410, configured to detect human infrared rays by using a human infrared ray transmission device of the camera to obtain original image data of the hand when the hand of the user operates on the current page of the training materials.
And the positioning unit 420 is configured to perform three-dimensional modeling based on the hand original image data, generate hand three-dimensional displacement data, and position an operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data.
The shooting unit 410 is further configured to control the camera to shoot a current page of the practice teaching material when the shooting unit 410 does not detect the human infrared ray by using the human infrared ray transmission device of the camera, so as to obtain a current page image.
As an alternative embodiment, when the human infrared ray is not detected by the human infrared ray transmission devices of the cameras, the shooting unit 410 controls the human infrared ray transmission devices on the lenses of the cameras to move away from the lenses, so that the cameras without the human infrared ray transmission devices shoot the current page of the practice teaching material to obtain a colorful current page image.
The searching unit 430 is used for identifying teaching material contents corresponding to the operation position from the current page image; and searching based on the teaching material content to obtain the reference answer.
As an alternative embodiment, the searching unit 430 directly searches the reference answer matched with the textbook content; or after the teaching material content is identified, detecting a voice search question input by a user aiming at the teaching material, then generating a target question according to the voice search question and the teaching material content, and further searching for a reference answer matched with the target question.
Further optionally, after the reference answer is searched, the searching unit 430 obtains an output type of the reference answer, and outputs the reference answer in an output mode corresponding to the output type, where the output type includes a voice type, a text type, a video type, or an image type. In this embodiment, the reference answers searched by the family education device may be output in a voice manner, may be output in a text manner, may be output in a video manner, or may be output in an image manner.
Through implementing above-mentioned family education equipment, can go to detect in order to obtain the operating position of user's hand on the current page of exercise teaching material through the human infrared ray printing opacity device that sets up on the camera lens, then when detecting human infrared ray, when the user hand moves away from this exercise teaching material current page and no longer shelters from current page, go to shoot current page through the camera, then go to match this operating position through going on current page, obtain corresponding teaching material content, thereby can discern the teaching material content that the user wants to search for comprehensively, realize the intelligent location and the discernment of teaching material content, improve search accuracy and user's use experience.
As an optional implementation manner, when the user's hand operates on the current page of the practice teaching material, the manner of detecting the human infrared ray by using the human infrared ray transmission device of the camera to obtain the original image data of the hand by the shooting unit 410 is specifically:
the shooting unit 410 is configured to, when the user's hand is operating on the current page of the training material, detect the human infrared ray through the human infrared ray transmitting device of one of the cameras to obtain first hand original image data, and detect the human infrared ray through the human infrared ray transmitting device of the other one of the cameras to obtain second hand original image data;
furthermore, the manner of performing three-dimensional modeling based on the original hand image data by the positioning unit 420 to generate three-dimensional hand displacement data, and positioning the operation position of the hand of the user on the current page of the exercise book according to the three-dimensional hand displacement data specifically includes:
the positioning unit 420 is configured to perform image binarization on the first hand original image data to obtain a first hand image, and perform image binarization on the second hand original image data to obtain a second hand image; performing edge extraction processing on the first gesture image to obtain a first edge image, and performing edge extraction processing on the second gesture image to obtain a second edge image; and carrying out two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material by taking the first edge image and the second edge image as a basis to obtain two-dimensional finger positioning coordinates of the hand of the user; and converting the two-dimensional finger positioning coordinates into three-dimensional finger positioning coordinates, and obtaining the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinates.
Example four
Referring to fig. 5, fig. 5 is a schematic structural diagram of a family education device according to another embodiment of the present invention; the family education device shown in fig. 5 is optimized based on the family education device shown in fig. 4, and the family education device shown in fig. 5 further comprises: a reminding unit 510 and a start detection unit 520;
as an optional implementation manner, the reminding unit 510 is configured to perform three-dimensional modeling on the basis of the original image data of the hand at the positioning unit 420, generate three-dimensional displacement data of the hand, and output a reminding message after positioning an operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional displacement data of the hand, where the reminding message is used to remind that the hand of the user is moved away from the exercise teaching material; and, when the photographing unit 410 does not detect the human infrared rays using the human infrared ray transmitting means of the camera, it is determined that the user's hand has been removed from the practice teaching material.
As an optional implementation manner, the start detection unit 520 is configured to detect whether a question searching start instruction is received before the shooting unit 410 detects human infrared rays by using a human infrared ray transmission device of a camera to obtain original image data of the hand when the hand of the user operates on the current page of the practice teaching material; and after receiving a question searching starting instruction, detecting whether question inquiry voice is received or not.
As an optional implementation manner, with reference to fig. 1, the detecting whether the search question starting instruction is received by the starting detecting unit 520 specifically includes: the start detection unit 520 detects whether a touch operation (including a click operation or a press operation) of the user on the circular icon (smart learning mode) is received, and when the touch operation of the user on the circular icon is detected, it is determined that a search question start instruction is received.
Furthermore, the above-mentioned shooting unit 410 is used for detecting the human infrared ray by using the human infrared ray transmission device of the camera to obtain the original image data of the hand when the hand of the user is operated on the current page of the exercise teaching material specifically:
the shooting unit 410 is configured to determine that the user's hand is operating on the current page of the practice teaching material when the detection unit 520 is started and receives the question inquiry voice, and detect the human infrared rays by using the human infrared ray transmission device of the camera to obtain the original image data of the hand.
Referring to fig. 1, when detecting a touch operation (including a click operation or a press operation) of a user on a circular icon (smart learning mode), the start detection unit 520 starts the smart learning mode, and then triggers the shooting unit 410 to control the human infrared ray transmission device to move to a lens corresponding to the camera, so as to be disposed on the lens of the camera, and detect the human infrared ray by using the human infrared ray transmission device of the camera to obtain original image data of the hand. Through this embodiment, can just dispose it to the camera lens of camera when needing to use human infrared ray printing opacity device, move away human infrared ray printing opacity device from the camera lens of camera at ordinary times, the camera can accomplish the shooting of colour image.
Furthermore, as an optional implementation manner, the manner for searching and outputting the reference answer corresponding to the textbook content by the searching unit 430 is specifically as follows:
the search unit 430 is configured to generate a target question for the textbook content based on the textbook content and the question query voice, and search for a reference answer matching the target question; and acquiring an output type of the reference answer, and outputting the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type.
EXAMPLE five
Referring to fig. 6, fig. 6 is a schematic structural diagram of a family education device according to another embodiment of the present invention. As shown in fig. 6, the family education device may include:
a memory 601 in which executable program code is stored;
a processor 602 coupled to a memory 601;
the processor 602 calls the executable program code stored in the memory 601 to execute any one of the search methods based on three-dimensional space positioning in fig. 2 to 3.
The embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer program, wherein the computer program enables a computer to execute the search method based on three-dimensional space positioning disclosed in fig. 2 to 3.
An embodiment of the present invention further discloses a computer program product, which, when running on a computer, causes the computer to execute part or all of the steps of any one of the methods disclosed in fig. 2 to 3.
An embodiment of the present invention further discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps of any one of the methods disclosed in fig. 2 to fig. 3.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The searching method based on three-dimensional space positioning and the family education equipment disclosed by the embodiment of the invention are described in detail, a specific embodiment is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (12)
1. The utility model provides a search method based on three-dimensional space location, its characterized in that is applied to family education equipment, be provided with two cameras on the same side of family education equipment, distance between the camera satisfies preset distance, the camera is provided with human infrared ray printing opacity device, just when family education equipment places with the preset mode the camera should have appointed shooting region, appointed shooting region is the crossing region of the visual angle of two cameras, appointed shooting region is used for placing the exercise teaching material, the method includes:
when the hands of the user operate on the current page of the exercise teaching material, the family education equipment detects human infrared rays by using the human infrared ray transmitting device of the camera to obtain original image data of the hands;
the family education equipment performs three-dimensional modeling by taking the hand original image data as a basis to generate hand three-dimensional displacement data, and positions the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data;
when the human infrared ray is not detected by the human infrared ray transmitting device of the camera, the family education equipment controls the camera to shoot the current page of the practice teaching material to obtain a current page image;
the family education equipment identifies the teaching material content corresponding to the operation position from the current page image;
and the family education equipment searches on the basis of the teaching material content to obtain a reference answer.
2. The method of claim 1, wherein the family education device performs three-dimensional modeling based on the hand raw image data, generates hand three-dimensional displacement data, and positions the operation position of the user hand on the current page of the exercise book according to the hand three-dimensional displacement data, and the method further comprises:
the family education equipment outputs a reminding message, and the reminding message is used for reminding the user to move the hand away from the exercise textbook;
the family education equipment determines that the hands of the user are removed from the exercise teaching material when the human infrared ray transmitting device of the camera does not detect the human infrared ray.
3. The method according to claim 1 or 2, wherein the family education device detects the human infrared ray by using the human infrared ray transmission device of the camera to obtain the hand original image data when the user's hand operates on the current page of the exercise textbook, comprising:
when the hands of a user operate on the current page of the exercise teaching material, the family education equipment utilizes the human body infrared ray transmitting device of one camera to detect human body infrared rays so as to obtain first hand original image data, and utilizes the human body infrared ray transmitting device of the other camera to detect human body infrared rays so as to obtain second hand original image data;
the family education equipment performs three-dimensional modeling by taking the hand original image data as a basis, generates hand three-dimensional displacement data, and positions the operation position of the hand of the user on the current page of the exercise textbook according to the hand three-dimensional displacement data, and the method comprises the following steps:
the family education equipment performs image binarization processing on the first hand original image data to obtain a first gesture image, and performs image binarization processing on the second hand original image data to obtain a second gesture image;
the family education equipment performs edge extraction processing on the first gesture image to obtain a first edge image, and performs edge extraction processing on the second gesture image to obtain a second edge image;
the family education equipment carries out two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material by taking the first edge image and the second edge image as a basis to obtain two-dimensional finger positioning coordinates of the hand of the user;
and the family education equipment converts the two-dimensional finger positioning coordinates into three-dimensional finger positioning coordinates, and obtains the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinates.
4. The method according to claim 1 or 2, wherein before the family education apparatus detects the human infrared rays by using the human infrared ray transmission device of the camera to obtain the hand original image data when the user's hand operates on the current page of the exercise textbook, the method further comprises:
the family education equipment detects whether a search question starting instruction is received or not;
after receiving the search question starting instruction, the family education equipment detects whether question inquiry voice is received or not;
the family education equipment is receiving when the question asks pronunciation, then affirms the user's hand is in practice the present page of textbook is operated, family education equipment carries out and utilizes the human infrared ray printing opacity device of camera detects the step of human infrared ray in order to obtain the original image data of hand.
5. The method as claimed in claim 4, wherein the home education device searches for reference answers based on the teaching material contents, comprising:
the family education equipment generates a target question aiming at the teaching material content according to the teaching material content and the question inquiry voice, and searches a reference answer matched with the target question;
and the family education equipment acquires the output type of the reference answer and outputs the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type.
6. The utility model provides a family education equipment, its characterized in that, family education equipment is provided with two cameras on the same side, distance between the camera satisfies preset distance, the camera is provided with human infrared ray printing opacity device, just when family education equipment places with the predetermined mode the camera should have appointed shooting region, appointed shooting region is the crossing region of visual angle of two cameras, appointed shooting region is used for placing the exercise teaching material, family education equipment includes:
the shooting unit is used for detecting human infrared rays by using the human infrared ray transmitting device of the camera to obtain original image data of the hands when the hands of a user operate on the current page of the exercise teaching material;
the positioning unit is used for carrying out three-dimensional modeling by taking the hand original image data as a basis, generating hand three-dimensional displacement data and positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data;
the shooting unit is further used for controlling the camera to shoot a current page of the practice teaching material to obtain a current page image when the shooting unit does not detect the human infrared rays by using the human infrared ray transmitting device of the camera;
the searching unit is used for identifying teaching material contents corresponding to the operation positions from the current page image; and searching based on the teaching material content to obtain a reference answer.
7. The family education device of claim 6, further comprising:
the reminding unit is used for performing three-dimensional modeling by the positioning unit according to the original hand image data to generate hand three-dimensional displacement data, positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data, and then outputting a reminding message, wherein the reminding message is used for reminding the user to move the hand away from the exercise teaching material; and when the shooting unit does not detect the human infrared rays by using the human infrared ray transmitting device of the camera, determining that the hand of the user is removed from the exercise teaching material.
8. The family education device of claim 6 or 7 wherein the shooting unit is configured to detect the human infrared ray by the human infrared ray transmission device of the camera to obtain the original image data of the hand when the hand of the user operates on the current page of the exercise book specifically:
the shooting unit is used for detecting human infrared rays by using the human infrared ray transmitting device of one camera to obtain first hand original image data and detecting the human infrared rays by using the human infrared ray transmitting device of the other camera to obtain second hand original image data when the hands of a user operate on the current page of the exercise teaching material;
the mode that the positioning unit is used for performing three-dimensional modeling by taking the hand original image data as a basis, generating hand three-dimensional displacement data, and positioning the operation position of the hand of the user on the current page of the exercise teaching material according to the hand three-dimensional displacement data is specifically as follows:
the positioning unit is used for carrying out image binarization processing on the first hand original image data to obtain a first hand image and carrying out image binarization processing on the second hand original image data to obtain a second hand image; performing edge extraction processing on the first gesture image to obtain a first edge image, and performing edge extraction processing on the second gesture image to obtain a second edge image; and performing two-dimensional finger coordinate positioning on the hand of the user on the current page of the exercise teaching material by taking the first edge image and the second edge image as a basis to obtain two-dimensional finger positioning coordinates of the hand of the user; and converting the two-dimensional finger positioning coordinates into three-dimensional finger positioning coordinates, and obtaining the operation position of the hand of the user on the current page of the exercise teaching material according to the three-dimensional finger positioning coordinates.
9. The family education device of claim 6 or 7, further comprising:
the starting detection unit is used for detecting whether a question searching starting instruction is received or not before the shooting unit detects human infrared rays by using the human infrared ray transmitting device of the camera to obtain the original image data of the hands when the hands of the user operate on the current page of the exercise teaching material; after receiving the search question starting instruction, detecting whether question inquiry voice is received or not;
the shooting unit is used for utilizing the human infrared ray transmission device of the camera to detect human infrared rays so as to obtain the original image data of the hand when the hand of a user operates on the current page of the exercise teaching material, and the mode specifically comprises the following steps:
the shooting unit is used for identifying the hand of the user to operate on the current page of the exercise teaching material when the starting detection unit receives the question inquiry voice, and detecting the human infrared rays by using the human infrared ray transmitting device of the camera so as to obtain the original image data of the hand.
10. The home education device of claim 9, wherein the search unit is configured to search based on the teaching material content to obtain the reference answer specifically:
the searching unit is used for generating a target question aiming at the teaching material content according to the teaching material content and the question inquiry voice and searching a reference answer matched with the target question; and acquiring an output type of the reference answer, and outputting the reference answer in an output mode corresponding to the output type, wherein the output type comprises a voice type, a text type, a video type or an image type.
11. A family education device, comprising:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute a search method based on three-dimensional space positioning according to any one of claims 1-5.
12. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, wherein the computer program causes a computer to execute a search method based on three-dimensional spatial localization according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030731.3A CN109753554B (en) | 2019-01-14 | 2019-01-14 | Searching method based on three-dimensional space positioning and family education equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030731.3A CN109753554B (en) | 2019-01-14 | 2019-01-14 | Searching method based on three-dimensional space positioning and family education equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109753554A CN109753554A (en) | 2019-05-14 |
| CN109753554B true CN109753554B (en) | 2021-03-30 |
Family
ID=66405623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910030731.3A Active CN109753554B (en) | 2019-01-14 | 2019-01-14 | Searching method based on three-dimensional space positioning and family education equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109753554B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110969159B (en) * | 2019-11-08 | 2023-08-08 | 北京字节跳动网络技术有限公司 | Image recognition method and device and electronic equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201327424A (en) * | 2011-12-21 | 2013-07-01 | Tien-Hwa Ho | A method of finger-point image reading and cloud information recommended |
| CN103714345A (en) * | 2013-12-27 | 2014-04-09 | Tcl集团股份有限公司 | Method and system for detecting fingertip space position based on binocular stereoscopic vision |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| WO2016029581A1 (en) * | 2014-08-27 | 2016-03-03 | 华南理工大学 | Touch reading method and device based on visual gestures |
| CN106803864A (en) * | 2013-01-25 | 2017-06-06 | 陈旭 | Certain graphics context collection identifying device |
| CN108021320A (en) * | 2017-12-25 | 2018-05-11 | 广东小天才科技有限公司 | Electronic equipment and item searching method thereof |
| CN108305618A (en) * | 2018-01-17 | 2018-07-20 | 广东小天才科技有限公司 | Voice acquisition and search method, intelligent pen, search terminal and storage medium |
| CN108647354A (en) * | 2018-05-16 | 2018-10-12 | 广东小天才科技有限公司 | Tutoring learning method and lighting equipment |
| CN109189885A (en) * | 2018-08-31 | 2019-01-11 | 广东小天才科技有限公司 | Real-time control method based on intelligent equipment camera and intelligent equipment |
| CN109192204A (en) * | 2018-08-31 | 2019-01-11 | 广东小天才科技有限公司 | Voice control method based on intelligent equipment camera and intelligent equipment |
-
2019
- 2019-01-14 CN CN201910030731.3A patent/CN109753554B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201327424A (en) * | 2011-12-21 | 2013-07-01 | Tien-Hwa Ho | A method of finger-point image reading and cloud information recommended |
| CN106803864A (en) * | 2013-01-25 | 2017-06-06 | 陈旭 | Certain graphics context collection identifying device |
| CN103714345A (en) * | 2013-12-27 | 2014-04-09 | Tcl集团股份有限公司 | Method and system for detecting fingertip space position based on binocular stereoscopic vision |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| WO2016029581A1 (en) * | 2014-08-27 | 2016-03-03 | 华南理工大学 | Touch reading method and device based on visual gestures |
| CN108021320A (en) * | 2017-12-25 | 2018-05-11 | 广东小天才科技有限公司 | Electronic equipment and item searching method thereof |
| CN108305618A (en) * | 2018-01-17 | 2018-07-20 | 广东小天才科技有限公司 | Voice acquisition and search method, intelligent pen, search terminal and storage medium |
| CN108647354A (en) * | 2018-05-16 | 2018-10-12 | 广东小天才科技有限公司 | Tutoring learning method and lighting equipment |
| CN109189885A (en) * | 2018-08-31 | 2019-01-11 | 广东小天才科技有限公司 | Real-time control method based on intelligent equipment camera and intelligent equipment |
| CN109192204A (en) * | 2018-08-31 | 2019-01-11 | 广东小天才科技有限公司 | Voice control method based on intelligent equipment camera and intelligent equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109753554A (en) | 2019-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107422949B (en) | Projection touch image selection method | |
| US11579904B2 (en) | Learning data collection device, learning data collection system, and learning data collection method | |
| CN103824481B (en) | Method and device for detecting user recitation | |
| US8848088B2 (en) | Product identification using mobile device | |
| CN109376612B (en) | Method and system for assisting positioning learning based on gestures | |
| KR101929077B1 (en) | Image identificaiton method and image identification device | |
| US10564712B2 (en) | Information processing device, information processing method, and program | |
| US20130283202A1 (en) | User interface, apparatus and method for gesture recognition | |
| CN104102336A (en) | Portable device and method for providing non-contact interface | |
| KR101631011B1 (en) | Gesture recognition apparatus and control method of gesture recognition apparatus | |
| CN106020454B (en) | A kind of intelligent terminal touch screen operating method and system based on eye control technology | |
| CN111050017A (en) | Picture and text photographing equipment | |
| KR100692526B1 (en) | Gesture recognition apparatus and methods for automatic control of systems | |
| CN107977146B (en) | Mask-based question searching method and electronic equipment | |
| CN109753554B (en) | Searching method based on three-dimensional space positioning and family education equipment | |
| JP2014106597A (en) | Autonomous moving body, object information acquisition device, and object information acquisition method | |
| CN111160308A (en) | Gesture motion recognition method, device, equipment and readable storage medium | |
| CN111753715B (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium | |
| CN106951077B (en) | Prompting method and first electronic device | |
| CN112699796A (en) | Operation method and device of electronic equipment | |
| CN108280184B (en) | Test question extracting method and system based on intelligent pen and intelligent pen | |
| CN110765926A (en) | Drawing book identification method and device, electronic equipment and storage medium | |
| CN113093907B (en) | Man-machine interaction method, system, equipment and storage medium | |
| CN113158912B (en) | Gesture recognition method and device, storage medium and electronic equipment | |
| CN103984499A (en) | Action command control method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |