CN101799996A - Click-reading method of click-reading machine based on video image - Google Patents
Click-reading method of click-reading machine based on video image Download PDFInfo
- Publication number
- CN101799996A CN101799996A CN201010122524A CN201010122524A CN101799996A CN 101799996 A CN101799996 A CN 101799996A CN 201010122524 A CN201010122524 A CN 201010122524A CN 201010122524 A CN201010122524 A CN 201010122524A CN 101799996 A CN101799996 A CN 101799996A
- Authority
- CN
- China
- Prior art keywords
- click
- reading
- image
- books
- pen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a click-reading method of a click-reading machine based on a video image, which is characterized in that: the steps of the method are that: (1) real time obtain video images of a click-reading pen and a book by a video camera; (2) lightly click a switch by the pen point of the click-reading pen and input the image to a microprocessor; (3) carry out correction to the edge contour of the book; (4) build a book coordinate system; (5) obtain the rod type characteristic of the click-reading pen by utilizing a maximum connected domain method; (6) obtain the pen point location of the click-reading pen by utilizing a line scanning method according to the rod type characteristic of the click-reading pen; (7) mark the image coordinates by utilizing the length and width values of a known book and the pixel values of the length and the width of the book in the image; (8) calculate the pen point coordinates of the click-reading pen by utilizing the mark result in the book coordinate system; (9) realize the click-reading of the click-reading machine based on the video image. The invention has the advantages that: the click-reading function of the click-reading machine is realized by utilizing the video camera, the click-reading pen and the micro processor; the noise after the image binarization and the interference of other non-target object are effectively removed by utilizing the maximum connected domain method; the click-reading machine has the advantages of being simple and practical, being convenient to carry, having good generality and high click-reading precision.
Description
Technical field
The present invention relates to a kind of click-reading method of click-reading machine, relate in particular to a kind of click-reading method of click-reading machine based on video image.
Background technology
Point reader (is called the intelligent computer book reading machine again, the interactive electronics textbook of English, synchronous book reading machine, the mechanical, electrical philosophical works of English intelligence reading, electronics textbook etc.) be the study product of a kind of sound interaction of modern digital code information technology and up-to-date teaching demand perfect adaptation, it can become the books teaching material of literalization the Sound teaching material that can need any sounding by study.
In recent years, point reader has entered the home market rapidly, develops into one of main aid of domestic and international children's study.At present popular point reader adopts pressure sensitive method acquisition point coordinate reading, realizes the reading function.Its reading principle is: the pressure transducer of placing dot matrix way in the pressure sensitive panel, utilize horizontal ordinate and ordinate method for scanning to obtain the position (being x and y coordinate figure) of talking pen reading on the pressure sensitive panel, microprocessor receives a little and reads instruction, and reading coordinate conversion on the pressure sensitive panel become corresponding books coordinate, read corresponding voice document, realized the reading function.Adopt the point reader of pressure sensitive method, have the reading advantage of high precision, but since its pressure sensitive panel need the plastic casing protection and hold the books of all size, thereby bulky, Heavy Weight, carry inconvenience; The point reader that different manufacturers is produced, even the point reader of same producer different model all need special-purpose pressure sensitive panel, and versatility is poor.
Summary of the invention
The object of the present invention is to provide a kind of click-reading method of click-reading machine based on video image, this reading method is simple and practical, easy to carry, versatility is good, and has higher reading precision.
The present invention is achieved like this, and it is characterized in that method step is:
(1) obtains the video image of talking pen and books in real time with video frequency pick-up head;
(2) utilize the nib touch-switch of talking pen, trigger microprocessor and catch single-frame images, and this image is input in the microprocessor;
(3) utilize edge detection operator and thresholding method with image binaryzation earlier, adopt image expansion, image burn into image filtering and largest connected territory method to get rid of the interference of non-target object again, accurately extract the edge contour of books, and the books edge contour is proofreaied and correct;
(4) utilize the books edge contour to obtain the pixel value of books length and width, and set up the books coordinate system;
(5) earlier according to the colouring information of talking pen, utilize thresholding method, adopt largest connected territory method to obtain the shaft-like feature of talking pen again image binaryzation;
(6), utilize the line scanning method to obtain the pen tip position of talking pen according to the shaft-like feature of talking pen;
(7) utilize the pixel value of books length and width in the length and width value of known books and the image, image coordinate is demarcated;
(8) under the books coordinate system, utilize calibration result to calculate the nib coordinate of talking pen;
(9) according to the coordinate figure of nib under the books coordinate system, access corresponding voice messaging, thereby realized point reader reading based on video image.
Utilize video frequency pick-up head, talking pen and microprocessor to realize the reading function of point reader.
Described talking pen has the penholder of special color, and nib has touch-switch, can produce signal during switch triggering and also can be discerned and receive by microprocessor.
Principle is: utilize video frequency pick-up head to obtain the video image of talking pen and books in real time; Utilize Image Edge-Detection operator and thresholding method with image binaryzation, the books edge contour is split from background, for accurately extracting the books edge contour, adopt image expansion and burn into image filtering and largest connected territory method to eliminate background and noise; Adopt least square fitting method to obtain the coboundary straight line of books, calculate the coboundary straight line of books and the angle of horizontal direction, and utilize this angle to proofread and correct the books edge contour; On this basis, utilize least square fitting method to obtain the edge line of books again, and set up the books coordinate system; Special colouring information according to talking pen utilizes thresholding method with image binaryzation, and adopts largest connected territory method to extract the position of profile and definite its nib of talking pen; Utilize the pixel value of books length and width in the length and width value of known books and the image, image coordinate is demarcated; Utilize calibration result to calculate the nib coordinate of talking pen, the coordinate figure of nib under the books coordinate system according to talking pen accesses corresponding voice messaging, realizes the point reader reading based on video image.
Advantage of the present invention is: utilize largest connected territory method effectively to get rid of the interference of the noise behind the image binaryzation and other non-target objects; Utilize least square fitting method to obtain the edge line equation of books, accurately detect the edge contour of books; Utilize the special color of talking pen accurately to obtain the shaft-like feature of talking pen; Adopt said method to improve the reading precision, utilize video frequency pick-up head, talking pen and microprocessor realization point reader reading function based on video image.Therefore, based on the point reader of video image have simple and practical, easy to carry, versatility is good, the reading advantage of high precision.
Description of drawings
Fig. 1 is a workflow diagram of the present invention.
Embodiment
The inventive method requires to support common wide-angle imaging head with simple beam and enables vertical shooting, have only single books in the scene of taking, and can comprise whole book fully, background in the scene is common any monochromatic desktop, talking pen in the scene is that pure color and nib have touch-switch, microprocessor can receive the signal that produces when the nib touch-switch triggers, and the control camera obtains image.Simultaneously, the actual length and width of books should be known.
The present invention adopts the process flow diagram based on the click-reading method of click-reading machine of video image as shown in Figure 1, carries out the some reading location of point reader and accurately measures and read corresponding voice, and its concrete implementation step is as follows:
1, video image obtains in real time
The camera that will have support is placed on the correct position in books dead ahead, obtains the video image of talking pen and books in real time.
2, whether the nib touch-switch triggers
Judge whether the nib exploitation triggers, if trigger, then microprocessor is carried out the single-frame images collection of talking pen and books, otherwise, wait for reading.
3, single-frame images collection
When the talking pen reading, the touch-switch on the nib triggers, and produce signal and import microprocessor into, control camera collection single-frame images data, and in the input microprocessor.
4, the profile of books extracts and proofreaies and correct
The single-frame images that the 3rd step was obtained carries out the edge contour extraction and the correction of books, and its key step is as follows:
1) utilize edge detection operator to extract the marginal information of books, wherein edge detection operator can be used Canny, Robert or Sobel.
2) adopt threshold method that image is carried out binaryzation, and adopt image expansion, image burn into image filtering and largest connected territory method to get rid of the interference of non-target object, accurately extract the edge contour of books.
3) adopt vertical scanning method and twice least square fitting method to obtain the coboundary straight line of books after, calculate the angle α of this straight line and horizontal direction, with the image α angle that turns clockwise, finished the correction of image.
Twice least square fitting method is as follows:
At first, the coboundary point set of books is carried out first time least square fitting method obtain the coboundary straight-line equation, secondly, calculation level concentrates at every to the distance of this straight line and by ordering from small to large, remove point set middle distance 1/2nd point far away, got rid of the influence of noise spot, last, utilize the concentrated remaining point of this point to carry out second time least square fitting method and obtain the coboundary straight line.
5, the foundation of books coordinate system
Utilize corrected books edge contour image of the 4th step, the key step of setting up the books coordinate system is as follows:
1) utilizes books summit branch to be clipped to the shortest feature of respective image vertex distance, determine upper left and upper right two vertex positions of books, and calculate the pixel value of books length of upper edge, be the long pixel value of books.
2) utilize the books coboundary straight-line equation of books left upper apex position and the acquisition of the 4th step, and utilize the books coboundary feature vertical, calculate books left hand edge straight-line equation with left hand edge.
3) pixel value of known books length and width value and the books length of upper edge that obtains calculates the pixel value of books lower-left vertex position and left hand edge length, is the wide pixel value of books.
4) with the left upper apex being initial point, is coordinate system x axle and y axle with books coboundary straight line and left hand edge straight line respectively, sets up the books coordinate system.
6, the shaft-like feature extraction of talking pen and pen tip position thereof are determined
The present invention utilizes the shaft-like feature of the special color extracting talking pen of talking pen, and obtains its pen tip position with scanning method, and its key step is as follows:
1) utilizes the redness (or blueness, green etc.) of talking pen, and the edge contour of talking pen is separated from image with thresholding method.
2) adopt largest connected territory method to remove other and disturb, extract the shaft-like feature of talking pen.
3) adopt the line scanning method to obtain pen tip position, if the right hand is held talking pen, then the pen tip position of talking pen is obtained in scanning from left to right; If left hand is held talking pen, then the pen tip position of talking pen is obtained in scanning from right to left.
7, the nib coordinate Calculation of image coordinate demarcation and talking pen
Utilize the pixel value of books length and width in the length and width value of known books and the image, image coordinate is demarcated, promptly obtain the pairing actual coordinate value of each pixel in the image.Utilize the pen tip position of calibration result and the acquisition of the 6th step, calculate the nib coordinate of talking pen.
8, reading function realizes
Nib coordinate according to talking pen accesses corresponding voice messaging, has realized the point reader reading function based on video image.
Claims (3)
1. click-reading method of click-reading machine based on video image is characterized in that method step is:
(1) obtains the video image of talking pen and books in real time with video frequency pick-up head;
(2) utilize the nib touch-switch of talking pen, trigger microprocessor and catch single-frame images, and this image is input in the microprocessor;
(3) utilize edge detection operator and thresholding method with image binaryzation earlier, adopt image expansion, image burn into image filtering and largest connected territory method to get rid of the interference of non-target object again, accurately extract the edge contour of books, and the books edge contour is proofreaied and correct;
(4) utilize the books edge contour to obtain the pixel value of books length and width, and set up the books coordinate system;
(5) earlier according to the colouring information of talking pen, utilize thresholding method, adopt largest connected territory method to obtain the shaft-like feature of talking pen again image binaryzation;
(6), utilize the line scanning method to obtain the pen tip position of talking pen according to the shaft-like feature of talking pen;
(7) utilize the pixel value of books length and width in the length and width value of known books and the image, image coordinate is demarcated;
(8) under the books coordinate system, utilize calibration result to calculate the nib coordinate of talking pen;
(9) according to the coordinate figure of nib under the books coordinate system, access corresponding voice messaging, thereby realized point reader reading based on video image.
2. a kind of click-reading method of click-reading machine based on video image according to claim 1 is characterized in that: utilize video frequency pick-up head, talking pen and microprocessor to realize the reading function of point reader.
3. a kind of click-reading method of click-reading machine based on video image according to claim 1 is characterized in that described talking pen has the penholder of special color, and nib has touch-switch, can produce signal during switch triggering and also can be discerned and receive by microprocessor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010122524 CN101799996B (en) | 2010-03-11 | 2010-03-11 | Click-reading method of click-reading machine based on video image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010122524 CN101799996B (en) | 2010-03-11 | 2010-03-11 | Click-reading method of click-reading machine based on video image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101799996A true CN101799996A (en) | 2010-08-11 |
| CN101799996B CN101799996B (en) | 2013-04-10 |
Family
ID=42595664
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010122524 Expired - Fee Related CN101799996B (en) | 2010-03-11 | 2010-03-11 | Click-reading method of click-reading machine based on video image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101799996B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390163A (en) * | 2012-05-10 | 2013-11-13 | 中邮科技有限责任公司 | Letter address automatic-collection method |
| CN104050838A (en) * | 2014-07-15 | 2014-09-17 | 北京网梯科技发展有限公司 | Reading system, device and method capable of recognizing and reading common printed matter |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| CN104217197A (en) * | 2014-08-27 | 2014-12-17 | 华南理工大学 | Touch reading method and device based on visual gestures |
| CN104766501A (en) * | 2015-04-09 | 2015-07-08 | 广东小天才科技有限公司 | Clicking and reading machine and coordinate correction method thereof |
| CN104835361A (en) * | 2014-02-10 | 2015-08-12 | 陈旭 | Electronic dictionary |
| CN107066919A (en) * | 2016-12-21 | 2017-08-18 | 网易（杭州）网络有限公司 | Pen tip position method for solving, equipment and computer-readable recording medium |
| CN107765978A (en) * | 2017-09-26 | 2018-03-06 | 张超 | A kind of method and recognizing apparatus for object top layer marker location information |
| CN109360454A (en) * | 2018-09-30 | 2019-02-19 | 与德科技有限公司 | A kind of reading method |
| CN109545006A (en) * | 2018-12-29 | 2019-03-29 | 钟意 | A kind of new teaching electronic reader |
| CN110767000A (en) * | 2019-10-28 | 2020-02-07 | 安徽信捷智能科技有限公司 | Children's course synchronizer based on image recognition |
| CN111078083A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Method for determining click-to-read content and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050018904A1 (en) * | 2003-07-22 | 2005-01-27 | Jason Davis | Methods for finding and characterizing a deformed pattern in an image |
| US20050053304A1 (en) * | 2001-11-15 | 2005-03-10 | Bernhard Frei | Method and device for the correction of a scanned image |
| CN201159944Y (en) * | 2008-03-06 | 2008-12-03 | 东莞市步步高教育电子产品有限公司 | Point reading machine |
| CN201194112Y (en) * | 2008-05-12 | 2009-02-11 | 刘建生 | Video shooting type multifunctional click-to-read machine |
| CN201345173Y (en) * | 2009-02-05 | 2009-11-11 | 刘建生 | Point reading and learning machine based on optical identification |
-
2010
- 2010-03-11 CN CN 201010122524 patent/CN101799996B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050053304A1 (en) * | 2001-11-15 | 2005-03-10 | Bernhard Frei | Method and device for the correction of a scanned image |
| US20050018904A1 (en) * | 2003-07-22 | 2005-01-27 | Jason Davis | Methods for finding and characterizing a deformed pattern in an image |
| CN201159944Y (en) * | 2008-03-06 | 2008-12-03 | 东莞市步步高教育电子产品有限公司 | Point reading machine |
| CN201194112Y (en) * | 2008-05-12 | 2009-02-11 | 刘建生 | Video shooting type multifunctional click-to-read machine |
| CN201345173Y (en) * | 2009-02-05 | 2009-11-11 | 刘建生 | Point reading and learning machine based on optical identification |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390163A (en) * | 2012-05-10 | 2013-11-13 | 中邮科技有限责任公司 | Letter address automatic-collection method |
| CN103390163B (en) * | 2012-05-10 | 2016-12-14 | 中邮科技有限责任公司 | A kind of Post address automatic acquiring method |
| CN104835361A (en) * | 2014-02-10 | 2015-08-12 | 陈旭 | Electronic dictionary |
| CN104050838A (en) * | 2014-07-15 | 2014-09-17 | 北京网梯科技发展有限公司 | Reading system, device and method capable of recognizing and reading common printed matter |
| CN104050838B (en) * | 2014-07-15 | 2016-06-08 | 北京网梯科技发展有限公司 | A kind of point-of-reading system, equipment and method that can identify the common printed thing with reading |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| CN104157171B (en) * | 2014-08-13 | 2016-11-09 | 三星电子（中国）研发中心 | A kind of point-of-reading system and method thereof |
| CN104217197B (en) * | 2014-08-27 | 2018-04-13 | 华南理工大学 | A kind of reading method and device of view-based access control model gesture |
| CN104217197A (en) * | 2014-08-27 | 2014-12-17 | 华南理工大学 | Touch reading method and device based on visual gestures |
| CN104766501A (en) * | 2015-04-09 | 2015-07-08 | 广东小天才科技有限公司 | Clicking and reading machine and coordinate correction method thereof |
| CN107066919A (en) * | 2016-12-21 | 2017-08-18 | 网易（杭州）网络有限公司 | Pen tip position method for solving, equipment and computer-readable recording medium |
| CN107765978A (en) * | 2017-09-26 | 2018-03-06 | 张超 | A kind of method and recognizing apparatus for object top layer marker location information |
| CN109360454A (en) * | 2018-09-30 | 2019-02-19 | 与德科技有限公司 | A kind of reading method |
| CN109545006A (en) * | 2018-12-29 | 2019-03-29 | 钟意 | A kind of new teaching electronic reader |
| CN111078083A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Method for determining click-to-read content and electronic equipment |
| CN110767000A (en) * | 2019-10-28 | 2020-02-07 | 安徽信捷智能科技有限公司 | Children's course synchronizer based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101799996B (en) | 2013-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101799996B (en) | Click-reading method of click-reading machine based on video image | |
| CN102902355B (en) | The space interaction method of mobile device | |
| CN103198477B (en) | Apple fruitlet bagging robot visual positioning method | |
| CN106934351B (en) | Gesture recognition method and device and electronic equipment | |
| CN106384355B (en) | A kind of automatic calibration method in projection interactive system | |
| CN106204633B (en) | Student tracking method and device based on computer vision | |
| CN103886107A (en) | Robot locating and map building system based on ceiling image information | |
| CN104700385B (en) | The binocular visual positioning device realized based on FPGA | |
| CN104050838A (en) | Reading system, device and method capable of recognizing and reading common printed matter | |
| CN105120172A (en) | Photographing method for front and rear cameras of mobile terminal and mobile terminal | |
| CN104460951A (en) | Human-computer interaction method | |
| CN103942843A (en) | Fairway and ship three-dimensional model dynamic presenting method based on video | |
| CN104517101A (en) | Game poker card recognition method based on pixel square difference matching | |
| CN101188020A (en) | Method for precisely getting pixel geometric location mapping relation between projector image and computer frame buffer image | |
| CN103197774A (en) | Method and system for mapping application track of emission light source motion track | |
| CN102890826A (en) | Method for resetting scan edition document | |
| CN104539890A (en) | Target tracking method and system | |
| Shibo et al. | A new approach to calibrate range image and color image from Kinect | |
| CN105809664A (en) | Method and device for generating three-dimensional image | |
| CN104731372A (en) | Mouse cursor pointing direction control method, mouse cursor pointing direction control device and mouse cursor pointing direction control system | |
| CN102023759B (en) | Writing and locating method of active pen | |
| Su et al. | Virtual keyboard: A human-computer interaction device based on laser and image processing | |
| CN101980299B (en) | Chessboard calibration-based camera mapping method | |
| JP2015035799A (en) | Information processing apparatus, imaging apparatus, information processing system, information processing method, and program | |
| CN108521594B (en) | Free viewpoint video playing method based on motion sensing camera gesture recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130410 Termination date: 20150311 |
|
| EXPY | Termination of patent right or utility model |