CN108062886A - Braille point interactive mode mask method and system - Google Patents
Braille point interactive mode mask method and system Download PDFInfo
- Publication number
- CN108062886A CN108062886A CN201711070494.0A CN201711070494A CN108062886A CN 108062886 A CN108062886 A CN 108062886A CN 201711070494 A CN201711070494 A CN 201711070494A CN 108062886 A CN108062886 A CN 108062886A
- Authority
- CN
- China
- Prior art keywords
- braille
- point
- mark
- interactive
- digitized image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to a kind of braille point interactive mode mask method and system, including：The digitized image of paper mold braille is obtained using collecting device；The digitized image is displayed on the screen；It puts in the braille orientation that some braille is chosen on the digitized image by interactive device；By belong to put in the braille orientation braille side mark be displayed on the screen；It is labeled by interactive device for the braille point in braille side mark, and real-time display has marked the braille point of completion on the screen；The mobile braille orientation is put to the braille orientation of next braille side or the next braille of selection and is put, until completing mark to whole braille points in the digitized image.Thus the present invention, which is used, interacts the digitized image in units of braille side formula braille point mark, improves annotating efficiency.
Description
Technical field
The present invention relates to brailles to mark field, more particularly to a kind of braille point interactive mode mask method and system.
Background technology
For personage with visual disabilities due to dysopia, no image of Buddha person of good sense equally obtains cleartext information, mainly blind by touching
Literary braille symbol obtains information to read braille.Braille is made of braille side, each braille Fang Youliu points composition, left side is from upper
It is 123 under, a side, i.e. braille side herein are in right side 456.The braille books quantity to circulate at present is also less, can not
Meet the reading requirement of friend blind person.On the other hand, braille library classical collection valuable braille books of many early stages and text
It offers, digital information of these books due to lacking braille, the labor expense for causing second edition.Moreover, it is led in special education
Domain, the establishment of blind raw paper and gos over examination papers or by the way of braille teacher's manual translation, and time and effort consuming lacks objectivity.Cause
This, for the Braille of papery braille image detects and identification technology is of great significance automatically.And in order to test braille point
The detection performance of word detection method obtains the Braille image pattern for being used for machine learning, is required for braille image
In braille click through pedestrian work mark.
Braille is commonly called as " braille " or " type ", is invented by Frenchman Louis Blair in 1824, is that a kind of rely on is touched
Feel the word perceived.One page of braille books probably has 1000 to 2000 braille salient points.The basic composition unit of braille is blind
Whether square or blind symbol, each blind side have 6 point positions, are distributed on the matrix of three rows two row, convex according to having on corresponding point position
It puts to represent different blind sides.Blind root is according to " national braille standard ", and according to certain side away from being arranged with line-spacing, composition is blind
Text.
In order to save paper, generally using dual-sided printing mode, i.e., the braille image that we obtain contains braille books
The salient point region of current page, and include pit area.Salient point and pit area have certain inconsistent phenomenon, but two-sided blind
The braille close quarters of text, salient point and concave point are often interleaved together, and cause the image of Braille is apparent diversity spy is presented
Point, the mode of appearance of sags and crests can also occur greatly to change, this to the artificial mark band of two-sided braille come it is greatly difficult and
Challenge, label time cost is very high, and easily since the fatigue of people causes marking error.
The content of the invention
In order to solve the above-mentioned inadequate robust of paper mold braille identification technology, speed is slower, can not adapt to various braille printing
The problem of form and acquisition geometry, the present invention propose a kind of braille point interactive mode mask method and system.
Specifically, the invention discloses a kind of braille point interactive mode mask method, including：
Step 1, the digitized image that paper mold braille is obtained using collecting device；
Step 2 interacts the digitized image in units of braille side formula braille point mark；
Wherein the step 2 includes：
The digitized image is displayed on the screen by step 21；
Step 22, the braille orientation for choosing some braille on the digitized image by interactive device are put；
Step 23, by belong to put in the braille orientation braille side mark be displayed on the screen；
Step 24 is labeled by interactive device for the braille point in braille side mark, and aobvious in real time on the screen
Show the braille point for having marked completion；
Step 25, the mobile braille orientation put to next braille side or perform the step 22 and choose next braille
Braille orientation is put, and repeats the step 23 until completing mark to whole braille points in the digitized image.
The braille point interactive mode mask method, the collecting device includes scanner, video camera or braille figure wherein in step 1
As acquisition instrument；The paper mold braille includes salient point and/or the braille point of concave point form.
The braille point interactive mode mask method, wherein the braille side are identified as the corresponding 6 brailles point in braille side or braille
Corresponding " day " the font grid in side, each crosspoint for being somebody's turn to do " day " font grid represent a braille point position.
The braille point interactive mode mask method, wherein the resolution according to Chinese braille normalized written and the digitized image
Rate determines the dimension scale of the spacing or " day " font grid between the corresponding 6 brailles point in braille side.
The braille point interactive mode mask method, the wherein interactive device include keyboard, mouse, Trackpad.
The invention also provides a kind of braille point Interactive Marking System, including：
Acquisition module, for obtaining the digitized image of paper mold braille by collecting device；
Labeling module, for interacting formula braille point mark to the digitized image in units of braille side；
Wherein the labeling module includes：
Braille side chooses module, which is displayed on the screen, and passes through interactive device in the digitlization
It puts in the braille orientation that some braille is chosen on image；
Display module being displayed on the screen for will belong to the braille side put in braille orientation mark, passing through interactive device
It is labeled for the braille point in braille side mark, and real-time display has marked the braille point of completion on the screen；It is mobile to be somebody's turn to do
Braille orientation puts to next braille side or performs the step 22 and choose the braille orientation of next braille and put, and repeats this
Step 23 to whole braille points in the digitized image until completing mark.
The braille point Interactive Marking System, the wherein collecting device include scanner, video camera or braille Image Acquisition
Instrument；The paper mold braille includes salient point and/or the braille point of concave point form.
The braille point Interactive Marking System, wherein the braille side are identified as the corresponding 6 brailles point in braille side or braille
Corresponding " day " the font grid in side, each crosspoint for being somebody's turn to do " day " font grid represent a braille point position.
The braille point Interactive Marking System, wherein the resolution according to Chinese braille normalized written and the digitized image
Rate determines the dimension scale of the spacing or " day " font grid between the corresponding 6 brailles point in braille side.
The braille point Interactive Marking System, the wherein interactive device include keyboard, mouse, Trackpad.
Thus the present invention, which is used, interacts the digitized image in units of braille side formula braille point mark, improves
Annotating efficiency.
Description of the drawings
Fig. 1 is two-sided braille image sectional drawing；
Fig. 2 is to show that braille side corresponds to the schematic diagram of braille point position on the screen in dots；
Fig. 3 is to show that braille side corresponds to the schematic diagram of braille point position on the screen in the form of the crosspoint of " day " word；
Fig. 4 is the braille side's schematic diagram for having marked completion；
Fig. 5 is the schematic diagram that selection braille side is deleted；
Fig. 6 is the annotation results displaying figure of salient point and concave point；
Fig. 7 is the salient point testing result displaying figure based on cascade classifier；
Fig. 8 is braille side's positioning result schematic diagram；
Fig. 9 is initial computer braille point testing result figure；
Figure 10 is key step block diagram of the present invention.
Specific embodiment
For allow the present invention features described above and effect can illustrate more clearly understandable, special embodiment below simultaneously coordinates explanation
Book attached drawing is described in detail below.Wherein it should be noted that although attached drawing of the present invention is gray scale picture, in practical operation
Display is all coloured image.
As shown in Figure 10, the present invention includes, step 1, braille Image Acquisition：
The digitized image of paper mold braille is obtained using collecting device.Acquisition mode can include scanner scanning, camera shooting
Machine is taken pictures or the modes such as special braille Image Acquisition instrument.The paper mold braille includes salient point and/or the braille of concave point form
Point, paper mold braille can include braille books, and either braille paper etc. can be printed on one side or the braille of printed on both sides.It is single
For every page of the braille of face printing only comprising salient point or a form of braille point of concave point, every page of the braille of printed on both sides includes salient point
With the braille point of two kinds of forms of concave point.For example, Fig. 1 shows the sectional drawing of the two-sided braille image obtained using scanner scanning,
Existing salient point has concave point again, in word compact district, together with salient point and concave point interact.
Step 2, the interactive mark of braille point：
Formula braille point mark is interacted to the digitized image in units of braille side, is comprised the following steps：
Step 21, using the digitized image as braille image display to be marked on the screen.For example, Fig. 1 is shown
The sectional drawing of one braille image.
Step 22, put by the braille orientation that some braille is chosen on the digitized image of interactive device, example
The upper left corner of braille side is such as clicked on by interactive device mouse to determine that the braille orientation is put.
Step 23, by belong to put in the braille orientation braille side mark be displayed on the screen.Wherein braille side, which identifies, to be
Corresponding " day " the font grid of the corresponding 6 brailles point in braille side or braille side, for example, selected braille side is corresponding
6 braille point position displays on the screen, directly can show braille side (as shown in Fig. 2, wherein braille side using 6 points
Corresponding braille point position is with light grey point identification), it can also represent that braille side identifies (such as Fig. 3 using " day " font grid
Shown, the wherein corresponding braille point position in braille side is identified with light grey rectangle frame), each crosspoint represents a braille point position
It puts.Braille side identifies corresponding braille point pitch information, may be referred to the resolution of Chinese braille normalized written and scan image
Rate size obtains braille point spacing, braille side's spacing and line spacing information in advance by the method for statistics.And it is clicking above
During braille side, mark salient point braille side or concave point braille side can be distinguished by mouse shortcuts, such as click on a mouse left side
Key represents mark salient point braille side, clicks on right mouse button and represents mark concave point braille side；Can braille be carried out by keyboard shortcut
Orientation is put, the fine tuning of size, so as to more accurately matching braille image on some braille side, such as by " I ", " K ",
" J ", " L " put in four keys progress braille orientation fine tuning up and down, and a mobile pixel or multiple pixels, specific to move every time
Dynamic pixel number class is determined according to the resolution ratio of Image Acquisition.
Step 24, (filling) is labeled for the braille point in braille side mark by interactive device, and on the screen
The braille point that real-time display has had been filled with.It is, for example, that keyboard shortcut carries out braille side with interactive device exemplified by marking salient point
The Fast Filling of interior braille point, and the salient point that real-time display has had been filled on the screen.The mask method of concave point braille side is similar.
For example, being required according to Chinese braille, three, " day " word left side point represents 1,2,3, and three, the right point represents 4,5,6.In actual mark
During note, the number key of keypad can be used, only select the number for having salient point on some position.If for example, in the braille side only
There is 1,2,5 three position to have salient point, then select 1,2,5 three key that filling out for braille side's salient point can be completed merely with number key
It fills.It shows the salient point having had been filled on the screen simultaneously, is identified for example with black color dots.Fig. 4 shows a mark
Good braille side, such as the stain information of left side braille side, 6, right side Grey Point is that the next braille orientation being moved to is put.
Step 25, after which has marked, shortcut may be employed and carry out the movement that braille orientation is put, be moved to down
It puts in one braille orientation.Since the arrangement of Chinese braille has followed national standard, braille side's line space and column pitch have fixed
Scope can combine the resolution ratio of braille Image Acquisition, count corresponding braille side's line space and row in the braille image in advance
Spacing, the movement of convenient procession direct in interactive operation.For example, using " up and down " directionkeys on keyboard into
The single step movement that row braille orientation is put, each displacement distance, which can shift to an earlier date, to be counted and is determined according to braille image.It can also
Using step 22, the mode directly clicked chooses next braille side for needing to mark.Here shortcut can also further be used
The position of braille side is finely tuned, method is same as above step 23, and shows braille side on the screen.
The modification of information can also be labeled to the braille side of selection.Such as the braille side marked has been selected,
It can again be marked again through digital shortcut keys.
Braille side can also be deleted.For example, as shown in figure 5, the mode of rectangle frame is drawn on the screen using mouse to draw a circle to approve
A certain braille side region carries out the deletion of braille side by shortcut, such as DEL.Or a certain braille side is directly clicked, using Del
Keys is waited to carry out the deletion of braille side's markup information.
Step 22 is repeated, to step 25, completes to mark whole the interactive of braille image braille point.During actual mark,
It can only mark that salient point either only marks concave point or salient point and concave point is all labeled as needed.The different face of Fig. 6
Color information illustrates the annotation results of salient point and concave point, and bumps use black, and concave point is using white.
After mark terminates, the markup information of the braille image is preserved by shortcut.For example, clicking on, " " key is labeled S
The preservation of information in the form of braille side, preserves braille side's location information and the location information of braille point of filling etc..
The experiment effect of the present invention.If carrying out mouse according to salient point to be marked one by one, a braille image is completed
Mark probably need more than 2 hours.And employ based on braille side and combine the quick mask method of number key, mark one
Image drastically increased the efficiency manually marked within 10 minutes.Other optional mask methods have, direct interaction formula
On braille image, bump location is selected using mouse.
Special act following embodiment of the invention, further carries out expansion description to above steps in detail.
The present invention further includes in addition to above-mentioned steps：
Step 3 braille point quickly detects, the correction of step 4 braille image wing drop, step 5 braille side adaptive location,
Step 6 braille point area of computer aided is marked to be identified with step 7 high-precision braille point and braille side.
Step 3 braille point quickly detects, it is proposed that the braille point rapid detection method based on cascade classifier, including：
Step S1, based on above step 1 and step 2, the markup information of braille image has been obtained, the position letter comprising salient point
Breath.The present invention below will be by taking salient point detects as an example, and the detection method of concave point is similar.
Step S2, using markup information, interception image obtains positive negative sample.Such as centered on the salient point of mark around
Area image as positive example sample, an equal amount of background and pit area are as negative data.
Step S3, the feature vector of sample, training grader are extracted.The small bauds of Haar of sample can preferably be extracted
Sign, training Adaboost cascade classifiers.On braille image to be detected, using sliding window mode, scheme in extraction window
The individual features of picture, such as haar features, be made whether using trained Adaboost graders be salient point discriminant classification.
Step S4, the bump location information of Preliminary detection can be obtained by step S1 and step S2, preserves entire braille
The salient point information of image.Such as save file name and corresponding salient point coordinate information.What the present invention was obtained for scanner
The braille image of 200dpi, using the method for preferred Haar+Adaboost, one image of detection is within 0.5 second.It is convex simultaneously
The average recognition accuracy of point reaches 99.74%, recall rate 94.01%.Fig. 7 illustrates one using cascade classifier detection
Salient point recognition result.
Other optional schemes can extract the gray feature of sample either HOG direction histograms feature or LBP bis-
It is worth the feature vectors such as textural characteristics, the training graders such as SVM or random forest equally carry out salient point using sliding window mode
Detection.
Braille point can be carried out the segmentation of foreground and background by other optional modes by image partition method, so as to
Obtain braille point position.If salient point or concave point information that one-sided image can be arrived directly.If dual-side image, need
Salient point or concave point further are distinguished using feature, so as to obtain the bump location information on braille image.
Step 4 braille image slant correction.Braille tilts may be there are two types of situation, and one kind is since gatherer process is made
Into, such as the placement inclination of braille paper, one kind is that braille is inherently inclined when printing in the early stage, causes braille corresponding
Braille side's row and column is not horizontal and vertical, carrys out very big error for later stage braille side's positioning and mark band.Therefore need first
Carry out braille image slant correction.It is as follows：
Step S5, based on steps 1 and 2,3, the bump location information in braille image has been obtained.
Step S6, preferably, first with the bump location information being previously obtained by salient point and background binary.For example,
It is replaced in bump location using the small square of a black, background etc. is then set to complete white.Or it is represented using the dot of black
Salient point, background are set to complete white.
Step S7, by the binary image with 1 ° for interval, multiple rotary is carried out, counts floor projection row after rotation every time
Pixel value and the line number and vertical projection row pixel that are 0 and the columns summation for being 0.Blank line columns more at most means the rotation
The maximum corresponding rotation angle of blank line columns summation is denoted as α ° by angle closer to true slope angle.For example, from -5 ° to
5 ° of progress multiple rotaries.
Step S8, newer angle in order to obtain, the binary image obtained by spin step S7 again, between being with 0.1 °
Every from (α -0.5) ° to (α+0.5) ° carries out multiple rotary.It is with the method for step S7, projection blank line columns summation maximum is right
The rotation angle answered is denoted as β °.
Step S9, angle beta ° is obtained braille image inclination angle, and the former braille image of negative direction rotation can obtain
Braille image after correction.
By rotation image above from thick to thin, the angle of inclination of image can be quickly obtained, error is fine to
0.1°。
Other optional sloped correcting methods include, and are placed on braille image or paste a black rectangle frame, it is assumed that
The horizontal line and vertical curve of the box are parallel with the row and column of braille side, and the inclination of braille image is carried out by correcting the rectangle frame
Correction.
Other optional sloped correcting methods include, then extract the salient point on upper braille image border, use least square
Method fitting a straight line is come into line tilt correction.Optionally in addition, the first row salient point for marking out certain braille side's row of man-machine interactively formula
Position or other with the bump location of a line, using the mode of fitting a straight line, the angle of inclination of straight line is obtained, so as to
Carry out braille image slant correction.
Other optional sloped correcting methods include, and detect the paper edge straight line of braille image, utilize the inclination of straight line
To correct braille image.
Step 5, braille side's adaptive location.The positioning of braille side is the committed step of braille identification.Existing braille Fang Ding
Position algorithm utilizes rule and method mostly, it is believed that ten sectional specification of arrangement of braille side's ranks line is using braille side's grid of standard
The positioning of braille side can be achieved.It is but blind in actual treatment braille image it was found that due to production technology, scanning device etc.
The arrangement of braille side's ranks line is there is slight error in texts and pictures picture, and braille side's line-spacing, side are away from also not fully consistent.Specific step
It is rapid as follows：
Step S10, it is preferred, after Preliminary detection result and slant correction that salient point is obtained using steps 1 and 2,3,4
Braille image.Or utilize traditional image partition method, obtain salient point testing result and slant correction after braille figure
Picture.
Step S11, for the image after slant correction, the characteristics of being arranged using three row two of braille side, to bump location information
The cluster of ordinate is carried out, the close braille point of salient point ordinate is divided into one group, its ordinate is asked to be worth to a plurality of pre-
Select the position of the horizontal line in braille side.
Step S12, standard compliant three horizontal lines are found out from top to bottom, i.e., distance accords between adjacent two horizontal lines
Close braille side's point in statistical information away from scope, braille side's grid of an acquiescence is generated if it can not find, algorithm terminates.
Step S13, if it is found, then since this three horizontal line positions, according to the obtained braille side's point of statistics away from,
The information such as line-spacing difference is expanded upwards, downwards, and is generated during expanding using one group of three horizontal line of newest expansion as base
Standard, while the horizontal line of positional fault is rejected until reaching braille image both ends, you can obtain multigroup one group of three horizontal lines
Braille side's horizontal line.
Step S14, it can obtain braille side's vertical curve of multigroup one group of two vertical curves with the above method.
Step S15, the crosspoint of three horizontal lines and two vertical curves is braille point position that may be present in every group,
Six crosspoints form a braille side, ultimately generate entire braille side's grid.
The braille side's locating effect obtained according to above-mentioned algorithm is as shown in Figure 8, it is seen that is carried out on the basis of salient point detection blind
Text side positions, and eliminates the influence that concave point is brought, and the fast robustness of algorithm speed is high.
Step 6, braille point area of computer aided mark.When needing to mark new books printed in braille or braille paper.
If we have had the grader of a braille point detection, which can aid in us to carry out the fast of new braille image
Speed mark, i.e., be first labeled by machine, be manually modified again, so as to promote annotating efficiency, reduces the manually mark amount of labour.
It is as follows.
Step S16, based on above step 1,2,3,4,5, the salient point testing result that there is braille side to position is obtained.Such as Fig. 9
It is shown, which is displayed on the screen.
Step S17, being clicked using mouse needs the braille orientation changed to put, and obtains the information of the braille side.
Step S18, the markup information of the braille side is deleted by shortcut.For example DEL carries out the deletion of braille side's mark.
Step S19, the Fast Filling of braille point in braille side is carried out with keyboard shortcut, and real-time display has been on the screen
Filled salient point.When actually marking, the number key of keypad can be used, only select the number for having salient point on some position.
If for example, only having 1,2,5 three position in the braille side has salient point, 1,2,5 three key is selected merely with number key
Complete the filling of braille side's salient point.Show the salient point having had been filled on the screen simultaneously.
Step S20, also can braille side's fine position be carried out by keyboard shortcut, so as to more accurately match braille image
On some braille side.
Step S21, after the braille side has marked, shortcut may be employed and carry out the movement that braille orientation is put, be moved to
It puts in next braille orientation.Since the arrangement of Chinese braille has followed national standard, braille side's line space and column pitch have fixation
Scope, the resolution ratio of braille Image Acquisition can be combined, count in advance in the braille image corresponding braille side's line space and
Column pitch, the movement of convenient procession direct in interactive operation.For example, utilize " up and down " directionkeys on keyboard
The single step put in braille orientation movement is carried out, each displacement distance, which can shift to an earlier date, to be counted and determined according to braille image.Also may be used
To use step S17, the mode directly clicked chooses next braille side for needing to mark.It here can also be further with fast
The position of prompt key fine tuning braille side, method are same as above step S20.
Step S22, step S17 to step S21 is repeated, completes to repair the interactive auxiliary of whole braille image braille point
Change.
Step S23, after mark terminates, the markup information of the braille image is preserved by shortcut.For example, click on " S " keys
The preservation of information is labeled, in the form of braille side, preserves the position letter of braille side's location information and the braille point of filling
Breath etc..
Step 7, high-precision braille point and the identification of braille side.By above step 1 to step 5, the positioning of braille side is obtained
As a result, braille side's location information can be utilized, the part wrong report that removal Adaboost cascade classifiers are brought, because salient point is basic
On appear in six braille point positions of braille side, so as to promote the recognition effect based on Adaboost graders.More
, can be only for the corresponding 6 brailles point region in each braille side it is important that on braille side's location base, utilization is more complicated
Grader come promoted salient point identification accuracy.It is as follows：
Step S24, it is preferred, it obtains salient point markup information based on steps 1 and 2 or is obtained using steps 1 and 2,3,4,5,6
To salient point markup information.
Step S25, the image that interception is put using centered on salient point is as positive example sample, with concave point and the figure of the central point of background
As being used as negative data.Such as the sample size using 24*24.
Step S26, the various features of sample are extracted, multiple graders are respectively trained.Preferably, gray scale spy can be extracted
Sign, can extract HOG histogram of gradients features, can extract LBP local binaries feature or HOG and LBP further connects
Feature, and using support vector machines either random forest or other grader, the grader of training salient point, simultaneously
Obtain multiple graders.
Step S27, braille side's location information is obtained based on step 5.
Step S28, small figure of the interception centered on the corresponding 6 brailles point in each braille side, these small figures are carried respectively
Various features are taken, carry out the discriminant classification of salient point respectively using trained grader.Preferably, HOG, LBP can be extracted, is gone here and there
Then the HOG_LBP features of connection are identified using three corresponding SVM classifiers, including HOG-SVM, LBP-SVM, HOG_
LBP+SVM。
Step S29, by multiple SVM classifier classification results, carry out result with cascade classifier and merge.Final fusion knot
Fruit is the product of the corresponding weights of the result of different classifications device.If final fusion results are more than certain threshold value, illustrate big
The output of most graders is salient point, then it is assumed that there are salient points for it.The same salient point of detection method of concave point.
Step S30, can the salient point information in braille side be further converted into braille side's information, so as to complete based on blind
The detection and identification of Wen Fang.
Step S31, the recognition result of the braille point of positive and negative can be merged, to improve the identity of braille point and braille side
Energy.
Step S32, the information of braille side can also be translated as Chinese written language and sentence, inspection is investigated according to the analysis of sentence
The blind side of sniffing by mistake, so as to improve the work efficiency of braille editorial staff.
Based on above step, the method based on assembled classifier, be averaged to the salient point of braille image recognition performance, reaches
Accuracy rate 99.75%, recall rate 99.58%.To the average recognition performance of braille side, accuracy rate 98.27%, recall rate are reached
98.84%.The braille image for the 200dpi that the present invention is obtained for scanner, braille point is obtained using above step 1 to step 7
With braille side's testing result, one image averaging of detection is within 1.8 seconds.
It is below system embodiment corresponding with above method embodiment, this implementation system can be mutual with the above embodiment
Cooperation is implemented.The above-mentioned relevant technical details mentioned in mode of applying are still effective in this implementation system, in order to reduce repetition, this
In repeat no more.Correspondingly, the relevant technical details mentioned in this implementation system are also applicable in the above embodiment.
The invention also provides a kind of braille point Interactive Marking System, including：
Acquisition module, for obtaining the digitized image of paper mold braille by collecting device；
Labeling module, for interacting formula braille point mark to the digitized image in units of braille side；
Wherein the labeling module includes：
Braille side chooses module, which is displayed on the screen, and passes through interactive device in the digitlization
It puts in the braille orientation that some braille is chosen on image；
Display module being displayed on the screen for will belong to the braille side put in braille orientation mark, passing through interactive device
It is labeled for the braille point in braille side mark, and real-time display has marked the braille point of completion on the screen；It is mobile to be somebody's turn to do
Braille orientation puts to next braille side or performs the step 22 and choose the braille orientation of next braille and put, and repeats this
Step 23 to whole braille points in the digitized image until completing mark.
The braille point Interactive Marking System, the wherein collecting device include scanner, video camera or braille Image Acquisition
Instrument；The paper mold braille includes salient point and/or the braille point of concave point form.
The braille point Interactive Marking System, wherein the braille side are identified as the corresponding 6 brailles point in braille side or braille
Corresponding " day " the font grid in side, each crosspoint for being somebody's turn to do " day " font grid represent a braille point position.
The braille point Interactive Marking System, wherein the resolution according to Chinese braille normalized written and the digitized image
Rate determines the dimension scale of the spacing or " day " font grid between the corresponding 6 brailles point in braille side.
The braille point Interactive Marking System, the wherein interactive device include keyboard, mouse, Trackpad.
Although the present invention is disclosed with above-described embodiment, specific embodiment only to explain the present invention, is not used to limit
The present invention, any those skilled in the art of the present technique without departing from the spirit and scope of the invention, can make the change and complete of some
It is kind, therefore the scope of the present invention is subject to claims.
Claims (10)
1. a kind of braille point interactive mode mask method, which is characterized in that including：
Step 1, the digitized image that paper mold braille is obtained using collecting device；
Step 2 interacts the digitized image in units of braille side formula braille point mark；
Wherein the step 2 includes：
The digitized image is displayed on the screen by step 21；
Step 22, the braille orientation for choosing some braille on the digitized image by interactive device are put；
Step 23, by belong to put in the braille orientation braille side mark be displayed on the screen；
Step 24 is labeled by interactive device for the braille point in braille side mark, and real-time display has been on the screen
Mark the braille point completed；
Step 25, the mobile braille orientation put to next braille side or perform the braille that the step 22 chooses next braille
Orientation is put, and repeats the step 23 until completing mark to whole braille points in the digitized image.
2. braille point interactive mode mask method as described in claim 1, which is characterized in that the collecting device includes in step 1
Scanner, video camera or braille Image Acquisition instrument；The paper mold braille includes salient point and/or the braille point of concave point form.
3. braille point interactive mode mask method as described in claim 1, which is characterized in that the braille side is identified as braille side pair
Corresponding " day " the font grid of the 6 braille points answered or braille side, should " day " font grid each crosspoint represent one it is blind
Text point position.
4. braille point interactive mode mask method as claimed in claim 3, which is characterized in that according to Chinese braille normalized written and
The resolution ratio of the digitized image determines the size ratio of the spacing or " day " font grid between the corresponding 6 brailles point in braille side
Example.
5. braille point interactive mode mask method as described in claim 1, which is characterized in that the interactive device include keyboard,
Mouse, Trackpad.
6. a kind of braille point Interactive Marking System, which is characterized in that including：
Acquisition module, for obtaining the digitized image of paper mold braille by collecting device；
Labeling module, for interacting formula braille point mark to the digitized image in units of braille side；
Wherein the labeling module includes：
Braille side chooses module, which is displayed on the screen, and passes through interactive device in the digitized image
It puts in the upper braille orientation for choosing some braille；
Display module is displayed on the screen for that will belong to the braille side put in braille orientation mark, and being by interactive device should
Braille point in braille side's mark is labeled, and real-time display has marked the braille point of completion on the screen；The mobile braille
Orientation puts to next braille side or performs the step 22 and choose the braille orientation of next braille and put, and repeats the step
23 to whole braille points in the digitized image until completing mark.
7. braille point Interactive Marking System as claimed in claim 6, which is characterized in that the collecting device include scanner,
Video camera or braille Image Acquisition instrument；The paper mold braille includes salient point and/or the braille point of concave point form.
8. braille point Interactive Marking System as claimed in claim 6, which is characterized in that the braille side is identified as braille side pair
Corresponding " day " the font grid of the 6 braille points answered or braille side, should " day " font grid each crosspoint represent one it is blind
Text point position.
9. braille point Interactive Marking System as claimed in claim 8, which is characterized in that according to Chinese braille normalized written and
The resolution ratio of the digitized image determines the size ratio of the spacing or " day " font grid between the corresponding 6 brailles point in braille side
Example.
10. braille point Interactive Marking System as claimed in claim 6, which is characterized in that the interactive device include keyboard,
Mouse, Trackpad.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711070494.0A CN108062886A (en) | 2017-11-03 | 2017-11-03 | Braille point interactive mode mask method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711070494.0A CN108062886A (en) | 2017-11-03 | 2017-11-03 | Braille point interactive mode mask method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108062886A true CN108062886A (en) | 2018-05-22 |
Family
ID=62134868
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711070494.0A Pending CN108062886A (en) | 2017-11-03 | 2017-11-03 | Braille point interactive mode mask method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108062886A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110298236A (en) * | 2019-05-20 | 2019-10-01 | 中国科学院计算技术研究所 | A kind of braille automatic distinguishing method for image and system based on deep learning |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080318191A1 (en) * | 2004-03-25 | 2008-12-25 | Mcadams John B | Braille type device, system, and method |
| CN101840648A (en) * | 2010-04-28 | 2010-09-22 | 长春大学 | Automatic braille marking system |
| CN102063628A (en) * | 2011-01-14 | 2011-05-18 | 长春大学 | Method for extracting double-sided braille |
| CN202150089U (en) * | 2011-07-18 | 2012-02-22 | 中国科学院计算技术研究所 | Braille converter |
| CN105404621A (en) * | 2015-09-25 | 2016-03-16 | 中国科学院计算技术研究所 | Method and system for blind people to read Chinese character |
| CN106446885A (en) * | 2016-09-21 | 2017-02-22 | 北京联合大学 | Paper-based Braille recognition method and system |
-
2017
- 2017-11-03 CN CN201711070494.0A patent/CN108062886A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080318191A1 (en) * | 2004-03-25 | 2008-12-25 | Mcadams John B | Braille type device, system, and method |
| CN101840648A (en) * | 2010-04-28 | 2010-09-22 | 长春大学 | Automatic braille marking system |
| CN102063628A (en) * | 2011-01-14 | 2011-05-18 | 长春大学 | Method for extracting double-sided braille |
| CN202150089U (en) * | 2011-07-18 | 2012-02-22 | 中国科学院计算技术研究所 | Braille converter |
| CN105404621A (en) * | 2015-09-25 | 2016-03-16 | 中国科学院计算技术研究所 | Method and system for blind people to read Chinese character |
| CN106446885A (en) * | 2016-09-21 | 2017-02-22 | 北京联合大学 | Paper-based Braille recognition method and system |
Non-Patent Citations (2)
| Title |
|---|
| 尹佳: "《纸介盲文自动识别系统关键技术研究》", 《中国优秀硕士学位论文全文数据库（电子期刊） 信息科技辑》 * |
| 尹佳等: "《盲文自动识别方法研究》", 《长春大学学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110298236A (en) * | 2019-05-20 | 2019-10-01 | 中国科学院计算技术研究所 | A kind of braille automatic distinguishing method for image and system based on deep learning |
| CN110298236B (en) * | 2019-05-20 | 2021-11-30 | 中国科学院计算技术研究所 | Automatic Braille image identification method and system based on deep learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102855495B (en) | Method for implementing electronic edition standard answer, and application system thereof | |
| CN108052955A (en) | A kind of high-precision braille recognition methods and system | |
| CN111291629A (en) | Method and device for recognizing text in image, computer equipment and computer storage medium | |
| CN108052936A (en) | A kind of braille image wing drop bearing calibration and system | |
| CN114005123A (en) | System and method for digitally reconstructing layout of print form text | |
| WO2015100428A1 (en) | Systems and methods for computer-assisted grading of printed tests | |
| US8526766B2 (en) | Use of composite bitmapped images in conjunction with display of captured data | |
| CN108564079A (en) | A kind of portable character recognition device and method | |
| CN110443235B (en) | Intelligent paper test paper total score identification method and system | |
| CN107958261A (en) | A kind of braille point detecting method and system | |
| CN109598185A (en) | Image recognition interpretation method, device, equipment and readable storage medium storing program for executing | |
| CN101581981A (en) | Method and system for directly forming Chinese text by writing Chinese characters on a piece of common paper | |
| CN106446885A (en) | Paper-based Braille recognition method and system | |
| CN113191309A (en) | Method and system for recognizing, scoring and correcting handwritten Chinese characters | |
| CN110298236B (en) | Automatic Braille image identification method and system based on deep learning | |
| CN114463770A (en) | Intelligent question-cutting method for general test paper questions | |
| CN108062548A (en) | A kind of braille side's adaptive location method and system | |
| CN108062886A (en) | Braille point interactive mode mask method and system | |
| CN109284702A (en) | A kind of answer sheet based on image model to point and marking system | |
| CN107886808A (en) | A kind of braille point auxiliary mask method and system | |
| Zhang et al. | Computational method for calligraphic style representation and classification | |
| CN116189212A (en) | Intelligent table identification and scoring method based on image | |
| CN109522892A (en) | The character image information labeling method of neural network aiding | |
| JP2024536432A (en) | SYSTEM AND METHOD FOR DETECTING OBJECTS - Patent application | |
| CN114445744A (en) | Education video automatic positioning method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180522 |
|
| RJ01 | Rejection of invention patent application after publication |