CN106547891A - For the quick visualization method of the pictured text message of palm display device - Google Patents

For the quick visualization method of the pictured text message of palm display device Download PDF

Info

Publication number
CN106547891A
CN106547891A CN201610966423.8A CN201610966423A CN106547891A CN 106547891 A CN106547891 A CN 106547891A CN 201610966423 A CN201610966423 A CN 201610966423A CN 106547891 A CN106547891 A CN 106547891A
Authority
CN
China
Prior art keywords
text message
pictured
display device
data
palm display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610966423.8A
Other languages
Chinese (zh)
Inventor
陈为
朱标
张宏鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201610966423.8A priority Critical patent/CN106547891A/en
Publication of CN106547891A publication Critical patent/CN106547891A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/146Aligning or centring of the image pick-up or image-field
    • G06V30/1475Inclination or skew detection or correction of characters or of image to be recognised
    • G06V30/1478Inclination or skew detection or correction of characters or of image to be recognised of characters or characters lines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Abstract

The invention provides a kind of quick visualization method of the pictured text message for palm display device, comprises the following steps:(1) picture with text message is obtained by palm display device;(2) the pictured text message in step (1) is changed into into digitized text message, obtains isolated character fragments;(3) desired character fragments are chosen in the isolated character fragments that user is obtained from step (2), and the character fragments that selection is obtained is mapped with desired dimension;(4) dimension and corresponding data that obtain in step (3) are carried out into graph visualization;The inventive method compensate for the blank in this research field of pictured text message quick visualization, more people can go to accelerate the understanding of data using visualization tool, go preferably to propagate data, the present invention also enriches us and obtains the channel of data simultaneously, makes the data inside more real worlds become extremely easy to obtain.

Description

For the quick visualization method of the pictured text message of palm display device
Technical field
The present invention relates to data visualization technique field, more particularly to a kind of pictured text for palm display device The quick visualization method of information.
Background technology
In daily life, we can touch many pictured text messages, the nutrition on such as milk pack into Divide information, the telephone expenses package information on article and China Mobile Service Hall poster inside books etc..Directly by the side of reading text Formula goes the effective information for obtaining the inside generally more poorly efficient, when particularly with regard to many numbers according to being compared to each other.
Visualization is to solve one of maximally effective instrument of problems, and visualization (Visualization) is using meter Calculation machine graphics and image processing techniquess, convert the data into figure or image is shown on screen, and interact place The theory of reason, methods and techniques.It is related to computer graphicss, image procossing, computer vision, computer-aided design etc. Multiple fields, become data represent, data processing, decision analysis a series of problems, such as complex art.Currently fly The virtual reality technology of speed development is also with the visualization technique of graph image to rely on.
Visualization can rapidly help the effective information it is appreciated that including inside data, while effectively can also aid in People carry out being compared to each other between multi-group data.However, existing visualization tool majority all only supports digitized data, The pictured information visuallization in above-mentioned real world can not directly be supported.Visualize above-mentioned pictured information needs Alphanumeric is then converted into the available structural data of visualization tool, most by the first instrument by character recognition Structurized data are visualized with visualization tool afterwards.Completing above-mentioned steps needs computer and visualizes the special of field Industry knowledge, which greatly enhances the threshold that domestic consumer uses visualization technique.
OCR (Optical Character Recognition, optical character recognition) refers to that electronic equipment (is for example scanned Instrument or digital camera) character printed on paper is checked, its shape is determined by the pattern for detecting dark, bright, character recognition is then used Method is translated into the process of computword by shape;That is, for printed character, using optical mode by paper document Text conversion become the image file of black and white lattice, and by identification software by the text conversion in image into text formatting, For the technology that word processor is further edited and processed.How except mistake or using auxiliary information raising recognition correct rate, it is OCR Therefore most important problem, the noun of ICR (Intelligent Character Recognition) also produce.Weigh one What individual OCR system performance was fine or not refers mainly to indicate:Reject rate, misclassification rate, recognition speed, the friendly of user interface, product Stability, ease for use and feasibility etc..
On the other hand, with the high speed development in smart mobile phone field, the high-resolution photographic head of current smart mobile phone and Display screen, powerful CPU and sensitive touch-responsive can only be in personal electricity before it is supported much well Just completing on brain for task.We can go to obtain the various letters in real world by the camera function of smart mobile phone completely Then these information are processed by its powerful processor, and then information are shown, are shared by breath.
In sum, there is presently no effectively by the method and apparatus of the data visualization on entity picture.
The content of the invention
The invention provides a kind of quick visualization method of the pictured text message for palm display device, makes up In the blank of pictured text message quick visualization, so as to be more effectively carried out data dissemination, while going back richness acquisition data Channel.
A kind of quick visualization method of the pictured text message for palm display device, it is characterised in that include Following steps:
(1) picture with text message is obtained by palm display device;
By palm display device, such as smart mobile phone is taken pictures to pictured text message, obtains original band There is the picture of text message, data are copied in mobile phone storage from physical world.
(2) the pictured text message in step (1) is changed into into digitized text message, obtains isolated character Fragment;
(3) desired character fragments are chosen in the isolated character fragments that user is obtained from step (2), and selection is obtained Character fragments be mapped with desired dimension;
(4) dimension and corresponding data that obtain in step (3) are carried out into graph visualization.
In order to be applied to common sphere of life, it is preferred that in step (3), described dimension include title, type and Corresponding unit.
User operation for convenience, it is preferred that in step (3), desired dimension are that user is selected to determine, shown by palm Show judge module automatic decision that equipment prestores or after the judge module automatic decision that palm display device prestores again by User selects to determine.
For the ease of realizing the inventive method, it is preferred that in step (2), by optical character recognition to pictured Text message change into digitized text message.
In order to improve the extraction effect of picture character, it is preferred that in step (2), by the pictured text in step (1) Before information changes into digitized text message, picture is obtained to step (1) and is corrected.
It is further preferred that picture is obtained to step (1) being corrected using computer vision storehouse of increasing income.
Specifically, step (2) can be accomplished by operation:
User's step (1) is taken pictures picture for getting uploads to cloud server, and then, server end uses OpenCV (Open Source Computer Vision Library are a cross-platform computer vision storehouses) carries out school to picture Just (ajust the position of character, improve definition of character etc.), to improve the accuracy rate of OCR identifications;Then, server end by Character in picture is changed into computer by optical character recognition (OCR, Optical Character Recognition) technology The digitized character information that can be recognized, and the result of identification is returned to into user;Finally, after user sees the result of identification, Manually further the recognition result of mistake can be modified on the basis of OCR identifications;
Specifically, step (3) can be accomplished by operation:
Step (2) can generate some isolated character fragments, and user can first select a dimension, and (dimension is typically chosen 2 It is individual or 3, with correspondence xy coordinate systems and xyz coordinate systems), some of which fragment is then arbitrarily chosen, as correspondence dimension The data of degree, it is intended that the essential information such as the name of the dimension corresponding to them, type, unit.
The inventive method can also design some auxiliary strategies to accelerate selection of the user to data.Select simultaneously for user Certain set of segments for taking, also automatically can be carried out to its type, unit according to the data content that fragment in the set is included pre- Judge, if recognizing some conventional units, the conversion also between support unit is set to single dimension so as to accelerate user Put.Additionally, our method also allows user that algebraic manipulation is carried out to existing data dimension, new dimension is generated.
Beneficial effects of the present invention:
The blank in this research field of pictured text message quick visualization is compensate for, the text in physical world is erected The bridge between visualization technique in this information and digital world, can greatly increase the audient of visualization technique after popularization, More people can go to accelerate the understanding of data using visualization tool, goes preferably to propagate data, while this It is bright also to enrich us and obtain the channel of data, make the data inside more real worlds become extremely easy to obtain.
Description of the drawings
Fig. 1 is the flow process of the quick visualization method of the pictured text message for palm display device of the present invention Figure.
Fig. 2 is to obtain the original picture with text message by smart mobile phone.
Fig. 3 is some isolated character fragments that user obtains.
Fig. 4 is the result schematic diagram that user carries out selection to the character fragments in Fig. 3.
Fig. 5 is that the attribute of the dimension of the colored background chosen in Fig. 4 arranges interface schematic diagram.
Fig. 6 is that the attribute of the dimension of the colored background chosen in Fig. 4 arranges interface schematic diagram.
Fig. 7 is the result schematic diagram that the dimension of the colored background to choosing in Fig. 4 carries out each row selection.
Fig. 8 is the result schematic diagram that the dimension of the colored background to choosing in Fig. 7 carries out Conversion of measurement unit.
Fig. 9 is the initial interface schematic diagram that two dimensions to choosing in Fig. 8 carry out algebraic manipulation.
Figure 10 is the operation chart that two dimensions to choosing in Fig. 8 carry out algebraic manipulation.
Figure 11 is the result schematic diagram of Figure 10 algebraic manipulations.
Figure 12 is the gesture schematic diagram that pattern is chosen into transverse axis dimension.
Figure 13 is the gesture schematic diagram that pattern is chosen into longitudinal axis dimension.
Figure 14 is the gesture schematic diagram for operating that resets.
Figure 15 is the gesture schematic diagram for adding division operation.
Figure 16 is the block diagram visualization result schematic diagram of data in Figure 11.
Figure 17 is the broken line graph visualization result schematic diagram of data in Figure 11.
Figure 18 is the result schematic diagram for changing visualization result title in Figure 17.
Specific embodiment
Describe the present invention below in conjunction with the accompanying drawings in detail.
The quick visualization method of the pictured text message for palm display device of the present embodiment,
As shown in figure 1, comprising the steps:
Step 1:Pictured text message is obtained with smart mobile phone:
Pictured text message is taken pictures by smart mobile phone, obtains the original picture with text message, As shown in Fig. 2 data are copied in mobile phone storage from physical world;
Step 2:The character in the picture that gets is identified using OCR technique, detailed process is as follows:
First, the picture that user is got taking pictures uploads to cloud server;Then, server end uses OpenCV (Open Source Computer Vision Library are a cross-platform computer vision storehouses) carries out school to picture Just (ajust the position of character, improve definition of character etc.), to improve the accuracy rate of OCR identifications;Then, server end by Character in picture is changed into computer by optical character recognition (OCR, Optical Character Recognition) technology The digitized character information that can be recognized, and the result of identification is returned to into user;Finally, after user sees the result of identification, Manually further the recognition result of mistake can be modified on the basis of OCR identifications;
Step 3:Structuring is carried out to the result of OCR identifications:
Step 2 can recognize the character in picture, but can not obtain automatically the association between these character fragments, user What is obtained is some isolated character fragments, as shown in Figure 3.
User selects dimension, such as the first two icon of Fig. 3 bottoms to correspond to two dimensions of the longitudinal axis and transverse axis respectively first first;
Then some of which fragment is arbitrarily chosen, as the data of selected dimension, it is intended that the dimension corresponding to them The essential informations such as name, type, unit.As shown in 4 and 6, colored background (is light-colored part in figure, can actually be arranged to appoint A kind of color, such as yellow) those character fragments it is selected, our specified attributes entitled " expense ", attribute classification be " classification Type ", unit are " $ ".
This method accelerates selection of the user to data also with auxiliary strategy, and interlacing selecting step is as follows:
The colored background in Fig. 4 is chosen (to be dark parts in figure, can actually be arranged to any one color, to distinguish expense It is use this string, such as blue) after fragment, settings starting point is 0 (from the beginning of 0), selects one (as shown in Figure 5) per 2 fragments, must The effect that interlacing as shown in Figure 7 is chosen is arrived.
Simultaneously for certain set of segments that user chooses, can with the data content that included according to fragment in the set from Dynamic ground carries out pre- judgement to its type, unit, if recognizing some conventional units, the conversion also between support unit, from And accelerate setting of the user to single dimension, automatic decision step is as follows:
As shown in figure 5, the identifying system for carrying automatically judges that selected data is numeric type, be extracted unit m and g and to The conversion proportion for having gone out between the two.Additionally, this method also allows user that algebraic manipulation is carried out to existing data dimension, generate new Dimension.As shown in Fig. 9~11, by expense dimension and flow dimension are carried out division arithmetic, we can obtain network flow The univalent dimension of amount.
Additionally, for mobile phone screen icon it is little easily overdue the characteristics of, the inventive method is also added to gesture operation Support, as shown in Figure 12~15, round dot represents the starting point of gesture, four gestures correspond to respectively into transverse axis dimension choose pattern, Pattern, reset are chosen into longitudinal axis dimension, these four operate to add packet.
Step 4:The final visualization works of design
According to the data type being tied in step 3 in two dimensions, recommend automatically visualization scheme and visual encoding choosing Item is selected, changes and is shared for user.As shown in Figure 16~18, this method is directed to the data recommendation block diagram and broken line graph two Kind visualization coded system, and provide it is various color matching for user select, user can also to this visualize works title Modify.
The present invention is made up well by the visualization tasks of smart mobile phone and pictured text message are combined In the blank of this research field of pictured text message quick visualization, the text message and numeral in physical world is erected The bridge between visualization technique in the world.By the application of the present invention, user is completed by only needing to a smart mobile phone From pictured text message to all steps of final visualization works, the threshold of visualization application is greatly reduced, is promoted The audient of visualization technique can be greatly increased afterwards, and more people can go to accelerate the understanding of data using visualization tool, Go preferably to propagate data.The present invention also enriches us and obtains the channel of data simultaneously, makes in more real worlds The data in face become extremely easy to obtain.

Claims (6)

1. a kind of quick visualization method of the pictured text message for palm display device, it is characterised in that include with Lower step:
(1) picture with text message is obtained by palm display device;
(2) the pictured text message in step (1) is changed into into digitized text message, obtains isolated character sheet Section;
(3) desired character fragments are chosen in the isolated character fragments that user is obtained from step (2), and the word that selection is obtained FUPIAN section is mapped with desired dimension;
(4) dimension and corresponding data that obtain in step (3) are carried out into graph visualization.
2. the quick visualization method of the pictured text message of palm display device is directed to as claimed in claim 1, and which is special Levy and be, in step (3), described dimension includes title, type and corresponding unit.
3. the quick visualization method of the pictured text message of palm display device is directed to as claimed in claim 1, and which is special Levy and be, in step (3), desired dimension is that user selects the judge module for determining, prestoring by palm display device automatic Judge or select to determine by user after the judge module automatic decision that palm display device prestores again.
4. the quick visualization method of the pictured text message of palm display device is directed to as claimed in claim 1, and which is special Levy and be, in step (2), digitized text envelope is changed into pictured text message by optical character recognition Breath.
5. the quick visualization method of the pictured text message of palm display device is directed to as claimed in claim 1, and which is special Levy and be, in step (2), the pictured text message in step (1) is changed into before digitized text message, to step (1) obtain picture to be corrected.
6. the quick visualization method of the pictured text message of palm display device is directed to as claimed in claim 5, and which is special Levy and be, picture is obtained to step (1) and is corrected using computer vision storehouse of increasing income.
CN201610966423.8A 2016-10-28 2016-10-28 For the quick visualization method of the pictured text message of palm display device Pending CN106547891A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610966423.8A CN106547891A (en) 2016-10-28 2016-10-28 For the quick visualization method of the pictured text message of palm display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610966423.8A CN106547891A (en) 2016-10-28 2016-10-28 For the quick visualization method of the pictured text message of palm display device

Publications (1)

Publication Number Publication Date
CN106547891A true CN106547891A (en) 2017-03-29

Family

ID=58394388

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610966423.8A Pending CN106547891A (en) 2016-10-28 2016-10-28 For the quick visualization method of the pictured text message of palm display device

Country Status (1)

Country Link
CN (1) CN106547891A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107861925A (en) * 2017-10-27 2018-03-30 广西小草信息产业有限责任公司 A kind of word processor and method
CN110688483A (en) * 2019-09-16 2020-01-14 重庆邮电大学 Dictionary-based noun visibility labeling method, medium and system in context conversion

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679800A (en) * 2013-12-03 2015-06-03 中兴通讯股份有限公司 Data inputting method and device
CN105005578A (en) * 2015-05-21 2015-10-28 中国电子科技集团公司第十研究所 Multimedia target information visual analysis system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104679800A (en) * 2013-12-03 2015-06-03 中兴通讯股份有限公司 Data inputting method and device
CN105005578A (en) * 2015-05-21 2015-10-28 中国电子科技集团公司第十研究所 Multimedia target information visual analysis system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
BIAO ZHU等: "ShotVis: Smartphone-Based Visualization of OCR Information from Images", 《ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107861925A (en) * 2017-10-27 2018-03-30 广西小草信息产业有限责任公司 A kind of word processor and method
CN110688483A (en) * 2019-09-16 2020-01-14 重庆邮电大学 Dictionary-based noun visibility labeling method, medium and system in context conversion
CN110688483B (en) * 2019-09-16 2022-10-18 重庆邮电大学 Dictionary-based noun visibility labeling method, medium and system in context conversion

Similar Documents

Publication Publication Date Title
CN109618222B (en) A kind of splicing video generation method, device, terminal device and storage medium
US10049308B1 (en) Synthesizing training data
CN109688463A (en) A kind of editing video generation method, device, terminal device and storage medium
US10185701B2 (en) Unsupported character code detection mechanism
CN109948549B (en) OCR data generation method and device, computer equipment and storage medium
CN107209631A (en) User terminal and its method for displaying image for display image
WO2005069170A1 (en) Image file list display device
US20110246939A1 (en) Information Processing Method and Graphical User Interface
US10558745B2 (en) Information processing apparatus and non-transitory computer readable medium
JP2011221605A (en) Information processing apparatus, information processing method and program
CN110232111A (en) A kind of text display method, device and terminal device
US11314991B2 (en) Information display method, information display system, and storage medium
US8564594B2 (en) Similar shader search apparatus and method using image feature extraction
KR102471343B1 (en) Online print production system using keyword analysis of text data input from users
CN106547891A (en) For the quick visualization method of the pictured text message of palm display device
CN104615639A (en) Method and equipment for providing showing information of picture
CN110232131A (en) Intention material searching method and device based on intention label
CN113313066A (en) Image recognition method, image recognition device, storage medium and terminal
JP6372165B2 (en) Design management apparatus and program
US20170262141A1 (en) Information processing apparatus, information processing method and non-transitory computer readable medium
US11430166B1 (en) Facilitating generation of number-bullet objects
CN111107264A (en) Image processing method, image processing device, storage medium and terminal
CN111027533A (en) Conversion method and system of point-to-read coordinates, terminal device and storage medium
US20170032218A1 (en) Information processing apparatus, information processing method, and non-transitory computer readable medium
CN109493401B (en) PowerPoint generation method, device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170329