CN101393564A - Document-image-data providing system, document-image-data providing device, information processing device and method - Google Patents

Document-image-data providing system, document-image-data providing device, information processing device and method Download PDF

Info

Publication number
CN101393564A
CN101393564A CNA2008102131473A CN200810213147A CN101393564A CN 101393564 A CN101393564 A CN 101393564A CN A2008102131473 A CNA2008102131473 A CN A2008102131473A CN 200810213147 A CN200810213147 A CN 200810213147A CN 101393564 A CN101393564 A CN 101393564A
Authority
CN
China
Prior art keywords
document image
image data
data
file
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2008102131473A
Other languages
Chinese (zh)
Other versions
CN101393564B (en
Inventor
岩崎雅二郎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Publication of CN101393564A publication Critical patent/CN101393564A/en
Application granted granted Critical
Publication of CN101393564B publication Critical patent/CN101393564B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

In a document-image-data providing device, a document image inputting unit is configured to input document image data. An area recognition unit is configured to recognize a text area of a document image element containing text data among document image elements constituting the document image data, and another area of a document image element containing data other than the text data. A text data acquiring unit is configured to acquire text data contained in the recognized text area. A providing unit is configured to provide, in response to a document image data request received from the information processing device, both image data generated from the input document image data to have a resolution lower than a resolution of the input document image data and the text data acquired by the text data acquiring unit, to the information processing device.

Description

Document image data provides system, apparatus and method, and signal conditioning package and method
Technical field
The present invention relates generally to the processing of document image data, more particularly, relating to document image data provides system, document image data generator, signal conditioning package, document image data to provide method, information processing method, document image data that program and message processing program are provided
Background technology
In recent years, by the improvement of computer-related technologies and the maintenance of intraoffice network environment, the electronization of document data was developed significantly.Usually, when reusing the electronic data of file and picture, the use that can imagine the editing application program can allow the partial data that needs of document to be excised from document image data, and the use of OCR (optical character reader) application program allows document image data to be converted into the character code that is used to reuse document image data.
Japanese Laid-Open Patent Application discloses a kind of signal conditioning package 2007-200014 number, it is arranged to the selection that receives the two or more objects that constitute the electronic document view data, with the object unification of selecting is an object, and this unified object is associated so that it is managed with the electronic document view data.
Yet, when the partial data of the needs of planning only to reuse document image data, signal conditioning package in Japanese Laid-Open Patent Application 2007-200014 number need be by carrying out the partial data that the needs that are used to reuse are excised in manual operation, and this manual operation is complicated.
Summary of the invention
In one aspect of the invention, the invention provides a kind of document image data provides system, document image data generator, signal conditioning package, document image data to provide method, information processing method, document image data that program and message processing program are provided, and it can easily reuse document image data.
Solving or reducing in the embodiments of the invention of one or more the problems referred to above, the invention provides a kind of document image data generator, it provides document image data to signal conditioning package, the document view data generator comprises: the file and picture input block, and configuration is used to import document image data; The file and picture key element that region identification block, configuration are used for being identified in the document image data that constitutes input comprises file and picture key element text filed of text data, and another zone that comprises the data document image-element except text data; Text data acquiring unit, configuration are used for obtaining the text filed text data that comprises by region identification block identification; And provide the unit, configuration is used in response to the document image data request that receives from signal conditioning package, provide the view data that generates from the document image data of input, have the resolution lower to signal conditioning package than the resolution of the document image data of input, and the text data that obtains by the text data acquiring unit.
Solving or reducing in the embodiments of the invention of one or more the problems referred to above, the invention provides a kind of signal conditioning package, it is connected to the document image data generator, this signal conditioning package comprises: acquiring unit, configuration are used for obtaining the document image data of input and the text filed text data of discerning that comprises from the document image data generator; File and picture key element selected cell, configuration are used for selecting from the document image data of input the file and picture key element of the document image data of formation input; And indicative control unit, configuration is used for when the factor data of the file and picture key element of being selected by file and picture key element selected cell is text data, shows the text data corresponding to the factor data in the text data that is obtained by acquiring unit on display device.
Other purposes of the present invention, feature and advantage will read following detailed in conjunction with the drawings and become more obvious.
Description of drawings
Fig. 1 is the chart that the document image data of expression embodiments of the invention provides the composition of system.
Fig. 2 is the block scheme that the hardware of the multi-function peripheral (MFP) of expression embodiments of the invention is formed.
Fig. 3 is the block scheme that the hardware of the signal conditioning package of expression embodiments of the invention is formed.
Fig. 4 is each the block scheme of function composition that the document image data of the expression first embodiment of the present invention provides multi-function peripheral (MFP) in the system and messaging device.
Fig. 5 is the chart of example of the data structure of expression document table.
Fig. 6 is the chart of example of the data structure of representation page table.
Fig. 7 is the chart of example of the data structure of expression key element table.
Fig. 8 is used to illustrate that first embodiment's provides the process flow diagram of the registration of the document image data that system carries out by document image data.
Fig. 9 is used to illustrate that first embodiment's provides the process flow diagram of the demonstration of the document image data that system carries out by document image data.
Figure 10 is the chart of the example of expression display screen, the wherein tabulation of display document view data on display device.
Figure 11 is the chart of the example of expression display screen, wherein shows preview image on display device.
Figure 12 is editor's the process flow diagram that is used to illustrate the file and picture that is undertaken by signal conditioning package of first embodiment.
Figure 13 is the chart of the example of expression display screen, wherein shows preview image and editing screen.
Figure 14 is the block scheme that the document image data of the expression second embodiment of the present invention provides the composition of system.
Embodiment
Below with reference to accompanying drawing embodiments of the invention are described.
Document image data at embodiments of the invention provides in the system, if the input document image data, the identification of document image data generator constitutes each zone of the file and picture key element of document image data.And if in the signal conditioning package that is connected to the document image data generator by network, selected the file and picture key element from file and picture, the document image data generator extracts the factor data of the file and picture key element of selecting from document image data, and will the prime number certificate offer signal conditioning package.
Fig. 1 represents that the document image data of embodiments of the invention provides the composition of system 100.In this embodiment, the document image data generator is made of the multi-function peripheral (MFP) as image processing apparatus, it can be stored document image data and have multi-functional, comprise scanner functions, duplicating machine function and facsimile function, and signal conditioning package is made of the multi-purpose computer with processing unit and storage unit.
The document image data of Fig. 1 provides system 100 by constituting by network 400 interconnective multi-function peripheral (MFP) 200 and signal conditioning package 300.
Provide in the system 100 at document image data, if document image data 10 is transfused to and is read as document image data 10A, MFP 200 identifications constitute the file and picture key element 11,12 of document image data 10A and 13 zone separately.During this time, MFP 200 identifications comprise the zone and the zone that comprises the file and picture key element of the view data except text data of the file and picture key element of text data.
Above-mentioned text data represents to be included in the cover of one among document image data 10A character code.In the example of Fig. 1, MFP 200 identifications constitute the file and picture key element 11,12 of document image data 10A and 13 zone separately.In addition, MFP 200 is associated document image data 10A and file and picture key element 11,12 and 13, and stores them in MFP 200.
When the file and picture key element in signal conditioning package 300, among file and picture key element 11,12 and 13, selected except the file and picture key element that comprises text data, MFP 200 extracts the factor data corresponding to selected file and picture key element from document image data 10A, and provides it to signal conditioning package 300 (output).
On the other hand, the process that MFP 300 carries out when selection comprises the file and picture key element of text data in signal conditioning package 300 will be described after a while.
Signal conditioning package 300 obtains the factor data that MFP 200 provides, and makes signal conditioning package 300 can use the factor data that obtains to come Edit Document view data 10A.
In this embodiment, when the zone of file and picture key element was the form of rectangle, the positional information of the point in the positional information of the point in the upper left corner that can be by obtaining this zone (rectangle) and the lower right corner that should zone (rectangle) was carried out the identification in the zone of file and picture key element.On the other hand, when the zone of file and picture key element is not the form of rectangle, can be by obtaining the identification that comes execution area around the positional information in the upper left corner of the rectangle of file and picture key element and the lower right corner.
The replica data of factor data that in this embodiment, can be by generating the file and picture key element of selecting from document image data 10 is also transmitted the extraction that this replica data is carried out factor data.
The file and picture key element can be included in image in the file and picture, text, figure, form etc.Factor data can be the data corresponding to each file and picture key element.For example, when comprising image and text in document image data, the file and picture key element is image and text.When the file and picture key element was image, corresponding factor data was acquired as view data.When the file and picture key element was text, corresponding factor data was acquired as text data.For example, when the file and picture key element was figure and form, figure and form were identified as image, and factor data in this case is acquired as the view data of indicating graphic and form.
Relation between the factor data of the kind of table 1 expression file and picture key element and the correspondence that is acquired.As shown in table 1, when the file and picture key element was image, figure or form, factor data was acquired as view data in this embodiment.When the file and picture key element was text, factor data was acquired as text data in this embodiment.
Table 1
The kind of file and picture key element Factor data
The image view data
Graphic image data
The form view data
The text text data
Fig. 2 represents the hardware composition of the multi-function peripheral (MFP) 200 of embodiments of the invention.
MFP 200 comprises scanner 21, plotting apparatus 22, drive unit 23, supplementary storage 24, storage arrangement 25, processing unit 26, interface arrangement 27 and guidance panel 28, and it interconnects respectively by bus B.
Scanner 21 comprises scanner engine and engine control part, and this scanner 21 is used to obtain document image data by reading the print media (for example, type face) of having printed file and picture on it.
Plotting apparatus 22 comprises plotting apparatus engine and engine control part, and this plotting apparatus 22 is used to output image data to print media, for example type face.
Interface arrangement 27 comprises modulator-demodular unit or LAN card, and this interface arrangement 27 is used to connect MFP 200 with network 400.
Guidance panel 28 is the devices that are used to operate MFP 200, and this guidance panel 28 comprises touch pad, and it provides Presentation Function and input function.
The image processing program of embodiments of the invention is made of at least a portion of the various programs that are used to control MFP 200.For example, provide image processing program by recording medium 29 being distributed to MFP 200 or being downloaded to MFP 200 from network 400.
Example of the recording medium 29 of memory image handling procedure can comprise various types of recording mediums on it: optics, electricity and magnetic recording recording of information medium on it, for example CD-ROM, floppy disk or magneto-optic disk, perhaps it powers on and learns the semiconductor memory of record information, for example ROM or flash memories.
When in drive unit 23, the recording medium 29 of memory image handling procedure on it being set, be installed in the supplementary storage 24 by drive unit 23 from the image processing program of recording medium 29.The image processing program of downloading from network 400 is installed in the supplementary storage 24 by interface arrangement 27.
The image processing program that supplementary storage 24 storages among the MFP 200 are installed, necessary file and data.Storage arrangement 25 is from supplementary storage 24 reading images handling procedures, and when starting MFP 200 image processing program is stored among the MFP 200.Processing unit 26 according to be stored in image processing program in the storage arrangement 25 carry out various will be in the process of describing after a while.
Fig. 3 represents the hardware composition of the signal conditioning package 300 of embodiments of the invention.As shown in Figure 3, signal conditioning package 300 comprises input media 31, output unit 32, drive unit 33, supplementary storage 34, storage arrangement 35, processing unit 36 and interface arrangement 37, and it interconnects respectively by bus B.
Input media 31 comprises keyboard, mouse etc., and this input media 31 is used to import various signals.Display device 32 comprises display unit etc., and this display device 32 is used to show various windows, data etc.Interface arrangement 37 comprises modulator-demodular unit or LAN card, and this interface arrangement 37 is used to network 400 link information treating apparatus 300.
The message processing program of embodiments of the invention is made of at least a portion of the various programs that are used for control information treating apparatus 300.For example, for example, provide message processing program by recording medium 38 being distributed to signal conditioning package 300 or being downloaded to signal conditioning package 300 from network 400.
Example of the recording medium 38 of canned data handling procedure can comprise various types of recording mediums on it: optics, electricity and magnetic recording recording of information medium on it, for example CD-ROM, floppy disk or magneto-optic disk, perhaps it powers on and learns the semiconductor memory of record information, for example ROM or flash memories.
When in drive unit 33, the recording medium 38 of canned data handling procedure on it being set, be installed in the supplementary storage 34 by drive unit 33 from the message processing program of recording medium 38.The message processing program of downloading from network 400 is installed in the supplementary storage 34 by interface arrangement 37.
The message processing program that supplementary storage 34 storages in the signal conditioning package 300 are installed, necessary file and data.Storage arrangement 35 reads message processing program from supplementary storage 34, and in log-on message treating apparatus 300 message processing program is stored in the signal conditioning package 300.Processing unit 36 according to be stored in message processing program in the storage arrangement 35 carry out various will be in the process of describing after a while.
Fig. 4 represents that the document image data of the first embodiment of the present invention provides each function of multi-function peripheral (MFP) in the system and signal conditioning package to form.
The MFP 200 of this embodiment comprises that file and picture input block 205, region identification block 210, text data acquiring unit 215, image generation unit 220, storage control unit 230, tabulation provide unit 240, preview image to provide unit 250, factor data extraction unit 260 and factor data that unit 270 is provided.MFP 200 further comprises database 280, and it is disposed in the supplementary storage 240.
File and picture input block 205 scanning document images (original document) and the file and picture of correspondence is input among the MFP 200 as document image data.
210 identifications of file and picture recognition unit constitute the zone separately of the file and picture key element of document image data.At length, which of text data, graph data, list data, picture data etc. be region identification block 210 determine separately to comprise in each of zone based on the feature of the data in the document image data that is included in input, and determine the kind of the data in each zone based on the feature of the data in that zone, make identification file and picture key element.
The zone that the region identification block 210 of this embodiment will comprise the file and picture key element of text data is identified as text filed, and will be identified as image-region except the zone of the file and picture key element the file and picture key element that comprises text data.In the region identification block 210 of this embodiment, the area information of file and picture key element can obtain based on the coordinate information of the file and picture key element in the document image data.The method of known region identification will be omitted its detailed description in correlation technique.
Text data acquiring unit 215 obtains text data from the file and picture key element that is identified as text filed zone by region identification block 210.For example, provide document data acquiring unit 215 by OCR (optical character identification) function of using MFP 200.The text data that is obtained by document data acquiring unit 215 is stored in after a while with in the database of describing 280.
Image generation unit 220 has the document image data that resolution is lower than the document image data of input by using document image data from the input of file and picture input block 205 to generate.
Image generation unit 220 first document image datas and second document image data of this embodiment, the resolution of first document image data is lower than the resolution of the document image data of input, and the resolution of second document image data is lower than the resolution of first document image data.The details of first document image data and second document image data will be described after a while.
Storage control unit 230 controls are stored document image data in the database of describing after a while 280.Tabulation provides unit 240 to obtain the tabulation that is stored in the document image data the database 280 from database 280, and provides (output) to give signal conditioning package 300 this tabulation.
Preview image provides unit 250 to obtain the data of the preview image of selection from database 280, and the preview image data that will select provide (output) to give signal conditioning package 300.Preview image provides unit 250 to provide the area information of the file and picture key element that is included in the text data in the document image data (it is the source of preview image) and discerns with the preview image data to signal conditioning package 300 in document image data.
Factor data extraction unit 260 extracts the factor data corresponding to the file and picture key element of selecting from the document image data of input.The factor data that factor data provides unit 270 to provide (output) to be extracted by factor data extraction unit 260 to signal conditioning package 300.
Database 280 comprises metadata portion 281, wherein stores the metadata of document image data, and document image data portion 282, wherein stores document image data.
Metadata portion 281 comprises document table 283, wherein the information (directory information) of the attribute of storage indication document image data; Page table 284, wherein the storage indication is included in the information of the page in the document image data; And key element table 285, wherein store the information of each file and picture key element.
Fig. 5 represents the example of the data structure of document table 283.In the document table 283 of Fig. 5, the directory information of the document image data of storage input.At length, the title that is used for discerning the number of pages of date, document image data of document id, producer's document image data of document image data and document image data is associated and is stored in document table 283.
In the document table 283 of this embodiment, when when the recording medium of for example memory card is directly imported document image data, document image data directly is stored in the document table 283.
In this embodiment, when scanner 21 uses ADF (automatic document feeder) functions jointly to read two pages or multipage file and picture, two pages or multipage file and picture can be converted to and allow the document image data of a plurality of images as the processed form of file, and subsequently can be with the document image data storage in document table 283.
In page table 284, storage is used to manage each the information of document image data of the page separately.The example of the data structure of Fig. 6 representation page table 284.
In the page table 284 of Fig. 6, page ID, document id, the page number, thumbnail image, preview image and text data (being obtained by text data acquiring unit 215) are associated and are stored.Page number ID is every page the identifier that is used to discern document image data.Document id is to be used to discern the identifier that comprises by the document image data of the page number of page number ID appointment.The page number is at the number by the corresponding page or leaf in the document image data of document id appointment.Thumbnail image is the thumbnail image of corresponding page or leaf.Preview image is the preview image of corresponding page or leaf.
To provide the description of thumbnail image and preview image below.In this embodiment, if document image data is transfused to, image generation unit 220 generates document image data (preview image data), be used for preview image, the resolution of preview image is lower than each the resolution of document image data of the page separately that is included in the document image data.These preview image data are called as first document image data.
In addition, image generation unit 220 generates document image data (thumbnail image data), is used for thumbnail image, and the resolution of this thumbnail image also is lower than the resolution of the document image data that is used for preview image.This thumbnail image data is called as second document image data.
In the MFP 200 of this embodiment, if document image data is transfused to and generates preview image data and thumbnail image data, storage control unit 230 is in the correspondence position storage preview image data and the thumbnail image data of page table 284.
The document image data that obtains when scanner 21 scanning document images is stored in the document image data portion 282 of database 280.In document image data portion 282, the document view data is associated with the page table 284 of metadata portion 281 by the page number ID that is included in the document image data.
The resolution identical resolution storage of the document image data that is stored in document image data portion 282 of this embodiment to obtain when scanner 21 scanning document images.Thus, even after document image data is copied to Another application, the document image data that is stored in the document image data portion 282 allows to come reproduced image with enough reusable resolution.
In this embodiment, when the resolution of the document image data in being stored in document image data portion 282 equals 600dpi, preferably the resolution of preview image data is set to about 100dpi, and the picture size of thumbnail image data is by unification and be set to about 100 pixels * 100 pixels, to improve the tabulation characteristic.
In addition, except thumbnail image data and preview image data, the page-images data with different resolution can further be stored in the page table 284.The resolution of page-images data can be provided the system manager of system to set in advance by document image data in this case.In this case, if document image data is transfused to, except thumbnail image data and preview image data, image generation unit 220 generates the page-images data of the resolution with setting.Storage control unit 230 is associated the page-images data that generate with page ID, and with in its memory page table 284.
Fig. 7 represents the example of the data structure of key element table 285.
Storage is based on the document image data of file and picture input block 205 input in key element table 285, the information of each of the key element of file and picture separately that obtains by region identification block 210 identification file and picture key elements.
In the key element table 285 of Fig. 7, be associated and be stored in the key element table 285 as the kind of the information (coordinate information) of the position of the file and picture key element of the area I D of the identifier in the zone that is used for discerning the file and picture key element, document id that identification comprises the document image data of file and picture key element, page ID that identification comprises the page of file and picture key element, indication document image data and file and picture key element.
With reference to figure 4, the formation document image data of describing this embodiment is provided the signal conditioning package 300 of the part of system 100.
Signal conditioning package 300 comprises scope extraction unit 344, indicative control unit 350 and the edit cell 360 of tabulation acquiring unit 310, preview image acquiring unit 320, regional display unit 325, file and picture key element selected cell 330, factor data acquiring unit 340, scope selected cell 342, selection.
The tabulation that tabulation acquiring unit 310 obtains the document image data in the database 280 that is stored in MFP 200.Preview image acquiring unit 320 obtains the preview image data, the preview image of selecting the tabulation corresponding to the document image data that obtains from tabulation acquiring unit 310.In addition, preview image acquiring unit 320 obtains the text data that is included in corresponding in the preview image data document view data, and the area information of the file and picture key element of discerning in document image data.
Each the demonstration in zone of zone display unit 325 execution file and picture key element separately when showing the preview image data obtain.File and picture key element selected cell 330 is selected the file and picture key element from file and picture.Factor data acquiring unit 340 obtains the document data corresponding to the file and picture key element of being selected by file and picture key element selected cell 330.
The scope of the text data that 342 selections of scope selected cell will be extracted from text data, text data are by preview image acquiring unit 320 and preview image synchronization gain.The details of extracting text data is described after a while.
The scope extraction unit of selecting 344 extracts the text data of the scope of being selected by scope selected cell 342 from the text data that preview image acquiring unit 320 obtains.
Indicative control unit 350 is controlled at display image on the display device 32.Edit cell 360 is for the factor data executive editor operation that has factor data acquiring unit 340 to obtain.
For example, edit cell 360 can be made of the editing application that is installed in the signal conditioning package 300, to allow edit cell 360 editor's factor datas.
In this embodiment, tabulation acquiring unit 310, preview image acquiring unit 320, file and picture key element selected cell 330, factor data acquiring unit 340, scope selected cell 342, the scope extraction unit of selecting 344 and indicative control unit 350 are made of the Web browser of arranging in signal conditioning package 300 370.
The document image data of describing this embodiment below with reference to Fig. 8 and Fig. 9 provides the operation of system 100.
Fig. 8 is the process flow diagram that the document image data that is used to illustrate first embodiment provides the registration (accumulation) of the document image data of system 100.
When document image data is imported by the file and picture input block 205 of MFP 200, the zone (step S801) of region identification block 210 each file and picture key element of identification.In step S801, after the zone is identified separately of file and picture key element, storage control unit 230 will be included in catalogue (bibliographic) message stores of the document image data in the document image data in document table 283.
In addition, in step S801, storage control unit 230 will be included in each information stores of the page separately in the document image data in page table 284.Storage control unit 230 with each information stores of the file and picture key element of each self-identifying in key element table 285.In addition, storage control unit 230 is stored in document image data in the document image data portion 282.
Carry out step S802 after step S801, MFP 200 makes text data acquiring unit 215 obtain text data, and it is corresponding to the factor data that is identified as text filed file and picture key element in step S801 from the file and picture key element.Carry out step S803 after step S802, the text data store that storage control unit 230 will be obtained by text data acquiring unit 215 is in page table 284.
Carry out step S804 after step S803, image generation unit 220 generates preview image data and thumbnail image data based on the document image data in step S801 input.At length, image generation unit 220 condensed document view data and generation preview image data and thumbnail image data.
Carry out step S803 after step S802, storage control unit 230 stores preview image data and the thumbnail image data that generates in the page table 284 into.
By this way, document image data is registered and is stored among the MFP200 of this embodiment.
The signal conditioning package 300 that to describe then by this embodiment carries out the demonstration of document image data.
Fig. 9 is the process flow diagram that is used to illustrate that the document image data by first embodiment provides system 100 to carry out the demonstration of document image data.
In step S901, signal conditioning package 300 receives the order of obtaining of the tabulation of document image data, and control proceeds to step S902.
In step S902, obtain order in response to the tabulation that receives from signal conditioning package 300, the tabulation that MFP200 makes tabulation provide unit 240 will be stored in the document image data in the database 280 offers signal conditioning package 300.During this time, the tabulation that tabulation provides unit 240 to obtain to be stored in the thumbnail image data in the page table 284 is as the tabulation of document image data, and outputs it to signal conditioning package 300.
Carry out step S903 after step S902, signal conditioning package 300 makes tabulation acquiring unit 310 obtain from the tabulation of the thumbnail image data of MFP 200 outputs.In addition, in step S903, signal conditioning package 300 makes indicative control unit 350 show the tabulation of obtaining on display device 32.
Figure 10 represents the example of display screen, and wherein the tabulation of thumbnail image is presented on the display device 32.As shown in figure 10, the tabulation that shows on display device 32 is represented by the thumbnail image of file and picture.
In the display screen 32A of Figure 10, four thumbnail image 81-84 are shown as the tabulation of document image data.The title of each document image data be presented at each thumbnail image below.
For example, when two pages or multipage document image data are provided with the form that will be treated to a file, can only show the thumbnail image of first page document image data at display screen 32A.
With reference to figure 9, after step S903, control proceeds to step S904.In step S904, select thumbnail image in the tabulation of the thumbnail image among the display screen 32A from signal conditioning package 300.The signal conditioning package 300 of this embodiment can be configured to make when the thumbnail image among the pointing device click display screen 32A of for example mouse, select thumbnail image.
Carry out step S905 after step S904, after selecting thumbnail image, MFP 200 makes preview image provide unit 250 to obtain preview image corresponding to the thumbnail image of selecting from database 280.In addition, in step S905, MFP 200 makes preview image provide unit 250 to provide the preview image that obtains data to signal conditioning package 300.
During this time, MFP 200 makes preview image provide unit 250 area information of file and picture key element to be provided and to be stored in text data in the page table 284 to signal conditioning package 300 with the preview image data.
Carry out step S906 after step S905, signal conditioning package 300 makes preview image acquiring unit 320 obtain the positional information of preview image data and file and picture key element from MFP 200.In addition, in step S906, signal conditioning package 300 makes indicative control unit 350 show preview image based on the preview image data that this obtains on display device 32.
Carry out step S907 after step S906, signal conditioning package 300 makes the rectangle that regional display unit 325 shows within the preview images based on the positional information of file and picture key element, and it represents the zone of file and picture key element respectively.
After having carried out step S907, stop the demonstration of document image data.
The demonstration of rectangle will be described then.Figure 11 represents the example of display screen 32B, and wherein preview image is displayed on the display device 32.
The display screen 32B of Figure 11 is the display screen when selecting thumbnail image 82 from the tabulation of the document image data of Figure 10.
Suppose to comprise file and picture key element 91,92 and 93 from wherein generating the source document image that is presented at the preview image 90 on the display screen 32B.Therefore, show that among preview image 90 the rectangle 94A in the zone be used to represent file and picture key element 91, the rectangle 94B and being used to that is used to represent the zone of file and picture key element 92 represent the rectangle 94C in the zone of file and picture key element 93.
In order to show preview image 90, show rectangle 94A, 94B and 94C based on file and picture key element of obtaining with the preview image data 91,92 and 93 positional information.
In this embodiment, the layout of the file and picture key element in document image- element 91,92 and 93 layout and the source document image that document image data is provided is identical in preview image 90.
In this embodiment, may change according to the kind of file and picture key element by rectangle 94A, the 94B of regional display unit 325 demonstrations and the color of 94C.For example, when the kind of file and picture key element 91 is image, can be blue, and when the type of file and picture key element 92 is text, can be red the color change of rectangle 94B with the color change of rectangle 94A.
As mentioned above, in this embodiment, register documents view data in MFP 200, and the document image data of this registration is presented on the signal conditioning package 300.
Document image data at this embodiment provides in the system 100, use the above-mentioned functions of MFP 200 and signal conditioning package 300, and can reuse the factor data that is stored in the document image data among the MFP 200, the feasible editor that can carry out file and picture.
The editor of the file and picture among this embodiment will be described below.
In the signal conditioning package 300 of this embodiment, when the editing screen of edit cell 360 display document image on display device 32, can the user element data come the Edit Document image.
In the signal conditioning package 300 of this embodiment, on display device 32, show preview image and editing screen.If use mouse that the file and picture key element of preview image is dragged and dropped into editing screen, the factor data of the file and picture key element of selection can be attached on the editing screen.
Figure 12 is the process flow diagram that is used to illustrate the editor of the file and picture that the signal conditioning package 300 by first embodiment carries out.
In step S1201, signal conditioning package 300 obtains the preview image data of document image data.Obtaining of preview image data with top described identical.
Proceed to step S1202 after step S1201, indicative control unit 350 shows preview image based on the preview image data of obtaining on display device 32.In the preview image of this demonstration, also show the rectangle in the zone of representing the file and picture key element respectively.The editing screen of edit cell 360 display document image on display device 32.
Carry out step S1203 after step S1202, file and picture key element selected cell 330 is chosen in the file and picture key element in the preview image.
In the preview image 90 of this embodiment, if cursor is placed on by clicking on the point in the zone that surrounds of rectangle 94A, 94B and 94C and by the pointing device of for example mouse, select in the file and picture key element 91,92 and 93 of a correspondence of the click among rectangle 94A, 94B and the 94C.Therefore, the file and picture key element selected cell 330 of this embodiment is arranged the output signal that receives input block 31.
If select the file and picture key element in signal conditioning package 300, the positional information of the file and picture key element of select command and selection is sent to MFP 200.
Carry out step S1204 after step S1203, signal conditioning package 300 obtains the factor data corresponding to the file and picture key element of selecting.In addition, in step S1204, determine whether the factor data corresponding to the file and picture key element of selecting is text data in step S1203.
When the factor data corresponding to the file and picture key element of selecting in step S1203 was text data, control proceeded to step S1205.In step S1205, signal conditioning package 300 makes factor data acquiring unit 340 obtain text data corresponding to the file and picture key element of selecting as factor data based on the area information that obtains with the preview image data and text data.At length, factor data acquiring unit 340 is extracted in the text data in the zone of being represented by area information from the text data that obtains with the preview image data, and with the text data that obtains as factor data.
After step S1205, carry out step S1206, the text data (factor data) that signal conditioning package 300 makes indicative control unit 350 be presented at step S1205 in preview image to obtain.
Alternatively, indicative control unit 350 can be arranged and show near the window of selecting of file and picture key element in the preview image, and shows corresponding text data in window.
In the above embodiments, in the inside of using click rectangular areas such as mouse, carry out the selection of file and picture key element.The present invention is not limited to this embodiment.For example, top embodiment can be modified and make when cursor is arranged in the rectangular area, and display window also shows corresponding text data in window.
Carry out step S1207 after step S1206, what signal conditioning package 300 made that scope selected cell 342 selects from the text data that shows will be by the scope of the text data of drag and drop.At length, by using for example pointing device of mouse, selecting in the text data from the window of videotex data wherein will be by the text data of drag and drop.Therefore, the scope selected cell 342 of this embodiment can be made of the input block 31 that is provided in the signal conditioning package 300.
After step S1207, carry out step S1208, carry out the drag-and-drop operation of the text data that is chosen as edit object.After this, signal conditioning package 300 makes the scope extraction unit of selecting 344 extract the text data in the scope of selecting from the text data that factor data acquiring unit 340 obtains.
Finally, proceed to step S1209, in editor shows, show the text data that extracts by edit cell 360.
On the other hand, when the factor data corresponding to the file and picture key element of selecting in step S1203 was not text data in step S1204, control proceeded to step S1210.In step S1210, editing screen is carried out the drag and drop of the file and picture key element of selecting.After the file and picture key element that drag and drop are selected in step S1210, control proceeds to step S1211.In step S1211, signal conditioning package 300 makes factor data acquiring unit 340 obtain the factor data of the file and picture key element of selection.
To provide the description of obtaining of factor data below.In response to the select command and the positional information that receive from signal conditioning package 300, MFP 200 makes factor data extraction unit 260 obtain the document image data of the file and picture key element that comprises selection from document image data portion 282.Make factor data extraction unit 260 position-based information from the document image data that obtains, excise and extract factor data corresponding to the file and picture key element.Cut factor data is to have the data of document image data that resolution is higher than the resolution of preview image.The factor data acquiring unit 350 of signal conditioning package 300 obtains the factor data that unit 270 outputs are provided by the factor data of MFP 200.
Carry out step S1209 after step S1211, signal conditioning package 300 makes edit cell 360 show the factor data that obtains on editing screen.
By this way, in the signal conditioning package 300 of this embodiment, can be arranged in the factor data that shows on the editing screen arbitrarily.
As mentioned above, in this embodiment, during at every turn from document image data selection file and picture key element, excision and extraction are corresponding to the factor data of the file and picture key element of selecting from document image data.Therefore, embodiment may be divided into document image data aforesaid file and picture key element and not need to preserve the data of each file and picture key element hereto.Therefore, may reduce the needed storage space of accumulation file and picture key element.
In this embodiment, if in preview image, select the file and picture key element, be higher than the factor data that extracts the document image data of resolution of preview image corresponding to the file and picture key element of selecting from having resolution.Therefore, if embodiment may maintain the quality of the image reused on the high level hereto.
The editor of file and picture is described below with reference to Figure 13.Figure 13 represents the example of display screen, wherein shows preview image and editing screen.
In the display screen 32C of Figure 13, show preview image 90 and editing screen 111.The preview image 90 that is presented among the display screen 32C comprises file and picture key element 91,92 and 93, and the rectangle 94A-94C that represents the zone of file and picture key element 91-93 respectively.
The editor of the file and picture when the factor data of the file and picture key element of selecting among the step S1203 at Figure 12 is text data at first will be described.
In display screen 32C, the file and picture key element 92 in preview image 90 is chosen as the factor data that will be reused.In the example of display screen 32C, file and picture key element 92 is text datas.For example, if cursor K is placed on the point in the zone of the file and picture key element 92 in the preview image 90 and by using mouse to select file and picture key element 92, demonstration is used for the window W of videotex data in the position file and picture key element 92 below so.In window W, show the text data that is included in by in the zone of rectangle 94B indication.
For example, if by using cursor K that the scope M of the text data among the window W is chosen as edit object, and scope M is dragged and dropped on the editing screen 111, then the text data 92A among the indication range M in editing screen 111.In this embodiment, the text data among the scope M among the window W can be replicated and make it be attached on the editing screen 111.
The editor of the file and picture when the factor data of the file and picture key element of selecting among the step S1203 at Figure 12 is not text data will be described then.
In display screen 32C, the file and picture key element 91 in preview image 90 is chosen as the factor data that will be reused.If cursor is placed on the point in the zone of the file and picture key element 91 in the preview image 90 and the file and picture key element 91 among the rectangle 94A is dragged and dropped to editing screen 111 in the signal conditioning package 300 of this embodiment, from MFP200 the factor data of file and picture key element 91 is offered signal conditioning package 300 then.Mode same as described above is provided by providing from the factor data of MFP 200.
The factor data 91A that provides of file and picture key element 91 is attached on the editing screen 111.When factor data 91A can be attached to drag and drop by cursor appointed positions in editing screen 111.Suppose document image-element 91 composing images in the example of display screen 32C.Therefore, factor data 91A is the view data of extracting from document image data.
Therefore, in this embodiment, when factor data was text data, text data can be displayed in the preview image 90 before the executive editor in editing screen 111.Based on this reason, in this embodiment, can when whether checking document image data before the editor, correctly obtain text data by text data acquiring unit 215 in input.
In addition, in this embodiment, selection portion divides text data as edit object in the text data that only shows from preview image, and the text data of selecting can be reused.Therefore, in this embodiment, when reusing text data, no longer must carry out the complex operations of deleting the unnecessary data of once obtaining.
According to this embodiment, can come the Edit Document image by reusing the factor data that is stored in the document image data among the MFP 200, and the file and picture key element of formation document image data can be reused easily.
Can revise the foregoing description and make that factor data that extract and that be reused is stored in the page table 284 from document image data.At this moment, factor data can be associated with the page of the document image data that comprises factor data by page ID and be stored.
In the above-described embodiments, when file and picture key element composing images, factor data is acquired as view data, and when the file and picture key element constituted text, factor data was acquired as text data.Yet the present invention not only is confined to the foregoing description.
Alternatively, the signal conditioning package 300 of the foregoing description can be arranged and make when carrying out predetermined operation in selecting the file and picture key element, and the factor data identification that can carry out about correspondence is acquired as determining of view data or text data.In so optional embodiment, MFP 200 must be able to carry out the OCR (optical character identification) that is used for document image data and handle, and obtains the character code corresponding to the text data of all file and picture key elements that constitute document image data.
Thus, when file and picture input block 205 input document image datas, the MFP200 of optional embodiment can carry out the OCR that is used for document image data and handle, obtain the character code of the obtained result's who handles as OCR text data, and by page ID with the document data that obtains be associated with the page of document image data will acquisition text data store in page table 284.
Alternatively, when carrying out scheduled operation in the file and picture key element of selecting composing images on signal conditioning package 300, the MFP 200 of this embodiment can be arranged to determine that having received text data from signal conditioning package 300 obtains order.In this case, MFP 200 will provide the result of text data as the OCR processing (substituting factor data) to signal conditioning package 300, and not extract factor data from document image data.
Alternatively, when carrying out scheduled operation in the file and picture key element of selecting the formation text on signal conditioning package 300, the MFP 200 of this embodiment can be arranged to determine that having received text data from signal conditioning package 300 obtains order.In this case, MFP 200 will provide factor data as view data the factor data of text data (rather than as) to signal conditioning package 300.The factor data that is provided in this case is the view data of extracting from document image data.
For example, above-mentioned scheduled operation is the operation of being clicked file and picture key element (being presented in the signal conditioning package 300) by mouse (selection), depresses definite key of keyboard simultaneously, and this is carried out by the user.
Various details second embodiment.In the second embodiment of the present invention, be arranged in the Web browser 370 in the signal conditioning package 300 of first embodiment and the function of edit cell 360 and be disposed among the MFP 200.
In a second embodiment, use identical reference number representative and the corresponding elements components identical among first embodiment, and the descriptions thereof are omitted.
Figure 14 represents that the document image data of second embodiment provides the composition of the 100A of system.
The document image data of Figure 14 provides the 100A of system to be made of multi-function peripheral (MFP) 200A and signal conditioning package 300, and the two links together by network 400.
As shown in figure 14, the MFP 200A of this embodiment also comprises Web browser 370 and edit cell 360 (its corresponding unit with the signal conditioning package 300 of first embodiment is identical) except the unit of arranging in the MFP 200 of first embodiment.
Identical among the function of Web browser 370 and edit cell 360 and above-mentioned first embodiment in a second embodiment.The MFP 200A of second embodiment is arranged and makes and can show preview image on the guidance panel 28 of MFP 200A, wherein rectangle (rectangle) is indicated the zone of file and picture key element respectively, and allows the user of MFP 200A to select the file and picture key element from the file and picture key element that shows.The editor that can use the factor data cause MFP 200A of the file and picture key element of selection to carry out file and picture.Therefore, according to second embodiment, document image data can easily be reused.
The present invention is not limited to specific disclosed embodiment, can carry out variants and modifications and does not depart from scope of the present invention.

Claims (12)

1. document image data generator, it provides document image data to signal conditioning package, and the document view data generator comprises:
The file and picture input block, configuration is used to import document image data;
The file and picture key element that region identification block, configuration are used for being identified in the document image data that constitutes input comprises file and picture key element text filed of text data, and another zone that comprises the data document image-element except text data;
Text data acquiring unit, configuration are used for obtaining the text filed text data that comprises by region identification block identification; And
The unit is provided, configuration is used in response to the document image data request that receives from signal conditioning package, provide the view data that generates from the document image data of input, have the resolution lower to signal conditioning package than the resolution of the document image data of input, and the text data that obtains by the text data acquiring unit.
2. document image data generator according to claim 1, further comprise image generation unit, configuration is used to generate the document image data with resolution lower than the resolution of the document image data of importing, to allow the selection of the file and picture key element in signal conditioning package.
3. document image data generator according to claim 2, wherein image generation unit is arranged to and generates first document image data with first resolution lower than the resolution of the document image data of importing, and second document image data with second resolution lower than first resolution of first document image data.
4. according to each the described document image data generator in the claim 1 to 3, further comprise the factor data extraction unit, configuration is used for when signal conditioning package has been selected the file and picture key element of document image data of input, the factor data of the file and picture key element of extract selecting from the document image data of input, wherein
The described configuration of cells that provides is for providing the factor data factor data that extraction unit is extracted to signal conditioning package.
5. signal conditioning package, it is connected to the document image data generator, and the document view data generator provides document image data to signal conditioning package and comprise: the file and picture input block, configuration is used to import document image data; The file and picture key element that region identification block, configuration are used for being identified in the document image data that constitutes input comprises file and picture key element text filed of text data, and another zone that comprises the data document image-element except text data; Text data acquiring unit, configuration are used for obtaining the text filed text data that comprises by region identification block identification; And provide the unit, configuration is used in response to the document image data request that receives from signal conditioning package, the view data that generates from the document image data of input, have the resolution lower than the resolution of the document image data of importing is provided to signal conditioning package, and the text data that obtains by the text data acquiring unit, this signal conditioning package comprises:
Acquiring unit, configuration are used for obtaining the document image data of input and the text filed text data of discerning that comprises from the document image data generator;
File and picture key element selected cell, configuration are used for selecting from the document image data of input the file and picture key element of the document image data of formation input; And
Indicative control unit, configuration are used for when the factor data of the file and picture key element of being selected by file and picture key element selected cell is text data, the corresponding text data of factor data on display device in demonstration and the text data that is obtained by acquiring unit.
6. signal conditioning package according to claim 5 further comprises:
Scope selected cell, configuration are used for selecting will be by from being presented at the scope that text data on the display device extracts text data; And
The text data that the scope extraction unit of selecting, configuration are used on being presented at display device is extracted in by the text data the scope of scope selected cell selection.
7. according to the signal conditioning package of claim 5 or 6, further comprise the factor data acquiring unit, configuration is used to obtain the factor data of the file and picture key element of being selected by file and picture key element selected cell.
8. a document image data provides system, provides in the document view data that the document image data generator is connected by network with signal conditioning package in the system,
The document image data generator provides document image data to signal conditioning package and comprise: the file and picture input block, and configuration is used to import document image data; The file and picture key element that region identification block, configuration are used for being identified in the document image data that constitutes input comprises file and picture key element text filed of text data, and another zone that comprises the data document image-element except text data; Text data acquiring unit, configuration are used for obtaining the text filed text data that comprises by region identification block identification; And provide the unit, configuration is used in response to the document image data request that receives from signal conditioning package, the view data that generates from the document image data of input, have the resolution lower than the resolution of the document image data of importing is provided to signal conditioning package, and the text data that obtains by the text data acquiring unit
Signal conditioning package comprises: acquiring unit, configuration are used for obtaining the document image data of input and the text filed text data of discerning that comprises from the document image data generator; File and picture key element selected cell, configuration are used for selecting from the document image data of input the file and picture key element of the document image data of formation input; And indicative control unit, configuration is used for when the factor data of the file and picture key element of being selected by file and picture key element selected cell is text data, the corresponding text data of factor data on display device in demonstration and the text data that is obtained by acquiring unit.
9. a document image data provides method, is carried out by the document image data generator that document image data is provided to signal conditioning package, and the document view data provides method to comprise:
The file and picture input step, the input document image data;
The zone identification step is identified in the text filed of the file and picture key element that comprises text data in the file and picture key element of the document image data that constitutes input, and another zone that comprises the data document image-element except text data;
The text data obtaining step obtains the text data that comprises in regional identification step identification text filed; And
Step is provided, in response to the document image data request that receives from signal conditioning package, provide the view data that generates from the document image data of input, have the resolution lower to signal conditioning package than the resolution of the document image data of input, and the text data that obtains at the text data obtaining step.
10. information processing method, the document image data of the claim 9 of being carried out and being carried out with the document image data generator by signal conditioning package provides method to be performed simultaneously, this signal conditioning package is connected to the document image data generator, and this information processing method comprises:
Obtaining step obtains the document image data of input and the text data that comprises identification text filed from the document image data generator;
The file and picture key element is selected step, selects to constitute the file and picture key element of the document image data of importing from the document image data of input; And
Show controlled step, when the factor data of the file and picture key element of selecting step to select in the file and picture key element is text data, show on the display device with the text data that obtains at obtaining step in the corresponding text data of factor data.
11. a computer readable recording medium storing program for performing, storage computation machine readable program, when the computing machine of document image data generator was carried out this computer-readable program, the document image data that makes this computing machine carry out according to claim 9 provided method.
12. a computer readable recording medium storing program for performing, storage computation machine readable program when the computing machine of signal conditioning package is carried out this computer-readable program, makes this computing machine carry out the information processing method according to claim 10.
CN2008102131473A 2007-09-18 2008-09-18 Document-image-data providing system, document-image-data providing device, information processing device and method Expired - Fee Related CN101393564B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2007241585 2007-09-18
JP2007-241585 2007-09-18
JP2007241585 2007-09-18
JP2008209289A JP2009093627A (en) 2007-09-18 2008-08-15 Document-image-data providing system, document-image-data providing device, information processing device, document-image-data providing method, information processing method, document-image-data providing program, and information processing program
JP2008209289 2008-08-15
JP2008-209289 2008-08-15

Publications (2)

Publication Number Publication Date
CN101393564A true CN101393564A (en) 2009-03-25
CN101393564B CN101393564B (en) 2011-12-07

Family

ID=40493857

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008102131473A Expired - Fee Related CN101393564B (en) 2007-09-18 2008-09-18 Document-image-data providing system, document-image-data providing device, information processing device and method

Country Status (2)

Country Link
JP (1) JP2009093627A (en)
CN (1) CN101393564B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663035A (en) * 2012-03-27 2012-09-12 李卫伟 Method, device and terminal for previewing file
CN104820917A (en) * 2014-01-30 2015-08-05 富士施乐株式会社 Document management system, document management device, and document management method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000306103A (en) * 1999-04-26 2000-11-02 Canon Inc Method and device for information processing
JP4350414B2 (en) * 2003-04-30 2009-10-21 キヤノン株式会社 Information processing apparatus, information processing method, storage medium, and program
JP4671885B2 (en) * 2005-06-01 2011-04-20 株式会社リコー Image processing apparatus, program, and image processing method
JP4708888B2 (en) * 2005-07-12 2011-06-22 キヤノン株式会社 Image processing apparatus, image processing method, and computer program

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663035A (en) * 2012-03-27 2012-09-12 李卫伟 Method, device and terminal for previewing file
CN102663035B (en) * 2012-03-27 2015-06-17 北京慧眼智行科技有限公司 Method and device for previewing file
CN104820917A (en) * 2014-01-30 2015-08-05 富士施乐株式会社 Document management system, document management device, and document management method
CN104820917B (en) * 2014-01-30 2019-11-19 富士施乐株式会社 Document file management system, document management apparatus and document management method

Also Published As

Publication number Publication date
JP2009093627A (en) 2009-04-30
CN101393564B (en) 2011-12-07

Similar Documents

Publication Publication Date Title
US7197694B2 (en) Image display system, image registration terminal device and image reading terminal device used in the image display system
US7532757B2 (en) Image processing apparatus, control method therefor, and program
US7880919B2 (en) Image processing apparatus and method
JP4533273B2 (en) Image processing apparatus, image processing method, and program
EP2354966A2 (en) System and method for visual document comparison using localized two-dimensional visual fingerprints
JP4208780B2 (en) Image processing system, control method for image processing apparatus, and program
US8144988B2 (en) Document-image-data providing system, document-image-data providing device, information processing device, document-image-data providing method, information processing method, document-image-data providing program, and information processing program
JP7337612B2 (en) Image processing device, image processing system, image processing method, and program
US5950213A (en) Input sheet creating and processing system
US20190146646A1 (en) Information processing system, information processing apparatus, and non-transitory computer readable medium
JP2001337994A (en) Thumbnail display system and method and recording medium with processing program therefor recorded therein
US8355577B2 (en) Image processing apparatus and method
CN101393564B (en) Document-image-data providing system, document-image-data providing device, information processing device and method
US8194982B2 (en) Document-image-data providing system, document-image-data providing device, information processing device, document-image-data providing method, information processing method, document-image-data providing program, and information processing program
JP2007325196A (en) Device and method for managing document
JP2018195899A (en) Information processing apparatus and information processing program
JP2022170175A (en) Information processing apparatus, information processing method, and program
CN102196114B (en) Image processing apparatus and image processing method
JP2011053901A (en) Device, system, method and program for providing document image data, and background processing program
JP5831477B2 (en) Communication system, information processing apparatus, and program
JP2001297114A (en) Document processor
JP2011146852A (en) Control apparatus and control method
JP2010287094A (en) Apparatus and method for processing information and program
CN113378610A (en) Information processing apparatus and computer readable medium
JPH10260989A (en) Document information management system and discriminating method for medium form

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20111207

Termination date: 20170918