JP2008028716A - Image processing method and apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suitably change the security levels according to the change of the security conditions, in a system which vectrizes image data for the re-edition and sets the security level. <P>SOLUTION: The apparatus comprises: a means for executing the vectorizing process of images; a means for registering images in a server with security levels added thereto; a means for deciding whether the image is re-editable or printable according to a security level obtained by an information detecting means and a user level obtained from a user level obtaining means; a means for outputting an edited image with a security level added thereto; a means for recording the history of the added security level; and a means for issuing alarm according to the security level history when using the image registered in the server. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that processes document data as image information, and more particularly to a method and apparatus for effectively concealing image information and improving the security of document data.

  When an original data file of characters and images is stored in an image storage device using an MFP (multifunction multifunction peripheral) with an extended function, the original data file is printed and recorded on a paper document. There is an apparatus in which input image data is converted into vector data so that it can be edited, re-edited, and printed out.

However, since editing can be easily performed, it is not only easy to falsify data, but there is also a problem of copyright protection. Therefore, it is necessary to set a security level for each data. As a method of setting this security level, for example, it is considered to embed information such as a watermark so that a human cannot perceive an image. As this digital watermarking technique, a method such as Patent Document 1 in which image data is wavelet transformed and data is embedded using redundancy in a frequency space is known.
JP 2000-106624 A

  However, there are problems such as forgetting to embed security information, determining an appropriate security level, or accidentally setting a low security level.

  Therefore, in the present invention, the user level acquisition unit that acquires the user level by the user recognition unit, the image input unit that inputs the image information, and the image area information obtained by the image input unit are divided into blocks. Block selection means, information detection means for detecting pointer information and security level of information from information embedded in the block selected image, and image search and acquisition means for searching and acquiring an image in the server from the pointer information If the image cannot be acquired by the image search / acquisition means, or if the pointer information cannot be obtained, vectorization means for vectorizing the image, and adding a security level to the image and registering it in the server Image registration means and security obtained by the information detection means Means for determining whether the image is editable or printable according to the level and the user level obtained by the user level acquisition means; means for adding the security level to the edited image and outputting the edited image; There is provided an image processing apparatus comprising: a means for recording a history of added security level; and a security warning means for issuing a warning according to the security level history when using an image registered in a server. It is aimed.

  The security level can be appropriately changed according to the change of the security state in the system that can vectorize from the image data and can set the security level and can set the security level.

[First embodiment]
Next, a first embodiment of an image processing method according to the present invention will be described with reference to the drawings.

[Image processing system]
In FIG. 1, the image processing system for implementing the first embodiment of the image processing method according to the present invention is used in an environment in which area 1 and area 2 are connected by the Internet 104.

  A LAN 107 constructed in the area 1 includes an MFP (multifunction multifunction peripheral) 100 as a recording device, a management PC 101 that controls the MFP 100, a client PC (external storage means) 102, a document management server 106, and a document management server 106. Is connected to the database 105.

  A LAN 108 is constructed in the area 2, and a document management server 106 and a database 105 for the document management server 106 are connected to the LAN 108.

  A proxy server 103 is connected to the LANs 107 and 108, and the LANs 107 and 108 are connected to the Internet via the proxy server 103.

  The MFP 100 is in charge of part of the image processing for the input image read from the document, and the image data as the processing result is input to the management PC 101 via the LAN 109. The management PC 101 is a normal computer including an image storage unit, an image processing unit, a display unit, an input unit, and the like. Functionally, some of these components are integrated with the MFP 100, and the components of the image processing system It has become. In the present embodiment, the search processing described below is executed in the management PC, but the processing performed in the management PC may be executed in the MFP.

  Further, the MFP 100 is directly connected to the management PC 101 via the LAN 109.

[MFP]
In FIG. 2, an MFP 100 includes an image reading unit 110 having an unillustrated auto document feeder (ADF). The image reading unit 110 irradiates a bundle-like or one original image with a light source, and a reflected image with a lens. An image is formed on the solid-state imaging device. The solid-state imaging device generates an image reading signal having a predetermined resolution (for example, 600 dpi) and a predetermined density level (for example, 8 bits), and image data including raster data is configured from the image reading signal.

  The MFP 100 includes a storage device 111 and a recording device 112, and when executing a normal copying function, the image data is processed by the data processing device 115 and converted into a recording signal. In the case of copying a plurality of sheets, a recording signal for one page is temporarily stored in the storage device 111 and then sequentially output to the recording device 112 to form a recorded image on the recording paper.

  The MFP 100 includes a network IF 114 for connection with the LAN 107, and the image data output from the client PC 102 can be recorded by the recording device 112. The image data output from the client PC 102 is converted into a recording signal that can be recorded by the data processing device 115 from the LAN 107 via the network IF 114 and then recorded as a recorded image on the recording paper in the MFP 100.

  The MFP 100 is operated through a key operation unit (input device 113) provided in the MFP 100 or an input device (keyboard, pointing device, etc.) of the management PC 101. For these operations, the data processing apparatus 115 executes predetermined control by an internal control unit (not shown).

  In addition, a user recognition device 118 is connected to the input device 113 to perform user identification.

  The user recognition device is a biometric authentication means such as an IC card, ID input means, fingerprint or iris identification, and is an apparatus that identifies a user to be used.

  Further, a security level is set and stored for each user on the MFP side, and not only the user can be specified by the user recognition apparatus but also the security level for each user can be acquired.

  This security level may be stored in the IC card.

  The MFP 100 includes a display device 116, and the display device 116 can display an operation input state and image data to be processed.

  The storage device 111 can be directly controlled from the management PC 101 via the network IF 117. The LAN 109 is used for data exchange and control signal exchange between the MFP 100 and the management PC 101.

[Overall flow of image processing method]
The first embodiment of the image processing method according to the present invention is executed by each step of FIG.

  Step S301: The user is identified from the user recognition device 118. For identification, an individual is identified by biometric authentication such as an ID card, PIN, or fingerprint.

  If the unregistered ID, password, fingerprint, etc. do not match, a message indicating that personal authentication cannot be performed is displayed on the display device 116.

  When personal authentication is performed, a user security level registered in advance in a database on the MFP or network is acquired.

  For example, the security level of this user is classified into the following five levels together with the security level of the image as follows.

Level 5: All images can be printed and edited Level 4: Images below Level 4 can be printed and edited Level 3: Images below Level 3 can be printed and edited Level 2: Images below Level 2 Level 1: All images with security level cannot be printed or edited Step S302: When the user authentication is completed, the image reading unit 110 of the MFP 100 is operated to rasterize one original. The image reading signal having a predetermined resolution and a predetermined density level is acquired. The image reading signal is preprocessed by the data processing unit 115 and stored in the storage device 111 as image data for one page of the input image. Next, the process proceeds to step S303.

  Step S303 (Block selection (area division) step): The image data area stored in the storage device 111 by the management PC 101 is divided into a character / line drawing area including characters or line drawings, a halftone photo area, and an irregular image. Divide into areas and others. Further, with respect to the character / line drawing area, a character area mainly including characters and a line drawing area mainly including tables and figures are separated, and the line drawing area is separated into a table area and a graphic area. In this embodiment, connected pixels are detected and divided into regions for each attribute using the shape, size, pixel density, etc. of the circumscribed rectangular region of the connected pixels, but other region dividing methods are used. It doesn't matter.

  For the character area, the clustered blocks of each character paragraph are segmented into rectangular blocks (character area rectangular blocks), and in the line drawing area, individual objects such as tables and figures (table area rectangular block, line drawing area rectangular block) Segment into rectangular blocks every time.

  The photograph area expressed in halftone is segmented into rectangular blocks for each object such as an image area rectangular block and a background area rectangular block.

  Information on these rectangular blocks is referred to as “region division information”.

  Step S304: The area division information obtained in the block selection step and the input image are combined and displayed on the operation screen on the display device 116 of the MFP 100.

  An example of the operation screen displayed on the display device 116 is shown in FIG.

  On the operation screen, the input image itself is displayed as an image 41 on the left half, and an image 42 indicating region division information is displayed on the right half by a rectangular block.

  In the image 42, the input image is simply displayed and each rectangular block is indicated by a rectangle.

  In order to facilitate understanding of the concept of the rectangular block, each rectangular block is provided with TEXT, PICTURE, LINE, and TABLE indicating the attribute, but the attribute information is not actually displayed and divided. The rectangular area is displayed as a frame line.

  TEXT, PICTURE, LINE, and TABLE are attribute displays for a character area rectangular block, a drawing area rectangular block, a line figure area rectangular block, and a table area rectangular block. PHOTO indicating a photograph area rectangular block and other attribute displays are used.

  In FIG. 4, the input image and the area division information are displayed side by side, but various display forms are possible, such as displaying a rectangular block divided on the input image by overlapping them.

  Step S305: The image data of the region division information specified in step S304 is cut out, and the following processing is performed on the cut out image data.

  Step S306: An information detection process is performed to determine whether or not the pointer information of the original data file and the security information of the image are embedded in the image within the area or the entire image.

  As the image information recorded in the document image, a two-dimensional barcode, character string, a digital watermark as invisible information is detected, the information is decoded, and a storage device in which the original data file of the input image is stored The pointer information and the security level of the image are detected.

  Step S307 (pointer information extraction step): The pointer information in step S306 is detected, and the pointer information stored in the original image is extracted from the information from the OCR, OMR, or digital watermark information. The pointer information includes an image name, a server where the image is stored, an IP address of the server, and the like.

  Step S308 (security information extraction step): The security level for each image is extracted by the image information detection process in step S306.

  The security level is the security level information of the image set at the time of printing, or the security level information set by the user at the time of printing for an unregistered image.

  Step S309: It is determined whether pointer information has been acquired for each of the divided images. The image from which the pointer information has been acquired branches to step S314 to directly access the original data file.

  The original data file is stored in the form of an electronic file in the hard disk of the client PC 102 in FIG. 1, the database 105 in the document management server 106, the storage device 111 provided in the MFP 100, and the like obtained in step S308. These storage devices are searched according to the address information (pointer information).

  Step S310 (vectorization step): When pointer information is not extracted, the image data of each area is converted into vector data by vectorization processing.

  The vectorization methods include the following (a) to (f).

  (A) When the specific area is a character area, the character image code conversion is further performed by OCR, or the character size, style and font are recognized, and the character obtained by scanning the document is visually faithful. Convert to font data.

  (B) When the specific area is a character area and cannot be recognized by OCR, the outline of the character is traced, and the outline information (outline) is converted into a format that represents the connection of line segments.

  (C) When the specific area is a graphic area, the outline of the graphic object is tracked and converted into a format in which the outline information is expressed as a connection of line segments.

  (D) Fitting the outline information in the line segment format of b and c with a Bezier function or the like to convert it into function information.

  (E) The shape of the figure is recognized from the contour information of the figure object of c, and converted into figure definition information such as a circle, a rectangle, and a polygon.

  (F) When the specific area is a graphic area and the object is a tabular object in the specific area, a ruled line or a frame line is recognized and converted into form format information of a predetermined format.

  In addition to the above methods, various vectorization processes can be considered in which image data is replaced with command definition information such as code information, graphic information, and function information.

  Step S311: The vectorized data is stored in the server as reusable data. In that case, five levels of security levels can be set according to the importance of the image. In particular, when the security level is not set, the lowest security level 1 is set.

  Step S312: The vectorized data for which the security level is set is stored in the server as reusable data. The stored server pointer and security level are embedded in the image as image information when the image is printed.

  Step S314: When pointer information is acquired in step S307, an original data file is acquired based on the pointer information.

  Step S315: If the original data file is accessible, the latest security level of the image stored with the image on the server is acquired. The security level changes every moment depending on the situation, and may be different from the security level embedded in the paper at the time of previous printing, so it is necessary to always obtain the latest security level.

  The image security level can be changed at any time by an image registrant. In the image data in the database, the registrant's ID information is recorded together with the image, and the registrant can search the list of images registered by the input device 113 from information such as date, file name, image capacity, It is possible to specify the image whose security level is to be changed from the searched files and change the level.

  Next, the main steps of FIG. 3 will be described in detail.

[Block selection step]
In step S303 (block selection step), as shown in the image 42 in the right half of FIG. 4, the input image is divided into rectangular blocks for each attribute. As described above, the attributes of the rectangular block include character (TEXT) / drawing (PICTURE) / line drawing (Line) / table (Table) / photograph (PHOTO).

  In the block selection step, first, the input image is binarized to black and white, and a pixel block surrounded by a black pixel outline is extracted.

  Further, the size of the black pixel block extracted in this way is evaluated, and the contour tracking is performed for the white pixel block inside the black pixel block whose size is a predetermined value or more. As long as the internal pixel block is equal to or greater than a predetermined value, such as size evaluation for the white pixel block and tracking of the internal black pixel block, the internal pixel block is extracted recursively and the contour is traced.

  The size of the pixel block is evaluated by, for example, the area of the pixel block.

  A rectangular block circumscribing the pixel block thus obtained is generated, and attributes are determined based on the size and shape of the rectangular block.

  For example, a rectangular block with an aspect ratio close to 1 and a fixed size range is a character equivalent block that may be a character area rectangular block, and when the adjacent character equivalent blocks are regularly aligned, these characters are equivalent. A new rectangular block in which the blocks are collected is generated, and the new rectangular block is set as a character area rectangular block.

  In addition, flat pixel block is a line drawing area rectangular block, black pixel block that is larger than a certain size and contains square white pixel block in a well-aligned manner is a front region rectangular block, and an area where irregular pixel blocks are scattered is a photo area A rectangular block and other irregular pixel blocks are defined as a photographic area rectangular block.

  In the block selection step, block information such as attributes and input file information shown in FIG. 5 are generated for each of the rectangular blocks generated in this way.

  In FIG. 5, the block information includes attributes of each block, position coordinates X, coordinates Y, width W, height H, and OCR information. The attribute is given by a numerical value of 1 to 5, where 1 is a character area rectangular block, 2 is a drawing area rectangular block, 3 is a table area rectangular block, 4 is a line drawing area rectangular block, and 5 is a photograph area rectangular block. The coordinates X and Y are the X and Y coordinates (upper left corner coordinates) of the start point of each rectangular block in the input image. The width W and the height H are the width in the X coordinate direction and the height in the Y coordinate direction of the rectangular block. The OCR information indicates the presence or absence of pointer information in the input image.

  Furthermore, the total number N of blocks indicating the number of rectangular blocks is included as input file information.

  The block information for each rectangular block is used for vectorization in a specific area. Further, the relative positional relationship when the specific area and other areas are combined can be specified by the block information, and the vectorized area and the raster data area can be combined without impairing the layout of the input image.

[Pointer information and security information extraction step using 2D barcode]
Step S307 (pointer information extraction step) and step S308 (security information extraction step) are executed by each step of FIG.

  FIG. 7 shows a document 310 to be processed in the pointer information extraction step, and the document 310 is stored in a page memory (not shown) in the data processing device 115. In the original 310, character area rectangular blocks 312 and 313, a drawing area rectangular block 314, and a two-dimensional barcode (QR code) symbol 311 are recorded.

  Step S701: First, an input image of the original 310 stored in the page memory of the storage device 111 is scanned by a CPU (not shown), and the position of the two-dimensional barcode symbol 311 is detected from the processing result of the block selection step. To do.

  The QR code symbol is provided with specific position detection element patterns at three of the four corners, and the QR code symbol can be detected by detecting the position detection element pattern.

  Step S702: Next, the format information adjacent to the position detection pattern is restored, and the error correction level and mask pattern applied to the symbol are obtained.

  Step S703: Next, the model number (model) of the symbol is determined.

  Step S704: Using the mask pattern obtained from the format information in step S702, the coding area bit pattern of the QR code symbol is XORed to cancel the QR code symbol mask processing.

  Step S705: An arrangement rule is acquired based on the model obtained in step S703. Based on the arrangement rule, a symbol character is read, and message data and an error correction code word are restored.

  Step S706: The restored message is detected whether there is an error based on the error correction code word. If an error is detected, the process branches to step S707 for correction.

  Step S707: The restored message is corrected.

  Step S708: Based on the mode indicator and the character number indicator, the data code word is divided into segments from the error-corrected data, and the data code word is restored.

  Step S709: The data code character is decoded based on the detected specification mode, and the result is output.

  The data embedded in the two-dimensional bar code includes an image identification name, image position information in the document, security level, IP address, server name and directory name, URL, etc. as shown in FIG. Composed.

  In the present embodiment, the document 310 provided with pointer information in the form of a two-dimensional barcode has been described. However, various pointer information recording forms can be employed.

  For example, pointer information may be directly recorded as a character string according to a character string according to a predetermined rule, and a rectangular block of the character string may be detected by a block selection step. The pointer information can be acquired by recognizing the detected character string.

  Alternatively, in the character area rectangular block 312 or the character area rectangular block 313, modulation that is difficult to visually recognize is added to the interval between adjacent character strings, and the pointer information can be expressed by the information on the character string interval modulation. Such watermark information can be detected by detecting an interval between characters when performing character recognition processing described later, and pointer information can be acquired. It is also possible to add pointer information as a digital watermark.

  Regarding the pointer information extraction as described above, the pointer information can be acquired quickly and reliably by designating a specific area to be vectorized as in the present embodiment. That is, when the user designates a rectangular block in which a barcode, digital watermark or the like is embedded, efficient pointer information extraction can be performed.

[Search electronic files using pointer information]
The electronic file search based on the pointer information in step S314 in FIG. 3 is executed as follows.

  First, a file server is specified based on the address included in the pointer information, and the address is transferred to the file server. The file server includes all of the client PC 102, the document management server 106 including the database 105, and the MFP 100 including the storage device 111. The address is URL or path information including a server name and a file name.

  The file server that receives the address searches the original data file based on this address. When the original data file can be extracted by this file search, the address of the file is notified to MFP 100, and when the user desires to acquire the original data file, the original data file is transferred to MFP 100. On the other hand, when the file cannot be extracted in the file server, MFP 100 is notified of this.

[Vectorization step]
Step S310 (vectorization step) is executed by each step of FIG. The vectorization step is a process of vectorizing image data in the specific area when no pointer information is extracted in the specific area in step S309.

  Step S901: It is determined whether or not the specific area is a character area rectangular block. If the specific area is a character area rectangular block, the process proceeds to step S902 and the subsequent steps, recognition is performed using one pattern matching method, and the corresponding character code is determined. obtain. If the specific area is not a character area rectangular block, the process proceeds to step S912.

  Step S902: In order to perform horizontal writing and vertical writing determination (assembling direction determination) on the specific area, a horizontal / vertical projection of the pixel value is taken within the specific area.

  Step S903: The dispersion of the projection in step S902 is evaluated. If the horizontal projection variance is large, it is determined as horizontal writing, and if the vertical projection variance is large, it is determined as vertical writing.

  Step S904: Based on the evaluation result of step S903, the composition direction is determined, lines are cut out, and then characters are cut out to obtain character images.

  In the case of horizontal writing, character strings and characters are cut out using horizontal projection, and characters are cut out from the projection in the vertical direction with respect to the cut lines. For vertically written character areas, the process is reversed for horizontal and vertical. When cutting out lines and characters, the size of characters can also be detected.

  Step S905: For each character cut out in step S904, an observation feature vector is generated by converting the feature obtained from the character image into a numerical sequence of tens of dimensions. There are various known methods for extracting feature vectors. For example, there is a method in which characters are divided into meshes, and a mesh number-dimensional vector obtained by counting character lines in each mesh as line elements according to directions is used as a feature vector.

  Step S906: The observation feature vector obtained in step S905 is compared with the dictionary feature vector previously obtained for each character type, and the distance between the observation feature vector and the dictionary feature vector is calculated.

  Step S907: The distance calculated in step S906 is evaluated, and the character type with the closest distance is set as the recognition result.

  Step S908: In the distance evaluation in step S907, it is determined whether or not the shortest distance is larger than a predetermined value. When the degree of similarity is equal to or greater than a predetermined value, there is a high possibility that the dictionary feature vector is erroneously recognized as another character having a similar shape. Therefore, if the similarity is greater than or equal to a predetermined value, the recognition result of step S907 is not adopted, and the process proceeds to step S911. When the similarity is lower (smaller) than the predetermined value, the recognition result in step S907 is adopted, and the process proceeds to step 909.

  Step S909 (font recognition step): A plurality of dictionary feature vectors for the number of character types used for character recognition are prepared for the character shape type, that is, the font type, and the character code and the font are used for pattern matching. The character font can be recognized by outputting the seed.

  Step S910: Using the character code and font information obtained by character recognition and font recognition, each character is converted into vector data using outline data prepared in advance. When the input image is color, the color of each character is extracted from the color image and recorded together with vector data.

  Step S911: Characters are handled in the same way as general line drawings, and the characters are outlined. In other words, outline vector data that is visually faithful to the image data is generated for characters that are likely to cause erroneous recognition.

  Step S912: When the specific area is not a character area rectangular block, vectorization processing is executed based on the contour of the image.

  Through the above processing, the image information belonging to the character area rectangular block can be converted into vector data that is substantially faithful in shape, size, and color.

[Vectorization of non-character area]
If it is determined in step S912 that the area is not a character area rectangular block, that is, a drawing area rectangular block, a line drawing area rectangular block, a table area rectangular block, or the like, the outline of the black pixel block extracted in the specific area is used as vector data. Convert.

  In vectorization of areas other than character areas, first, “corners” that divide a curve into a plurality of sections (pixel columns) are detected in order to represent a line drawing or the like as a combination of straight lines and / or curves. A corner is a point at which the curvature is maximized, and whether or not the pixel Pi on the curve in FIG. 10 is a corner is determined as follows.

  That is, a line segment L connects pixels Pi−k and Pi + k separated from each other by a predetermined number of pixels (k pixels) in both directions along the curve, starting from Pi. When the distance between the pixels Pi-k and Pi + k is d1, the distance between the line segment L and the pixel Pi is d2, and the arc length between the curved pixels Pi-k and Pi + k is A, d2 is a maximum. Or when the ratio (d1 / A) is less than or equal to the threshold, the pixel Pi is determined to be a corner.

The pixel row divided by the corner is approximated by a straight line or a curve. The approximation to a straight line is executed by the least square method or the like, and the approximation to a curve uses a cubic spline function or the like. The pixel at the corner that divides the pixel row is the approximate line or the start or end of the approximate line.

  Furthermore, it is judged whether or not the inner contour of the white pixel block exists in the vectorized contour, and when there is an inner contour, the contour is vectorized and recursively inverted as the inner contour of the inner contour. The inner contour of the pixel is vectorized.

  As described above, the outline of a figure having an arbitrary shape can be vectorized by using the contour line approximation. If the original document is in color, the figure color is extracted from the color image and recorded together with vector data.

  As shown in FIG. 11, when the outer contour PRj and the inner contour PRj + 1 or another outer contour are close to each other in a certain section of interest, two or a plurality of contour lines are combined and expressed as a line having a thickness. can do. For example, the distance PiQi from each pixel Pi of the contour Pj + 1 to the pixel Qi that is the shortest distance on the contour PRj is calculated, and when the variation of PQi is slight, the interval of interest is set to the midpoint Mi of the pixels Pi and Qi. It can be approximated by a straight line or curve along the point sequence. The thickness of the approximate line and the approximate curve is, for example, an average value of the distance PiQi.

  A table ruled line, which is a line or a set of lines, can be efficiently expressed as a vector by using a set of lines having a thickness.

  After the outline summarization process, the entire process is terminated.

  Note that the photographic area rectangular block is not vectorized and remains as image data.

[Figure recognition]
After the outlines of the above line figures and the like are vectorized, the vectorized dividing lines are grouped for each graphic object.

  Each step of FIG. 12 shows a process of grouping vector data for each graphic object.

  Step S1401: First, the start point and end point of each vector data are calculated.

  Step S1402 (graphic element detection): A graphic element is detected using the start point and end point information obtained in step S1401. A graphic element is a closed graphic formed by a dividing line, and a vector is connected at a common corner pixel serving as a start point and an end point for detection. That is, the principle that each vector constituting the closed shape has a vector connected to both ends thereof is applied.

  Step S1403: Next, other graphic elements or dividing lines existing in the graphic element are grouped into one graphic object. If there is no other graphic element or dividing line in the graphic element, the graphic element is set as a graphic object.

[Detection of graphic elements]
The process of step S1402 (graphic element detection) is executed by each step of FIG.

  Step S1501: First, unnecessary vectors that are not connected to both ends are removed from vector data, and a vector constituting a closed figure is extracted.

  Step S1502: Next, for the vectors constituting the closed figure, the vectors are searched in order in a certain direction, for example, clockwise, with the end point (start point or end point) of one of the vectors as the start point. That is, the end point of another vector is searched at the other end point, and the closest end point within a predetermined distance is set as the end point of the connected vector. When the vector constituting the closed figure is rotated by one and returned to the starting point, all the passed vectors are grouped as a closed figure constituting one graphic element. In addition, all closed graphic constituent vectors inside the closed graphic are also grouped. Further, the same processing is repeated with the starting point of a vector not yet grouped as a starting point.

  Step S1503: Finally, from the unnecessary vectors removed in Step S1501, a vector whose end point is close to the vector grouped as a closed graphic in Step S1502 is detected and grouped as one graphic element.

  With the above processing, a graphic block can be handled as a reusable individual graphic object.

[Flow of image editing and output processing]
The flow of image editing and output processing will be described with reference to FIG.
Each image in the document image can be handled as a graphic object, and an image whose security level is determined for each image is redisplayed on the display device 116.

FIG. 15A shows an image when it is displayed again.
Step S1401 (Image Redisplay): The image 310 includes a security level 1 character object 312, a security level 2 character object 313, and a security level 5 image object 314.

  When the user security level by the user identification means is 4, since the objects 312 and 313 are objects having a security level lower than the user level, this user can perform editing processing such as enlargement, reduction, movement, and change. However, since the object 314 is an object having a security level higher than the security level of the user, the object 314 is shaded to indicate that it cannot be edited.

  Step S1402 (image editing setting): When editing an image, an object is designated on the display device, and editing setting is performed from the input device 113.

  As a method for designating an image, there are a method using a touch panel on a screen, a method using a pointing device, and the like.

  Step S1403 (editing process determination): When an editing object is specified, it is determined whether editing is possible from the security level of the specified object and the security level of the user.

  For example, when the object 312 is selected as an editing target, it is determined that editing is possible because the security level of the user is higher than the security level of the object.

  Step S1404 (image editing processing): When it is determined that editing is possible, the input device 113 performs editing processing.

  The process flow of FIG. 16 describes the process of step S1404 in detail.

  In step S1601, an editable object is edited. Taking the editing of the object 312 as an example, as shown in FIG. 15B, it is possible to enlarge the character string by specifying scaling, add an underline, and add a date. The object name of the object 312 is word040211.

  In step S1602, the security level history of the object is acquired.

  FIG. 17 shows an example of the security level history. It can be seen that level 1 was added at the time of registration for the object word040211, and then levels 1, 2 and 3 were added by the user at the time of output.

  In step S1603, an output security level is set. The security level for output can be set higher than the security level at the time of registration, but it cannot be lowered.

  For example, if the security level at the time of registration is 3, the user can only set the level 3 or higher at the time of output.

Next, in step S1604, among the security levels at the time of past output, the number of times higher than the security level at the time of registration is greater than a threshold (for example, three times), and the level set for output in S1603 is the past. When the output level of the object is lower than the highest level, "The security level of this object is ** (the security level set in S1603: 2 for example). Are you sure?"
For example, according to the history of FIG. 17, the output level set before 12/9 is higher than the level 1 at the time of registration more than 3 times (12/6 4), the highest level of the previously set level is 3, so if the user tries to set level 2, the user will be warned that the security level of this object is 2, but are you sure? put out.

  The user can then set the level carefully with respect to the security level of this object. In the example of FIG. 17, the level set to 12/9 is finally level 3.

  In step S1605, the determined security level is recorded in the security level history of the object.

  With these processes, the process of step S1404 is terminated, and the process proceeds to step S1405.

  Step S1405 (print instruction): After the output layout is determined by the editing process, a print instruction is issued from the input device 113.

  Step S1406 (print process determination): When the print process is instructed, a determination process of whether printing is possible or not is performed according to the security level of the object and the security level of the user.

  Step S1407 (print processing): When an object to be printed is determined, the vector data of each object for printing is subjected to data conversion processing for printing, sent to the recording device 112, printed on a recording medium such as paper, and output. The

[Second Embodiment]
In the first embodiment, the image pointer information and the image security level are set by the two-dimensional barcode and the electronic watermark as the image information of the document.
For example, data such as position information of each image, security level information at the time of registration, security level history information at the time of output, and pointer information of the image as shown in FIG. 18 is registered in the server in the form of form data. By recording the server pointer, form name, etc. as image information in the image, reading the image information at the time of scanning, and obtaining the form data of the image from the server, the coordinates of each image There are methods for acquiring information, pointer information, and security level.

[Third embodiment]
The step S1404 (image editing process) of the third embodiment will be described.

The process flow of FIG. 19 describes the process of step S1404 in detail.
In step S1901, an editable object is edited. Taking the editing of the object 312 as an example, as shown in FIG. 15B, it is possible to enlarge the character string by specifying scaling, add an underline, and add a date. The object name of the object 312 is word040211.

  In step S1902, an object security level history is acquired.

  FIG. 20 shows an example of the security level history. It can be seen that level 1 was added at the time of registration for the object word040211, and then levels 1, 2 and 3 were added by the user at the time of output.

  In step S1903, a security level for output is set. The security level for output can be set higher than the security level at the time of registration, but it cannot be lowered.

  For example, if the security level at the time of registration is 3, the user can only set the level 3 or higher at the time of output.

  In step S1904, the determined security level is recorded in the security level history of the object.

  In step S1905, if the number of times that a level higher than the security level at the time of registration exceeds the threshold value (for example, 3 times) at the time of output, the object registrant is asked to “review security level” (for example, by e-mail) ) Encourage.

  For example, according to the history of FIG. 20, the number of times higher than level 1 at the time of registration is 4 times as of 7/12/2004, exceeding the threshold value of 3 times.

  The security level when registering the word040211 object is 1, but a higher level was set by the user four times. Please consider whether it is necessary to increase the security level of the registered object. Email to registrants. The registrant can then revisit the security level of this object.

  In the example of FIG. 20, the level is changed to 3 by the registrant on 12/14 thereafter.

  With these processes, the process of step S1404 is terminated, and the process proceeds to step S1405.

  By these processes, the same effect as in the first embodiment can be obtained.

[Fourth embodiment]
The step S1404 (image editing process) of the fourth embodiment will be described.

  The processing flow in FIG. 21 describes the processing in step S1404 in detail.

  In step S2101, the editable object is edited. Taking the editing of the object 312 as an example, as shown in FIG. 15B, it is possible to enlarge the character string by specifying scaling, add an underline, and add a date. The object name of the object 312 is word040211.

  In step S2102, an object security level history is acquired.

  FIG. 22 shows an example of the security level history. It can be seen that level 1 was added at the time of registration for the object word040211, and then levels 1, 2 and 3 were added by the user at the time of output.

Next, in step S2103, if a security level higher than the security level at the time of registration is set at the time of output more than a threshold (for example, 3 times), the security level that is forcibly set at the time of registration is set to a higher security level. For example, in the example of FIG. 22, it will be the 4th time on 12/7/2004, and the security level will be forcibly set to level 3 (the higher level is both 2 and 3, so it will be the higher level 3) .

  In step S2104, the changed security level is recorded in the security level history of the object.

  With these processes, the process of step S1404 is terminated, and the process proceeds to step S1405.

  By these processes, the same effect as in the first embodiment can be obtained.

[Fifth Embodiment]
The step S1404 (image editing process) of the fifth embodiment will be described.

  The processing flow in FIG. 21 describes the processing in step S1404 in detail. FIG. 23 shows step S2103 of the fifth embodiment that replaces step S2103 in the processing flow of FIG.

  This will be described with reference to FIGS.

  In step S2101, the editable object is edited. Taking the editing of the object 312 as an example, as shown in FIG. 15B, it is possible to enlarge the character string by specifying scaling, add an underline, and add a date. The object name of the object 312 is word040211.

  In step S2102, an object security level history is acquired.

  FIG. 22 shows an example of the security level history. It can be seen that level 1 was added at the time of registration for the object word040211, and then levels 1, 2 and 3 were added by the user at the time of output.

Next, in step S2103 of FIG. 23, if a security level higher than the security level at the time of registration is set at the time of output more than a threshold (for example, 3 times), and the level of the object registered by the registrant in that case is set. When the setting that can be changed automatically is made, the security level set at the time of registration is forcibly changed to a higher security level. For example, in the example of FIG. Yes. Therefore, if the registrant has set to "can automatically change the level of the registered object", the security level set at the time of registration is forcibly set to level 3 (higher levels are both 2 and 3) Therefore, the higher level becomes 3). If it is not set to "Automatically change the level of the registered object", it is not changed. For example, the registrant says "The security level at the time of registering the word040211 object is 1, but it is higher by the user. The level has been set four times. Please consider whether it is necessary to increase the security level of the registered object. "

  In the example of FIG. 22, “the level of the registered object may be automatically changed” is set, and the security level set at the time of registration is forcibly changed to level 3.

  In step S2104, the changed security level is recorded in the security level history of the object.

  With these processes, the process of step S1404 is terminated, and the process proceeds to step S1405.

  By these processes, the same effect as in the first embodiment can be obtained.

[Sixth Embodiment]
The step S1404 (image editing process) of the sixth embodiment will be described.

  The processing flow in FIG. 21 describes the processing in step S1404 in detail. FIG. 24 shows step S2103 of the sixth embodiment that replaces step S2103 in the processing flow of FIG.

  Hereinafter, a description will be given with reference to FIGS.

  The step S1404 (image editing process) of the sixth embodiment will be described.

The processing flow in FIG. 21 describes the processing in step S1404 in detail.
In step S2101, the editable object is edited. Taking the editing of the object 312 as an example, as shown in FIG. 15B, it is possible to enlarge the character string by specifying scaling, add an underline, and add a date. The object name of the object 312 is word040211.

  In step S2102, an object security level history is acquired.

  FIG. 25 shows an example of the security level history. It can be seen that level 1 was added at the time of registration for the object word040211, and then levels 1, 2 and 3 were added by the user at the time of output.

  Next, in step S2103 in FIG. 24, when a security level higher than the security level at the time of registration is set more than the first threshold value (for example, twice) at the time of output, If you exceed the second threshold (for example, 5 times), the security level set at the time of registration is forcibly increased. Change to security level.

  For example, in the example of FIG. 25, since it was the third time on 12/5/2004, the first threshold (twice) was exceeded, and the registrant was told that “the user has set a higher level three times for object word040211. Please check "warning. However, the registrant has not changed the level. Since the 6th time on 12/11, the second threshold (5 times) has been exceeded, and the security level at the time of registration is forcibly set to level 3 (the higher level has both 2 and 3, so the higher level 3 Change to

  In step S2104, the changed security level is recorded in the security level history of the object.

  With these processes, the process of step S1404 is terminated, and the process proceeds to step S1405.

  By these processes, the same effect as in the first embodiment can be obtained.

1 is a block diagram showing an image processing system for implementing a first embodiment of an image processing method according to the present invention. FIG. 2 is a block diagram showing the MFP in FIG. 1. 1 is a flowchart showing a first embodiment of an image processing method according to the present invention. FIG. 4 is a diagram illustrating a document processed by the image processing method of FIG. 3 and an image of a processing result. It is a table | surface which shows the block information and input file information which are obtained by a block selection process. It is a flowchart which shows the process which extracts pointer information and security information from an image. It is a figure which shows the image of the original document containing pointer information. It is a flowchart which shows the process of vectorization of the character area of FIG. It is a figure which shows the example of the image information analyzed by the image information. It is a figure which shows the process of the corner extraction in the process of vectorization. It is a figure which shows the process of the outline grouping in the process of vectorization. It is a flowchart which shows the process of grouping the vector data produced | generated by vectorization of FIG. It is a flowchart which shows the process of a graphic element detection with respect to the vector data grouped by the process of FIG. 5 is a flowchart showing an image editing and output processing method according to the present invention. FIG. 6 is a diagram illustrating display of a document image after object processing and object security level determination. It is a flowchart which shows the edit process of step S1404 of FIG. 14 of 1st Example. It is a figure which shows the log | history of the security level of a 1st Example. It is a figure which shows the log | history of the security level of a 2nd Example. It is a flowchart which shows the edit process of step S1404 of FIG. 14 of 3rd Example. It is a figure which shows the log | history of the security level of a 3rd Example. It is a flowchart which shows the edit process of step S1404 of FIG. 14 of 4th Example. It is a figure which shows the log | history of the security level of the 4th, 5th Example. It is a flowchart which shows the process part of FIG.21 S2103 of 5th Example. It is a flowchart which shows the process part of FIG.21 S2103 of 6th Example. It is a figure which shows the log | history of the security level of a 6th Example.

Claims (13)

  User level acquisition means for acquiring a user level by means of user recognition means, image input means for inputting image information, block selection means for dividing the block according to image area information of the image obtained by the image input means, Information detecting means for detecting pointer information and security level of the image from information embedded in the block selected image, image searching and acquiring means for searching and acquiring an image in the server from the pointer information, and the image searching When the image cannot be obtained by the obtaining unit, or when the pointer information cannot be obtained, a vectorizing unit that vectorizes the image, an image registration unit that adds a security level to the image and registers it in the server, The security level obtained by the information detection means and the user -A means for judging whether an image can be edited or printed according to a user level obtained by the level acquisition means, a means for adding a security level to the edited image and outputting, and an added security level An image processing apparatus comprising: means for recording the history of the information; and security warning means for issuing a warning according to the security level history when the image registered in the server is used.   User level acquisition means for acquiring a user level by means of user recognition means, image input means for inputting image information, block selection means for dividing the block according to image area information of the image obtained by the image input means, The information indicating the format information storage destination of the image is acquired from the information embedded in the image, the means for acquiring the format information from the server, and the pointer information and the security information of the image described in the format information are acquired. The image acquisition means for searching and acquiring the image in the server, the vectorization means for vectorizing the image when the image acquisition means cannot acquire the image, and the server with a security level added to the image The image registration means to be registered and the security level obtained by the information detection means. And means for determining whether the image can be edited or printed according to the user level obtained by the user level acquisition means, and storing the image format of the edited image data in the server, Means for adding information indicating the image to the image and outputting it, means for recording the history of the added image format, and security for issuing a warning according to the security level history of the image format when using the image registered in the server An image processing apparatus having warning means.   The image processing apparatus according to claim 1 or 2, wherein the information embedded in the image is a character string, barcode information, electronic watermark information, or tint block information.   3. The image forming apparatus according to claim 1, wherein the image pointer information is image identification information, a server name, an IP address, and a URL.   3. The image forming apparatus according to claim 2, wherein the format information is image pointer information and an image security level.   6. The image forming apparatus according to claim 5, wherein the image pointer information described in the format information is image identification information, a server name, an IP address, and a URL.   3. The image forming apparatus according to claim 1, wherein the user recognition unit is an ID card, a biometric authentication unit, or an ID number.   The user level is set in advance according to the user, and printable / impossible, editable / impossible, vectorizable / impossible are set according to the security level of the image. The image forming apparatus according to claim 1 or 2.   The security warning means that the number of times that the security level set at the time of output is added higher than the security level set at the time of registration exceeds the threshold, and the new user exceeds the security level higher than the threshold number of times. 3. The image forming apparatus according to claim 1, wherein a warning is issued when an attempt is made to set a low security level.   3. The image forming apparatus according to claim 1, wherein the security warning means warns the registrant when the number of times a level higher than the security level set at the time of registration exceeds a threshold. .   The security warning means is characterized by forcibly setting the security level set at the time of registration to a high level when the number of times that a level higher than the security level set at the time of registration exceeds the threshold. The image forming apparatus according to claim 1.   The security warning means forcibly switches whether the security level set at the time of registration is forcibly changed to a higher level when the number of times that a level higher than the security level set at the time of registration exceeds the threshold 3. The image forming apparatus according to claim 1, further comprising: a switching unit configured to change a security level set at the time of registration based on the switching unit.   The security warning means gives a warning to the registrant when the number of times that a level higher than the security level set at the time of registration exceeds the first threshold, and forcibly when the number exceeds the second threshold. 3. The image forming apparatus according to claim 1, wherein the security level set at the time of registration is changed to a high level.

Images