JP2006041624A - Print control apparatus and method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire three-dimensional information of an image printed on a paper surface from the image to reuse the information. <P>SOLUTION: When a two-dimensional image in which a three-dimensional image is projected on a flat surface is printed on the paper surface, address information indicating the location of the three-dimensional image data is made into an image and embedded into the same paper surface together with the printed image, and printed for recording. When the image is read with a scanner or the like, an embedded information extracting means 601 firstly extracts the embedded image, an information analyzing means 602 analyzes the image to acquire the address information, and the three-dimensional image data are acquired on the basis of the acquired address information. When a rotating operation is performed by a user for the acquired three-dimensional image, a 3D image rotating means 605 rotates the image, and after the image is rotated by a predetermined amount, a 3D image printing means 606 prints the image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus having, for example, a printout and image scanning function, or connected to a unit having such functions, and in particular, relates to an image so that related information possessed by an electronic document can be recognized on paper. The present invention relates to an information processing apparatus that enables an electronic document having related information indicated by an image to be used when an image formed on a paper surface is read.

Conventionally, various value-added information possessed by electronic data is lost when electronic data is printed on paper, and data obtained by scanning an image from the paper again is the same as the original electronic data. There was a problem that editing and usage could not be realized. To solve this problem, the storage location of the information held in the electronic data and the application identification information that can process the information are inserted as marks at predetermined positions of the document, and the inserted marks are read. A technique for acquiring original electronic information from an image printed on paper is known (see, for example, Patent Document 1).
JP 2001-30588 A

  When 3D data (3D data) is printed on paper, 3D information is lost, and only 2D image information can be acquired even if the image is scanned by scanning the paper. It was not possible to effectively reuse the information.

  Furthermore, even when an image from a viewpoint different from the viewpoint is required for a printed object of 3D data, 3D information cannot be obtained from the printed image. . Therefore, it is necessary to use the original three-dimensional image data to move the viewpoint to a desired position by rotating the object or the like, and to print the resulting two-dimensional image. For this reason, work is very troublesome and productivity is low. In addition, the source of the three-dimensional image data is not always clear.

  As described above, Patent Document 1 exists as a technique for acquiring original electronic information from an image printed on a paper surface. By using this technology, it is possible to acquire value-added information and re-editable application information that the original electronic data has, but further processing speed, efficiency, operability and productivity are desired. .

  The present invention has been made in view of the above-described conventional example, and makes it possible to add the three-dimensional image information lost by printing onto the printed paper, and thus cannot be obtained conventionally by image scanning on the paper. It is possible to easily acquire 3D image information by reading an image formed on a paper surface, and to provide a printing control apparatus and method that can further effectively use information acquired from the paper surface. Objective.

  Also provided is a printing control apparatus and method capable of reading an image formed on a paper surface, acquiring three-dimensional image information from a location obtained from the read image, and printing a two-dimensional image from a desired direction. The purpose is to do.

  In order to achieve the above object, the present invention has the following configuration.

Acquisition means for acquiring location information indicating the location where the 3D image data is stored;
Conversion means for converting the location information into embedded image data in a format in which the contents can be read;
Composite image generation means for generating two-dimensional image data obtained by projecting the three-dimensional image data and combining composite image data associated with the embedded image data;
A printing processing apparatus comprising: means for printing according to the composite image data.

Or
Reading means for reading a document image;
Embedded image extraction means for extracting an embedded image from the document image;
Embedded information restoring means for restoring information embedded from the embedded image;
Acquisition means for acquiring three-dimensional image data based on the location of the three-dimensional image data indicated by the restored embedded information;
Generating means for generating two-dimensional image data obtained by projecting the three-dimensional image data;
A printing processing apparatus comprising: means for printing according to the two-dimensional image data.

  According to the present invention, it is possible to add three-dimensional drawing information lost by printing onto a printed paper surface. Therefore, three-dimensional drawing information that could not be obtained conventionally by image scanning on a paper surface is added to the paper surface. By reading the formed image, it can be easily acquired, and the information acquired from the paper surface can be used more effectively.

  Further, it is possible to read an image formed on a paper surface, acquire three-dimensional image information from a location obtained from the read image, and print a two-dimensional image from a desired direction.

<Overview of printer>
Hereinafter, an example in which the present invention is applied to a laser beam printer (hereinafter abbreviated as LBP) will be described in more detail with reference to the drawings. In this embodiment, an example in which the present invention is applied to a printer control system is shown. First, a configuration of a printer suitable for applying this embodiment will be described with reference to the drawings.

  The printer to which this embodiment is applied is not limited to a laser beam printer, but may be a printer of another printing method, such as an ink jet printer. Furthermore, the software to which the present invention is applied is not limited to the printer control system, but is also supplemented in addition to being widely applicable to word processor (word processor) software, spreadsheet software, plotting software, and the like. .

  FIG. 1 is a diagram showing an outline of a system configuration of an image recording apparatus (printer) according to an embodiment of the present invention. In the figure, a data processing apparatus 101 is a computer, for example, and functions as a supply source of an image processing apparatus control code or a printer control apparatus. In this embodiment, LBP is used as the image recording apparatus 102. The image recording apparatus applied in the present embodiment is not limited to the LBP, and may be a printer of another printing method such as an ink jet printer.

  The printer controller 103 generates raster data for each page based on image information in an image processing apparatus control code (for example, ESC code, page description language, band description language, etc.) supplied from the data processing apparatus 101. It is sent to the printer engine 105. The printer engine 105 forms a latent image on the photosensitive drum based on the raster data supplied from the printer controller 103, and records the image by transferring and fixing the latent image on a recording medium (electrophotographic method). To do. The panel unit 104 is used as a user interface. The user can instruct a desired operation by operating the panel unit 104. The panel unit 104 displays processing contents of the printer 102 and warning contents to the user.

  FIG. 2 is a cross-sectional view illustrating the configuration of the tandem color printer 102. In the figure, 201 is a printer housing. Reference numeral 202 denotes an operation panel on which a switch for giving various instructions by a user, an LED display or an LCD display for displaying messages, printer settings, and the like are arranged. The panel unit 104 shown in FIG. It is one aspect | mode. A board accommodating unit 203 accommodates boards constituting the electronic circuit portions of the printer controller 103 and the printer engine 105.

  A paper cassette 220 holds a paper (recording medium) S and has a mechanism for electrically detecting the paper size by a partition plate (not shown). Reference numeral 221 denotes a cassette clutch that takes out the uppermost sheet S of the paper S placed on the paper cassette 220 and moves the taken paper S to the paper feed roller 222 by a driving force transmitted from a driving means (not shown). It has a cam to convey. The cam rotates intermittently each time a sheet is fed, and feeds one sheet S corresponding to one rotation. Reference numeral 223 denotes a paper detection sensor that detects the amount of paper S held in each paper cassette 220.

  The paper feed roller 222 is a roller that conveys the leading edge of the paper S to the registration shutter 224. Reference numeral 224 denotes a registration shutter that can stop paper feeding by pressing the paper S. 230 is a manual feed tray, and 231 is a manual paper feed clutch. The manual paper feed clutch 231 is used for conveying the leading edge of the paper S to the manual paper feeding roller 232, and the manual paper feeding roller 232 is used for conveying the leading edge of the paper S to the registration shutter 224. The sheet S to be used for image recording is fed by selecting one of the sheet cassette 220 and the manual feed tray 230.

  The printer engine 105 communicates with the printer controller 103 according to a predetermined communication protocol, selects one of the paper feeding means from the paper cassette 220 manual feed tray 230 according to an instruction from the printer controller unit 103, and starts printing. In response to the instruction, the sheet S is conveyed from the corresponding sheet feeding means to the registration shutter 224. The printer engine 105 includes a sheet feeding unit, a mechanism relating to an electrophotographic process such as formation, transfer, and fixing of a latent image, a sheet discharge unit, and a control unit thereof.

  204a, 204b, 204c, and 204d are image recording units having photosensitive drums 205a, 205b, 205c, and 205d, a toner holding unit, and the like, and form a toner image on the sheet S by an electrophotographic process. On the other hand, 206a, 206b, 206c, and 206d are laser scanner units that supply image information by a laser beam to the image recording unit. In the image recording units 204a, 204b, 204c, and 204d, a sheet conveying belt 250 that conveys the sheet S is flattened in a sheet conveying direction (from the bottom to the top in the figure) by a plurality of rotating rollers 251 to 254. In the most upstream area, the sheet is electrostatically attracted to the sheet conveying belt 250 by the attracting roller 225 to which a bias is applied. Further, four photosensitive drums 205a, 205b, 205c, and 205d are arranged in a straight line so as to face the belt conveyance surface, and constitute an image forming unit. In each of the image recording units 204a, 204b, 204c, and 204d, a charger and a developing device are disposed so as to sequentially surround the vicinity of the periphery of the photosensitive drum.

  In the laser scanner units 206a, 206b, 206c, and 206d, reference numerals 207a, 207b, 207c, and 207d are laser units that drive a built-in semiconductor laser in accordance with an image signal (/ VIDEO signal) sent from the printer controller 103. And fire a laser beam. Laser beams emitted from the laser units 207a, 207b, 207c, and 207d are scanned by polygon mirrors (rotating polygon mirrors) 208a, 208b, 208c, and 208d to form latent images on the photosensitive drums 205a, 205b, 205c, and 205d. To do.

  A fixing device 260 fixes the toner image formed on the sheet S by the image recording units 204a, 204b, 204c, and 204d to the recording sheet S by heat. A conveyance roller 261 conveys and conveys the paper S. A paper discharge sensor 262 detects the paper discharge state of the paper S. Reference numeral 263 denotes a paper discharge roller and double-sided printing conveyance path switching roller, which conveys the paper S in the paper ejection direction. If the conveyance instruction for the paper S is paper ejection, the paper S is ejected as it is to the paper ejection tray 264. In the case of conveyance, immediately after the trailing edge of the paper S passes the paper discharge sensor 262, the rotation direction is changed to the reverse direction, and the paper S is conveyed to the double-sided printing conveyance path 270 by switching back. Reference numeral 265 denotes a discharge stack amount detection sensor that detects the stack amount of the sheets S stacked on the discharge tray 264.

  Reference numeral 270 denotes a duplex printing conveyance path. The sheet S conveyed for duplex printing by the discharge roller / double-sided printing conveyance path switching roller 263 is conveyed again to the registration shutter 224 by the duplex conveyance rollers 271 to 274, and is imaged. It waits for a conveyance instruction to the recording units 204a, 204b, 204c, and 204d. The printer 102 can be further equipped with optional units such as an optional cassette and an envelope feeder.

  FIG. 3 is a block diagram illustrating a configuration example of the printer controller 103. In the figure, reference numeral 301 denotes a panel interface unit that performs data communication with the panel unit 104. The CPU 309 can confirm the contents set and instructed by the user on the panel unit 104 via the panel interface unit 301. Reference numeral 302 denotes a host interface unit for two-way communication connection with the data processing apparatus 101 such as a host computer via a network. Reference numeral 306 denotes an engine interface unit for communication connection with the printer engine 105. The CPU 309 can recognize the state of the printer engine 105 via the engine interface unit 306.

  An image data generation unit 303 generates raster data to be supplied to the printer engine 105 based on the image processing device control code supplied from the data processing device 101. Reference numeral 305 denotes an image memory for temporarily storing the generated raster data. Reference numeral 309 denotes a CPU that controls a device connected to the CPU bus 320 based on a control program code held in the ROM 304. Reference numeral 307 denotes a RAM as a temporary storage memory used by the CPU 309, and is configured such that the memory capacity can be expanded by an optional RAM connected to an expansion port (not shown). The RAM 307 is used as a work memory that is temporarily used by a control program stored in the ROM 304. Reference numeral 310 denotes an EEPROM composed of a non-volatile memory for holding control information such as a density correction table. A DMA control unit 308 transfers raster data in the image memory 305 to the engine interface unit 306 in response to an instruction from the CPU 309.

  A CPU bus 320 includes an address, data, and control bus. The panel interface unit 301, host interface unit 302, image data generation unit 303, ROM 304, image memory 305, engine interface unit 306, RAM 307, DMA control unit 308, CPU 309, and EEPROM 310 are all devices connected to the CPU bus 320. Is accessible.

<Process overview>
Next, an embodiment of the present invention will be described with reference to the drawings. FIG. 4 is a block diagram showing the configuration of the information processing system according to the embodiment of the present invention. This information processing system is an extension of the configuration shown in FIG. Station) 410 is connected. In the present embodiment, the configuration and operation of a data processing apparatus connected to a printer will be described. However, the functions of the present embodiment can also be realized by a multifunction peripheral (MFP) that incorporates printer and scanner functions. In the case of this configuration, “data processing apparatus” in the present embodiment should be read as “MFP”.

  In the data processing apparatus 101 of FIG. 4, an input unit 401 is a pointing device such as a keyboard and a mouse, and inputs an operation instruction from a user and a document editing (document creation, information association, etc.) instruction. The information processing unit 402 includes a CPU 402a, a memory 402b such as a ROM and a RAM, and the like, and corresponds to a data processing apparatus main body. In accordance with a user instruction from the input unit 401, the information processing unit 402 creates a document and associates original information with the document (generation of an embedded image, synthesis of an embedded image into a document), which will be described later with reference to FIGS. Process according to the flow procedure. In addition, the information processing unit 402 converts a document as image data input via the image scanner 406 and the FAX 407 into electronic data using a technique such as image processing, and link information printed in the document and embedded information. Information is extracted, and the link information and embedded information can be displayed. The storage unit 403 stores the document itself, link destination information of original information associated with the document, original information attached to the document (related document, image information, audio information, etc.), and the like.

  The display unit 404 displays the document created or edited (including information association) by the information processing unit 402. The image scanner 406 scans a printed paper document, reads it as image data, and supplies it to the information processing unit 402. Also, the FAX 407 receives binarized data (image data) and supplies it to the information processing unit 402. The printer 405 prints out the document created and edited (including information association) by the information processing unit 402 on paper.

  The data processing apparatus 101 described above is connected to a network such as a LAN via a predetermined interface (not shown), and a file server 408, a PC (personal computer) 409, and a W / S (workstation) on the network. Various information such as 410 is exchanged. In particular, in the present embodiment, a document as electronic information, original information, link destination information, and the like may be stored in the file server 408, PC 409, W / S 410, etc. on the network. When the PC 409 and the W / S 410 function as an HTTP (Hypertext Transfer Protocol) server, the data provided by the HTTP is specified and accessed from the data processing apparatus 101 by a URL (Uniform Resource Locator). Can do. Further, when the file server 408 is connected by a LAN (local area network) or the like, the file sharing function provided by the operating system is used as if the file is under the control of the own device. Data provided by the file server 408 as a shared file can be accessed from the data processing device. In addition, if it is an FTP (File Transfer Protocol) server, a file provided by the server can be acquired through FTP, and data provided by an external device can be accessed from the data processing device 101 by various mechanisms for data sharing. it can.

  As described above, the information processing unit 402 synthesizes link information and embedded information into a document and outputs the document as a recognizable document and the input image data as electronic data. The link information and embedded information in the document are extracted, and the added value of the original document (displaying the linked original information, starting the application that created the document, editing data, etc.) is extracted according to the information. It has a document playback function that makes it reusable. Hereinafter, the document editing function and the document reproduction function will be described.

  In order to realize the document editing function, the data processing apparatus 101 includes at least a print document analysis unit (501), a print image generation unit (502), an embedded information generation unit (503), and an image information merge unit (504) shown in FIG. ) And merged image printing means (505). In order to realize the document reproduction function, the data processing apparatus includes at least an embedded information extracting unit (601), an embedded information analyzing unit (602), a 3D image display unit (603), a rotation instruction receiving unit (shown in FIG. 604) 3D image rotating means (605), 3D image printing means (606).

  The role of each function processing means will be described with reference to the drawings. FIG. 5 is a block diagram illustrating a configuration for realizing a function of printing a document including 3D information so that the 3D information can be reproduced. The print document analysis unit (501) acquires a document for which a printing instruction has been received, passes necessary information to the print image generation unit (502) and the embedded information generation unit (503), and starts each operation. A print image generation unit (502) renders an image of a document that has received a print command, and converts the image into image information that can be processed by the printer. The embedded information generation unit (503) detects the storage location of the document that has received the print command acquired from the print document acquisition unit (501), and generates a URL indicating the storage location as a character image. Also, not a character image but a so-called digital watermark that is not directly visualized, such as a method of generating a two-dimensional barcode indicating URL information, a method of embedding information in the space between characters, a method of embedding in a halftone image, etc. You may use the method. The image information merging means (504) merges the print image generated by the print image generating means (502) and the image information indicating the storage location of the print document generated by the embedded information generating means (503) into one image. Convert. The merge image printing unit (505) prints the merge image generated by the image information merge unit (504).

  Each of these means can be realized by hardware, but can also be realized by software. When implemented by software, the data processing apparatus 101, particularly the information processing unit 402, executes a program for realizing the procedure of FIG. Thereby, the configuration of FIG. 5 is realized.

  FIG. 6 is a block diagram showing a configuration for realizing a function of reproducing a document including 3D information printed on a paper surface including 3D information. The embedded information extraction unit (601) scans image information printed on a paper surface in a raster pattern to obtain an image. Alternatively, a method may be used in which physical coordinates of information to be embedded are determined in advance and embedded information is detected only in the area indicated by the coordinates. The embedded information analyzing means (602) detects the object corresponding to the two-dimensional barcode or URL recorded as additional information from the original image read by the embedded information extracting means (601), and the URL recognizes the character by OCR. Alternatively, in the case of a two-dimensional bar code, the mark is decoded to detect location information in the storage device in which the original electronic file of the document is stored. Note that there are other means for adding the location information of the document to be printed, such as a method of embedding information in the space between characters, a method of embedding in a halftone image, and so-called digital watermarking that is not directly visualized. The 3D image display means (603) performs a search based on the location information of the original electronic data of the image printed on the paper surface detected by the embedded information analysis means (602), reads the original electronic data, and performs 2D rendering. Display to the user. Based on the original electronic data image displayed by the 3D image display means (603), the rotation instruction receiving means (604) acquires the coordinate information of the viewpoint in order to view the image from the viewpoint desired by the user. The rotation command and the acquired viewpoint coordinates are delivered to the image rotation means (605). The 3D image rotation means (605) receives the rotation command from the rotation instruction reception means (604), and based on the original document information, the 3D image of the 3D image is displayed so that the image from the received viewpoint coordinates can be visually displayed. Rotate. The 3D image printing unit (606) acquires the image currently displayed by the 3D image display unit (603) and performs printing when receiving a print command from the user. Each unit that processes 3D image data, such as the 3D image display unit 603, the 3D image rotation unit 605, and the 3D image printing unit, can be most easily realized by an application program that creates the 3D image data. In addition, if the data format of the 3D image data is clear, it can be processed even if it is not the application program that created it.

  Each of these means can be realized by hardware, but can also be realized by software. When implemented by software, the data processing apparatus 101, particularly the information processing unit 402, executes a program for realizing the procedure shown in FIG. Thereby, the configuration of FIG. 6 is realized.

<Printing procedure>
Next, a flow of processing for printing electronic data including 3D information will be described with reference to FIGS. 5, 7, 8, and 15. In the following description, it is assumed that each unit in FIG. 5 performs the processes in FIG. 8 and FIG. However, when the data processing apparatus 101 realizes these procedures by software, each process of FIG. 8 is executed by the CPU 402a. FIG. 7 is a diagram showing the flow of processing by paying attention to data to be processed.

  First, the print document analysis unit (501) acquires application data (701) including a 3D object that has received a print command (S801). This process corresponds to, for example, the data processing apparatus 101 opening a document file having a designated name. Next, the embedded information generating means (503) uses the acquired application data (701) to store the location information of the 3D image data that is the contents of the application data (701), that is, the storage address (702) where the data is stored. Is detected and taken out (S802). For example, if the application data is document data, various objects may be inserted therein. Although these objects may actually be included in the document data, only the link information is included in the document data, and the data that is the substance of the object is stored in a location specified by the link information, such as a directory. In some cases. In the case of HTML data, the storage address is already described as the contents of the ref tag. In step S802, the storage address as the link information is extracted.

  Then, the storage address (704) extracted from the application data is converted into an embedded image (706) such as a character image or a two-dimensional barcode indicating the address (S803). This embedded image becomes additional information added to the image to be printed.

  The print image generation means (502) renders the image from the viewpoint that received the print command based on, for example, the three-dimensional image data (703) stored in the location specified by the extracted storage address, and print image It is generated as (705) (S804). For this purpose, the structure of the three-dimensional image data is defined in advance. In step S804, the three-dimensional image data is projected onto a plane and rendered in accordance with the definition. Of course, the process of step S804 can be performed by any application that has generated three-dimensional image data.

  Next, the two images of the embedded image (706) generated in step S803 and the print image (705) generated in step S804 are combined (merged) into one image (S805). At the time of composition, there is no pixel to be drawn with respect to the print image (705) in a coordinate area (referred to as an embedded image area) in which the embedded image (706) is drawn in advance in the entire image after the composition. In this case, the image is combined with the print image so that the embedded image (706) is drawn in the embedded image area as it is. When the print image (705) is also drawn in the embedded image area, the embedded image is synthesized at a predetermined position so that the print image is overwritten with the embedded image (706). That is, in any case, for the image area where embedding is performed, these images are synthesized so that the print image is covered with the embedded image.

  In addition, as a method of embedding an image, a method of embedding information in a space between characters or a method of embedding in a halftone image, such as a so-called digital watermark that is not directly visualized, cannot be recognized from the displayed or printed image with the naked eye. There is also a way to embed. In these methods, the embedded image cannot be created separately from the print image. Therefore, when the embedded image (706) is created using a technique that is not directly visualized such as a digital watermark, a print image is first generated in step S803, and information indicating the storage address of the three-dimensional image data is included in the print image. Embed.

<Add location information>
Next, the location information addition process shown in step S803 will be described in detail. In the case of recording a document to be printed, the original document can be easily acquired when various processes are performed again using this document by recording the location information including the location information.

  FIG. 15 is a flowchart showing a process of encoding a data character string as location information with a two-dimensional barcode (QR code (registered trademark) symbol: JIS X0510) (see FIG. 13) and adding it to an image. The data to be incorporated in the two-dimensional barcode represents the location information of the corresponding file (three-dimensional image data file), and is composed of, for example, path information including a file server name and a file name. Alternatively, it is composed of a URL to the corresponding file, a file ID managed in the database in which the corresponding file is stored, and the like. Alternatively, when the entire system excluding the servers shown in FIG. 4 is realized by a digital multifunction peripheral (MFP), the MFP itself may be in a storage device.

  First, an input data string is analyzed in order to identify different characters to be encoded. Further, an error detection and error correction level is selected, and a minimum model number that can accommodate input data is selected (S1501). Next, the input data string is converted into a predetermined bit string, and an indicator indicating a data mode (numeric, alphanumeric, 8-bit byte, kanji, etc.) and a termination pattern are added as necessary. Further, it is converted into a predetermined bit code word (S1502). At this time, in order to perform error correction, the code word string is divided into a predetermined number of blocks according to the model number and the error correction level, an error correction code word is generated for each block, and is added after the data code word string ( S1503). Then, the data code words of the respective blocks obtained in step S1503 are connected, and the error correction code word of each block and, if necessary, the remainder code word are followed (S1504).

  Next, the code word module is arranged in the matrix together with the position detection pattern, separation pattern, timing pattern, alignment pattern, and the like (S1505). Further, an optimal mask pattern is selected for the symbol coding region, and the mask processing pattern is converted into the module obtained in step S1505 by an XOR operation (S1506). Finally, format information and model number information are generated and added to the module obtained in step S1506 to complete a two-dimensional code symbol (S1507).

  The procedure of FIG. 15 is a procedure for generating a two-dimensional barcode of the JIS X0510 standard, and there are already commercially available programs. Such a program can also be used as FIG. The terminology described above is defined in JIS X0510. The model number represents the size of the symbol, and the position detection pattern is an element pattern arranged at the three corners of the symbol. The mask process is performed in order to suppress generation of a pattern that hinders high-speed image processing.

<Acquisition of 3D image from printed image>
Next, referring to FIGS. 6, 9, 10, 12, and 14, a flow of scanning of an image including a 3D object printed on a paper surface in the procedure of FIG. 8 and a printing process of an image read by scanning is shown. Show. In the following description, it is assumed that each unit in FIG. 6 performs the processing in FIGS. 10, 12, and 14 mainly according to FIG. On the other hand, when the data processing apparatus 101 realizes these procedures by software, each process of FIGS. 10, 12, and 14 is executed by the CPU 402a. FIG. 9 is a diagram showing the flow of processing by paying attention to the data to be processed.

  First, the embedded information extraction unit (601) scans the scan target paper surface (901) in a raster shape and reads a document image. In practice, the image is read by an image scanner (406), a FAX (407) or the like, and image data (903) of the original image is acquired (S1001). Further, as described with reference to FIG. 8, a method of reading out only the image of the embedded image area by determining the embedded image area in advance may be used.

  The embedded information analyzing unit (602) extracts an embedded image recorded as additional information of the print image from the image data of the original image read by the embedded information extracting unit (601) (S1002). The embedded image is an object (906) such as a character string corresponding to a two-dimensional barcode or URL, for example. If the embedded image is a character string, the character is recognized by OCR, and if it is a two-dimensional barcode, the mark is decoded, and the location information (908) in the storage device in which the original electronic file (original electronic file) of the document is stored Is detected (907) (S1003). In addition, as means for adding the location information of a document to be printed, there are other so-called digital watermark methods that are not directly visualized, such as a method of embedding information in the space between characters and a method of embedding in halftone images. . Of course, in these cases, the embedded information is restored by a method corresponding to the embedding method.

  Next, the 3D image display means (603) searches the location indicated by the storage location address (908) such as the detected location information, for example, URL or path, and the original electronic data (3D image stored therein) 810) is read (S1004). Next, based on the read original electronic data (810), an image represented by the original electronic data is displayed on a display, a printer panel, or the like (S1005). The display of 3D objects uses application specifications, 2D conversion processing of known 3D objects, display technology, and the like. While referring to the displayed image, the user performs a rotation operation to acquire an image from the desired angle or viewpoint. In response to the rotation operation by the user, the rotation instruction reception unit (604) issues a rotation processing command to the 3D image rotation unit (605). When it is identified that the rotation processing command is issued from the rotation instruction receiving unit (604) (S1006-YES), the 3D image rotation unit (605) performs the rotation process using the rotation angle specified by the user as a parameter, This is applied to the original electronic data (910). Then, the rotated three-dimensional image is converted into two-dimensional image data and displayed on the 3D image display means (603) (S1007). When a rotation command is not issued (S1006-NO) and a print command is issued (S1008-YES), the 3D object is projected from the current viewpoint, converted into a two-dimensional image, and the image is printed (S1009). .

  For the three-dimensional image data processing in steps S1005, S1007, S1009, etc., the structure of the three-dimensional image data is defined in advance, and the three-dimensional image data processing is performed in these steps according to the definition. Of course, the process of these steps is possible if the application generates three-dimensional image data.

<Block selection processing>
In the block selection process, when the embedded image is extracted in step S1002, the read image data of one page shown in (a) on the right side of FIG. This is processing for recognizing a region as a block, determining the attribute of each block, and dividing the block into regions having different attributes. Attributes are defined corresponding to types of objects such as characters, drawings, photographs, lines, and tables. An example of the block selection process will be described below.

  First, the read image data is binarized into black and white, and outline tracking is performed to extract a block of pixels surrounded by the outline of black pixels (an area in which pixels of the same color are continuous). For a black pixel block with a large area, contour tracing is also performed for white pixels inside, and a white pixel block is extracted. Extract a block of pixels.

  The black pixel blocks obtained in this way are classified by size and shape, and are classified into regions having different attributes. For example, a pixel block having an aspect ratio close to 1 and having a constant size is defined as a pixel block corresponding to a character, and a portion where adjacent characters can be grouped with good alignment is defined as a character region. In addition, a flat pixel block is a line region, a range occupied by a black pixel block that is larger than a certain size and includes a white pixel block aligned in a square system is a table region, and an area where irregular pixel blocks are scattered A picture area and a pixel block having any other shape are used as a picture area. Table 1 shows block information for each block obtained by the block selection process. Although not included in Table 1, the two-dimensional barcode 1303 shown in FIG. 13 includes a characteristic pattern for identifying it. In the example of FIG. 13, the pattern at the three corners is that, and when the pattern is detected, it can be determined that the block is a two-dimensional barcode. In that case, the attribute value of the two-dimensional barcode is stored in the corresponding part of the block information. This also applies to ordinary one-dimensional barcodes.

  In this way, the block information shown in Table 1 is created by the block selection process. Based on this block information, vectorization described later, or address information indicating the location of the original electronic data is extracted.

<Detection of location information>
Next, the OCR / OMR process for extracting the storage location of the original electronic data file shown in step S1003 from the image information will be described. FIG. 12 is a flowchart showing a process of decoding a two-dimensional barcode (QR code (registered trademark) symbol) added to a document image and outputting a data character string. An example of a document (1301) to which a two-dimensional barcode is added is shown in FIG.

  First, an image representing a document (1301) stored in a page memory (not shown) is scanned by a CPU (not shown), and a predetermined two-dimensional barcode symbol (1303) is obtained from the result of the block selection process described above. ) Position is detected. The QR code position detection pattern is composed of the same position detection element patterns arranged in three of the four corners of the symbol (S1201).

  Next, the format information adjacent to the position detection pattern is restored, and the error correction level and mask pattern applied to the symbol are obtained (S1202). After determining the symbol model number (S1203), the mask process is canceled by performing an XOR operation on the encoded area bit pattern using the mask pattern obtained from the format information (S1204). The symbol character is read in accordance with the arrangement rule corresponding to the model, and the message data and the error correction code word are restored (S1205). It is detected whether or not there is an error on the restored code (S1206). If an error is detected, the process branches to (S1207) and is corrected. Based on the mode indicator and the character number indicator, the data code word is divided into segments from the error-corrected data (S1208). Finally, the data character is decoded based on the specification mode, and the result is output (S1209).

  The data incorporated in the two-dimensional barcode, that is, the data decoded in step S1208 represents the address information (location) of the corresponding file, and constitutes path information including, for example, a file server name and a file name. Alternatively, a URL to the corresponding file is constructed.

  In FIG. 12, the document (1301) in which the location information is given using a two-dimensional barcode has been described. However, when address information is recorded as a character string, a block of the character string in accordance with a predetermined rule is placed on the previous block. The storage address information of the original image data file can be obtained directly by detecting the block selection process and recognizing each character of the character string.

  Further, the character block (1302) of the document (1301) in FIG. 13 or the character string (1304) is modulated such that the distance between adjacent characters is difficult to see, and information is added to the character spacing. The storage address information can also be given by embedding. Such so-called watermark information can be obtained as pointer information by detecting an interval between characters when performing character recognition processing described later. It is also possible to add pointer information as a digital watermark in the natural image (1305).

<File search by location information>
Next, retrieval of an electronic file from location information shown in step S1004 described above with reference to FIG. 10 will be described using the flowchart of FIG.

  First, the file server (408) is specified based on the address included in the location information (S1401). Instead of the file server, a PC (409), W / S (410), a document management server with a built-in database, or a data processing device with a built-in storage device may be used. As long as the data processing apparatus of FIG. 4 and the printer are integrated with each other, the MFP itself may be used. Here, the location information is storage address information of the original image data, and is path information including a URL and a server name and a file name. If the file server (408) can be specified, the location information is transferred to the file server (408) (S1402). Upon receiving the location information, the file server (408) searches for the corresponding file (S1403). If the file does not exist (S1404-N), the data processing apparatus or MFP is notified.

  If the file exists (S1404-Y), as described in FIG. 10, the file location information is notified, and if the processing desired by the user is acquisition of image file data, the file is sent to the MFP. Forward. If the file does not exist at the location indicated by the location information (S1404-N), the image on the paper and the document existing in the file server / PC / W / S / MFP are used by using a known technique. And a document including a similar image may be identified and acquired as the original electronic data of the image printed on the paper.

  In this way, the three-dimensional image data that is the basis of the printed image can be acquired based on the storage address information included in the read image data.

  With the above configuration, three-dimensional drawing information that is lost by printing can be added on the sheet. Therefore, it is possible to acquire three-dimensional drawing information that could not be acquired up to now only by scanning the paper surface, and it is possible to further effectively use the information acquired from the paper surface.

  In addition, it is possible to acquire three-dimensional drawing information that is lost when printing is performed from the location indicated by the embedded location information.

  In addition, it is possible to identify which image held by the document information is the three-dimensional drawing information to be printed, and it is possible to acquire the three-dimensional drawing information.

  In addition, it is possible to identify which image held by the document information is the three-dimensional drawing information to be printed, and it is possible to acquire the three-dimensional drawing information.

  In addition, when searching for an embedded image, it is only necessary to search for a specified area, so that the processing speed can be increased.

  In addition, when scanning an image on paper, it is possible to reproduce 3D drawing information lost with printing, and to enable editing, etc., enabling more effective use of information acquired from paper. It becomes.

  Also, it is possible to acquire the original three-dimensional drawing information before being converted into the two-dimensional drawing information, and it is possible to re-edit and rotate the scanned image that cannot be realized only by the two-dimensional drawing information acquired by scanning. It can be used.

  In addition, it is possible to reuse scanned images such as editing and rotation that cannot be realized only by the two-dimensional drawing information acquired by scanning.

  In addition, it is possible to print again an image that has been subjected to processing such as editing and rotation of a scanned image that cannot be realized only by the two-dimensional drawing information acquired by scanning.

  In the present embodiment, only rotation is described as the operation of the three-dimensional image, but general image processing such as deformation and color conversion can also be performed.

1 is a diagram showing an outline of a system configuration of an image recording apparatus according to an embodiment of the present invention. Sectional drawing which shows the example of 1 structure of the printer in connection with embodiment of this invention 1 is a block diagram illustrating a configuration example of a printer controller according to an embodiment of the present invention. The block diagram which shows the structure of the information processing apparatus by embodiment of this invention 1 is a block diagram showing a configuration for explaining print processing according to an embodiment of the present invention. 1 is a block diagram showing a configuration for explaining scan processing according to an embodiment of the present invention. The figure of an example for demonstrating the printing process in connection with embodiment of this invention 1 is a flowchart illustrating an example of print processing according to an embodiment of the present invention. The figure of an example for demonstrating the scanning process in connection with embodiment of this invention 1 is a flowchart illustrating an example of scan processing according to an embodiment of the present invention. The figure of an example for demonstrating the block selection process in connection with embodiment of this invention 6 is a flowchart showing a process of decoding a two-dimensional barcode (QR code symbol) and outputting a data character string according to the embodiment of the present invention. FIG. 4 is a diagram illustrating an example of a document to which a two-dimensional barcode is added according to an embodiment of the present invention The flowchart which shows the process of the search of the electronic file from location information in connection with embodiment of this invention The flowchart which shows the process in connection with embodiment of this invention which encodes the data character string as location information into a two-dimensional barcode, and adds it to an image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Data processing apparatus 102 Image recording apparatus 103 Printer controller 104 Panel part 105 Printer engine 301 Panel I / F part 302 Host I / F part 303 Image data generation part 304 ROM
305 Image memory 306 Engine I / F unit 307 RAM
308 DMA control unit 309 CPU
310 EEPROM
311 Hard disk 320 CPU bus

Claims (10)

Acquisition means for acquiring location information indicating the location where the 3D image data is stored;
Conversion means for converting the location information into embedded image data in a format in which the contents can be read;
Composite image generation means for generating two-dimensional image data obtained by projecting the three-dimensional image data and combining composite image data associated with the embedded image data;
A printing control apparatus comprising: printing means according to the composite image data.   The location information acquired by the acquisition means is path information for specifying a file including the 3D image data, a URL (Uniform Resource Locator), or a page number of document data including the 3D image data. The print control apparatus according to claim 1, further comprising:   The print control apparatus according to claim 1, wherein the composite image generation unit associates the embedded image with the two-dimensional image data by drawing the image in a certain area. Reading means for reading a document image;
Embedded image extraction means for extracting an embedded image from the document image;
Embedded information restoring means for restoring information embedded from the embedded image;
Acquisition means for acquiring three-dimensional image data based on the location of the three-dimensional image data indicated by the restored embedded information;
Generating means for generating two-dimensional image data obtained by projecting the three-dimensional image data;
A printing control apparatus comprising: means for printing according to the two-dimensional image data.   The print control apparatus according to claim 4, wherein the embedded image extraction unit extracts an embedded image by searching a predetermined area of the read document image.   The apparatus further includes rotation conversion means for converting the three-dimensional image data generated by the generation means so that the object represented by the data is rotated by a desired amount, and the generation means converts the 3D image converted by the rotation conversion means. The print control apparatus according to claim 4, wherein two-dimensional image data is generated based on the two-dimensional image data.   A printing apparatus comprising: the printing control apparatus according to claim 1; and a printer unit that performs printing under the control of the printing control apparatus. An acquisition step of acquiring location information indicating the location where the 3D image data is stored;
A conversion step for converting the location information into embedded image data in a format in which the content can be read;
Generating a two-dimensional image data obtained by projecting the three-dimensional image data, and combining a composite image data associated with the embedded image data;
And a step of printing according to the composite image data. A reading process for reading a document image;
An embedded image extraction step of extracting an embedded image from the document image;
An embedded information restoring step for restoring information embedded from the embedded image;
An acquisition step of acquiring 3D image data based on the location of the 3D image data indicated by the restored embedded information;
A generating step of generating two-dimensional image data obtained by projecting the three-dimensional image data;
Printing according to the two-dimensional image data.   A computer program for causing a computer to function as the print control apparatus according to any one of claims 1 to 6 when executed by the computer.

Images