JP2021033862A - Print finish presentation device, print finish presentation method, and program - Google Patents

Abstract

To allow a user to further correctly check glossiness of a printed matter and also check an additionally-printed image.SOLUTION: A print finish presentation device in one aspect of the present invention comprises: a script data re-forming unit 88 for re-forming script data so as to, in an area where a glossy area present in a photographic image obtained by imaging a print sheet and script data for performing printing on the print sheet overlap, have a target permeability to the photographic image; and an overlap image generating unit 85 for displaying the re-formed script data overlapping the photographic image, on a display unit.SELECTED DRAWING: Figure 5

Description

The present invention relates to a print finish presentation device, a print finish presentation method, and a program.

Conventionally, there is a printed matter having a metallic luster and an added value by placing a foil such as gold or silver, which is called foil stamping, on paper. Nowadays, by further printing on gold and silver foil using a printing press, higher value-added printed matter such as reddish gold and bluish silver is created.

In general, in high-value-added printing having a metallic luster, printing is actually performed including reprinting, and the color of the reprinted original is adjusted while checking the actual product.

For example, Patent Document 1 discloses a technique of simulating and displaying the processing results of various processes scheduled to be performed on an image or output paper by a printing apparatus. In Patent Document 1, "an output image image simulating the processing result when the additional processing is performed by the printing apparatus according to the setting contents acquired from the outside is created, and this is matched with the orientation of the paper in the real space. The augmented reality space, which is obtained by superimposing the corrected output image on the paper existing in the real space, is displayed in AR. As a result, the user performs additional processing on the printing device according to the setting contents. Can be easily confirmed in advance. "

Japanese Unexamined Patent Publication No. 2015-99448

By the way, metallic luster recognizes the texture by dynamically feeling the reflection of luster caused by the shaking of the real thing when a human holds the real thing in his hand, so the preview display based on the still image (print data) shows the luster. Is difficult to reproduce accurately.

In addition, there is a preview display in which the viewing angle is switched (for example, rotated by 360 degrees) to reproduce the gloss. However, the actual printed matter does not emit light by itself, and is reflected and glossy due to the influence of the lighting in the real world, and the reproducibility is not high. The dynamic range differs greatly between the range that can be reproduced by the device that displays the preview and the actual reflection.

As mentioned above, where the gloss of the background (background image) is not well reproduced, even if the color of the reprinted part is superimposed on it and the preview is displayed, the printed original image that can be felt in the preview and the actual image are displayed. There is a problem that the finished products of printed matter are significantly different.

The present invention has been made in view of the above circumstances, and an object of the present invention is to enable a user to confirm a reprint image while confirming the glossiness of a printed matter more accurately.

In order to solve the above problems, the print finish presenting apparatus of one aspect of the present invention is provided in an area where a glossy region existing in a photographed image of a printing paper and original data for printing on the printing paper overlap. A document data reforming unit that reshapes the original data so as to have a target transparency with respect to the captured image, and a superposed image generation unit that superimposes the reformed original data on the captured image and displays it on the display unit. , Equipped with.

According to at least one aspect of the present invention, the user can confirm the reprint image while confirming the glossiness of the printed matter more accurately.
Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a figure which shows the whole structure example of the reprint printing system which concerns on 1st Embodiment of this invention. It is a figure which shows the outline of the additional printing printing with respect to the GS printed matter. It is a block diagram which shows the hardware configuration example of the image forming apparatus included in the reprint printing system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the hardware configuration example of the smart device included in the reprint printing system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the functional structure example of the smart device included in the reprint printing system which concerns on 1st Embodiment of this invention. It is a figure which shows the output image example of the GS printed matter moving image taken by the camera of the smart device which concerns on 1st Embodiment of this invention. It is a flowchart which shows the procedure example of the image output processing of the augmented reality space by the smart device which concerns on 1st Embodiment of this invention. It is a flowchart which shows the procedure example of the gold-silver region identification process which concerns on 1st Embodiment of this invention. It is a figure which shows the estimation method of a lighting condition. It is a flowchart which shows the procedure example of the process which specifies the superposition area of the CMYK version data and GS version data which concerns on 1st Embodiment of this invention. It is a flowchart which shows the procedure example of the RGB data creation processing which concerns on 1st Embodiment of this invention. It is a figure which shows the transmittance conversion table which concerns on 1st Embodiment of this invention. It is a figure which shows the superposition of the GS printed matter moving image which concerns on 1st Embodiment of this invention, and RGB data for transmission. It is a figure which shows the modification of superposition of GS printed matter moving image and RGB data for transmission. It is a figure which shows the output image example (RGB setting change) of the augmented reality space when the additional printing is performed on the GS printed matter which concerns on 1st Embodiment of this invention. It is a figure which shows the output image example (CMYK setting change) of the augmented reality space when the additional printing is performed on the GS printed matter which concerns on 1st Embodiment of this invention. It is a flowchart which shows the procedure example of the slider value reflection processing which concerns on 1st Embodiment of this invention. It is a flowchart which shows the procedure example of the color conversion setting confirmation process which concerns on 1st Embodiment of this invention. It is a block diagram which shows the hardware configuration example of the transmissive glass device as a smart device which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure example of the transmission type glass device which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure example of the image output processing of the augmented reality space by the smart device which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure example of the pseudo transmission image generation processing which concerns on 2nd Embodiment of this invention. It is a figure which shows the display example of the real space including the GS printed matter in the transmissive glass device which concerns on 2nd Embodiment of this invention. It is a figure which shows the output image example (CMYK setting change) of the augmented reality space when the additional printing is performed on the GS printed matter which concerns on the 2nd Embodiment of this invention.

Hereinafter, examples of embodiments for carrying out the present invention (hereinafter, referred to as “embodiments”) will be described with reference to the accompanying drawings. In the present specification and the accompanying drawings, components having substantially the same function or configuration are designated by the same reference numerals, and duplicate description will be omitted.

<1. First Embodiment>
[Overall configuration of reprint printing system]
FIG. 1 shows an overall configuration example of a reprint printing system according to a first embodiment of the present invention.
The reprint printing system 5 connects a gold printing machine 1G, a silver printing machine 1S, an image forming device 2, a smart device 3, and a DTP (DeskTop Publishing) terminal 4 to a network N such as a LAN (Local Area Network). It is composed. The smart device 3 is wirelessly connected to the network N.

The gold printing machine 1G is a foil stamping machine or a printer (image forming apparatus) capable of forming characters and patterns made of gold on paper. In foil stamping printing, an adhesive such as varnish is applied to paper, and a thin metal film (foil) is adhered to a portion to which the adhesive is applied to obtain a printed matter having metallic luster (glossy region). Further, in the case of a printer, so-called printing is performed using gold ink, toner, or the like. The silver printing machine 1S is a foil stamping machine or a printer (image forming apparatus) for forming silver characters or patterns on paper. In the present specification, the printed matter in which gold and silver are formed on the paper is referred to as "GS printed matter". Although the glossy region made of gold and silver has been described as the glossy region, the glossy region is not limited to this, and copper or other gloss may be used. In the present specification, metallic luster such as gold and silver and luster similar to metallic luster are collectively referred to as "metallic luster".

The image forming apparatus 2 forms a color image using, for example, four basic colors of cyan (C), magenta (M), yellow (Y), and black (K). In the present embodiment, the image forming apparatus 2 is used as a reprint printing device that prints a printed matter having metallic luster produced by a gold printing machine 1G, a silver printing machine 1S, or the like. The basic color of the image forming apparatus 2 is an example of the color corresponding to the image forming apparatus 2 (printing device), and is not limited to the above types and numbers.

The smart device 3 is an example of a terminal device having a camera, an image processing IC, a display, and the like. As the smart device 3, for example, a tablet terminal, a notebook PC (Personal Computer), or the like is used.

DTP software such as Adobe Illustrator (registered trademark) is installed in the DTP terminal 4. As the DTP terminal 4, for example, a personal computer is used. The user uses the DTP software of the DTP terminal 4 to create a printing original, for example, a plate having only a gold / silver glossy region (spot color) and a CMYK plate for additional printing (additional printing original). In this specification, they are referred to as "GS version" and "CMYK version", respectively.

The reprint printing system 5 captures a printed matter having a metallic luster with a camera, and displays the augmented reality (AR) as if the reprint original was superimposed on the captured image to display the metallic luster. It is possible to correct the reprinted manuscript while making the user recognize the above.

When the gold printing machine 1G and the silver printing machine 1S are printers (image forming devices) instead of foil stamping machines, GS printed matter can be obtained by inputting the GS plate data to the printer as it is.

[Overview of reprint printing]
FIG. 2 shows an outline of reprint printing on GS printed matter.
First, a GS plate (Gold / Silver version) 50 is used to create a gold and / or silver-only printed matter (GS printed matter). Generally, since gold and silver cannot be foil-pressed at the same time, the GS plate 50 is divided into a gold plate and a silver plate, the gold plate is first printed by the gold printing machine 1G, and the gold printed matter is used as printing paper on the silver printing machine 1S. By printing the silver plate after setting it, a printed matter with gold and silver foil printed is obtained (the printing order of gold and silver may be silver first).

In the example of FIG. 2, the GS plate 50 includes a gold object 51G representing a golden ring, a horizontally long gold object 52G, a silver object 53S representing a silver ring, and a horizontally long silver object 54S. Further, in the CMYK version (reprint version) 60, a red object 61R representing a red ring is displayed in a place corresponding to the gold object 51G of the ring, and a red object representing a red character (Au: 79 in the figure) is displayed in other places. There is 62R. Further, a blue object 63B representing a blue ring is present at a location corresponding to the silver object 53S of the ring, and a blue object 64B representing a blue character (Ag: 47 in the figure) is present at another location. Further, there is a black object 65K representing a black character (Print Technology).

By superimposing the CMYK plate 60 on the GS plate 50, a final print image 70 showing the finish of printing can be obtained. In the final print image 70, the reddish golden ring object 71GR, in which the ring red object 61R is superimposed on the ring gold object 51G, and the ring blue object 63B are superimposed on the ring silver object 53S. In addition, a bluish silver ring object 73SB, a horizontally long gold object 52G, a horizontally long silver object 54S, a character red object 62R, a character blue object 64B, and a character black object 65K are formed.

[Configuration of image forming apparatus]
FIG. 3 is a block diagram showing a hardware configuration example of the image forming apparatus 2 included in the reprint printing system 5. The image forming apparatus 2 has a CPU (Central Processing Unit) 11 that comprehensively controls the operation of the image forming apparatus 2. The CPU 11 has a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a non-volatile memory 14, a hard disk device 15, an automatic document feeder (ADF: Auto Document Feeder) 16, an authentication unit 17, an operation unit 18, and a bus. A display unit 19, a network communication unit 20, an image reading unit 21, an image processing unit 22, a printer unit 23, a facsimile communication unit 24, and the like are connected.

The CPU 11 is based on an OS (Operating System) program, and executes middleware, application programs, and the like on the OS (Operating System) program. Various programs are stored in the ROM 12, and each function of the image forming apparatus 2 is realized by the CPU 11 executing various processes according to these programs.

The RAM 13 is used as a work memory for temporarily storing various data, an image memory for storing image data, and the like when the CPU 11 executes processing based on a program.

The non-volatile memory 14 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used for storing various setting information and the like. The hard disk device 15 is a large-capacity non-volatile storage device, and stores various programs and data in addition to print data (for example, GS version data, CMYK version data), image data, and the like.

The image reading unit 21 functions to optically read the original and acquire image data. The image reading unit 21 includes, for example, a light source that irradiates the document with light, a line image sensor that receives the reflected light and reads the document for one line in the width direction, and sequentially shifts the reading position of each line in the length direction of the document. An optical path consisting of a moving unit to be moved, a lens or mirror that guides the reflected light from the document to the line image sensor to form an image, and a conversion unit that converts the analog image signal output by the line image sensor into digital image data. And so on.

The automatic document transport unit 16 has a function of feeding out and transporting the documents set on the platen one by one in order from the highest one, passing through the reading position of the image reading unit 21 and discharging the paper to a predetermined paper ejection position. Fulfill. In addition, it has a function to automatically reverse the front and back of the document, which enables automatic scanning of both sides of the document. The image reading unit 21 has a function of reading a document placed on a platen glass and a function of sequentially reading a document conveyed by the automatic document conveying unit 16.

The authentication unit 17 authenticates the user who uses the image forming apparatus 2. The authentication method may be any, such as a password, a fingerprint, and a vein.

The operation unit 18 and the display unit 19 constitute an operation panel that receives operations such as inputting a job from the user. The image forming apparatus 2 receives output settings, job execution instructions, and the like from the user on the operation panel. The display unit 19 is composed of a liquid crystal display (LCD) or the like, and functions to display various operation screens, setting screens, and the like. The display unit 19 displays using three colors of red (R), blue (B), and green (G), and these colors are examples of the colors supported by the display unit 19 (display device). Not limited to examples. The operation unit 18 includes various operation switches such as a start button and a touch panel provided on the physical screen of the display unit 19. The touch panel detects the coordinate position where the physical screen of the display unit 19 is touch-operated with a touch pen, a finger, or the like.

The network communication unit 20 fulfills a function of communicating with an external device such as a smart device 3, a gold printing machine 1G, a silver printing machine 1S, and a DTP terminal 4 through a network N such as a LAN.

The image processing unit 22 performs processing such as enlargement / reduction and rotation of an image, rasterization processing for converting print data into image data, compression and decompression processing of image data, and the like.

The printer unit 23 functions to form an image on the recording paper according to the image data. Here, a recording paper transport device, a photoconductor drum, a charging device, a laser unit, a developing device, a transfer separation device, a cleaning device, and a fixing device are provided, and image formation is performed by an electrophotographic process. It is configured as a so-called laser printer. Image formation may be performed by other methods. The printer unit 23 further has a function of performing post-processing such as binding, punching holes, and folding the printed paper with staples.

The facsimile communication unit 24 fulfills a function of transmitting and receiving image data through a telephone line with an external device having a facsimile function.

[Smart device configuration]
FIG. 4 is a block diagram showing a hardware configuration example of the smart device 3 included in the reprint printing system 5. The smart device 3 has a ROM 32, a RAM 33, a non-volatile memory 34, an orientation sensor unit 35, a camera unit 36, an authentication unit 37, an operation unit 38, a display unit 39, a network communication unit 40, and an image processing unit 41 via a bus to the CPU 31. It is configured by connecting the line-of-sight detection unit 42, the distance sensor 43, the audio output unit 44, and the like.

The CPU 31 controls the operation of the smart device 3 according to a program stored in the ROM 32 or the non-volatile memory 34. Programs and fixed data are stored in the ROM 32. The RAM 33 is used as a work memory or the like that temporarily stores various data when the CPU 31 executes a program. Various setting information and application programs are stored in the non-volatile memory 34.

The orientation sensor unit 35 detects the orientation and orientation of the smart device 3 and its changes. The azimuth sensor unit 35 is configured by combining a plurality of geomagnetic sensors and a plurality of acceleration sensors. The orientation sensor unit 35 detects the posture of the user holding the smart device 3 and the direction and angle in which the user is facing (these coincide with the direction and direction in which the camera unit 36 is shooting), and the smart device. It detects the direction and speed of the operation when 3 is tilted, and notifies the CPU 31 of the detection result. Based on the notification from the orientation sensor unit 35, the CPU 31 recognizes the posture, angle, direction and speed of the tilted operation of the user holding the smart device 3.

The camera unit 36 is an image sensor provided on the back surface side of the smart device 3 and captures a direction in which the back surface of the smart device 3 faces. The camera unit 36 can shoot a moving image, for example, captures an image of 30 frames per second.

The authentication unit 37 authenticates the user of the smart device 3. The authentication method may be any, such as a password, a fingerprint, and a vein.

The display unit 39 is composed of a liquid crystal display or the like. The operation unit 38 is composed of a touch panel or the like provided on the physical screen of the display unit 39.

The network communication unit 40 fulfills a function of communicating with an external device such as an image forming device 2 or a DTP terminal 4 through a network N including a wireless LAN.

Under the control of the CPU 31, the image processing unit 41 creates an image (RGB data converted from CMYK version data, etc.) to be combined with the captured image (GS printed object moving image) of the camera unit 36, and corrects (enlarges / reduces) the image. , Transformation) and so on. In addition, the image processing unit 41 converts and changes RGB data.

The line-of-sight detection unit 42 detects the line of sight (where you are looking) of the user of the smart device 3. The line-of-sight detection method may be arbitrary. For example, the smart device 3 is provided with a camera that captures the user's face and eyes, analyzes the image captured by the camera, and detects the user's line of sight from the position, orientation, and the like of the face, eyes, and eyes. The smart device 3 recognizes where the user of the smart device 3 is looking by detecting the user's line of sight with the line-of-sight detection unit 42.

The distance sensor 43 measures the distance from the smart device 3 to various objects in the shooting range of the camera unit 36 and the distance to the object seen by the user of the smart device 3. The distance sensor 43 is composed of an ultrasonic sensor or the like, similarly to the distance sensor 133 of the transmissive glass device 3A.

The voice output unit 44 is used when outputting display contents and warnings as voice.

In the case of the smart device 3, the display unit 39 displays an image (for example, the superimposed image 110) in which the output image image (reprint image) is superimposed on the paper in the image captured by the camera unit 36. The user will see the augmented reality space displayed on the display unit 39 of the smart device 3. Further, as a determination of whether or not the user is looking at the paper, the smart device 3 may determine whether or not the user is looking at the display unit 39.

The smart device 3 analyzes the captured image of the camera unit 36 and detects the paper (GS printed matter) existing in the captured image including its position and orientation. Further, the distance to the detected paper is measured by the distance sensor 43, and the actual size of the paper is recognized from the distance of the measurement result and the size of the paper in the captured image. Further, by measuring the distances to each part of the paper with the distance sensor 43 and totaling / analyzing these, the three-dimensional shape (tilt, bend, fold, etc.) of the paper as seen from the smart device 3 side is also recognized. For example, for recognition of a three-dimensional shape, a known technique disclosed in Japanese Patent Application Laid-Open No. 2008-26243 can be used.

The DTP terminal 4 in which the personal computer is used has, among the functional blocks of the smart device 3, for example, a CPU 31, a ROM 32, a RAM 33, a non-volatile memory 34, an authentication unit 37, an operation unit 38, a display unit 39, a network communication unit 40, and an image. It includes a processing unit 41, an audio output unit 44, and the like. In the second embodiment described later, the DTP terminal 4 has the function of the overlapping area specifying unit 81 (see FIG. 20) described later.

[Smart device functions]
Next, the function related to the print finish presentation of the smart device 3 will be described.
FIG. 5 is a block diagram showing a functional configuration example of the smart device 3 included in the reprint printing system 5. The smart device 3 includes a superimposition area identification unit 81, a gold / silver area identification unit 82, an RGB data creation unit 83, a transmission RGB data conversion unit 84, a superimposition image generation unit 85, and a color conversion setting determination unit 87. The gold-silver region identification unit 82, the RGB data creation unit 83, and the transparent RGB data conversion unit 84 constitute the original data reforming unit 88. The function of each block is realized by the CPU 31 executing the program stored in the ROM 32 or the like.

The overlap area specifying unit 81 compares the CMYK version data and the GS version data, and is an area where the CMYK version data (CMYK area) and the GS version data (glossy area) overlap (hereinafter referred to as “overlap area”). Performs the process of identifying. Then, the superimposition area specifying unit 81 outputs the pixel information of the specified superimposition area to the RGB data creation unit 83.

The original data reforming unit 88 prints on the printing paper and the glossy region existing in the photographed image (hereinafter referred to as “GS printed matter moving image”) obtained by photographing the printing paper (GS printed matter) with the camera unit 36. In the region where the original data (CMYK version data) to be performed is overlapped, the original data is reformed so as to have the transparency set for the captured image. Hereinafter, the gold-silver region identification unit 82, the RGB data creation unit 83, and the transparent RGB data conversion unit 84 will be described.

The gold-silver region specifying unit 82 performs a process of identifying a gold-colored or silver-colored glossy region (hereinafter, “gold-silver region”) on a captured image (GS printed matter moving image) obtained by photographing a GS printed matter. Then, the gold-silver region identification unit 82 outputs the pixel information of the specified gold-silver region to the RGB data creation unit 83. The GS printed matter moving image is stored in the RAM 33.

The RGB data creation unit 83 cooperates with the image processing unit 41 to perform a process of creating RGB data to be displayed on the display unit 39 from the CMYK version data. In the present embodiment, the RGB data creation unit 83 converts the CMYK version data into RGB data in consideration of the lighting conditions. Further, the RGB data creation unit 83 performs a process of updating the RGB data by reflecting the set values (setting change values) of the sliders SL1 and SL2 (see FIGS. 13 and 16) operated by the user in the RGB data. .. Then, the RGB data creation unit 83 outputs the created or updated RGB data to the transparent RGB data conversion unit 84.

The transparent RGB data conversion unit 84 collaborates with the image processing unit 41 to adjust the transmittance of the RGB data, thereby converting the RGB data into transparent RGB data for displaying the RGB data on the GS printed moving image. Perform the processing to be performed. Then, the transparent RGB data conversion unit 84 outputs the transparent RGB data to the superimposed image generation unit 85.

The superimposition image generation unit 85 (example of the superimposition processing unit) performs a process of generating a superimposition image (final printed matter confirmation image) from the GS printed matter moving image and the RGB data for transparency, and displays the superimposition image on the display unit 39. Output to.

The color conversion setting confirmation unit 87 performs a process of confirming the color conversion setting of the superimposed image. That is, the color conversion setting determination unit 87 receives an instruction from the operation unit 38 to confirm the RGB data constituting the superimposed image output to the display unit 39, reconstructs the CMYK version data from the RGB data, and reconstructs the CMYK version data from the RGB data, and reconstructs the CMYK version data from the RGB data. Remember in.

[Example of output image]
FIG. 6 shows an example of an output image of a GS printed matter moving image taken by the camera unit 36 of the smart device 3. As shown in FIG. 6, the print finish confirmation screen 90 is displayed on the display unit 39 of the smart device 3. The GS printed matter moving image 92 in the real space is displayed in the photographed image display area provided on the left half of the print finish confirmation screen 90. The GS printed matter moving image 92 is a photograph of the GS printed matter 91 on which an image based on the GS plate 50 (FIG. 2) is formed.

[Image output processing]
Next, the image output processing by the smart device 3 will be described.
FIG. 7 is a flowchart showing a procedure example of image output processing by the smart device 3. FIG. 7 shows a display process executed for each pixel on a frame-by-frame basis after acquiring a GS printed matter moving image. The processing of this flowchart is realized by the CPU 31 executing the program stored in the ROM 32 or the like.

First, the gold-silver region specifying unit 82 (see FIG. 5) identifies the gold-silver region of the GS printed matter moving image taken by the camera unit 36, that is, the actual GS printed matter (S1). Details of this gold-silver region identification process will be described with reference to FIG.

(Gold and silver area identification processing)
FIG. 8 is a flowchart showing a procedure example of the gold-silver region identification process by the gold-silver region identification unit 82. First, the gold-silver region identification unit 82 acquires the GS printed matter moving image 92 taken by the camera unit 36 and stores it in the RAM 33 (S21). The GS printed matter moving image 92 may be photographed in advance by the camera unit 36 and stored in the non-volatile memory 34.

Next, the gold-silver region specifying unit 82 compares the GS printed matter moving image 92 with the GS plate data 94 received from the DTP terminal 4 and identifies the gold-silver region on the GS printed matter (GS printed matter moving image 92) (S22). ).

Next, the gold-silver region specifying unit 82 estimates the lighting conditions from the difference between the GS plate data 94 and the paper color of the GS printed matter outside the specified gold-silver region, and uses the estimation result as the illumination amount data 96 for the GS printed matter in the RAM 33. Remember (S23). After the process of step S23, the process proceeds to step S2 of FIG.

Here, a method of estimating the lighting conditions will be described with reference to FIG.
In FIG. 9, it is assumed that the gold-silver region A2 of the GS printed matter moving image 92 at the corresponding position is specified from the gold-silver region A1 of the GS plate data 94. The portion of the GS plate data 94 other than the gold-silver region A1 (for example, pixel p1) is compared with the portion of the corresponding GS printed matter moving image 92 other than the gold-silver region A2 (for example, pixel p2). Guess is made. Pixel p2 corresponds to a GS printed matter, that is, a margin of paper.

Returning to the description of the flowchart of FIG. 7. After the processing of step S1, the gold-silver region identification unit 82 determines whether or not the pixel on the display unit 39 corresponds to the object (CMYK region) on the CMYK plate (S2). That is, when the CMYK value of the target pixel on the GS printed object moving image 92 is (0,0,0,0), the CMYK value on the CMYK plate corresponding to the target pixel is other than that (CMYK value ≠ (0,0, 0, 0, 0, 0, 0, 0, 0). It is determined whether or not it is 0,0)). When the target pixel on the GS printed matter moving image 92 does not correspond to the object on the CMYK plate (NO in S2), the gold-silver region identification unit 82 displays the GS printed matter moving image 92 as an output image on the display unit 39 with respect to the target pixel. Output (S9). After the process of step S9, the process proceeds to step S7.

On the other hand, when the pixel on the display unit 39 corresponds to the object on the CMYK version (YES in S2), the RGB data creation unit 83 estimates in step S23 because the CMYK version is displayed on the display unit 39 with respect to the target pixel. RGB data is created by converting CMYK values to RGB values (color gamut conversion) while taking into account the lighting conditions (S3). Details of this RGB data creation process will be described with reference to FIG.

(Overlapping area identification processing)
As shown in FIG. 10, the CMYK version data 95 and the GS version data 94 are input to the smart device 3 from the DTP terminal 4 together with the acquisition of the GS printed matter in the gold printing machine 1G and the silver printing machine 1S (S11). ). The superposition area specifying unit 81 (see FIG. 2) of the smart device 3 compares the CMYK version data 95 and the GS version data 94, identifies an area in which both version data are superposed, and holds the area in the RAM 33 as a superposition area. (S12).

(RGB data creation process)
Here, the RGB data creation process in step S3 will be described.
FIG. 11 is a flowchart showing an example of a procedure for RGB data creation processing by the RGB data creation unit 83 (see FIG. 5). First, the RGB data creation unit 83 of the original data reforming unit 88 determines whether or not RGB data for displaying the GS printed matter moving image 92 exists (S31). When RGB data does not exist (NO in S31), such as when the frame of the target pixel on the GS printed object moving image 92 is the first frame, the RGB data creation unit 83 considers the lighting conditions and CMYK version data. 95 is converted into RGB data (S32). That is, the RGB data creation unit 83 converts the CMYK value of the CMYK version data 95 of the target pixel into an RGB value based on the CMYK / RGB conversion lookup table 99 and the illumination amount data 96 for the GS printed matter, and the RGB data. Get 98. In the figure, the CMYK / RGB conversion lookup table 99 is referred to as "CMYK / RGB conversion LUT99".

Next, when the RGB data exists (YES in S31), the RGB data creation unit 83 determines whether or not the updated RGB data exists (S33), and when the updated RGB data does not exist (NO in S33). , The RGB conversion process of step S32 is performed. The updated RGB data is data in which the RGB values are changed by the sliders SL1 and SL2.

On the other hand, when the updated RGB data exists (YES in S33), the RGB data creation unit 83 converts the updated RGB data 97 into RGB data while taking into consideration the lighting conditions (S34). That is, the RGB data creation unit 83 converts the RGB value of the updated RGB data 97 of the target pixel into an RGB value reflecting the lighting conditions based on the illumination amount data 96 for the GS printed matter, and saves it as the RGB data 98. .. After the processing of step S32 or step S34, the process proceeds to step S4 of FIG.

In this way, the RGB data creation unit 83 (manuscript data reforming unit 88) compares the primary manuscript data (GS version data 94) of the captured image with the captured image (GS printed object moving image 92), and has a region other than the glossy region. The lighting conditions are estimated from the differences, and the lighting conditions are reflected in the reformed original data (RGB data). As a result, it is possible to accurately represent a reprint image in consideration of the lighting conditions, which is the actual environment, with respect to the GS printed matter (primary printed matter). The CMYK version data before RGB data conversion is an example of secondary manuscript data.

Returning to the description of the flowchart of FIG. 7 again. After the processing of step S3, the RGB data creation unit 83 determines whether or not the pixels on the created (or converted) RGB data 98 are within the overlapping region of the CMYK version data 95 and the GS version data 94 (S4). .. Then, when the target pixel on the RGB data 98 is not within the overlap region (NO in S4), the RGB data creation unit 83 outputs the RGB data 98 as an output image to the display unit 39 (S10). After the process of step S10, the process proceeds to step S7.

On the other hand, when the target pixel on the RGB data 98 is within the superposition region (YES in S4), the transparency conversion table 93 is displayed in the transmission RGB data conversion unit 84 (see FIG. 5) of the original data reforming unit 88. The RGB data 98 is converted into the transparent RGB data 100 (see FIG. 13) so as not to be filled on the display unit 39 (S5).

In this conversion process, as shown in FIG. 12, the transparency showing the relationship table between the RGB value of the RGB data 98 converted from the CMYK version data 95 and the transmittance (%) of the RGB value displayed on the display unit 39 is shown. This is performed based on the rate conversion table 93. The transmittance conversion table 93 is created in advance by performing color measurement based on the camera unit 36 of the smart device 3, the display unit 39 (output capacity), and the actual final printed matter printed on the GS printed matter. .. That is, the transmittance of the RGB data 98 converted from the CMYK version data 95 (original data) is represented by the transmittance conversion table 93 associated with the output capability of the display unit 39. It is desirable that the transmittance conversion table 93 be updated based on the output capacity of the display unit 39.

For example, in FIG. 12, when each value of the RGB value of the RGB data 98 is 100, the transmittance of each value is set to (15, 10, 15). The method of expressing the transmittance, that is, the shade of color, is, for example, changing the size of dots that make up an image of printed matter or a set of dots, fixing the size of halftone dots and changing only the density, or changing only the density. Some do both at the same time. Basically, the smaller the halftone dots and the lower the density, the lighter the color (high transmittance), and the larger the halftone dots and the higher the density, the darker the color (low transmittance).

Next, the superimposed image generation unit 85 generates an superimposed image 110 from the transparent RGB data 100 (transparent image) and the GS printed object moving image 92 (background image) as shown in FIG. 13 (S6), and the superimposed image is generated. 110 is output to the display unit 39 (S7). Next, it is determined whether or not there is a next frame (S8), and if there is a next frame (YES in S8), the process proceeds to step S1 and the image output process of FIG. 7 is repeated. Alternatively, if there is no next frame (NO in S8), the processing of this flowchart ends. As a result, real-time display of moving images based on GS printed matter moving images is realized.

In this way, the smart device 3 acquires the GS printed matter moving image 92 (background image) and sets the transmittance of the superimposed object (RGB data 98 to which the CMYK version data 95 is converted) according to the transmittance conversion table 93. While setting, the superimposed image 110 is generated and displayed on the display unit 39. As a result, the augmented reality space display based on the GS printed matter moving image 92 and the CMYK version data 95 is realized, and the user can confirm the finish of the additional printing before performing the additional printing.

(Modified example of superimposed image generation processing)
Here, a modified example of the superimposed image generation process by the superimposed image generation unit 85 will be described.
FIG. 14 shows a modified example of superimposing the GS printed matter moving image 92 and the transparent RGB data 100. If the smart device 3 cannot generate an image in which the GS printed matter moving image 92 and the transparent RGB data 100 are superimposed due to reasons such as low image processing capability, the CMYK version data 95 may be pseudo-transparently displayed. Conceivable.

For example, the processing by the transparent RGB data conversion unit 84 and the superimposed image generation unit 85 can be configured as follows. First, the transparent RGB data conversion unit 84 calculates a target transmittance with reference to the transmittance conversion table 93 in step S5. Next, in step S6, the superimposed image generation unit 85 calculates the area of the object and the number of pixels required for display for each object of the CMYK version data 95 corresponding to the superimposed area. Then, the superimposed image generation unit 85 fills the RGB values or displays the background image for each calculated pixel so that the RGB data corresponds to the target transmittance. That is, the density of halftone dots of the CMYK version data 95 is adjusted.

FIG. 14 shows an example of a superposed image 111 in which an object 114 including the filled pixels 113 and the pixels 112 on which the background image is displayed is formed. Since the superimposed image 111 is pseudo-transparently displayed, it can be said to be a pseudo superimposed image. This process is the same as the pseudo-transparent image generation process of the second embodiment.

With such a configuration, even if the device cannot generate an image in which the GS printed matter moving image 92 and the RGB data 100 for transparency are superimposed, a pseudo superimposed image 111 maintaining the desired transmittance is generated and the user follows. You can check the finish of the print in advance.

When the original data (RGB data) is reformed, the superimposed image generation unit 85 acquires the output capability of the display unit 29, and the display or transparency of the original data is set for each pixel (pseudo superimposed image 111). ) May be reshaped to reproduce the target transmittance.

[Overlaid image (change RGB settings)]
FIG. 15 shows an example of an output image (RGB setting change) in the augmented reality space when additional printing is performed on the GS printed matter 91. In the captured image display area of the print finish confirmation screen 90, the superimposed image 110 in which the transparent RGB data 100 is superimposed on the GS printed matter moving image 92 is displayed. The color setting changing unit 115 is displayed on the right half of the print finish confirmation screen 90. The color setting changing unit 115 displays the setting reference changing unit SE and the slider SL1.

The setting standard changing unit SE is a user interface that can select whether to change the color setting by the slider SL1 based on RGB standard or CMYK standard. In FIG. 15, the RGB reference is selected. The slider SL1 is a user interface in which the color setting of the overlay area can be adjusted. The original data reforming unit 88 (see FIG. 5) changes the transmittance of the RGB data 98 superimposed on the GS printed matter moving image 92 according to the set value (slider value) of the slider SL1 and reflects it on the display. When the OK button is operated, the hue (color setting) of the currently displayed superimposed image 110 is confirmed and saved.

[Overlaid image (CMYK setting change)]
FIG. 16 shows an example of an output image (CMYK setting change) in the augmented reality space when additional printing is performed on the GS printed matter 91. The setting standard changing unit SE and the CMYK standard slider SL2 are displayed on the right half of the print finish confirmation screen 90. Generally, the device value of the display unit 39 is an RGB value, but some users desire to adjust the color setting based on the CMYK standard. Therefore, by preparing the setting standard changing unit SE, the user can select the desired changing standard, and the convenience of the user is improved.

The standard for changing the color setting is not limited to the RGB standard and the CMYK standard, and may be another change standard. Further, although the change of the color setting has been described with reference to FIGS. 15 and 16, the saturation and the lightness may also be set.

[Slider value reflection processing]
Next, the slider value reflection processing using the sliders SL1 and SL2 will be described.
FIG. 17 is a flowchart showing a procedure example of the slider value reflection processing by the RGB data creation unit 83. This process is the same for the superimposed image 111 (see FIG. 14).

First, the RGB data creation unit 83 acquires the setting change value of the RGB data 98 constituting the superimposed image 110 (S41). The setting change values are the change criteria of the sliders SL1 and SL2 and the set values (slider values) shown in FIGS. 15 and 16. Next, the RGB data creation unit 83 determines whether or not the setting change is based on RGB based on the acquired setting change value (S42). When the setting change is based on RGB (YES in S42), the RGB data creation unit 83 updates the RGB data according to the slider value (RGB reference) based on the current position of the slider SL1 (S43). The RGB data 97 is stored in the RAM 33.

If the setting change is not based on RGB (NO in S42), the RGB data creation unit 83 determines whether or not the setting change is based on CMYK (S45). Then, when the setting change is based on CMYK (YES in S45), the RGB data creation unit 83 converts all the RGB values of the RGB data 98 into CMYK values with reference to the CMYK / RGB conversion LUT99, and CMYK. It is stored in the RAM 33 as the data 101 (S46).

Next, the RGB data creation unit 83 updates the CMYK data 101 according to the slider value (CMYK reference) based on the current position of the slider SL2 (S47). Next, the RGB data creation unit 83 creates the updated RGB data 97 from the updated CMYK data 101 with reference to the CMYK / RGB conversion LUT 99 (S48), and stores the updated RGB data 97 in the RAM 33.

If the setting change is not based on CMYK (NO in S45), the RGB data creation unit 83 executes conditional branching of other color setting changes if there are other options for the change standard (S49). In the figure, step S49 is shown by a broken line.

Next, after updating the RGB data 98 (RGB value of the transparent image) in step S43 or step S48 or the like, the smart device 3 performs the image output process shown in FIG. 7 (S44). After the image output process is completed, this flowchart ends.

[Color conversion setting confirmation process]
Next, a color conversion setting confirmation process using the print finish confirmation screen 90 (see FIGS. 15 and 16) will be described. When the user is satisfied with the hue of the superimposed image 110 or 111 displayed on the print finish confirmation screen 90 before finishing the display of the augmented reality space, he presses the OK button and instructs the confirmation of the color conversion setting. .. Then, the portion converted for display on the display unit 39 is inversely converted for print output.

FIG. 18 is a flowchart showing a procedure example of the color conversion setting confirmation process by the color conversion setting determination unit 87 (see FIG. 5).
First, the color conversion setting confirmation unit 87 determines whether or not there is a confirmation instruction by the user, that is, whether or not the OK button on the print finish confirmation screen 90 is pressed (S51), and when there is no confirmation instruction (NO in S51). Waits until there is a confirmation instruction.

Next, when there is a confirmation instruction (YES in S51), the color conversion setting confirmation unit 87 confirms the RGB data 98 (RGB value of the transparent image) output and displayed on the display unit 39 (S52). Next, the color conversion setting determination unit 87 reversely converts the RGB data 98 into RGB values for print output based on the transmittance conversion table 93 (S53).

Next, the color conversion setting determination unit 87 converts the RGB value for print output into the CMYK value with reference to the CMYK / RGB conversion LUT99 (S54). Then, the color conversion setting determination unit 87 stores the CMYK value in the RAM 33 or the non-volatile memory 34 as the reconstructed CMYK version data 102 that can be output to the image forming apparatus 2 (S55). After the process of step S55, this flowchart ends.

For example, the color conversion setting determination unit 87 of the smart device 3 outputs an instruction for performing additional printing to the designated image forming apparatus 2 after restoring the original data (after generating the reconstructed CMYK version data 102). Upon receiving the instruction, the image forming apparatus 2 forms an image based on the reconstructed CMYK plate data 102 on the preset GS printed matter. As a result, a final printed matter (deliverable product) having substantially the same color setting as the final printed image 70 can be obtained.

As described above, according to the reprint printing system 5 of the present embodiment, the user can adjust the color of the document (reprint image) to be superimposed on the reprint printing system 5 while observing the glossiness of the glossy region of the actual printed matter. That is, the user can confirm the reprint image while confirming the glossiness of the printed matter more accurately. Therefore, there is no need to redo printing, and the printing cost of metallic luster printing, which has a high printing cost, can be reduced.

Further, according to the present embodiment, in the case of a device having a high image processing ability, it is possible to synthesize and display the reformed original data that has undergone transmission processing on the captured image of the printing paper by the camera unit 36. Further, in the case of a device that does not have high image processing capability, an image expressing the target transparency is expressed by determining the display of the captured image of the printing paper and the original data after reforming by the camera unit 36 for each pixel. Can be expressed together with the captured image of the printing paper.

Further, according to the present embodiment, after confirming the glossiness of the printed matter and the reprint image, the reprint manuscript is automatically created based on the instruction. Therefore, the user is assisted in creating the reprinted original, and the workload of the user is reduced.

<2. Second embodiment>
The second embodiment is an example in which the transmissive glass device 3A (see FIG. 19) is used as the smart device of the first embodiment.

The transmissive glass device 3A has a shape similar to that of eyeglasses and is used by being worn on the human eye. The transmissive glass device 3A of the present embodiment employs a method (so-called light transmissive type) in which an image is superimposed on the outside state by a half mirror 135 (see FIG. 19). For example, the transmissive glass device 3A includes a display unit 129 that is arranged in front of the left and right eyes of the wearer when worn, and a half mirror 135 that is supported so as to be located in front of each display unit 129.

The half mirror 135 is provided so as to be inclined at an angle of 45 degrees or the like with respect to the external light incident on each display unit 129 from the front, and the projection unit 126 is a pseudo-transmission image (image of augmented reality information) described later. Light) is projected toward the half mirror 135. The pseudo-transparent image corresponds to the superimposed image in the first embodiment. The half mirror 135 is configured by coating a transparent substrate (glass substrate) with a reflective film (metal film and a dielectric film). In the half mirror 135, for example, the light amount ratio of transmission and reflection is 1: 1.

In the eyes of the wearer of the transmissive glass device 3A, light in which external light and image light are combined at a ratio of 1: 1 is incident through the display unit 129. That is, the wearer of the transmissive glass device 3A sees a state in which the outside state and the image projected by the projection unit 126 are superimposed at a transmittance of half and half.

[Configuration of transparent glass device]
FIG. 19 is a block diagram showing a hardware configuration example of the transmissive glass device 3A as a smart device according to the second embodiment. The transmissive glass device 3A has a ROM 122, a RAM 123, a non-volatile memory 124, an orientation sensor unit 125, a projection unit 126, a camera unit 127, an operation unit 128, a display unit 129, and a network communication unit 130 via a bus to the CPU 121 as a control unit. , Image processing unit 131, line-of-sight detection unit 132, distance sensor 133, audio output unit 134, and the like are connected to each other. Further, the transmissive glass device 3A includes a half mirror 135.

The transmissive glass device 3A differs from the smart device 3 in that it particularly includes a projection unit 126, a display unit 129, and a half mirror 135. Other CPU 121, ROM 122, RAM 123, non-volatile memory 124, orientation sensor unit 125, camera unit 127, operation unit 128, network communication unit 130, image processing unit 131, line-of-sight detection unit 132, distance sensor 133, and audio output unit 134. The basic functions of each are not significantly different from the corresponding parts of the smart device 3.

The CPU 121 controls the operation of the transparent glass device 3A according to a program stored in the ROM 122 or the non-volatile memory 124. Programs and fixed data are stored in the ROM 122. The RAM 123 is used as a work memory or the like that temporarily stores various data when the CPU 121 executes a program. Various setting information, application programs, and the like are stored in the non-volatile memory 124.

The orientation sensor unit 125 detects the orientation and orientation of the transmissive glass device 3A and its changes. The directional sensor unit 125 can have the same configuration as the directional sensor unit 35 of the smart device 3.

As described above, the projection unit 126 projects the image to be projected (image light of augmented reality information) toward the half mirror 135.

The camera unit 127 photographs the front of the transmissive glass device 3A. More specifically, it is an image sensor that captures a range substantially the same as the field of view when the wearer looks forward. The camera unit 127 may be provided on the left and right sides of the transmissive glass device 3A, or may be provided on only one of them. The camera unit 127 shoots a moving image, and captures, for example, an image of 30 frames per second.

The operation unit 128 is various switches and the like, and is used for power-on, adjustment of the brightness of the projected image, color setting, and the like.

External light transmitted through the half mirror 135 and image light reflected by the half mirror 135 (pseudo-transmitted image) are incident on the display unit 129. The user sees the augmented reality space in which the outside state and the pseudo-transparent image projected by the projection unit 46 are superimposed at a transmittance of half by the display unit 129.

The network communication unit 130 functions to communicate with an external device such as the image forming device 2 through the network N including the wireless LAN.

Under the control of the CPU 121, the image processing unit 131 projects an image (CMYK version data) that is projected from the projection unit 126 onto the display unit 129 via the half mirror 135 and combined with the captured image (GS printed moving image) of the camera unit 36. (RGB data converted from) is created, and the image is corrected (enlarged / reduced, transformed). In addition, the image processing unit 131 converts and changes RGB data.

The line-of-sight detection unit 132 detects the line of sight (where you are looking) of the user wearing the transmissive glass device 3A. The line-of-sight detection method may be arbitrary. For example, a camera for photographing the wearer's eyes is provided, the image captured by this camera is analyzed, and the wearer's line of sight is detected from the positions and orientations of the eyes and pupils. The transmissive glass device 3A recognizes a portion seen by the wearer of the transmissive glass device 3A by detecting the line of sight of the wearer with the line-of-sight detection unit 132.

The distance sensor 133 measures the distance from the transmissive glass device 3A to various objects in the photographing range of the camera unit 127 and the distance to the object seen by the wearer of the transmissive glass device 3A. The distance sensor 133 is composed of, for example, an ultrasonic sensor.

The voice output unit 134 is used when outputting display contents and warnings as voice.

In the transmissive glass device 3A, the transmissive glass device 3A (see FIG. 19), which will be described later, displays an output image image superimposed on the information from the real space. The camera unit 127 may be used as a stereo camera, and the posture of the paper and the three-dimensional shape seen from the transmissive glass device 3A side may be recognized by analyzing the image of the stereo camera.

[Functions of transparent glass device]
FIG. 20 is a block diagram showing a functional configuration example of the transmissive glass device 3A.
The transmissive glass device 3A is different from the smart device 3 (see FIG. 5) in the first embodiment in that it includes a pseudo-transparent image generation unit 85A instead of the superposed image generation unit 85. Further, in the present embodiment, the superposition area specifying portion 81 of the smart device 3 is provided not in the transmissive glass device 3A but in the DTP terminal 4. Of the functional blocks of the transmissive glass device 3A, the blocks corresponding to the smart device 3 will not be described in detail.

The superimposition area specifying unit 81 of the DTP terminal 4 compares the CMYK version data and the GS version data, and specifies the superimposition area where the CMYK version data 95 (CMYK area) and the GS version data 94 (glossy area) overlap. Perform processing. Then, the superimposition area specifying unit 81 transmits the pixel information of the specified superimposition area to the transmissive glass device 3A together with the CMYK version data 95 (CMYK area) and the GS version data 94.

When the pixels on the RGB data 98 created (or converted) are not within the superposition area of the CMYK version data 95 and the GS version data 94 received from the DTP terminal 4, the RGB data creation unit 83 determines the RGB data 98. Is projected from the projection unit 126 to the display unit 129 via the half mirror 135 as an output image.

The pseudo-transparent image generation unit 85A performs a process of generating a pseudo-transparent image (final printed matter confirmation image) from the GS printed moving image and the transmission RGB data converted by the transmission RGB data conversion unit 84, and produces the pseudo-transparency image. The image is projected from the projection unit 126 to the display unit 129 via the half mirror 135.

The color conversion setting determination unit 87 performs a process of confirming the color conversion setting of the pseudo-transparent image. That is, the color conversion setting determination unit 87 receives an instruction from the operation unit 38 to confirm the RGB data constituting the pseudo-transparent image projected on the display unit 129, reconstructs the CMYK version data from the RGB data, and reconstructs the CMYK version data from the RGB data, and reconstructs the CMYK version data from the RGB data. Remember in.

[Image output processing]
Next, the image output processing by the smart device 3 will be described.
FIG. 21 is a flowchart showing a procedure example of image output processing by the transmissive glass device 3A. In FIG. 21, the processing of steps S66 and S69 is different from the processing by the smart device 3 of the first embodiment (see FIG. 7). Since the processing of the other steps S61 to S65, S67 to S68, and S70 is the same as that of steps S1 to S5, S7 to S8, and S10 of FIG. 7, detailed description of these steps will be omitted.

After the gold-silver region identification process for the GS printed matter moving image 92 in step S61 is completed, if the pixels on the projection unit 126 do not correspond to the object (CMYK region) on the CMYK plate (NO in S62), the projection unit 126 , The process of projecting the output image onto the display unit 39 is not performed on the target pixel (S69). That is, the projection unit 126 sets the RGB value of the pixel that does not correspond to the object on the CMYK plate to (0, 0, 0).

Further, after the conversion process from the RGB data in step S65 to the RGB data for transparency is completed,
The pseudo-transparent image generation unit 85A generates a pseudo-transparent image 141 (see FIG. 23) from the transparent RGB data (transparent image) and the GS printed matter moving image 92 (background image) (S66). Then, the projection unit 126 projects (outputs) the pseudo-transparent image 141 onto the display unit 39 via the half mirror 135 (S67).

[Pseudo-transparent image generation process]
Next, the pseudo-transparent image generation process in step S66 will be described.
FIG. 22 is a flowchart showing a procedure example of the pseudo-transparent image generation process by the pseudo-transparent image generation unit 85A.

First, the pseudo-transparent image generation unit 85A calculates the area of the object and the number of pixels required for display for each object of the CMYK version data 95 corresponding to the overlap region (S81). Next, the pseudo-transparent image generation unit 85A determines the RGB value fill or transmission (RGB value = (0,0,0)) for each calculated pixel so that the RGB data corresponds to the target transmittance (S82). .. Then, a pseudo-transparency image reflecting the determined RGB value fill and transmission for each pixel is generated, projected from the projection unit 126, and displayed on the display unit 129. That is, the density of halftone dots of the CMYK version data 95 is adjusted.

FIG. 23 shows a display example of a real space including a GS printed matter in the transmissive glass device 3A. In FIG. 23, the real space 140 including the GS printed matter 91 is displayed. As described above, the GS printed matter 91 is formed with a gold object 51G representing a golden ring, a horizontally long gold object 52G, a silver object 53S representing a silver ring, and a horizontally long silver object 54S based on the GS plate 50. ing.

FIG. 24 shows an example of an output image (CMYK setting change) in the augmented reality space when additional printing is performed on the GS printed matter. FIG. 24 shows an augmented reality space 150 when additional printing is performed on the GS printed matter 91. In the augmented reality space 150 displayed on the display unit 129, a pseudo-transparent image is displayed at a position corresponding to the GS printed matter 91. The GS printed matter 91 of the extended real space 150 includes a reddish golden ring object 71GR instead of the ring gold object 51G, and a bluish silver ring object 73SB instead of the ring silver object 53S. , A horizontally long gold object 52G, a horizontally long silver object 54S, a character red object 62R, a character blue object 64B, and a character black object 65K are formed.

At this time, the color setting changing unit 115 is displayed on the right half of the augmented reality space 150. Similar to the first embodiment, the transmittance of the RGB data superimposed on the GS printed matter 91 can be changed based on the YMCK standard according to the set value of the slider SL2 and reflected in the display.

<3. Others>
It should be noted that the present invention is not limited to the above-described embodiments, and it goes without saying that various other application examples and modifications can be taken as long as the gist of the present invention described in the claims is not deviated. ..

For example, the document data reforming function and the superimposed image generation function of the smart device 3 described above may be executed by a server connected to the network N. For example, the GS printed matter is photographed by the camera unit 36 of the smart device 3 or an external camera device, and the photographed image, the GS version data, and the CMYK version data are transmitted from the smart device 3 to the server. The server executes original data reformation and superimposition image generation based on these images and data, and transmits the generated superimposition image or pseudo superimposition image to the smart device 3. Then, the smart device 3 displays the superimposed image or the pseudo superimposed image on the display unit 39. With such a configuration, the smart device 3 can confirm the reprint image even if it does not have a special application for confirming the reprint image.

Further, the above-described embodiment describes in detail and concretely the configuration of the reprint printing system in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the one including all the components described. In addition, it is possible to replace a part of the configuration of one embodiment with a component of another embodiment. It is also possible to add components of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace other components with respect to a part of the configuration of each embodiment.

Further, each of the above configurations, functions, processing units and the like may be realized by hardware by designing a part or all of them by, for example, an integrated circuit.

Further, each component of the reprint printing system according to the embodiment of the present disclosure described above may be implemented in any hardware as long as the respective hardware can send and receive information to and from each other via the network. Further, the processing performed by a certain processing unit may be realized by one hardware, or may be realized by distributed processing by a plurality of hardware.

1G ... Gold printing machine, 1S ... Silver printing machine, 2 ... Image forming device, 3 ... Smart device, 3A ... Transparent glass device, 4 ... DTP terminal, 5 ... Reprint printing system, 31 ... CPU, 36 ... Camera unit , 39 ... Display unit, 41 ... Image processing unit, 81 ... Overlay area identification unit, 82 ... Gold and silver area identification unit, 83 ... RGB data creation unit, 84 ... Transparency RGB data conversion unit, 85 ... Overlay image generation Part, 85A ... Overlaid image generation part, 87 ... Color conversion setting confirmation part, 88 ... Original data reshaping part, 90 ... Print finish confirmation screen, 91 ... GS printed matter, 92 ... GS printed matter moving image (background image), 93 ... Transmission conversion table, 94 ... GS version data, 95 ... CMYK version data, 96 ... Lighting amount data for GS printed matter, 97 ... Updated RGB data, 98 ... RGB data, 99 ... CMYK / RGB conversion lookup table, 101 ... CMYK data, 102 ... Reconstructed CMYK version data, 100 ... Transparent RGB data (transparent image), 110, 111 ... Overlaid image, 115 ... Color setting change unit, 140 ... Real space, 150 ... Extended real space, SL1, SL2 ... Slider

Claims (15)

In the area where the glossy region existing in the photographed image obtained by photographing the printing paper and the document data for printing on the printing paper overlap, the document data is regenerated so as to have a target transparency with respect to the photographed image. The manuscript data reforming part to be formed and
A print finish presenting apparatus including a superimposition image generation unit that superimposes the reformed original data on the captured image and displays it on the display unit. The print finish presenting apparatus according to claim 1, wherein the glossy region is a region having metallic gloss. The print finish presenting apparatus according to claim 1 or 2, wherein the printing paper is a primary printed matter printed with primary manuscript data different from the manuscript data. The print finish according to claim 3, wherein the manuscript data is manuscript data for additional printing on the printing paper, and when the printing paper is the primary printed matter, the manuscript data refers to the secondary manuscript data. Presentation device. The print finish presenting apparatus according to claim 1, wherein the manuscript data is manuscript data for printing in basic colors, and the basic colors are at least cyan, magenta, yellow, and black. The manuscript data reforming unit compares the primary manuscript data of the photographed image with the photographed image, estimates the illumination condition from the difference other than the glossy region, and applies the illumination condition to the reformed original data. The print finish presenting apparatus according to claim 3 to 5. The transmittance of the original data is represented by a transmittance conversion table associated with the output capacity of the display unit.
The print finish presenting apparatus according to claim 1, wherein the manuscript data reforming unit reshapes the manuscript data with reference to the transmittance conversion table. The print finish presenting apparatus according to claim 1, further comprising a user interface for adjusting the original data displayed on the display unit. Claim 8 that the manuscript data reforming unit adjusts the transmittance of the manuscript data based on the input value by the user interface, reshapes the manuscript data, and displays the manuscript data on the display unit again. The print finish presentation device described in 1. The print finish presenting apparatus according to claim 9, wherein the user interface is a slider, and the input value is determined based on the position where the slider is moved. The print finish presenting apparatus according to claim 1, wherein the original data reforming unit restores the original data displayed on the display to original data that can be reprinted by the image forming apparatus. The print finish presenting apparatus according to claim 11, wherein the original data reforming unit outputs an instruction for performing additional printing to a designated image forming apparatus after restoring the original data. The camera unit that shoots the printing paper and
The print finish presenting apparatus according to claim 1, further comprising the display unit. In the area where the glossy region existing in the photographed image obtained by photographing the printing paper and the document data for printing on the printing paper overlap, the document data is regenerated so as to have the target transmittance for the photographed image. The process of forming and
A process of superimposing the reformed original data on the captured image and displaying it on the display unit.
How to present the print finish including. In the area where the glossy region existing in the photographed image obtained by photographing the printing paper and the document data for printing on the printing paper overlap, the document data is regenerated so as to have the target transmittance for the photographed image. The procedure for forming and
The procedure of superimposing the reformed original data on the captured image and displaying it on the display unit, and
A program that lets your computer run.

Images