JP7434756B2 - Print finish presentation device, print finish presentation method, and program - Google Patents

Description

The present invention relates to a print finish presentation device, a print finish presentation method, and a program.

BACKGROUND ART Conventionally, value-added printed matter that has a metallic luster has been created by placing gold, silver, or other colored foil on paper using foil stamping. Nowadays, printing machines are used to perform additional printing on top of gold and silver foil to create printed matter with higher added value, such as reddish gold or bluish silver.

Generally, in high-value-added printing with metallic luster, printing is actually performed, including additional printing, and adjustments such as the color of the additional printing document are made while checking the actual product.

For example, Patent Document 1 discloses a technique for displaying a simulated image of the results of various processes that a printing device plans to perform on an image or output paper. Patent Document 1 states, ``An output image is created that simulates the processing result when additional processing is performed on the printing device according to settings acquired from the outside, and this is adjusted to match the orientation of the paper in real space. The augmented reality space in which the corrected output image is superimposed on the paper existing in the real space is displayed in AR.This allows the user to see the processing results when additional processing is performed on the printing device according to the settings. can be easily confirmed in advance."

JP2015-99448A

By the way, the texture of metallic luster is perceived by humans dynamically feeling the reflection of the luster caused by the shaking of the actual object when it is held in the hand, so the preview display based on a still image (print data) shows that it is glossy. difficult to reproduce accurately.

There are also devices that reproduce gloss by changing the viewing angle (for example, rotating 360 degrees) in preview display. However, actual printed matter does not emit light by itself, but is reflected and glossy due to the influence of real-world lighting, so it is not highly reproducible. The dynamic range differs greatly between the range that can be reproduced by a preview display device and the actual reflection.

As mentioned above, the gloss of the base (background image) is not well reproduced, and even if you display the preview by overlaying the color of the additional printing area, the printed original image as seen in the preview differs from the actual image. There is a problem in that the results of printed matter vary greatly.

The present invention has been made in view of the above situation, and it is an object of the present invention to enable a user to check the reprint image while checking the glossiness of the printed matter more accurately.

In order to solve the above problems, a print finish presentation device according to one aspect of the present invention provides a print finish presentation device that provides a print finish presentation device that provides a print finish presentation device that provides a print finish presentation device that provides a print finish presentation device in which a glossy area existing in a photographed image of printing paper overlaps with original data for printing on the printing paper. a document data re-forming section that re-forms the document data so that it has a target transmittance with respect to the photographed image; and a superimposed image generating section that superimposes the re-formed document data on the photographed image and displays it on a display section. , is provided.

According to at least one aspect of the present invention, a user can check the reprint image while checking the glossiness of the printed matter more accurately.
Problems, configurations, and effects other than those described above will be made clear by the following description of the embodiments.

1 is a diagram showing an example of the overall configuration of a reprint printing system according to a first embodiment of the present invention. FIG. 2 is a diagram illustrating an overview of reprint printing for GS printed matter. FIG. 1 is a block diagram showing an example of the hardware configuration of an image forming apparatus included in the reprint printing system according to the first embodiment of the present invention. FIG. 1 is a block diagram illustrating an example of the hardware configuration of a smart device included in the reprint printing system according to the first embodiment of the present invention. 1 is a block diagram showing an example of a functional configuration of a smart device included in a reprint printing system according to a first embodiment of the present invention. FIG. FIG. 3 is a diagram illustrating an example of an output image of a GS printed matter moving image taken by a camera of a smart device according to the first embodiment of the present invention. 2 is a flowchart illustrating an example of a procedure for image output processing in an augmented reality space by the smart device according to the first embodiment of the present invention. 2 is a flowchart illustrating a procedure example of gold and silver area specifying processing according to the first embodiment of the present invention. FIG. 3 is a diagram illustrating a method of estimating lighting conditions. 7 is a flowchart illustrating an example of a procedure for identifying an overlapping area of CMYK version data and GS version data according to the first embodiment of the present invention. 5 is a flowchart illustrating an example of a procedure of RGB data creation processing according to the first embodiment of the present invention. FIG. 3 is a diagram showing a transmittance conversion table according to the first embodiment of the present invention. FIG. 3 is a diagram showing superimposition of a GS printed matter moving image and transmission RGB data according to the first embodiment of the present invention. FIG. 6 is a diagram showing a modification example of superimposing a GS printed matter moving image and transparent RGB data. FIG. 3 is a diagram showing an example of an output image (RGB settings changed) in an augmented reality space when additional printing is performed on a GS printed matter according to the first embodiment of the present invention. FIG. 3 is a diagram illustrating an example of an output image (CMYK settings changed) in an augmented reality space when additional printing is performed on a GS printed matter according to the first embodiment of the present invention. 7 is a flowchart illustrating an example of a procedure of slider value reflection processing according to the first embodiment of the present invention. 7 is a flowchart illustrating an example of a procedure of color conversion setting confirmation processing according to the first embodiment of the present invention. FIG. 2 is a block diagram showing an example of the hardware configuration of a transparent glass device as a smart device according to a second embodiment of the present invention. FIG. 2 is a block diagram showing an example of the functional configuration of a transmission type glass device according to a second embodiment of the present invention. 12 is a flowchart illustrating an example of a procedure for image output processing in an augmented reality space by a smart device according to a second embodiment of the present invention. 7 is a flowchart illustrating an example of a procedure for pseudo-transparent image generation processing according to a second embodiment of the present invention. FIG. 7 is a diagram illustrating an example of displaying a real space including GS printed matter in a transmission type glass device according to a second embodiment of the present invention. FIG. 7 is a diagram showing an example of an output image (CMYK settings changed) in an augmented reality space when additional printing is performed on a GS printed matter according to the second embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Examples of modes for carrying out the present invention (hereinafter referred to as "embodiments") will be described below with reference to the accompanying drawings. In this specification and the accompanying drawings, components having substantially the same functions or configurations are given the same reference numerals and redundant explanations are omitted.

<1. First embodiment>
[Overall configuration of reprint printing system]
FIG. 1 shows an example of the overall configuration of a reprint printing system according to a first embodiment of the present invention.
The reprint printing system 5 connects a gold printing press 1G, a silver printing press 1S, an image forming apparatus 2, a smart device 3, and a DTP (DeskTop Publishing) terminal 4 to a network N such as a LAN (Local Area Network). configured. The smart device 3 is wirelessly connected to the network N.

The gold printing machine 1G is a foil stamping machine, a printer (image forming device), or the like that can form gold characters and patterns on paper. In foil stamping printing, an adhesive such as varnish is applied onto a sheet of paper, and a thin metal film (foil) is adhered to the area where the adhesive is applied, thereby producing a printed matter with a metallic luster (glossy area). Furthermore, in the case of a printer, so-called printing is performed using gold ink, toner, or the like. The silver printing machine 1S is a foil stamping machine, a printer (image forming device), or the like that forms silver characters and patterns on paper. In this specification, a printed matter in which gold and silver colors are formed on paper is referred to as a "GS printed matter." In addition, although the glossy area made of gold and silver has been described as the glossy area, the glossy area is not limited thereto, and copper or other glossy areas may be used. In this specification, metallic luster such as gold and silver and luster similar to metallic luster are collectively referred to as "metallic luster."

The image forming apparatus 2 forms a color image using four basic colors, for example, cyan (C), magenta (M), yellow (Y), and black (K). In the present embodiment, the image forming apparatus 2 is used as an overprint printing apparatus that performs overprinting on printed matter having metallic luster produced by a gold printing press 1G, a silver printing press 1S, or the like. Note that the basic colors of the image forming apparatus 2 described above are an example of colors supported by the image forming apparatus 2 (printing device), and are not limited to the types and numbers described above.

The smart device 3 is an example of a terminal device that includes a camera, an image processing IC, a display, and the like. As the smart device 3, for example, a tablet terminal, a notebook PC (Personal Computer), or the like is used.

DTP software such as Adobe Illustrator (registered trademark) is installed on the DTP terminal 4. For example, a personal computer is used as the DTP terminal 4. The user uses the DTP software of the DTP terminal 4 to create a printing document, for example, a plate with only gold/silver glossy areas (special colors) and a CMYK plate for additional printing (an additional printing document). In this specification, they are respectively referred to as the "GS version" and the "CMYK version."

The above-mentioned reprint printing system 5 photographs a printed matter with metallic luster with a camera, and performs augmented reality (AR) display as if the reprint original is superimposed on the photographed image. This allows the user to make corrections to the reprint manuscript while making the user aware of the above.

If the gold printing press 1G and the silver printing press 1S are not foil stamping machines but printers (image forming apparatuses), GS printed matter can be obtained by directly inputting the GS plate data to the printers.

[Overview of reprint printing]
FIG. 2 shows an overview of reprint printing for GS printed matter.
First, a GS plate (Gold/Silver plate) 50 is used to create a printed matter (GS printed matter) in only gold and/or silver. Generally, gold and silver cannot be foil-stamped at the same time, so the GS plate 50 is divided into a gold plate and a silver plate, and the gold plate is first printed by the gold printing machine 1G, and the gold printing is used as printing paper to be printed on the silver printing machine 1S. By printing the silver plate after setting, a printed matter with gold and silver foil printed can be obtained (the order in which gold and silver can be printed may be silver first).

In the example of FIG. 2, the GS version 50 includes a gold object 51G representing a gold ring, a horizontally long gold object 52G, a silver object 53S representing a silver ring, and a horizontally long silver object 54S. In addition, the CMYK version (reprint version) 60 includes a red object 61R representing a red ring at a location corresponding to the gold object 51G of the ring, and a red object representing red letters (Au: 79 in the figure) at other locations. 62R exists. Furthermore, there is a blue object 63B representing a blue ring at a location corresponding to the silver ring object 53S, and a blue object 64B representing blue letters (Ag: 47 in the figure) at other locations. Furthermore, there is a black object 65K representing black characters (Print Technology).

By superimposing the CMYK plate 60 on the GS plate 50, a final printed image 70 showing the print finish is obtained. The final print image 70 includes a reddish gold ring object 71GR in which a red ring object 61R is superimposed on a gold ring object 51G, and a blue ring object 63B is superimposed on a silver ring object 53S. In addition, a bluish silver ring object 73SB, a horizontally long gold object 52G, a horizontally long silver object 54S, a red text object 62R, a blue text object 64B, and a black text object 65K are formed.

[Configuration of image forming apparatus]
FIG. 3 is a block diagram showing an example of the hardware configuration of the image forming apparatus 2 included in the reprint printing system 5. As shown in FIG. The image forming apparatus 2 includes a CPU (Central Processing Unit) 11 that controls the operation of the image forming apparatus 2 in an integrated manner. The CPU 11 is connected to a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a nonvolatile memory 14, a hard disk device 15, an automatic document feeder (ADF) 16, an authentication section 17, an operation section 18, A display section 19, a network communication section 20, an image reading section 21, an image processing section 22, a printer section 23, a facsimile communication section 24, and the like are connected.

The CPU 11 is based on an OS (Operating System) program, and executes middleware, application programs, etc. thereon. Various programs are stored in the ROM 12, and each function of the image forming apparatus 2 is realized by the CPU 11 executing various processes according to these programs.

The RAM 13 is used as a work memory for temporarily storing various data when the CPU 11 executes processing based on a program, an image memory for storing image data, and the like.

The nonvolatile memory 14 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used to store various setting information. The hard disk device 15 is a large-capacity nonvolatile storage device, and stores various programs and data in addition to print data (eg, GS version data, CMYK version data), image data, etc.

The image reading unit 21 functions to optically read a document and obtain image data. The image reading unit 21 includes, for example, a light source that irradiates light onto the original, a line image sensor that receives the reflected light and reads one line of the original in the width direction, and a reading position for each line sequentially in the length direction of the original. A moving unit that moves the document, an optical path that includes lenses and mirrors that guide the reflected light from the document to the line image sensor to form an image, and a conversion unit that converts the analog image signal output from the line image sensor into digital image data. It is composed of the following.

The automatic document conveyance section 16 has a function of feeding out and conveying the documents set on the document table one by one starting from the top one, passing the reading position of the image reading section 21, and ejecting the documents to a predetermined paper ejection position. fulfill. It also has a function to automatically flip the front and back sides of the original, thereby enabling automatic reading of both sides of the original. The image reading section 21 has a function of reading a document placed on a platen glass and a function of sequentially reading documents conveyed by the automatic document conveyance section 16.

Authentication unit 17 authenticates a user who uses image forming apparatus 2 . Any authentication method may be used, such as a password, fingerprint, or vein.

The operation unit 18 and the display unit 19 constitute an operation panel that receives operations such as submitting a job from the user. The image forming apparatus 2 receives output settings, job execution instructions, and the like from the user through the operation panel. The display unit 19 is composed of a liquid crystal display (LCD) or the like, and has the function of displaying various operation screens, setting screens, and the like. The display unit 19 performs display using three colors, red (R), blue (B), and green (G), but these colors are examples of the colors that the display unit 19 (display device) corresponds to. Not limited to examples. The operation unit 18 includes various operation switches such as a start button, and a touch panel provided on the physical screen of the display unit 19. The touch panel detects the coordinate position where the physical screen of the display unit 19 is touched with a touch pen, a finger, or the like.

The network communication unit 20 functions to communicate with external devices such as the smart device 3, the gold printing press 1G, the silver printing press 1S, and the DTP terminal 4 through a network N such as a LAN.

The image processing unit 22 performs processes such as enlarging/reducing and rotating images, as well as rasterization processing for converting print data into image data, compression and expansion processing for image data, and the like.

The printer section 23 functions to form an image on recording paper according to the image data. This device includes a recording paper conveying device, a photoreceptor drum, a charging device, a laser unit, a developing device, a transfer separation device, a cleaning device, and a fixing device, and forms images using an electrophotographic process. It is configured as a so-called laser printer. Image formation may be performed using other methods. The printer unit 23 further has a function of performing post-processing such as stapling, punching holes, and folding printed sheets.

The facsimile communication unit 24 has the function of transmitting and receiving image data to and from an external device equipped with a facsimile function via a telephone line.

[Smart device configuration]
FIG. 4 is a block diagram showing an example of the hardware configuration of the smart device 3 included in the reprint printing system 5. As shown in FIG. The smart device 3 includes a ROM 32, a RAM 33, a non-volatile memory 34, an orientation sensor section 35, a camera section 36, an authentication section 37, an operation section 38, a display section 39, a network communication section 40, an image processing section 41, and a CPU 31 via a bus. It is configured by connecting a line of sight detection section 42, a distance sensor 43, an audio output section 44, and the like.

The CPU 31 controls the operation of the smart device 3 according to programs stored in the ROM 32 and nonvolatile memory 34. The ROM 32 stores programs and fixed data. The RAM 33 is used as a work memory for temporarily storing various data when the CPU 31 executes a program. The nonvolatile memory 34 stores various setting information and application programs.

The orientation sensor section 35 detects the orientation and posture of the smart device 3 and changes thereof. The orientation sensor section 35 is configured by combining a plurality of geomagnetic sensors and a plurality of acceleration sensors. The orientation sensor unit 35 detects the posture of the user holding the smart device 3, the direction and angle the user is facing (these correspond to the direction and orientation in which the camera unit 36 is photographing), and detects the orientation of the user holding the smart device 3. 3 is tilted, detects the direction and speed of the movement, and notifies the CPU 31 of the detection results. Based on the notification from the orientation sensor unit 35, the CPU 31 recognizes the posture and angle of the user holding the smart device 3, as well as the direction and speed of the tilted movement.

The camera unit 36 is an image sensor that is provided on the back side of the smart device 3 and photographs the direction in which the back side of the smart device 3 faces. The camera unit 36 can take moving images, and captures images at, for example, 30 frames per second.

The authentication unit 37 authenticates the user of the smart device 3. Any authentication method may be used, such as a password, fingerprint, or vein.

The display section 39 is composed of a liquid crystal display or the like. The operation unit 38 is configured with a touch panel or the like provided on the physical screen of the display unit 39.

The network communication unit 40 functions to communicate with external devices such as the image forming apparatus 2 and the DTP terminal 4 through a network N including a wireless LAN.

Under the control of the CPU 31, the image processing unit 41 creates an image (such as RGB data converted from CMYK version data) to be synthesized with the image captured by the camera unit 36 (GS printed matter video), and corrects (enlarges/reduces) the image. , transformation), etc. The image processing unit 41 also converts and changes RGB data.

The line of sight detection unit 42 detects the line of sight (where the user is looking) of the smart device 3 . The line of sight detection method may be arbitrary. For example, the smart device 3 is provided with a camera that photographs the user's face and eyes, and the image taken by this camera is analyzed to detect the user's line of sight based on the position and direction of the face, eyes, and pupils. The smart device 3 recognizes where the user of the smart device 3 is looking by detecting the user's line of sight with the line of sight detection unit 42 .

The distance sensor 43 measures the distance from the smart device 3 to various objects within the photographing range of the camera unit 36 and the distance to the object that the user of the smart device 3 is viewing. The distance sensor 43 is composed of an ultrasonic sensor or the like, similar to the distance sensor 133 of the transmission type glass device 3A.

The audio output unit 44 is used when outputting display contents or warnings as audio.

In the case of the smart device 3, the display unit 39 displays an image (for example, a superimposed image 110) in which an output image (reprint image) is superimposed on the paper in the image captured by the camera unit 36. The user will view the augmented reality space displayed on the display unit 39 of the smart device 3. Furthermore, in order to determine whether or not the user is looking at the paper, the smart device 3 may determine whether or not the user is looking at the display section 39 .

The smart device 3 analyzes the photographed image of the camera unit 36 and detects the paper (GS printed matter) present in the photographed image, including its position and orientation. Further, the distance to the detected paper is measured by a distance sensor 43, and the actual size of the paper is recognized from the measured distance and the size of the paper in the photographed image. Furthermore, by measuring the distances to each part of the paper using the distance sensor 43 and totaling and analyzing these, the three-dimensional shape (tilt, bend, fold, etc.) of the paper as seen from the smart device 3 is also recognized. For example, three-dimensional shape recognition can utilize a known technique disclosed in Japanese Patent Laid-Open No. 2008-26243.

The DTP terminal 4 using a personal computer includes, among the functional blocks of the smart device 3, for example, a CPU 31, a ROM 32, a RAM 33, a nonvolatile memory 34, an authentication section 37, an operation section 38, a display section 39, a network communication section 40, and an image. It includes a processing section 41, an audio output section 44, and the like. In a second embodiment described later, the DTP terminal 4 has the function of an overlapping area specifying section 81 (see FIG. 20) described later.

[Smart device functions]
Next, the functions of the smart device 3 regarding print finish presentation will be explained.
FIG. 5 is a block diagram showing an example of the functional configuration of the smart device 3 included in the reprint printing system 5. As shown in FIG. The smart device 3 includes an overlapping area specifying section 81 , a gold and silver area specifying section 82 , an RGB data creating section 83 , a transparent RGB data converting section 84 , an overlapping image generating section 85 , and a color conversion setting determining section 87 . The gold and silver area specifying section 82 , the RGB data creating section 83 , and the transmission RGB data converting section 84 constitute a document data re-forming section 88 . The functions of each block are realized by the CPU 31 executing a program stored in the ROM 32 or the like.

The overlapping area specifying unit 81 compares the CMYK version data and the GS version data, and determines an area where the CMYK version data (CMYK area) and the GS version data (glossy area) overlap (hereinafter referred to as the "overlapping area"). Perform processing to identify. Then, the overlapping area specifying unit 81 outputs pixel information of the specified overlapping area to the RGB data creating unit 83.

The original data re-formation unit 88 reproduces the glossy area existing in the photographed image (hereinafter referred to as "GS printed matter moving image") obtained by photographing the printing paper (GS printed material) with the camera section 36 and the printing on the printing paper. The original data is re-formed so as to have the transmittance set for the photographed image in the area where the original data (CMYK version data) for image processing overlaps. The gold and silver area specifying section 82, the RGB data creating section 83, and the transmission RGB data converting section 84 will be explained below.

The gold and silver area specifying unit 82 performs processing to identify a golden or silver glossy area (hereinafter referred to as a "gold and silver area") on a photographed image of a GS print (GS print moving image). Then, the gold and silver area specifying unit 82 outputs pixel information of the identified gold and silver area to the RGB data creation unit 83. The GS printed matter moving image is stored in the RAM 33.

The RGB data creation section 83 cooperates with the image processing section 41 to perform a process of creating RGB data to be displayed on the display section 39 from the CMYK version data. In this embodiment, the RGB data creation unit 83 converts CMYK version data into RGB data, taking into account lighting conditions. Further, the RGB data creation unit 83 performs a process of updating the RGB data by reflecting the setting values (setting change values) of the sliders SL1 and SL2 (see FIGS. 13 and 16) operated by the user in the RGB data. . Then, the RGB data creation unit 83 outputs the created or updated RGB data to the transparent RGB data conversion unit 84.

The transparent RGB data conversion unit 84 works with the image processing unit 41 to adjust the transmittance of the RGB data, thereby converting the RGB data into transparent RGB data for superimposing and displaying the GS print video image. Perform the processing to do. Then, the transmission RGB data conversion section 84 outputs the transmission RGB data to the superimposed image generation section 85.

The superimposed image generation unit 85 (an example of a superimposition processing unit) performs processing to generate a superimposed image (final print confirmation image) from the GS printed matter moving image and the RGB data for transparency, and displays the superposed image on the display unit 39. Output to.

The color conversion setting determination unit 87 performs processing for determining color conversion settings for superimposed images. That is, the color conversion setting confirmation unit 87 receives an instruction from the operation unit 38 to confirm the RGB data that constitutes the superimposed image output to the display unit 39, reconstructs CMYK version data from the RGB data, and stores it in the RAM 33. to be memorized.

[Output image example]
FIG. 6 shows an output image example of a GS printed matter moving image photographed by the camera unit 36 of the smart device 3. As shown in FIG. 6, a print finish confirmation screen 90 is displayed on the display unit 39 of the smart device 3. A GS printed matter moving image 92 in real space is displayed in a photographed image display area provided on the left half of the print finish confirmation screen 90. The GS printed matter moving image 92 is a photograph of a GS printed matter 91 on which an image based on the GS version 50 (FIG. 2) has been formed.

[Image output processing]
Next, image output processing by the smart device 3 will be explained.
FIG. 7 is a flowchart illustrating an example of a procedure of image output processing by the smart device 3. FIG. 7 shows display processing that is executed for each pixel in frame units after acquiring the GS printed matter moving image. The processing of this flowchart is realized by the CPU 31 executing a program stored in the ROM 32 or the like.

First, the gold and silver area specifying unit 82 (see FIG. 5) identifies the gold and silver area of the GS print moving image photographed by the camera unit 36, that is, the actual GS print (S1). The details of this gold and silver area specifying process will be explained with reference to FIG.

(Gold and silver area identification processing)
FIG. 8 is a flowchart illustrating an example of a procedure for gold and silver area specifying processing by the gold and silver area specifying unit 82. As shown in FIG. First, the gold and silver area specifying unit 82 acquires the GS printed matter moving image 92 photographed by the camera unit 36, and stores it in the RAM 33 (S21). The GS printed matter moving image 92 may be photographed by the camera unit 36 and stored in the nonvolatile memory 34 in advance.

Next, the gold and silver area specifying unit 82 compares the GS printed matter moving image 92 and the GS version data 94 received from the DTP terminal 4, and identifies the gold and silver colored area on the GS printed matter (GS printed matter moving image 92) (S22). ).

Next, the gold and silver area specifying unit 82 infers the lighting conditions from the difference between the GS plate data 94 and the paper color of the GS printed material outside the specified gold and silver area, and stores the estimation result in the RAM 33 as illumination amount data 96 for the GS printed material. It is stored (S23). After the processing in step S23, the process moves to step S2 in FIG.

Here, a method for estimating illumination conditions will be described with reference to FIG. 9.
In FIG. 9, it is assumed that a gold and silver area A2 of the GS printed matter moving image 92 located at a corresponding position is specified from a gold and silver area A1 of the GS plate data 94. A portion of the GS plate data 94 other than the gold and silver area A1 (for example, pixel p1) is compared with a portion of the corresponding GS printed matter video image 92 other than the gold and silver area A2 (for example, pixel p2), and based on the difference, the lighting conditions can be determined. Guessing is done. The pixel p2 corresponds to the margin of the GS printed material, that is, the paper.

Returning to the explanation of the flowchart in FIG. 7. After the processing in step S1, the gold and silver area specifying unit 82 determines whether the pixels on the display unit 39 correspond to objects (CMYK area) on the CMYK plate (S2). That is, when the CMYK value of a target pixel on the GS printed matter video image 92 is (0, 0, 0, 0), the CMYK value on the CMYK plate corresponding to the target pixel is other than that (CMYK value≠(0, 0, 0,0)). If the target pixel on the GS print video image 92 does not correspond to an object on the CMYK version (NO in S2), the gold and silver area specifying unit 82 outputs the GS print video image 92 as an output image to the display unit 39 regarding the target pixel. Output (S9). After the processing in step S9, the process moves to step S7.

On the other hand, if the pixel on the display unit 39 corresponds to an object on the CMYK version (YES in S2), the RGB data creation unit 83 estimates the target pixel in step S23 in order to display the CMYK version on the display unit 39. The CMYK values are converted into RGB values (color gamut conversion) while taking into account the illumination conditions obtained, and RGB data is created (S3). Details of this RGB data creation process will be explained with reference to FIG. 11.

(Overlapping area identification processing)
In addition to the above acquisition of GS printed matter by the gold printing press 1G and silver printing press 1S, as shown in FIG. ). The overlapping area specifying unit 81 (see FIG. 2) of the smart device 3 compares the CMYK version data 95 and the GS version data 94, identifies an area where both version data overlap, and stores it in the RAM 33 as an overlapping area. (S12).

(RGB data creation process)
Here, the RGB data creation process in step S3 will be explained.
FIG. 11 is a flowchart showing an example of a procedure of RGB data creation processing by the RGB data creation unit 83 (see FIG. 5). First, the RGB data creation unit 83 of the original data regeneration unit 88 determines whether RGB data for displaying the GS printed matter moving image 92 exists (S31). If RGB data does not exist (NO in S31), such as when the frame of the target pixel on the GS printed matter video image 92 is the first frame, the RGB data creation unit 83 creates CMYK version data while taking into account the lighting conditions. 95 into RGB data (S32). That is, the RGB data creation unit 83 converts the CMYK values of the CMYK version data 95 of the target pixel into RGB values based on the CMYK/RGB conversion lookup table 99 and the illumination amount data 96 for the GS printed matter, and generates the RGB data. Get 98. In the figure, the CMYK/RGB conversion lookup table 99 is expressed as "CMYK/RGB conversion LUT 99."

Next, if RGB data exists (YES in S31), the RGB data creation unit 83 determines whether updated RGB data exists (S33), and if no updated RGB data exists (NO in S33). , performs RGB conversion processing in step S32. The updated RGB data is data whose RGB values have been changed by sliders SL1 and SL2.

On the other hand, if updated RGB data exists (YES in S33), the RGB data creation unit 83 converts the updated RGB data 97 into RGB data while taking the lighting conditions into account (S34). That is, the RGB data creation unit 83 converts the RGB values of the updated RGB data 97 of the target pixel into RGB values that reflect the illumination conditions based on the illumination amount data 96 for the GS printed matter, and stores the converted RGB values as RGB data 98. . After the processing in step S32 or step S34, the process moves to step S4 in FIG.

In this way, the RGB data creation unit 83 (original data re-forming unit 88) compares the primary original data (GS version data 94) of the photographed image with the photographed image (GS printed matter moving image 92), and The illumination conditions are inferred from the difference, and the illumination conditions are reflected in the re-formed original data (RGB data). As a result, it is possible to accurately represent a reprint image for the GS printed material (primary printed material) in consideration of the lighting conditions of the actual environment. CMYK version data before RGB data conversion is an example of secondary manuscript data.

Returning to the explanation of the flowchart in FIG. 7 again. After the processing in step S3, the RGB data creation unit 83 determines whether the pixels on the created (or converted) RGB data 98 are within the overlapping region of the CMYK version data 95 and the GS version data 94 (S4) . If the target pixel on the RGB data 98 is not within the overlapping area (NO in S4), the RGB data creation unit 83 outputs the RGB data 98 as an output image to the display unit 39 (S10). After the processing in step S10, the process moves to step S7.

On the other hand, if the target pixel on the RGB data 98 is within the overlapping area (YES in S4), the transmission RGB data conversion unit 84 (see FIG. 5) of the original data reformation unit 88 converts the transmission rate conversion table 93 The RGB data 98 is converted into transparent RGB data 100 (see FIG. 13) so as not to fill the display unit 39 (S5).

This conversion process is performed as shown in FIG. This is done based on the rate conversion table 93. The transmittance conversion table 93 is created in advance by performing color measurement based on the camera section 36 of the smart device 3, the display section 39 (output capacity), and the actual final printed matter that is reprinted on the GS printed matter. . That is, the transmittance of the RGB data 98 converted from the CMYK version data 95 (original data) is expressed by the transmittance conversion table 93 associated with the output capability of the display section 39. It is desirable that the transmittance conversion table 93 be updated based on the output capability of the display section 39.

For example, in FIG. 12, when each RGB value of the RGB data 98 is 100, the transmittance of each value is set to (15, 10, 15). There are several ways to express transmittance, that is, color shading, for example, by changing the size of the dots that make up the printed image, or by changing the size of the dots by fixing the size of the dots and changing only the density. There are some that do both at the same time. Basically, the smaller the halftone dots and the lower the density, the lighter the color (higher transmittance), and the larger the halftone dots and higher the density, the darker the color (lower transmittance).

Next, as shown in FIG. 13, the superimposed image generation unit 85 generates a superimposed image 110 from the transparent RGB data 100 (transparent image) and the GS printed matter video image 92 (background image) (S6), and 110 is output to the display unit 39 (S7). Next, it is determined whether there is a next frame (S8), and if there is a next frame (YES in S8), the process moves to step S1 and the image output process of FIG. 7 is repeated. Alternatively, if there is no next frame (NO in S8), the process of this flowchart ends. As a result, real-time display of the moving image of the GS printed matter is realized.

In this way, the smart device 3 acquires the GS printed matter moving image 92 (background image) and adjusts the transmittance of the object to be superimposed (RGB data 98 into which the CMYK version data 95 has been converted) according to the transmittance conversion table 93. While making the settings, a superimposed image 110 is generated and displayed on the display unit 39. As a result, an augmented reality space display based on the GS printed matter moving image 92 and the CMYK version data 95 is realized, and the user can confirm the finish of additional printing before performing additional printing.

(Modified example of superimposed image generation processing)
Here, a modification of the superimposed image generation process by the superimposed image generation section 85 will be described.
FIG. 14 shows a modified example of superimposing the GS printed matter moving image 92 and the transmission RGB data 100. If the smart device 3 is unable to generate an image in which the GS printed matter moving image 92 and the transparent RGB data 100 are superimposed for reasons such as low image processing capacity, it is possible to pseudo-transparently display the CMYK version data 95. Conceivable.

For example, the processing by the transparent RGB data converter 84 and the superimposed image generator 85 can be configured as follows. First, the transmission RGB data converter 84 calculates the target transmittance by referring to the transmittance conversion table 93 in step S5. Next, in step S6, the superimposed image generation unit 85 calculates the area of the object and the number of pixels required for display for each object of the CMYK version data 95 that corresponds to the superimposed area. Then, the superimposed image generation unit 85 fills in the RGB values or displays the background image for each calculated pixel so that the RGB data corresponds to the target transmittance. That is, the density of halftone dots of the CMYK version data 95 is adjusted.

FIG. 14 shows an example of a superimposed image 111 in which an object 114 is formed, which is made up of a pixel 113 that has been filled in and a pixel 112 that displays a background image. The superimposed image 111 can be said to be a pseudo superimposed image because it is displayed in a pseudo transparent manner. This process is the same as the pseudo transparent image generation process of the second embodiment.

With this configuration, even if the device cannot generate an image in which the GS printed matter moving image 92 and the RGB data for transmission 100 are superimposed, a pseudo superimposed image 111 that maintains the desired transmittance can be generated, allowing the user to follow the instructions. You can check the print finish in advance.

Note that when re-forming the original data (RGB data), the overlapping image generation unit 85 acquires the output capability of the display unit 29, and generates an image (pseudo overlapping image 111) in which display or transparency of the original data is set for each pixel. ) may be configured to reproduce the target transmittance.

[Overlaid image (RGB settings change)]
FIG. 15 shows an example of an output image (RGB settings changed) in an augmented reality space when additional printing is performed on the GS printed material 91. In the photographed image display area of the print finish confirmation screen 90, a superimposed image 110 in which transmission RGB data 100 is superimposed on the GS printed matter moving image 92 is displayed. A color setting change section 115 is displayed on the right half of the print finish confirmation screen 90. The color setting change section 115 displays a setting standard change section SE and a slider SL1.

The setting standard change unit SE is a user interface that allows selection of whether to change the color setting using the slider SL1 using an RGB standard or a CMYK standard. In FIG. 15, the RGB standard is selected. The slider SL1 is a user interface that can adjust the color settings of the overlapping area. The document data re-formation unit 88 (see FIG. 5) changes the transmittance of the RGB data 98 superimposed on the GS printed matter moving image 92 according to the setting value (slider value) of the slider SL1, and reflects it on the display. When the OK button is operated, the hue (color setting) of the currently displayed superimposed image 110 is determined and saved.

[Overlaid image (CMYK settings change)]
FIG. 16 shows an example of an output image (CMYK settings changed) in the augmented reality space when additional printing is performed on the GS printed matter 91. On the right half of the print finish confirmation screen 90, a setting standard change section SE and a CMYK standard slider SL2 are displayed. Generally, the device values of the display unit 39 are RGB values, but some users may wish to adjust color settings based on CMYK standards. Therefore, by providing the setting standard change unit SE, the user can select the desired change standard, improving convenience for the user.

Note that the standards for changing color settings are not limited to the RGB standards and CMYK standards, but may be other changing standards. Moreover, although FIGS. 15 and 16 describe changes in color settings, a configuration may also be adopted in which saturation and brightness can also be set.

[Slider value reflection process]
Next, slider value reflection processing using sliders SL1 and SL2 will be explained.
FIG. 17 is a flowchart illustrating an example of a procedure of slider value reflection processing by the RGB data creation unit 83. This process is similar to the superimposed image 111 (see FIG. 14).

First, the RGB data creation unit 83 acquires setting change values of the RGB data 98 that constitute the superimposed image 110 (S41). The setting change value is the change standard and setting value (slider value) of the sliders SL1 and SL2 shown in FIGS. 15 and 16. Next, the RGB data creation unit 83 determines whether the setting change is based on the RGB standard based on the acquired setting change value (S42). If the setting change is based on the RGB standard (S42: YES), the RGB data creation unit 83 updates the RGB data according to the slider value (RGB standard) based on the current position of the slider SL1 (S43). RGB data 97 is stored in RAM 33.

Further, if the setting change is not based on the RGB standard (NO in S42), the RGB data creation unit 83 determines whether the setting change is based on the CMYK standard (S45). Then, if the setting change is based on the CMYK standard (YES in S45), the RGB data creation unit 83 converts all RGB values of the RGB data 98 to CMYK values with reference to the CMYK/RGB conversion LUT 99, and The data is stored in the RAM 33 as data 101 (S46).

Next, the RGB data creation unit 83 updates the CMYK data 101 according to the slider value (CMYK reference) based on the current position of the slider SL2 (S47). Next, the RGB data creation unit 83 creates updated RGB data 97 from the updated CMYK data 101 with reference to the CMYK/RGB conversion LUT 99 (S48), and stores the updated RGB data 97 in the RAM 33.

Furthermore, if the setting change is not based on the CMYK standard (NO in S45), the RGB data creation unit 83 performs conditional branching to change other color settings if there are other change standard options (S49). In the figure, step S49 is indicated by a broken line.

Next, after updating the RGB data 98 (RGB values of the transparent image) in step S43 or step S48, the smart device 3 performs the image output process shown in FIG. 7 (S44). After the image output process is completed, this flowchart ends.

[Color conversion setting confirmation process]
Next, a color conversion setting confirmation process using the print finish confirmation screen 90 (see FIGS. 15 and 16) will be described. Before ending the display of the augmented reality space, when the user is satisfied with the hue of the superimposed image 110 or 111 displayed on the print finish confirmation screen 90, the user presses the OK button and instructs to confirm the color conversion settings. . Then, the portion that has been converted for display on the display unit 39 is reversely converted for print output.

FIG. 18 is a flowchart illustrating an example of a procedure of color conversion setting confirmation processing by the color conversion setting confirmation section 87 (see FIG. 5).
First, the color conversion setting confirmation unit 87 determines whether or not there is a confirmation instruction from the user, that is, whether or not the OK button on the print finish confirmation screen 90 has been pressed (S51), and if there is no confirmation instruction (NO in S51), will wait until there is a confirmation instruction.

Next, if there is a confirmation instruction (YES in S51), the color conversion setting confirmation unit 87 confirms the RGB data 98 (RGB values of the transparent image) output and displayed on the display unit 39 (S52). Next, the color conversion setting determination unit 87 reversely converts the RGB data 98 into RGB values for print output based on the transmittance conversion table 93 (S53).

Next, the color conversion setting determination unit 87 refers to the CMYK/RGB conversion LUT 99 and converts the RGB values for print output into CMYK values (S54). Then, the color conversion setting determining unit 87 stores the CMYK values in the RAM 33 or the nonvolatile memory 34 as reconstructed CMYK version data 102 that can be output to the image forming apparatus 2 (S55). After the processing in step S55, this flowchart ends.

For example, after restoring the original data (after generating the reconstructed CMYK version data 102), the color conversion setting determining unit 87 of the smart device 3 outputs an instruction to perform additional printing to the designated image forming apparatus 2. Upon receiving the instruction, the image forming apparatus 2 forms an image based on the reconstructed CMYK version data 102 on a preset GS printed material. As a result, a final printed matter (product) having almost the same color settings as the final printed image 70 is obtained.

As described above, according to the reprint printing system 5 of the present embodiment, the user can adjust the color of the document (reprint image) to be superimposed on the actual printed matter while checking the glossiness of the glossy area. That is, the user can check the reprint image while checking the glossiness of the printed matter more accurately. Therefore, there is no need to reprint, and the printing cost of metallic gloss printing, which is expensive, can be reduced.

Further, according to the present embodiment, in the case of a device with high image processing capability, it is possible to combine and display the image of the printing paper taken by the camera unit 36 with the document data after transparency processing and re-formation. In addition, in the case of a device that does not have high image processing capability, by determining the display of the photographed image of the printing paper by the camera unit 36 and the document data after re-formation for each pixel, an image expressing the target transmittance can be obtained. can be expressed together with the photographed image of the printing paper.

Further, according to the present embodiment, after checking the glossiness of the printed material and the reprint image, the reprint document is automatically created based on an instruction. Therefore, the user's creation of a reprint manuscript is assisted, and the user's work load is reduced.

<2. Second embodiment>
The second embodiment is an example in which a transmission glass device 3A (see FIG. 19) is used as the smart device of the first embodiment.

The transmission type glass device 3A has a shape similar to glasses, and is used by being worn on a person's eyes. The transmission type glass device 3A of this embodiment employs a method (so-called light transmission type) in which an image is superimposed on the outside using a half mirror 135 (see FIG. 19). For example, the transmission type glass device 3A includes display sections 129 that are respectively placed in front of the wearer's left and right eyes when worn, and a half mirror 135 that is supported so as to be located in front of each display section 129.

The half mirror 135 is provided so as to be inclined at an angle of 45 degrees or the like with respect to external light that enters from the front toward each display section 129, and the projection section 126 displays a pseudo-transparent image (an image of augmented reality information), which will be described later. light) is projected toward the half mirror 135. The pseudo-transparent image corresponds to the superimposed image in the first embodiment. The half mirror 135 is configured by coating a transparent substrate (glass substrate) with a reflective film (metal film and dielectric film). For example, the half mirror 135 has a ratio of transmitted light to reflected light of 1:1.

Light obtained by combining external light and image light at a ratio of 1:1 enters the eyes of the person wearing the transmission glass device 3A through the display section 129. That is, the wearer of the transmission type glass device 3A sees the outside appearance and the image projected by the projection unit 126 superimposed at a half-and-half transmittance.

[Configuration of transmission type glass device]
FIG. 19 is a block diagram showing an example of the hardware configuration of a transparent glass device 3A as a smart device according to the second embodiment. The transmission type glass device 3A is connected to a CPU 121 as a control unit via a bus such as a ROM 122, a RAM 123, a nonvolatile memory 124, an orientation sensor unit 125, a projection unit 126, a camera unit 127, an operation unit 128, a display unit 129, and a network communication unit 130. , an image processing section 131, a line of sight detection section 132, a distance sensor 133, an audio output section 134, and the like are connected. Further, the transmission type glass device 3A includes a half mirror 135.

The transmission type glass device 3A differs from the smart device 3 in that it particularly includes a projection section 126, a display section 129, and a half mirror 135. Other CPU 121, ROM 122, RAM 123, nonvolatile memory 124, direction sensor section 125, camera section 127, operation section 128, network communication section 130, image processing section 131, line of sight detection section 132, distance sensor 133, and audio output section 134 The basic functions of each part are not significantly different from the corresponding parts of the smart device 3.

The CPU 121 controls the operation of the transmission glass device 3A according to programs stored in the ROM 122 and the nonvolatile memory 124. The ROM 122 stores programs and fixed data. The RAM 123 is used as a work memory for temporarily storing various data when the CPU 121 executes a program. The nonvolatile memory 124 stores various setting information, application programs, and the like.

The orientation sensor section 125 detects the orientation and posture of the transmission type glass device 3A, and changes thereof. The orientation sensor section 125 can have a similar configuration to the orientation sensor section 35 of the smart device 3.

As described above, the projection unit 126 projects an image to be projected (image light of augmented reality information) toward the half mirror 135.

The camera unit 127 photographs the front of the transmission type glass device 3A. More specifically, it is an image sensor that photographs approximately the same field of view as the wearer's field of view when looking forward. The camera section 127 may be provided on each of the left and right sides of the transmission type glass device 3A, or may be provided on only one of them. The camera unit 127 photographs moving images and captures images at, for example, 30 frames per second.

The operation unit 128 includes various switches and the like, and is used to turn on the power and adjust the brightness and color settings of the projected image.

The external light that has passed through the half mirror 135 and the image light (pseudo-transmitted image) that has been reflected by the half mirror 135 are incident on the display section 129 . The user views, on the display unit 129, an augmented reality space in which the outside appearance and the pseudo-transparent image projected by the projection unit 46 are superimposed at a half-transmittance ratio.

The network communication unit 130 functions to communicate with external devices such as the image forming apparatus 2 through a network N including a wireless LAN.

The image processing unit 131, under the control of the CPU 121, projects an image (CMYK version data) from the projection unit 126 onto the display unit 129 via the half mirror 135 and combines it with the captured image (GS printed matter moving image) of the camera unit 36. RGB data (converted from . The image processing unit 131 also converts and changes RGB data.

The line of sight detection unit 132 detects the line of sight (where the user is looking) while wearing the transmission glass device 3A. The line of sight detection method may be arbitrary. For example, a camera is provided to photograph the wearer's eyes, and the image taken by this camera is analyzed to detect the wearer's line of sight based on the position and direction of the eyes and pupils. The transmission type glass device 3A recognizes the location where the wearer of the transmission type glass device 3A is looking by detecting the line of sight of the wearer using the line of sight detection section 132.

The distance sensor 133 measures the distance from the transmission glasses device 3A to various objects within the photographing range of the camera unit 127 and the distance to the object viewed by the wearer of the transmission glasses device 3A. The distance sensor 133 is composed of, for example, an ultrasonic sensor.

The audio output unit 134 is used when outputting display contents or warnings as audio.

In the transmission type glass device 3A (described later) (see FIG. 19), an output image is displayed superimposed on information from the real space. Note that the camera unit 127 may be a stereo camera, and the posture of the paper and the three-dimensional shape viewed from the transmission glass device 3A side may be recognized by analyzing the image of the stereo camera.

[Functions of transmission glass device]
FIG. 20 is a block diagram showing an example of the functional configuration of the transmission type glass device 3A.
The transmission glass device 3A differs from the smart device 3 in the first embodiment (see FIG. 5) in that it includes a pseudo-transmission image generation section 85A instead of the superimposed image generation section 85. Furthermore, in the present embodiment, the overlapping area specifying section 81 of the smart device 3 is provided in the DTP terminal 4 instead of in the transmission type glass device 3A. Among the functional blocks of the transmissive glass device 3A, detailed explanations of blocks corresponding to the smart device 3 will be omitted.

The overlapping area specifying unit 81 of the DTP terminal 4 compares the CMYK version data and the GS version data, and identifies the overlapping area where the CMYK version data 95 (CMYK area) and the GS version data 94 (glossy area) overlap. Perform processing. Then, the overlapping area specifying unit 81 transmits the pixel information of the specified overlapping area, together with the CMYK plate data 95 (CMYK area) and the GS plate data 94, to the transmission type glass device 3A.

If a pixel on the created (or converted) RGB data 98 is not within the overlapping area of the CMYK version data 95 and the GS version data 94 received from the DTP terminal 4, the RGB data creation unit 83 converts the RGB data 98 into the RGB data 98. is projected from the projection unit 126 onto the display unit 129 via the half mirror 135 as an output image.

The pseudo-transparent image generation unit 85A performs processing to generate a pseudo-transparent image (final printed matter confirmation image) from the GS printed matter moving image and the transparent RGB data converted by the transparent RGB data conversion unit 84, and generates the pseudo-transparent image. The image is projected from the projection section 126 onto the display section 129 via the half mirror 135.

The color conversion setting determination unit 87 performs processing for determining the color conversion settings of the pseudo-transparent image. That is, the color conversion setting confirmation unit 87 receives an instruction from the operation unit 38 to confirm the RGB data constituting the pseudo-transparent image projected on the display unit 129, reconstructs CMYK version data from the RGB data, and stores it in the RAM 33. to be memorized.

[Image output processing]
Next, image output processing by the smart device 3 will be explained.
FIG. 21 is a flowchart showing an example of a procedure for image output processing by the transmission type glass device 3A. In FIG. 21, particularly the processing in steps S66 and S69 is different from the processing by the smart device 3 of the first embodiment (see FIG. 7). The other steps S61 to S65, S67 to S68, and S70 are the same as steps S1 to S5, S7 to S8, and S10 in FIG. 7, so a detailed explanation of these steps will be omitted.

After the gold and silver area identification process for the GS printed matter video image 92 in step S61 is completed, if the pixels on the projection unit 126 do not correspond to objects (CMYK area) on the CMYK plate (NO in S62), the projection unit 126 , for the target pixel, the process of projecting the output image onto the display unit 39 is not performed (S69). That is, the projection unit 126 sets the RGB values of pixels that do not correspond to objects on the CMYK version to (0, 0, 0).

Further, after the conversion process from RGB data to transparent RGB data in step S65 is completed,
The pseudo-transparent image generation unit 85A generates a pseudo-transparent image 141 (see FIG. 23) from the RGB data for transparency (transparent image) and the GS printed matter moving image 92 (background image) (S66). Then, the projection unit 126 projects (outputs) the pseudo-transparent image 141 onto the display unit 39 via the half mirror 135 (S67).

[Pseudo-transparent image generation processing]
Next, the pseudo transparent image generation process in step S66 will be explained.
FIG. 22 is a flowchart illustrating an example of a procedure for pseudo-transparent image generation processing by the pseudo-transparent image generation unit 85A.

First, the pseudo-transparent image generation unit 85A calculates the area of the object and the number of pixels required for display for each object of the CMYK version data 95 that corresponds to the overlapping area (S81). Next, the pseudo-transparent image generation unit 85A determines RGB value filling or transparency (RGB value = (0, 0, 0)) for each calculated pixel so that the RGB data corresponds to the target transmittance (S82). . Then, a pseudo-transparent image is generated that reflects the determined RGB value filling and transparency for each pixel, and is projected from the projection unit 126 and displayed on the display unit 129. That is, the density of halftone dots of the CMYK version data 95 is adjusted.

FIG. 23 shows a display example of a real space including GS printed matter on the transmission type glass device 3A. In FIG. 23, a real space 140 including a GS printed material 91 is displayed. As described above, the GS printed matter 91 includes a gold object 51G representing a gold ring, a horizontally long gold object 52G, a silver object 53S representing a silver ring, and a horizontally long silver object 54S based on the GS version 50. ing.

FIG. 24 shows an example of an output image (CMYK settings changed) in an augmented reality space when additional printing is performed on a GS printed material. FIG. 24 shows an augmented reality space 150 when additional printing is performed on the GS printed matter 91. In the augmented reality space 150 displayed on the display unit 129, a pseudo transparent image is displayed at a position corresponding to the GS printed material 91. In the GS printed matter 91 of the augmented reality space 150, a reddish gold ring object 71GR replaces the ring gold object 51G, and a bluish silver ring object 73SB replaces the ring silver object 53S. , a horizontally long gold object 52G, a horizontally long silver object 54S, a red text object 62R, a blue text object 64B, and a black text object 65K.

At this time, the color setting change section 115 is displayed on the right half of the augmented reality space 150. Similar to the first embodiment, the transmittance of RGB data to be superimposed on the GS printed material 91 can be changed based on the YMCK standard according to the setting value of the slider SL2, and the change can be reflected in the display.

<3. Others＞
It should be noted that the present invention is not limited to the embodiments described above, and it goes without saying that various other applications and modifications can be made without departing from the gist of the present invention as described in the claims. .

For example, the document data reshaping function and superimposed image generation function of the smart device 3 described above may be executed by a server connected to the network N. For example, a GS printed matter is photographed using the camera unit 36 of the smart device 3 or an external camera device, and the photographed image, GS version data, and CMYK version data are transmitted from the smart device 3 to the server. The server executes document data reformation and superimposed image generation based on these images and data, and sends the generated superimposed image or pseudo superimposed image to the smart device 3. Then, the smart device 3 displays the superimposed image or the pseudo superimposed image on the display unit 39. With such a configuration, the smart device 3 can check the reprint image even if it does not have a special application for checking the reprint image.

Further, in the above-described embodiments, the configuration of the reprint printing system is explained in detail and specifically in order to explain the present invention in an easy-to-understand manner, and the present invention is not necessarily limited to one having all the described components. Furthermore, it is possible to replace a part of the configuration of one embodiment with the components of another embodiment. It is also possible to add components of other embodiments to the configuration of one embodiment. Further, it is also possible to add, delete, or replace other components to a part of the configuration of each embodiment.

Further, each of the configurations, functions, processing units, etc. described above may be partially or entirely realized in hardware by designing, for example, an integrated circuit.

Further, each component of the reprint printing system according to the embodiment of the present disclosure described above may be implemented in any hardware as long as the respective hardware can send and receive information to and from each other via a network. Moreover, the processing performed by a certain processing unit may be realized by one piece of hardware, or may be realized by distributed processing by a plurality of pieces of hardware.

1G...Gold printing machine, 1S...Silver printing machine, 2...Image forming device, 3...Smart device, 3A...Transmissive glass device, 4...DTP terminal, 5...Reprint printing system, 31...CPU, 36...Camera section , 39...Display section, 41...Image processing section, 81...Overlapping area specifying section, 82...Gold and silver area specifying section, 83...RGB data creation section, 84...RGB data conversion section for transmission, 85...Overlapping image generation 85A... Superimposed image generation section, 87... Color conversion setting confirmation section, 88... Document data re-formation section, 90... Print finish confirmation screen, 91... GS printed matter, 92... GS printed matter moving image (background image), 93 ...Transmittance conversion table, 94...GS version data, 95...CMYK version data, 96...Illumination amount data for GS printed matter, 97...Updated RGB data, 98...RGB data, 99...CMYK/RGB conversion lookup table, 101... CMYK data, 102...Reconstructed CMYK version data, 100...RGB data for transparency (transparent image), 110, 111...Superimposed image, 115...Color setting change section, 140...Real space, 150...Augmented reality space, SL1, SL2…Slider

Claims (14)

In the area where the glossy area existing in the photographed image of the printing paper overlaps with the original data for printing on the printing paper, the original data is reproduced so that the target transmittance is achieved with respect to the photographed image. a document data re-formation unit to form;
a superimposed image generation unit that superimposes the re-formed manuscript data on the photographed image and displays it on a display unit ,
The transmittance of the document data is represented by a transmittance conversion table associated with the output capacity of the display unit,
The original data re-formation unit re-forms the original data by referring to the transmittance conversion table.
Print finish presentation device. The print finish presentation device according to claim 1, wherein the glossy area is an area with metallic luster. The print finish presentation device according to claim 1 or 2, wherein the printing paper is a primary printed matter printed using primary manuscript data different from the manuscript data. The print finish according to claim 3, wherein the manuscript data is manuscript data for additional printing on the printing paper, and when the printing paper is the primary printed material, the manuscript data refers to secondary manuscript data. Presentation device. The print finish presentation device according to any one of claims 1 to 4, wherein the manuscript data is manuscript data for printing in basic colors, and the basic colors are at least cyan, magenta, yellow, and black. . The original data re-formation unit compares the primary original data of the photographed image with the photographed image, estimates illumination conditions based on differences other than the glossy area, and applies the illumination conditions to the re-formed original data. The print finish presentation device according to claim 3 or 4 . The print finish presentation device according to claim 1, further comprising a user interface for adjusting the document data displayed on the display unit. 7. The document data re-forming section adjusts the transmittance of the document data based on the input value through the user interface, re-forms the document data, and displays the document data on the display section again. The print finish presentation device described in . The print finish presentation device according to claim 8 , wherein the user interface is a slider, and the input value is determined based on a position to which the slider is moved. The print finish presentation device according to claim 1, wherein the document data re-forming section restores the document data displayed on the display section to document data that can be reprinted by an image forming apparatus. The print finish presentation device according to claim 10 , wherein the document data re-formation unit outputs an instruction to perform additional printing to a designated image forming apparatus after restoring the document data. a camera unit that photographs the printing paper;
The print finish presentation device according to claim 1, comprising: the display section. In the area where the glossy area existing in the photographed image of the printing paper overlaps with the original data for printing on the printing paper, the original data is reproduced so that the target transmittance is achieved with respect to the photographed image. processing to form;
a process of superimposing the re-formed manuscript data on the photographed image and displaying it on a display unit ,
The transmittance of the document data is represented by a transmittance conversion table associated with the output capacity of the display unit,
In the process of re-forming the original data, the original data is re-formed by referring to the transmittance conversion table.
How to present the print finish. In an area where a glossy area existing in a photographed image of printing paper overlaps with original data for printing on the printing paper, the original data is reproduced so that a target transmittance is obtained for the photographed image. Steps to form;
a step of superimposing the re-formed manuscript data on the photographed image and displaying it on a display unit;
The transmittance of the document data is represented by a transmittance conversion table associated with the output capacity of the display unit, and in the procedure for re-forming the document data, the transmittance conversion table is referred to and the transmittance of the document data is Steps to perform reshaping
A program that causes a computer to execute

Images