JP2018106041A - Display device, display system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, a display system and a program for page space confirmation using a technique of augmented reality.SOLUTION: A tablet 1 for confirming a finish of a page space 3 comprises: an image acquisition part 15 which photographs the page space 3 having plate making data 31 output on proofread paper 30 give a marker 33 by a camera 26 to acquire a photographic image; an image recognition part 16 which recognizes the marker 33 from the photographic image that the image acquisition part 15 acquires; a layer acquisition part 17 which acquires, based upon the recognized marker 33, a layer 60 having an image of printing surface lines 61 and finish lines 62 to be used to confirm a finish of the page space 3; and a display processing part 18 which displays the layer 60, acquired by the layer acquisition part 17, over the photographic image at a position based upon the marker 33.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device, a display system, and a program.

  2. Description of the Related Art Conventionally, at a delivery destination of printed matter, a layout of a magazine is confirmed by drawing a finishing line for confirming the finish of the printed matter at a cutting position of a proof paper. Since the work of manually drawing the finish line is complicated, a method of grasping the image of the finished size of the magazine and the plate size by inserting the finish line on the plate-making data and outputting the proof is disclosed (for example, Patent Document 1).

  Also, with the advancement of augmented reality (AR) technology, a method is disclosed in which a camera detects a printed marker and displays a superimposed virtual object such as CG (Computer Graphics) (for example, Patent Document 2). reference).

JP 2014-172291 A International Publication No. 2012/049795

  If the method described in Patent Document 1 is used, the layout of the magazine can be confirmed without human intervention. However, since the finishing line is inserted directly into the plate making data plate surface, there is a risk of causing a quality accident.

  SUMMARY An advantage of some aspects of the invention is that it provides a display device, a display system, and a program for checking a magazine using augmented reality technology.

The present invention solves the above problems by the following means.
The first invention is a display device for confirming the finish of a magazine, and the photographed magazine is obtained by photographing the confirmation magazine in which the plate-making data is output on a proof paper with a marker. An image acquisition unit that recognizes the marker from the captured image acquired by the image acquisition unit, and acquires a layer having an image of a finish confirmation line used for the completion check of a magazine based on the recognized marker And a display processing unit that superimposes and displays the layer acquired by the layer acquisition unit on a position based on the marker on the captured image.
According to a second aspect of the present invention, in the display device of the first aspect, the magazine information acquisition means for acquiring the magazine information corresponding to the confirmation magazine from a magazine information storage unit that stores the magazine information relating to the confirmation magazine; And an information display means for displaying the magazine information acquired by the magazine information acquisition means.
According to a third aspect of the present invention, in the display device according to the first or second aspect of the present invention, the display device includes a layer storage unit that stores the plurality of layers having images of the finish confirmation lines having different dimensions, and the layer acquisition unit includes: The layer corresponding to the confirmation magazine of the photographed image acquired by the image acquisition unit is acquired from the layer storage unit, and the size of the layer is changed based on the recognized marker. It is a display device.
According to a fourth aspect of the present invention, in the display device according to the first or second aspect, the layer acquisition unit generates a layer on which the finish confirmation line is drawn based on the recognized marker. Display device.
According to a fifth aspect of the present invention, in the display device according to any one of the first to fourth aspects, the markers are attached to four corners of the confirmation magazine, and the layer acquisition unit includes a plurality of the markers. The size of the layer is determined based on the position coordinates, and the display processing means determines the display position of the layer based on the position coordinates of the plurality of markers, and displays the layer in a superimposed manner. The display device characterized by the above.
According to a sixth invention, in any one of the display devices from the first invention to the fifth invention, the layer has at least one of a plate line and a finish line as a quadrilateral image on a transparent surface. It is a display device characterized in that the finish confirmation line including is arranged.
7th invention is a display system provided with the display apparatus of 2nd invention or 3rd invention, and the information server connected by communication with the said display apparatus, Comprising: The said information server is the said magazine surface A display system comprising at least one of an information storage unit and the layer storage unit.
An eighth invention is a program executed by a computer that is a display device for confirming the finish of a magazine, and the computer photographs a magazine for confirmation in which plate-making data is output on a calibration paper with a marker attached. An image acquisition means for acquiring a captured image obtained by recognizing the marker from the captured image acquired by the image acquisition means, and an image of a finish confirmation line used for checking the finish of the magazine based on the recognized marker A layer acquisition unit that acquires a layer having a display function, and a display processing unit that superimposes the layer acquired by the layer acquisition unit on a position based on the marker on the captured image. A program characterized by the above.

  According to the present invention, it is possible to provide a display device, a display system, and a program for checking a magazine using augmented reality technology.

It is a figure for demonstrating the use image in the display system which concerns on this embodiment. It is a figure which shows the functional block of the display system which concerns on this embodiment. It is a figure which shows the example of the magazine surface and layer which concern on this embodiment. It is a flowchart which shows the magazine surface confirmation process of the display system which concerns on this embodiment. It is a flowchart which shows the magazine surface confirmation process of the display system which concerns on this embodiment. It is a figure which shows the example of a display with the tablet which concerns on this embodiment.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.
(Embodiment)
<Display system 100>
FIG. 1 is a diagram for explaining a usage image in the display system 100 according to the present embodiment.
FIG. 2 is a diagram showing functional blocks of the display system 100 according to the present embodiment.
FIG. 3 is a diagram showing an example of the magazine surface 3 and the layer 60 according to the present embodiment.

In the display system 100 shown in FIG. 1, when the tablet 1 (display device) captures a magazine surface 3 (confirmation magazine surface) with the camera 26 (imaging means), a captured image including the magazine surface 3 is displayed on the touch panel display 25 of the tablet 1. Further, a layer 60 (described later) having a finish confirmation line is superimposed on the magazine surface 3 and displayed. By doing so, the display system 100 is for the user to confirm the finish of the magazine 3 using the tablet 1.
As shown in FIG. 2, in the display system 100, the tablet 1 and the information server 4 are connected via a communication network N. The communication network N is a network between the tablet 1 and the information server 4 and is, for example, an Internet line.

<Tablet 1>
The tablet 1 superimposes a layer 60 having a finish confirmation line for confirming the finish of the magazine surface 3 on the magazine surface 3 included in the photographed image and displays the layer 60 on the touch panel display 25 (see FIG. 1). In addition, the tablet 1 displays the title of the magazine 3 and the magazine contents such as finishing dimensions on the touch panel display 25.
The tablet 1 is a terminal having a camera 26 carried by the user, for example. The tablet 1 may be a mobile terminal having a camera such as a smartphone or a mobile phone.
As shown in FIG. 2, the tablet 1 includes a control unit 10, a storage unit 20, and a communication interface unit 29.

The control unit 10 is a central processing unit (CPU) that controls the entire tablet 1. The controller 10 executes various functions in cooperation with the hardware described above by appropriately reading and executing an operating system (OS) and application programs stored in the storage unit 20.
The control unit 10 includes a reference number transmission unit 11, a reference result reception unit 12, an information output unit 13 (information display unit), a camera activation reception unit 14, an image acquisition unit 15 (image acquisition unit), and image recognition. A unit 16 (layer acquisition unit), a layer acquisition unit 17 (layer acquisition unit), and a display processing unit 18 (display processing unit) are provided.

The reference number transmission unit 11 transmits a reference number for specifying the magazine 3 to the information server 4. The reference number is information that the user of the tablet 1 can know in advance, and the page of which magazine or book is known by the reference number. The reference number is written at the end of the magazine 3, for example.
The inquiry result receiving unit 12 receives inquiry result data for the inquiry number from the information server 4. The inquiry result data includes magazine content data (magazine information) and layer data. The magazine content data is information relating to the title of the magazine 3 and the magazine content such as finishing dimensions. The layer data will be described later.
The information output unit 13 outputs the magazine content data included in the inquiry result data to the touch panel display 25.
The camera activation accepting unit 14 accepts an activation operation by the user of the camera 26.
The image acquisition unit 15 acquires a captured image obtained by capturing the magazine 3 via the camera 26.

Here, the magazine 3 will be described with reference to FIG.
The magazine 3 is obtained by printing plate making data 31 on a proof paper 30. On the calibration paper 30, registration marks 32 are arranged at the four corners, and a folding registration mark 34 is arranged at the center. Further, a marker 33 is arranged on the calibration paper 30 in the corner direction outside the registration mark 32.
The register mark 32 is indicated by a cross mark, and is a mark for making printing alignment correct.
The marker 33 is a mark for aligning a layer 60 described later. Note that the position of the marker 33 is not limited as long as it is in the corner direction outside the registration mark 32.
The folding registration mark 34 is a mark indicating a folding reference that is a mark necessary for the bookbinding process.

Returning to FIG. 2, the image recognition unit 16 analyzes the captured image and recognizes the marker 33 arranged on the magazine 3.
The layer acquisition unit 17 changes the size of the layer data included in the inquiry result data received by the inquiry result reception unit 12 according to the position of the marker 33 recognized by the image recognition unit 16.

Here, the layer 60 indicated by the layer data will be described with reference to FIG.
The layer 60 is image data having a plate line 61 (finish confirmation line) and a finish line 62 (finish confirmation line) on the sheet 63.
The plate surface line 61 is a line representing the plate making surface. The plate surface line 61 includes a line that is included as a margin for cutting. The printing plate line 61 forms a square shape.
The finish line 62 is a virtual line for finishing and cutting the printed material. The finishing line 62 is set, for example, 3 mm inside the plate line 61. The finishing line 62 forms a square shape.
The sheet 63 is provided with the plate line 61 and the finishing line 62, has transparency, and is colorless, for example.

Returning to FIG. 2, the display processing unit 18 causes the layer 60 indicated by the layer data acquired by the layer acquisition unit 17 to be displayed superimposed on the captured image based on the position of the marker 33 recognized by the image recognition unit 16.
Details of each process will be described later.

The storage unit 20 is a storage area such as a semiconductor memory element for storing programs, data, and the like necessary for the control unit 10 to execute various processes.
Here, the computer refers to an information processing device including a control unit, a storage device, and the like, and the tablet 1 is an information processing device including the control unit 10, the storage unit 20 and the like, and is included in the concept of a computer.
The storage unit 20 includes a program storage unit 21.
The program storage unit 21 is a storage area for storing various programs. The program storage unit 21 stores a confirmation program 21a. The confirmation program 21 a is a program for performing various functions executed by the control unit 10 of the tablet 1.

The touch panel display 25 has a function as a display unit configured by a liquid crystal panel or the like and a function as an input unit that detects a touch input by a user's finger or the like.
The camera 26 is a device for photographing the magazine surface 3.
The communication interface unit 29 is an interface for performing communication with the information server 4 via the communication network N.

<Information server 4>
The information server 4 is a server that stores magazine content data and layer data related to the magazine 3.
The information server 4 receives the reference number from the tablet 1 and extracts the magazine content data and the layer data stored in the storage unit 50. Then, the information server 4 transmits inquiry result data including the extracted magazine content data and layer data to the tablet 1.
The information server 4 includes a control unit 40, a storage unit 50, and a communication interface unit 59.
The control unit 40 is a CPU that controls the entire information server 4. The control unit 40 executes various functions in cooperation with the hardware described above by appropriately reading and executing the OS and application programs stored in the storage unit 50.

The control unit 40 includes a reference number receiving unit 41, a reference processing unit 42, and a reference result transmission unit 43.
The reference number receiving unit 41 receives the reference number of the magazine 3 from the tablet 1.
The inquiry processing unit 42 extracts the magazine content data for the inquiry number from the magazine content storage unit 51. Further, the inquiry processing unit 42 extracts layer data for the inquiry number from the layer storage unit 52.
The inquiry result transmission unit 43 transmits inquiry result data including magazine content data and layer data to the tablet 1 that has transmitted the inquiry number.

The storage unit 50 is a storage area such as a hard disk or a semiconductor memory element for storing programs, data, and the like necessary for the control unit 40 to execute various processes.
The storage unit 50 includes a magazine content storage unit 51 (magazine page information storage unit) and a layer storage unit 52.
The magazine content storage unit 51 is a storage area for storing magazine content data. The magazine content storage unit 51 stores the reference number and the magazine content data in association with each other.
The layer storage unit 52 is a storage area for storing layer data. The layer storage unit 52 stores the reference number and the layer data in association with each other.

<Processing of display system 100>
Next, processing of the display system 100 will be described.
4 and 5 are flowcharts showing a magazine confirmation process of the display system 100 according to the present embodiment.
FIG. 6 is a diagram illustrating a display example on the tablet 1 according to the present embodiment.
As a premise for starting the processing, the user prepares the magazine 3 in advance. Then, for example, the user selects the icon of the confirmation program 21 a displayed on the touch panel display 25 of the tablet 1.
By doing so, in step S (hereinafter referred to as “S”) 10 in FIG. 4, the control unit 10 of the tablet 1 executes the confirmation program 21 a stored in the program storage unit 21.

In S <b> 11, the control unit 10 displays, for example, the inquiry screen 70 illustrated in FIG. 6A on the touch panel display 25. The inquiry screen 70 includes an inquiry number input part 70a and a button part 70b. Here, the user inputs the reference number of the magazine 3 to the reference number input part 70a and selects the button part 70b.
By doing so, in S12, the control unit 10 (reference number transmission unit 11) receives the reference number and transmits the received reference number to the information server 4. Thereafter, the control unit 10 moves the process to S20.

In S15, the control unit 40 (reference number receiving unit 41) of the information server 4 receives the reference number.
In S16, the control unit 40 (inquiry processing unit 42) refers to the magazine content storage unit 51 and extracts the inquiry content data corresponding to the received inquiry number.
In S <b> 17, the control unit 40 (inquiry processing unit 42) refers to the layer storage unit 52 and extracts layer data corresponding to the received inquiry number.
In S <b> 18, the control unit 40 (inquiry result transmission unit 43) transmits inquiry result data including inquiry content data and layer data to the tablet 1. Thereafter, the control unit 40 ends this process.

In S20, the control unit 10 (inquiry result receiving unit 12) of the tablet 1 receives the inquiry result data.
In S <b> 21, the control unit 10 (information output unit 13) causes the touch panel display 25 to display the inquiry result screen 71 obtained by editing the inquiry content data included in the inquiry result data. The inquiry result screen 71 includes, for example, an inquiry number part 71a, a magazine content table 71b, and a button part 71c, as shown in FIG. 6B. The reference number part 71 a indicates the reference number input on the reference screen 70. The magazine content table 71b is obtained by editing the inquiry content data, and is information on a magazine name, a publisher name, a binding method, an opening direction, a finishing dimension, a printing plate dimension, and the like. The button part 71c is for activating the camera 26.
The user can check whether or not the magazine 3 is intended to check the layout by looking at the magazine content table 71b.

After the user confirms the contents of the magazine content table 71b, the control unit 10 (camera activation receiving unit 14) activates the camera 26 in S22 of FIG. 5 by selecting the button 71c on the inquiry result screen 71. It is determined whether or not it has been accepted. When the activation operation of the camera 26 is received (S22: YES), the control unit 10 moves the process to S23. On the other hand, when the activation operation of the camera 26 is not received (S22: NO), the control unit 10 remains in this process.
In S <b> 23, the control unit 10 (image acquisition unit 15) acquires a captured image via the camera 26. After selecting the button portion 71c, the user aligns the direction of the camera 26 with the magazine surface 3 so that the magazine surface 3 is displayed in a rectangular shape. By doing so, the captured image acquired by the control unit 10 includes the magazine 3. In addition, the camera 26 shall image | photograph a moving image, and the control part 10 continues acquiring a captured image continuously.
In S24, the control unit 10 (image recognition unit 16) analyzes the captured image and recognizes the marker 33 (see FIG. 3A) arranged on the magazine 3.

In S25, the control unit 10 (layer acquisition unit 17) changes the size of the layer 60 indicated by the layer data included in the inquiry result data based on the distance between the recognized markers 33, the size of the marker 33, and the like. . Specifically, the control unit 10 calculates the position and the like of the marker 33 by calculating the coordinate information of the recognized marker 33.
The layer data is data of an appropriate size when the distance between the markers 33 and the size of the marker 33 are predetermined. Therefore, when the distance between the markers 33 is narrow or the size of the markers 33 is small, the control unit 10 reduces the size of the layer 60 indicated by the layer data. In addition, when the distance between the markers 33 is large or the size of the markers 33 is large, the control unit 10 increases the size of the layer 60 indicated by the layer data.

In S <b> 26, the control unit 10 (display processing unit 18) displays the acquired captured image on the touch panel display 25, and displays the layer 60 whose size has been changed in a superimposed manner corresponding to the position of the marker 33.
FIG. 6C shows the display screen 72. The display screen 72 includes an image display unit 72a and a button unit 72b. The image display unit 72 a includes a magazine surface 3 included in the photographed image, and a plate surface line 61 and a finishing line 62 arranged on the layer 60. Therefore, the image display unit 72 a displays the plate surface line 61 and the finish line 62 as if they were drawn directly on the magazine surface 3. The button part 72b is a button for ending execution of the confirmation program 21a.

  Returning to FIG. 5, in S <b> 27, the control unit 10 determines whether or not the button unit 72 b is selected and the processing by the confirmation program 21 a is ended. When the process is to be ended (S27: YES), the control unit 10 ends the process by the confirmation program 21a. On the other hand, when the process is not terminated (S27: NO), the control unit 10 moves the process to S23 and displays the layer 60 in a superimposed manner while the camera 26 is activated. At that time, if the position of the camera 26 is moved, the control unit 10 can perform the processing from S23 to S26 each time so that the finish of the magazine 3 can be confirmed even if the position of the camera 26 is slightly deviated. The plate line 61 and the finishing line 62 are displayed.

Thus, according to the display system 100 of the present embodiment, the following effects are obtained.
(1) The tablet 1 photographs the magazine surface 3 and displays the layer 60 having the plate surface line 61 and the finishing line 62 corresponding to the magazine surface 3 superimposed on the magazine surface 3 included in the photographed image. Therefore, the tablet 1 can be displayed as if the plate surface 61 and the finishing line 62 are handwritten magazines 3. Therefore, it is possible to check the magazine 3 at the time of proofreading using augmented reality technology.
(2) Since the tablet 1 displays the magazine contents of the magazine 3 by using the reference number for specifying the magazine 3, the user can confirm the magazine contents of the magazine 3.

(3) By having the marker 33 on the magazine 3, the tablet 1 recognizes the marker 33 and changes the size of the layer 60 based on the positional relationship and the size between the recognized markers 33. Therefore, the tablet 1 can make the size of the layer 60 correspond to the size of the magazine 3 regardless of the shooting distance from which the magazine 3 is taken.
In addition, since the position of the layer 60 is determined based on the recognized position of the marker 33, the tablet 1 can perform alignment between the magazine surface 3 and the layer 60.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above. In addition, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. In addition, although embodiment mentioned above and the deformation | transformation form mentioned later can also be used in combination as appropriate, detailed description is abbreviate | omitted.

(Deformation)
(1) In the present embodiment, the layer has been described as including a plate line and a finish line, but is not limited thereto. Any layer may be used as long as the finish of the magazine can be confirmed, and the layer may include one of the plate line and the finish line.
(2) In the present embodiment, the case where the markers are arranged at the four corners has been described as an example, but the present invention is not limited to this. If the tablet has a marker in at least one place on the magazine, the tablet can determine the size and position of the layer. However, it is desirable to have markers at three or more locations for higher accuracy and easier processing.
Further, instead of the marker, an accessory such as a register mark previously provided on the calibration paper or a color code provided on the magazine may be used.

(3) In the present embodiment, the case where the user inputs the reference number has been described as an example, but the present invention is not limited to this. For example, the reference number may be acquired from the code information by having code information such as a barcode encoded with the reference number on the magazine and reading the code information by the camera.
(4) In the present embodiment, the layer storage unit has been described as storing the reference number and the layer data in association with each other, but is not limited thereto. The layer storage unit may store finishing dimensions and plate dimensions in association with layer data. In that case, finishing dimensions and plate dimensions are acquired from the magazine content storage unit, and layer data associated with the acquired finishing dimensions and plate dimensions are acquired.

(5) In the present embodiment, the layer data suitable for the magazine has been described as being acquired from the information server and displayed, but the present invention is not limited to this. The tablet may generate layer data having a finish confirmation line that matches the magazine.
(6) In the present embodiment, the example of displaying layer data corresponding to a magazine has been described as an example, but the present invention is not limited to this. The tablet on which the layer data is displayed may be provided with a finishing confirmation line editing function so that the finishing confirmation line can be moved by a user operation. When the position of the finish confirmation line is changed by the user's operation, the tablet may transmit change data to the information server, and the information server may have history information regarding the finish confirmation line. .

  (7) In the present embodiment, the camera is described as capturing a moving image, but the present invention is not limited to this. A still image may be photographed and a layer may be superimposed on the photographed image. Then, an image obtained by superimposing a layer on the captured image may be captured as a still image, and the captured image including the layer may be stored as data.

DESCRIPTION OF SYMBOLS 1 Tablet 3 Magazine 4 Information server 10,40 Control part 13 Information output part 15 Image acquisition part 16 Image recognition part 17 Layer acquisition part 18 Display processing part 21a Confirmation program 25 Touch panel display 26 Camera 30 Calibration paper 31 Plate making data 32 Dragonfly 33 Marker 43 Query result transmission unit 51 Journal content storage unit 52 Layer storage unit 60 Layer 61 Plate line 62 Finish line 63 Sheet 71 Query result screen 71b Journal content table 72 Display screen 100 Display system

Claims (8)

A display device for confirming the finish of a magazine,
An image acquisition means for acquiring a photographed image by photographing the magazine for confirmation in which the plate-making data is output on the calibration paper with the marker;
A layer acquisition unit for recognizing the marker from the captured image acquired by the image acquisition unit, and acquiring a layer having an image of a finish confirmation line to be used for confirmation of a finish of a magazine based on the recognized marker;
Display processing means for displaying the layer acquired by the layer acquisition means superimposed on the position based on the marker on the captured image;
A display device comprising: The display device according to claim 1,
Magazine information acquisition means for acquiring the magazine information corresponding to the confirmation magazine from a magazine information storage unit that stores magazine information relating to the confirmation magazine;
Information display means for displaying the magazine information acquired by the magazine information acquisition means;
Providing
A display device. The display device according to claim 1 or 2,
A layer storage unit that stores the plurality of layers having images of the finished confirmation lines having different dimensions;
The layer acquisition unit acquires the layer corresponding to the confirmation magazine of the captured image acquired by the image acquisition unit from the layer storage unit, and determines the size of the layer based on the recognized marker. Changing,
A display device. The display device according to claim 1 or 2,
The layer acquisition means generates a layer on which the finish confirmation line is drawn based on the recognized marker;
A display device. The display device according to any one of claims 1 to 4,
The markers are attached to the four corners of the confirmation magazine,
The layer acquisition means determines the size of the layer based on the position coordinates of the plurality of markers,
The display processing means determines the display position of the layer based on the position coordinates of the plurality of markers, and displays the layer in a superimposed manner.
A display device. The display device according to any one of claims 1 to 5,
The layer is formed by arranging the finish confirmation line including at least one of a plate line and a finish line as a quadrilateral image on a surface having transparency,
A display device. A display device according to claim 2 or claim 3,
An information server communicatively connected to the display device;
A display system comprising:
The information server includes at least one of the magazine information storage unit and the layer storage unit;
A display system characterized by A program executed by a computer which is a display device for confirming the finish of a magazine,
Computer
Image acquisition means for acquiring a photographed image obtained by photographing the confirmation magazine in which the plate-making data is output on the calibration paper with the marker;
A layer acquisition unit for recognizing the marker from the captured image acquired by the image acquisition unit, and acquiring a layer having an image of a finish confirmation line to be used for confirmation of a finish of a magazine based on the recognized marker;
Display processing means for displaying the layer acquired by the layer acquisition means superimposed on the position based on the marker on the captured image;
Make it work,
A program characterized by

Images