JP7070207B2 - Information processing systems, information processing methods, programs and media - Google Patents

Description

The present invention relates to an information processing system , an information processing method , a program and a medium.

It has been conventionally known that when an image of a code symbol is formed on paper, if a reduced layout is performed using the reduced layout function, information may not be read from the code symbol due to the reduction of the image.

For this reason, when laying out a multi-page manuscript containing a code symbol in a reduced layout, first, a code area for arranging the code symbol in a predetermined size equal to or larger than the minimum readable size in the code method of the code symbol is secured. A method of arranging a code symbol in the code area in the predetermined size has been proposed (see, for example, Patent Document 1).

There is an existing system that uses code images such as barcodes printed on slips such as work instructions. A user who uses such an existing system may want to add a new code image. However, if the slip image is simply reduced, there is a possibility that the code image printed on the slip cannot be read (recognized).

An embodiment of the present invention has been made in view of the above points, and the code image displayed on the first slip image is reduced in a readable state, and a new code image is displayed. An object of the present invention is to provide an information processing system capable of creating a slip image.

In order to achieve the above object, claim 1 of the present application is a reduction means for scaling and reducing the first slip image according to the direction of the code image of the first slip image in which at least one code image is displayed. A means for creating a second slip image in which a new code image is displayed in an area vacated by scaling, and the scaling-reduced first slip image and the new code image. A management means for managing the progress of the work process of the job corresponding to the new code image by taking a picture of the slip on which the second slip image including the second slip image is printed with a camera associated with the work process. It is characterized by being an information processing system having the above.

According to the embodiment of the present invention, the code image displayed on the first slip image can be reduced in a readable state to create a second slip image on which a new code image is displayed.

It is a block diagram of an example of the job management system which concerns on this embodiment. It is an image diagram of an example of the work instruction sheet used in the job management system according to this embodiment. It is a hardware block diagram of an example of a computer. It is a functional block diagram of an example of a work process management system. It is an image diagram which showed an example of the work process of a job in a printing factory. It is a flowchart of an example of the process of creating a work instruction sheet with a color code. It is a flowchart of an example of the process of generating a color code image. It is a figure for demonstrating the coding rule which can express a ternary number. It is a figure which shows the example of the information for encoding into an optical symbol. It is a figure which shows the example of the optical symbol when the number of colors assigned to each cell of an optical symbol is 4 colors. It is a figure which shows the process image which creates the work instruction sheet with a color code. It is a flowchart of an example of the process of reducing an image including a barcode image. It is an image diagram of an example of a barcode image. It is an image diagram of an example of a barcode image before being reduced in the vertical direction. It is an image diagram of an example of a barcode image after being reduced in the vertical direction. It is an image diagram of an example of a barcode image before being reduced in the horizontal direction. It is an image diagram of an example of a barcode image after being reduced in the horizontal direction. It is explanatory drawing of an example of the change count confirmation processing. It is an image diagram of an example of a barcode image. It is explanatory drawing of an example of the change count confirmation processing. It is a flowchart of an example of a job status update process at the time of passing through a gate. It is a flowchart of an example of a job status update process at the time of storage in a temporary storage place. It is a transition diagram of an example of the UI screen displayed by the work process management system. It is explanatory drawing of an example of grouping processing in a UI screen. It is explanatory drawing of an example of the search condition specification processing on a UI screen. It is an image diagram of an example of a map display screen of a temporary storage place. It is a functional block diagram of another example of a work process management system.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, a job management system that realizes the management of the work process of a job in a printing factory by a function using a work instruction sheet (slip) (a function of the work instruction sheet) will be described as an example.

[First Embodiment]
<System configuration>
FIG. 1 is a configuration diagram of an example of a job management system according to the present embodiment. FIG. 2 is an image diagram of an example of a work instruction sheet used in the job management system according to the present embodiment. In the job management system 1 of FIG. 1, a customer system 10, a work process management system 14, a printer 16, and one or more cameras 18 are connected to each other via a network 20 such as the Internet or a LAN so that data communication is possible.

The customer system 10 is an example of an existing system used by a customer, and creates a work instruction sheet 800 for the customer system 10 of FIG. 2A in which a job ID is displayed. The job ID is an example of identification information that identifies a job. Further, in the work instruction sheet 800 for the customer system 10, at least one bar code image 801 used on the customer system 10 side is displayed.

The job ID may be displayed as a barcode image 801 on the work instruction sheet 800 for the customer system 10, or may be displayed as a text. The customer system 10 provides the user with the existing functions realized by the work instruction sheet 800 for the customer system 10.

The work process management system 14, the printer 16, and one or more cameras 18 constitute an information processing system 12 that adds a new function to the work instruction sheet 800. The work process management system 14 monitors the progress of a job composed of a plurality of work processes by using the work instruction sheet 810 for the information processing system 12 to which the color code image 811 of FIG. 2 (B) is attached, as described later. to manage. The information processing system 12 can specify the job ID from the color code image 811 as described later.

The printer 16 prints the work instruction sheet 810 for the information processing system 12. The camera 18 is installed so as to be able to take a picture of a place corresponding to the work process of the job in the printing factory. The place corresponding to the work process of the job is a place where the printed matter passes by moving between the work processes, a temporary storage place where the printed matter is temporarily stored, and the like.

The camera 18 can use a PTZ camera or an IP camera. The PTZ camera is a camera capable of operating the PTZ (Pan Tilt Zoom) function via the network 20, and is a camera capable of transmitting captured images and captured videos via the network 20. The IP camera is a camera that can be operated via the network 20, and is a camera that can transmit captured images and captured videos via the network 20. The photographed image and the photographed moving image photographed by the camera 18 are transmitted to the work process management system 14 via the network 20.

In the information processing system 12 that adds a new function to the work instruction 800, the work instruction 810 for the information processing system 12 is a printed matter that is an example of an intermediate product or material of a job corresponding to the work instruction 810. It will be pasted. The work instruction sheet 810 is attached, for example, on a printed matter that is easily photographed by the camera 18.

The work process management system 14 progresses the work process of the job based on the work process of the job corresponding to the camera 18 that captured the work instruction sheet 810 and the job ID specified from the color code image 811 of the work instruction sheet 810. Manage (job status). Further, the work process management system 14 manages the history of the work process of the job, and the photographed image and the photographed moving image showing the state when the work instruction sheet 810 is photographed.

The configuration of the job management system 1 shown in FIG. 1 is an example. For example, the job management system 1 may include another system, or the work process management system 14 may have a different name. The work process management system 14 may be realized in a single server environment, or may be realized in a plurality of server environments.

<Hardware configuration>
The customer system 10 and the work process management system 14 are realized by, for example, a computer 500 having a hardware configuration shown in FIG.

FIG. 3 is a hardware configuration diagram of an example of a computer. The computer 500 of FIG. 3 includes an input device 501, a display device 502, an external I / F 503, a RAM 504, a ROM 505, a CPU 506, a communication I / F 507, an HDD 508, and the like, each of which is connected to each other by a bus B. The input device 501 and the display device 502 may be connected and used when necessary.

The input device 501 includes a keyboard, a mouse, a touch panel, and the like, and is used for the user to input each operation signal. The display device 502 includes a display and the like, and displays the processing result by the computer 500.

The communication I / F 507 is an interface for connecting the computer 500 to various networks. As a result, the computer 500 can perform data communication via the communication I / F 507.

Further, the HDD 508 is an example of a non-volatile storage device that stores programs and data. The stored programs and data include an OS, which is basic software that controls the entire computer 500, and application software (hereinafter, simply referred to as an application) that provides various functions on the OS. The computer 500 may use a drive device (for example, a solid state drive: SSD) that uses a flash memory as a storage medium instead of the HDD 508.

The external I / F 503 is an interface with an external device. The external device includes a recording medium 503a and the like. As a result, the computer 500 can read and / or write to the recording medium 503a via the external I / F 503. The recording medium 503a includes a flexible disk, a CD, a DVD, an SD memory card, a USB memory, and the like.

The ROM 505 is an example of a non-volatile semiconductor memory (storage device) capable of holding programs and data even when the power is turned off. The ROM 505 stores programs and data such as BIOS, OS settings, and network settings that are executed when the computer 500 is started. The RAM 504 is an example of a volatile semiconductor memory (storage device) that temporarily holds programs and data.

The CPU 506 is an arithmetic unit that realizes control and functions of the entire computer 500 by reading a program or data from a storage device such as a ROM 505 or an HDD 508 onto the RAM 504 and executing processing. The customer system 10 and the work process management system 14 can realize various processes described later by, for example, the hardware configuration of the computer 500 as shown in FIG. The description of the hardware configuration of the printer 16 and the camera 18 will be omitted.

<Software configuration>
FIG. 4 is a functional configuration diagram of an example of a work process management system. It should be noted that the functional configuration of FIG. 4 is appropriately omitted from the configuration unnecessary for the description of the present embodiment. The work process management system 14 of FIG. 4 includes a UI unit 30, a job ID detection unit 32, a job management unit 34, a color code image generation unit 36, a work instruction sheet creation unit 38 with a color code, a print instruction unit 40, and a captured image acquisition. It has a configuration including a unit 42, a color code recognition unit 44, a color code management table storage unit 46, and a job management table storage unit 48.

The UI unit 30 controls the display of various screens such as a screen for receiving various settings required from the user, a job status list screen described later, and a job detail history screen. The job ID detection unit 32 detects, for example, the job ID displayed in the barcode image 801 or text in the work instruction sheet 800 for the customer system 10 of FIG. 2 (A).

The job management unit 34 stores and manages the available color code IDs in the color code management table storage unit 46. The job management unit 34 limits the number of color code IDs that can be used, narrows the range of values required to express the color code IDs, maximizes the size of the color code image 811, and maximizes the size of the color code image 811 described later. It facilitates recognition.

If the unused color code ID does not remain in the color code management table storage unit 46, the job management unit 34 selects the old color code ID of the last update from the color code management table storage unit 46 and reuses it. The job management unit 34 manages the job ID detected by the job ID detection unit 32 and the selected color code ID in association with each other in the color code management table storage unit 46.

Further, the job management unit 34 stores and manages the job information corresponding to the job ID and the color code ID in the job management table storage unit 48. The job management table storage unit 48 manages progress information and history information of the work process of the job, a photographed image file and a photographed video file showing the state when the work instruction sheet 810 is photographed, and the job status list screen described later. Etc. are used to display.

The color code image generation unit 36 generates a color code image 811 described later from the color code ID provided by the job management unit 34. The work instruction sheet creating unit 38 with a color code is a work instruction sheet 810 for the information processing system 12 to which the color code image 811 of FIG. 2 (B) is attached from the work instruction sheet 800 for the customer system 10 of FIG. To create. The print instruction unit 40 instructs the printer 16 to print the work instruction sheet 810 for the information processing system 12 to which the color code image 811 of FIG. 2B is attached.

The photographed image acquisition unit 42 acquires a photographed image and a photographed moving image from the camera 18. The color code recognition unit 44 decodes the color code ID from the color code image 811 shown in the photographed image or the photographed moving image. The color code recognition unit 44 provides, for example, identification information for identifying the work process of the camera 18 or the job that captured the color code image 811 and the decoded color code ID to the job management unit 34. The job management unit 34 specifies the job ID corresponding to the decoded color code ID with reference to the job management table storage unit 48.

As a result, the job management unit 34 is managed by the job management table storage unit 48 based on the work process of the job corresponding to the camera 18 that captured the color code image 811 and the job ID corresponding to the decoded color code ID. You can update the progress information (job status) of the work process of the job.

<Processing>
FIG. 5 is an image diagram showing an example of a job work process in a printing factory. The work process of FIG. 5 includes "printing", "cutting", "folding", "bookbinding", "inspection", "temporary storage 1", and "temporary storage 2". The camera 16a is installed at the gate in front of the place where the work processes "printing", "cutting", "folding", "bookbinding" and "inspection" are performed. Further, the camera 16b is installed at a place where the work processes "temporary storage 1" and "temporary storage 2" are performed.

The work instruction sheet 810 for the information processing system 12 is photographed by the camera 16a and the camera 16b in a state of moving between work processes and being stored in a temporary storage place. As shown in FIG. 5, in the printing factory, the movement between work processes is not constant, and the work instruction sheet 810 for the information processing system 12 may not be photographed by the job, and a work process that is not detected or recorded may be included. be. In FIG. 5, an arrow indicating the movement of a job that performs all work processes and an arrow indicating the movement of a job that skips a part of the work process are shown.

In FIG. 5, after the printed matter is output by the work process “printing”, the work instruction sheet 810 is attached on the printed matter. As a result, in the example of FIG. 5, the work instruction sheet 810 attached on the printed matter is photographed by the camera 16a and the camera 16b while the printed matter passes through the gate or is stored in the temporary storage place.

<< Creation of work instructions with color code >>
FIG. 6 is a flowchart of an example of a process for creating a work instruction sheet with a color code. In step S11, the job ID detection unit 32 of the work process management system 14 detects the job ID displayed in the barcode image 801 or text in the work instruction sheet 800 for the customer system 10. The detection frame for detecting the job ID from the work instruction sheet 800 may be set in advance by the operator, or may be automatically set by using OCR or the like.

Proceeding to step S12, the job management unit 34 selects the color code ID to be used from the color code management table storage unit 46, and manages the selected color code ID in association with the job ID detected by the job ID detection unit 32. ..

Proceeding to step S13, the color code image generation unit 36 generates a color code image 811 from the color code ID associated with the job ID by the procedure shown in FIG. The procedure shown in FIG. 7 utilizes, for example, the technique described in JP-A-2017-199306.

FIG. 7 is a flowchart of an example of the process of generating a color code image. The color code image generation unit 36 accepts the input of the color code ID to be color coded in step S21. Proceeding to step S22, the color code image generation unit 36 decomposes the character string of the color code ID into the values of each digit. Proceeding to step S23, the color code image generation unit 36 converts the value of each decomposed digit into a value corresponding to the number of colors assigned to each cell of the optical symbol described in Japanese Patent Application Laid-Open No. 2017-199306. For example, if the number of colors assigned to each cell is four, the color code image generation unit 36 converts the value of each digit into a ternary value according to a coding rule as shown in FIG. 8, for example.

FIG. 8 is a diagram for explaining a coding rule capable of expressing a ternary number. FIG. 8 shows an example of a coding rule when four colors of R color (red), G color (green), B color (blue) and K color (black) are used. When four colors are used, they can be expressed in three values, that is, ternary numbers.

For example, as illustrated in FIG. 8A, each transition clockwise, that is, from R color to K color, from K color to B color, from B color to G color, and from G color to R color, has a value of "0". Is expressed. Further, counterclockwise, that is, each transition from R color to G color, G color to B color, B color to K color, and K color to R color expresses the value "1". Further, diagonally, that is, the bidirectional transition between the R color and the B color and the bidirectional transition between the K color and the G color each express the value "2".

For example, as shown in FIG. 8B, in a cell row in which cells are sequentially connected in the order of G color, R color, B color, K color, and G color, each cell is connected from left to right in the figure. Consider the case of seeing the color transition of a cell. In this case, the transition from G color to R color represents the value "0", the transition from R color to B color represents the value "2", and the transition from B color to K color represents the value "1". The transition from the K color to the G color represents the value "2". Therefore, the array in FIG. 8B represents the value "3d2120", i.e. the decimal value "69". In the notation of the value, the leading "3d" indicates that the following number is a ternary value.

The coding rule using the color transitions of the four colors is not limited to the example shown in FIG. 8 (a), and may be, for example, the example shown in FIG. 8 (d). FIG. 8 (e) shows an example of a conversion table that associates a color transition with a value according to the coding rule shown in FIG. 8 (d). In FIG. 8 (e), for example, when the color of the transition source cell is R color and the value "2" is desired to be expressed, the color of the transition destination cell adjacent to the transition source cell is set to B color. Similarly, if the color of the transition source cell is K color and the value "1" is to be expressed, the color of the transition destination cell is set to G color.

Following step S23 in FIG. 7, the process proceeds to step S24, and the color code image generation unit 36 has the color of the cell of the transition source, the value of the ternary number converted in step S23, and as shown in FIG. 8 (a). Assign a color to each cell of the optical symbol according to the conversion table of the coding rule. It is assumed that the color code image generation unit 36 stores in advance the color arrangement of each cell in the cell sequence of the main code of the optical symbol.

A more specific example will be described with reference to FIGS. 9 and 10 when the number of colors assigned to each cell of the optical symbol is four. FIG. 9 is a diagram showing an example of information for encoding into an optical symbol. FIG. 10 is a diagram showing an example of an optical symbol when the number of colors assigned to each cell of the optical symbol is four.

In FIG. 9, each cell column of the sub-code unit 301 connected to each cell “d1”, “d2”, “d3” and “d4” of the main code unit 300 has values “3d1”, “3d1” and “3d0”. And an example of "3d1".

FIG. 10 shows an example of an optical symbol in which the information exemplified in FIG. 9 is coded according to the coding rule described with reference to FIG. In this example, the cell row of the main code portion 300 includes an even number of cells, and the tip cell is K color, and K color and R color are alternately arranged.

Further, in the leftmost cell, for example, the sub-code unit 301 is assigned the color of the cell with the K color of the cell of the main code unit 300 to which the cell is connected as the first transition source color. In the example of FIG. 10, according to the K color of the cell of the main code unit 300, which is the transition source cell, and the value “3d1” of the cell of the sub code unit 301, the conversion table of the coding rule of FIG. 8A is referred to. The R color is assigned to the cell of the subcode portion 301 on the leftmost side of the optical symbol.

Following step S13 of FIG. 6, the process proceeds to step S14, and the work instruction sheet creating unit 38 with a color code creates a work instruction sheet 810 for the information processing system 12 by using the color code image 811 generated in step S13.

FIG. 11 is a diagram showing a processing image for creating a work instruction sheet with a color code. The paper size and layout frame may be set in advance by the operator. The work instruction sheet 800 for the customer system 10 of FIG. 2A is scaled down to generate an empty space. The work instruction sheet 810 for the information processing system 12 of FIG. 2B is a color code image 811 attached to an empty space generated by scaling the work instruction sheet 800 for the customer system 10 by scaling. ..

In the work instruction sheet 800 for the customer system 10 of FIG. 2A, at least one barcode image 801 used on the customer system 10 side is displayed. Therefore, if the work instruction sheet 800 for the customer system 10 is simply reduced, the barcode image 801 may not function (cannot be recognized).

Therefore, in order to generate an empty space without impairing the function of the barcode image 801 the work instruction sheet creating unit 38 with a color code, the direction of the barcode image 801 is confirmed by the procedure shown in FIG. 12, and the barcode image 801 is used. Scale reduction is performed in a direction that does not impair the function.

FIG. 12 is a flowchart of an example of a process of reducing an image including a barcode image. In step S31, the work instruction sheet creating unit 38 with a color code cuts out the position of the barcode image 801 of the work instruction sheet 800 for the customer system 10 of FIG. 2 (A). Proceeding to step S32, the work instruction sheet creating unit 38 with a color code determines whether the bar code image as shown in FIG. 13 cut out is a Bk (monochrome) image or an RGB image. FIG. 13 is an image diagram of an example of a barcode image.

If it is not a Bk (monochrome) image, the work instruction sheet creating unit 38 with a color code proceeds to step S33, converts the RGB image into a Lab image or a Luv image, and after the conversion, creates a monochrome image in which only the L component is extracted. , Step S34. If it is a monochrome image, the work instruction sheet creating unit 38 with a color code skips step S33 and proceeds to step S34.

In step S34, the work instruction sheet creating unit 38 with a color code raster scans all the pixels in the barcode image of FIG. Here, the pixel positions (x, y) are positions according to the X direction and the Y direction displayed in FIG. The work instruction sheet creating unit 38 with a color code integrates the pixels having the same pixel position x, that is, the pixel values in the Y direction.

Further, the process proceeds to step S35, and the work instruction sheet creating unit 38 with a color code integrates all the pixels. The work instruction sheet creating unit 38 with a color code obtains an average value by dividing the value obtained by integrating all the pixels by the total number of pixels.

Proceeding to step S36, the work instruction sheet creating unit 38 with a color code compares the integrated value of the pixels having the same pixel position x obtained in step S34 with the average value obtained in step S35 as shown in FIG. Check the number of changes. FIG. 18 is an explanatory diagram of an example of the change number confirmation process. For example, the work instruction sheet creating unit 38 with a color code is the total number of changes of the number of changes from the integrated value higher than the average value to the integrated value lower than the average value and the number of changes from the integrated value lower than the average value to the integrated value higher than the average value. To confirm.

Proceeding to step S37, the work instruction sheet creating unit 38 with a color code determines whether or not the number of changes confirmed in step S36 is 24 or more. If the number of changes is 24 or more, the process proceeds to step S38, and the work instruction sheet creating unit 38 with a color code changes the bar code image of FIG. 14 in the vertical direction like the bar code image of FIG. Do double reduction. FIG. 14 is an image diagram of an example of a barcode image before being reduced in the vertical direction. FIG. 15 is an image diagram of an example of a barcode image after being reduced in the vertical direction.

For example, when the barcode image shown in FIG. 13 is reduced in the X direction, the black lines approach each other, making it difficult to discriminate changes in black and white. On the other hand, even if the barcode image shown in FIG. 13 is reduced in the Y direction, the spacing between the black lines does not change, so that there is no effect on the discrimination between black and white.

On the other hand, if the number of changes is not 24 or more, the process proceeds to step S39, and the work instruction sheet creating unit 38 with a color code tends to reduce the barcode image of FIG. 16 in the horizontal direction as in the barcode image of FIG. Scale reduction is performed.

The processing of the flowchart of FIG. 12 determines the direction of the barcode image based on the following idea. For example, in the case of a vertical barcode as shown in FIG. 13, since the black line has a width, a change from a white line to a black line and a change from a black line to a white line occur as a set. The number of changes varies depending on the number of digits displayed on the barcode, but as a result of investigating a general barcode, if the number of changes is 24 or more, it can be determined that the barcode is a vertical barcode as shown in FIG.

Similarly, in the case of a horizontal barcode as shown in FIG. 19, the work instruction sheet creating unit 38 with a color code confirms the number of changes as shown in FIG. 20 in step S36. FIG. 19 is an image diagram of an example of a barcode image. FIG. 20 is an explanatory diagram of an example of the change number confirmation process.

In the case of FIG. 20, for example, the total number of changes from the integrated value higher than the average value to the integrated value lower than the average value and the number of changes from the integrated value lower than the average value to the integrated value is extremely small. Even if information other than the barcode image is integrated, the number of changes does not exceed 24 times. Therefore, if the number of changes is 24 or more, it can be determined that the barcode is in the horizontal direction as shown in FIG.

In addition to the above-mentioned method of determining the direction of the barcode image, the direction of the barcode image can be determined by Fourier transform, Hough transform, which is one of the feature extraction methods, and the like. However, recent printers perform halftone processing. In particular, an electrophotographic printer may use a dither.

When the Hough transform is used, the line segment component in the image can be extracted. Although the line segment component of the barcode is dominant, it is difficult to eliminate the influence of halftone processing, especially dithering. In order to reduce the influence of the dither, the position of the barcode image 801 must be strictly specified in step S31. Similarly, when the Fourier transform is used, the problem is whether the influence of the halftone processing around the barcode can be strictly eliminated.

On the other hand, in the method of determining the direction of the barcode image of the present embodiment, even if a dither image or some characters or images are included in the periphery of the barcode image cut out in step S31, it is counted as the number of changes. There is no such thing and it does not matter.

As described above, in the work process management system 14 of the present embodiment, an empty space is created by scaling in a direction that does not impair the function of the barcode image 801 and the empty space is a color code image that can be read remotely. 811 can be added. Even if the work instruction sheet 800 for the customer system 10 is scaled down, the function of the barcode image 801 is not impaired, and the function of the color code image 811 is informed while keeping the function of the work instruction sheet 800 for the customer system 10. It can be added to the work instruction sheet 810 for the processing system 12.

Following step S14 in FIG. 6, the process proceeds to step S15, and the print instruction unit 40 has a work instruction sheet 810 (work instruction sheet with a color code) for the information processing system 12 to which the color code image 811 created in step S14 is attached. Instruct the printer 16 to print. The printer 16 prints the work instruction sheet 810 for the information processing system 12 to which the color code image 811 as shown in FIG. 2B is attached, for example, according to the instruction from the print instruction unit 40.

《Update job status when passing through the gate》
In the job management system 1 according to the present embodiment, the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is attached is photographed by the camera 18a, so that the job status of the job management table storage unit 48 is as follows. Will be updated.

FIG. 21 is a flowchart of an example of the job status update process when passing through the gate. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image or the photographed moving image from the camera 18a, the process proceeds to step S52.

In step S52, the color code recognition unit 44 attempts to cut out the color code image 811 from the photographed image or the photographed moving image acquired by the photographed image acquisition unit 42. Proceeding to step S53, the color code recognition unit 44 performs the recognition process of the color code image 811 by the procedure described in, for example, Japanese Patent Application Laid-Open No. 2017-199306.

When the color code image 811 is recognized, the color code recognition unit 44 detects an image of each cell from the color code image 811. Proceeding to step S54, the color code recognition unit 44 recognizes the color information of each cell detected in step S53 and the connection information of each cell as symbol information. The color code recognition unit 44 proceeds to step S54 and, for example, decodes the symbol information according to the coding rule shown in FIG. 8A to restore the color code ID encoded in the color code image 811.

Proceeding to step S55, the color code recognition unit 44 provides, for example, the identification information of the camera 18a in which the color code image 811 is captured and the color code ID restored by decoding to the job management unit 34. The job management unit 34 refers to the job management table storage unit 48 to specify the job ID corresponding to the color code ID.

Then, the job management unit 34 is managed by the job management table storage unit 48 based on, for example, the identification information of the camera 18a that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811. You can update the current job status from "not detected" to "passed".

<< Update job status when storing in temporary storage location >>
In the job management system 1 according to the present embodiment, the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is attached is photographed by the camera 18b, so that the job status of the job management table storage unit 48 is as follows. Will be updated.

FIG. 22 is a flowchart of an example of the job status update process at the time of storage in the temporary storage location. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image from the camera 18b, the process proceeds to step S62.

In step S62, the color code recognition unit 44 attempts to cut out the color code image 811 from the photographed image or the photographed moving image acquired by the photographed image acquisition unit 42. Proceeding to step S63, the color code recognition unit 44 performs the recognition process of the color code image 811 by the procedure described in, for example, Japanese Patent Application Laid-Open No. 2017-199306.

If the color code image 811 is recognized in step S63, the color code recognition unit 44 proceeds from steps S64 to S65, and decodes the symbol information recognized from the color code image 811 to encode the color code image 811. Restore the color code ID that was there.

Proceeding to step S66, the color code recognition unit 44 provides the job management unit 34 with the identification information of the camera 18b that captured the color code image 811 and the color code ID restored by decoding. The job management unit 34 refers to the job management table storage unit 48 to specify the job ID corresponding to the color code ID.

Then, the job management unit 34 does not change the job status of the job ID based on, for example, the identification information of the camera 18b that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811. To determine whether or not a predetermined time has passed.

If the predetermined time has elapsed without changing the job status, the job management unit 34 performs a process for displaying a retention alert on the job detail history screen described later, and then proceeds to the process of step S70. If the job status has not changed and the predetermined time has not elapsed, the job management unit 34 proceeds to step S70. In step S70, the job management unit 34 can update the job status managed by the job management table storage unit 48 from "not detected" to "current process" or the like.

If the color code image 811 is not recognized in step S63, the color code recognition unit 44 proceeds from step S64 to S68, and cannot recognize the color code image 811 from the image taken from the camera 18b installed in the temporary storage location. The job status is a process for updating the job ID that is supposed to be stored in the temporary storage location.

The color code recognition unit 44 provides, for example, the identification information of the camera 18b to the job management unit 34. The job management unit 34 is a job in which the color code image 811 is not recognized from the captured image for a predetermined number of times in a row among the job IDs whose job status of the temporary storage location corresponding to the identification information of the provided camera 18b is "current process". Determine if there is an ID.

If there is a job ID whose job status of the temporary storage location is "current process" in which the color code image 811 is not recognized from the captured image for a predetermined number of times in a row, the job management unit 34 proceeds to step S69, and the job ID thereof proceeds to step S69. The color code ID associated with the job ID is set to Null, and the process proceeds to step S70.

Further, there is a possibility that the work instruction sheet 810 for the information processing system 12 is stored in a state where it cannot be photographed from the camera 18b, such as printed matter being piled up in the temporary storage place. In consideration of this point, if there is no job ID in which the job status of the temporary storage location is "current process" and the color code image 811 is not recognized from the captured image for a predetermined number of times in a row, the job management unit 34 has no job ID. Skip step S69 and proceed to step S70.

According to the processing of the flowcharts of FIGS. 21 and 22, the work instruction sheet 810 for the information processing system 12 is attached by automatically updating the job status of the printed matter to which the work instruction sheet 810 for the information processing system 12 is attached. Printed matter can be tracked.

《Job inquiry》
The operator of the job management system 1 can use various UI screens provided by the work process management system 14 to display progress information and history information of the work process of the job in the printing factory, a photographed image file showing the state when the work instruction sheet 810 is photographed, and the photographed image file. You can inquire about recorded video files.

FIG. 23 is a transition diagram of an example of the UI screen displayed by the work process management system. The UI unit 30 of the work process management system 14 displays, for example, the job status list screen 1000 on the display device 502. The job status list screen 1000 displays a list of job information including job ID, color code ID, job name, last update data, and progress information of one or more work processes.

The progress information of one or more work processes indicates whether the progress of the work process is "not detected", "passed", "current process", or "alert". The progress of the work process "not detected" means that the camera 18 corresponding to the work process has not photographed the work instruction sheet 810 for the information processing system 12. The progress of the work process "passed" indicates that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to the work process before the final update. Progress of the work process The "current process" indicates that the work instruction sheet 810 for the information processing system 12 was photographed at the last update by the camera 18 corresponding to the work process. The progress "alert" of the work process indicates that an alert such as a stay alert has occurred.

The key mark 1002 on the job status list screen 1000 indicates that the color code ID associated with, for example, a long-term storage job is locked so as not to be automatically released. In this way, the work process management system 14 provides the operator with a lock function in which the color code ID is not reused.

The operator can display the job details history screen 1010 by selecting one job from the job status list screen 1000. The job detail history screen 1010 displays a button for transitioning to a screen for displaying a start date / time, a completion date / time, a photographed image, and a photographed moving image for each work process. When the work process is "temporary storage 1" or "temporary storage 2", the address representing the storage area in the temporary storage location is also displayed on the job details history screen 1010.

Further, when the button for transitioning to the screen 1020 for displaying the captured image or the captured video of the job detail history screen 1010 is pressed, the UI unit 30 transitions to the screen 1020 for displaying the captured image or the captured video. The screen 1020 for displaying the photographed image or the photographed moving image displays the photographed image file or the photographed moving image file showing the state when the work instruction sheet 810 is photographed by pressing the play button.

When the button for transitioning to the map display screen 1030 of the job corresponding to the work process “temporary storage 1” or “temporary storage 2” is pressed, the UI unit 30 transitions to the map display screen 1030 shown in FIG. do. FIG. 26 is an image diagram of an example of a map display screen of a temporary storage location. The UI unit 30 displays, for example, a photographed image of a temporary storage location in the background, and then displays the storage area in which the printed matter is stored so that it can be identified by a mark “●” or the like.

The job status list screen 1000 of FIG. 23 may be displayed by grouping as shown in FIG. 24, or may accept the designation of search conditions as shown in FIG. 25.

FIG. 24 is an explanatory diagram of an example of grouping processing on the UI screen. FIG. 24A is an example of the job status list screen 1000 before the grouping process. In FIGS. 24 (B) and 24 (C), progress information of one or more work processes of the job status list screen 1000 after the grouping process is grouped by "1st floor area" and "2nd floor area" visually. This is an example that is easy to understand.

In FIG. 24C, the grouped "first floor area" is folded and displayed. When the progress information of grouped work items is folded and displayed, the progress information of the work items included in the group is ANDed (logical) so that the progress information of the work items included in the group of the folded "1st floor area" can be understood. The product) is displayed as the progress information of the group.

FIG. 25 is an explanatory diagram of an example of the search condition designation process on the UI screen. FIG. 25 is an example of the job status list screen 1000 provided with a search line. The operator can search for jobs that match the search conditions by specifying the search conditions in the search line. The search line provided as shown in FIG. 25 has few screen transitions and has the effect of improving immediacy and visibility. FIG. 25A is an example in which search conditions are input in text on the search line. FIG. 25B is an example in which the search condition is selected from the pull-down menu.

As described above, according to the work process management system 14 according to the present embodiment, the progress information of the work process of the job in the printing factory can be confirmed in a list. Further, according to the work process management system 14 according to the present embodiment, history information of the work process of the job in the printing factory, a photographed image file showing a state when the work instruction sheet 810 is photographed, a photographed moving image file, and the like can be easily obtained. You can check it by operation.

[Second Embodiment]
In the first embodiment, the work process management system 14 created the work instruction sheet 810 for the information processing system 12. In the second embodiment, the customer system 10 creates a work instruction sheet 810 for the information processing system 12. The second embodiment is the same as the first embodiment except for a part. Therefore, the same parts as those of the first embodiment will be omitted as appropriate.

<System configuration>
FIG. 27 is a functional configuration diagram of another example of the work process management system. The work process management system 14a of FIG. 27 has a configuration in which the work instruction sheet creating unit 38 with a color code and the print instruction unit 40 are excluded from the work process management system 14 of FIG. On the other hand, in the customer system 10a, a work instruction sheet creating unit 60 with a color code and a printing instruction unit 62 are added.

In the job management system 1 according to the second embodiment, the work process management system 14a performs up to the generation of the color code image 811 in the same manner as in the first embodiment, and steps S14 and S15 in FIG. 6 are the color codes of the customer system 10. This is done by the work instruction sheet creating unit 60 and the print instruction unit 62.

The job management system 1 according to the second embodiment can also obtain the same effect as the job management system 1 according to the first embodiment.

[Third Embodiment]
The first and second embodiments described above are techniques realized by the work instruction sheet 810 for the information processing system 12 in which a new code (color code image 811) is added to the work instruction sheet 800 for the customer system 10. This technique can be applied to the technique of a transfer system represented by, for example, an AGV (automated guided vehicle).

For example, in a transport system for transporting an article, a work instruction sheet 810 for an information processing system 12 to which a color code image 811 is added is attached to the article, and the article being transported is photographed by a camera 18 by the transport device. It is possible to manage the work process of the goods being transported. Further, since the position of the transport device during transport of the article and the transport destination of the article can be specified, the transport system can also control the movement of the transport device for transporting the article.

[Fourth Embodiment]
Although the first and second embodiments described above have described the management of the work process of a job in a printing factory, they can also be applied to, for example, the management of the work process of an article flowing on a belt conveyor. For example, if the technique of the present embodiment is provided for managing the work process of the articles flowing on the belt conveyor, it is possible to track the articles flowing on the belt conveyor and control the branching of the belt conveyor.

The present invention is not limited to the above-described embodiment disclosed specifically, and various modifications and modifications can be made without departing from the scope of claims. The work instruction sheet 800 for the customer system 10 is an example of the first slip image described in the claims. The work instruction sheet 810 for the information processing system 12 is an example of the second slip image. The barcode image 801 is an example of the code image displayed on the first slip image. The color code image 811 is an example of a new code image.

The work instruction sheet creating unit 38 with a color code for confirming the direction of the barcode image 801 shown in FIG. 12 is an example of the determination means. The work instruction sheet creating unit 38 with a color code that scales and reduces in a direction that does not impair the function of the barcode image 801 shown in FIG. 12 is an example of the reduction means. The work instruction sheet creating unit 38 with a color code for creating a work instruction sheet 810 for the information processing system 12 using the generated color code image 811 is an example of the creating means. The color code image generation unit 36 is an example of the generation means.

1 Job management system 10 Customer system 12 Information processing system 14 Work process management system 16 Printer 18, 18a, 18b Camera 20 Network 30 UI section 32 Job ID detection section 34 Job management section 36 Color code image generation section 38, 60 With color code Work instruction sheet creation unit 40, 62 Print instruction unit 42 Photographed image acquisition unit 44 Color code recognition unit 46 Color code management table storage unit 48 Job management table storage unit 800 Work instruction sheet for customer system 801 Bar code image 810 Information processing system Work instructions for 811 Color code image 1000 Job status list screen 1010 Job details history screen 1020 Screen for displaying shot images and shot videos 1030 Job map display screen

Japanese Unexamined Patent Publication No. 2014-42148

Claims (14)

A reduction means for scaling and reducing the first slip image according to the direction of the code image of the first slip image on which at least one code image is displayed.
A means of creating a second slip image in which a new code image is displayed in the area vacated by scaling, and
The new code is obtained by photographing the slip on which the second slip image including the scaled-down first slip image and the new code image is printed with a camera associated with the work process. A management means for managing the progress of the work process of the job corresponding to the image, and
Information processing system with. The information processing system according to claim 1, wherein the reduction means scales and reduces the first slip image in a direction that does not impair the function of the code image displayed on the first slip image. .. The reduction means scales and reduces the first slip image in the vertical direction when the direction of the code image is the vertical direction, and when the direction of the code image is the horizontal direction. The information processing system according to claim 1 or 2, wherein the first slip image is scaled and reduced in the horizontal direction. A generation means for generating a color code image in which a value is expressed by using a color transition between adjacent cells as the new code image.
The information processing system according to any one of claims 1 to 3, further comprising. The information processing system according to claim 4, wherein the generation means generates the color code image of the second identification information corresponding to the first identification information detected from the first slip image. The information processing system according to claim 4 or 5 , wherein the code image displayed on the first slip image is a barcode image. The bar code image of the first slip image includes job identification information that identifies the job.
The second slip image is the first slip image scaled down according to the detection of the job identification information based on the barcode image of the first slip image, and the job identification. Created including the color code image corresponding to the information,
The information processing system according to claim 6. The management means manages the progress of the job by updating the work process of the job corresponding to the new code image when the slip is photographed by the camera associated with the work process.
The information processing system according to any one of claims 1 to 7. The slip is a work order for the job.
The information processing system according to any one of claims 1 to 7. The job is a job for producing printed matter in a printing factory.
The information processing system according to any one of claims 1 to 9. The camera is a camera installed so that the slip can be photographed from above.
The information processing system according to any one of claims 1 to 10. A reduction step of scaling the first slip image according to the direction of the code image of the first slip image displaying at least one code image, and a reduction step.
A creation step to create a second slip image in which a new code image is displayed in the area vacated by scaling.
The new code is obtained by photographing the slip on which the second slip image including the scaled-down first slip image and the new code image is printed with a camera associated with the work process. A management step that manages the progress of the work process of the job corresponding to the image, and
An information processing method that executes information processing in an information processing system. Computer,
A reduction means for scaling the first slip image according to the direction of the code image of the first slip image on which at least one code image is displayed.
A creation method for creating a second slip image in which a new code image is displayed in an area vacated by scaling.
The new code is obtained by photographing the slip on which the second slip image including the scaled-down first slip image and the new code image is printed with a camera associated with the work process. A management means for managing the progress of the work process of the job corresponding to the image,
A program to function as. A medium on which a second slip image generated by the information processing system according to any one of claims 1 to 11 is displayed.

Images