JP7200526B2 - Information processing system, information processing method, program and medium - Google Patents

Description

The present invention relates to an information processing system , an information processing method , a program and a medium.

2. Description of the Related Art Conventionally, the progress of a job consisting of a plurality of work processes is managed by using barcodes or the like printed on work instructions.

In addition, RFID tags are attached to workers and work objects (materials, work-in-progress, products in the factory, etc.), and by reading the RFID tags at the entrance gate at the entrance of the processing factory and the exit gate at the exit of the processing factory, the work can be performed. A system that manages the working time of workers and the flow of objects to be worked on (entering and exiting the workplace) has been known in the past (see, for example, Patent Literature 1).

In the existing system that manages the progress of a job consisting of multiple work processes by using barcodes printed on work instructions, users can use functions that were realized by using work instructions (work instruction There are cases where you want to add a new function while leaving the function). However, it was not easy to add new functions to work instructions while minimizing changes to existing systems.

The embodiments of the present invention have been devised in view of the above points, and it is an object of the present invention to provide an information processing system that can easily add functions realized by slips.

In order to achieve the above object, claim 1 of the present application provides detection means for detecting first identification information used to identify one or more jobs in an existing system, and a job corresponding to the first identification information. generating means for generating the attached second identification information; creating means for creating a slip on which the first identification information and the second identification information are displayed; and the second identification displayed on the slip and managing means for managing progress information of the work process of the job based on recognition of the information.

According to the embodiment of the present invention, it is possible to easily add functions realized by slips.

1 is a configuration diagram of an example of a job management system according to an embodiment; FIG. FIG. 4 is an image diagram of an example of a work instruction sheet used in the job management system according to the embodiment; 1 is a hardware configuration diagram of an example of a computer; FIG. 1 is a functional configuration diagram of an example of a work process management system; FIG. FIG. 2 is an image diagram showing an example of a job work process in a printing factory; FIG. 10 is a flowchart of an example of processing for creating a color-coded work instruction sheet; FIG. 4 is a flowchart of an example of processing for generating a color code image; FIG. 4 is a diagram for explaining coding rules that can express ternary numbers; FIG. 3 shows an example of information for encoding into an optical symbol; FIG. 10 is a diagram showing an example of an optical symbol when four colors are assigned to each cell of the optical symbol; It is a figure which shows the processing image which creates a work instruction sheet with a color code. 6 is a flowchart of an example of processing for reducing an image including a barcode image; FIG. 4 is an image diagram of an example of a barcode image; FIG. 4 is an image diagram of an example of a barcode image before being reduced in the vertical direction; FIG. 10 is an image diagram of an example of a barcode image after being reduced in the vertical direction; FIG. 10 is an image diagram of an example of a barcode image before being reduced in the horizontal direction; FIG. 10 is an image diagram of an example of a barcode image after being reduced in the horizontal direction; FIG. 10 is an explanatory diagram of an example of change count confirmation processing; FIG. 4 is an image diagram of an example of a barcode image; FIG. 10 is an explanatory diagram of an example of change count confirmation processing; 8 is a flowchart of an example of job status update processing when passing through a gate; FIG. 11 is a flowchart of an example of job status update processing during storage in a temporary storage location; FIG. FIG. 10 is a transition diagram of an example of a UI screen displayed by the work process management system; FIG. 10 is an explanatory diagram of an example of grouping processing on the UI screen; FIG. 10 is an explanatory diagram of an example of search condition designation processing on a UI screen; FIG. 11 is an image diagram of an example of a map display screen of a temporary storage location; FIG. 11 is a functional configuration diagram of another example of the work process management system;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, a job management system that manages the work process of a job in a printing factory by a function (work instruction function) using a work instruction (slip) will be described as an example.

[First Embodiment]
<System configuration>
FIG. 1 is a configuration diagram of an example of a job management system according to this embodiment. FIG. 2 is an image diagram of an example of a work instruction sheet used in the job management system according to this embodiment. In the job management system 1 of FIG. 1, a customer system 10, a work process management system 14, a printer 16, and one or more cameras 18 are connected via a network 20 such as the Internet or LAN so as to be able to communicate data.

The customer system 10 is an example of an existing system used by a customer, and a work instruction sheet 800 for the customer system 10 shown in FIG. 2A, in which job IDs are displayed, is created. A job ID is an example of identification information that identifies a job. At least one barcode image 801 used on the customer system 10 side is displayed on the work instruction sheet 800 for the customer system 10 .

The job ID may be displayed in the work instruction sheet 800 for the customer system 10 as a bar code image 801 or as text. The customer system 10 provides the user with the existing functionality realized by the work order 800 for the customer system 10 .

Work process control system 14 , printer 16 and one or more cameras 18 constitute information processing system 12 that adds new functionality to work instructions 800 . The work process management system 14 uses the work instruction sheet 810 for the information processing system 12 to which the color code image 811 shown in FIG. to manage. Note that the information processing system 12 can identify the job ID from the color code image 811 as described later.

Printer 16 prints work instructions 810 for information handling system 12 . A camera 18 is installed so as to be able to photograph a location corresponding to the work process of a job in the printing factory. Note that the location associated with the work process of the job includes a location through which the printed material passes during movement between the work processes, a temporary storage location where the printed material is temporarily stored, and the like.

A PTZ camera or an IP camera can be used as the camera 18 . The PTZ camera is a camera capable of operating a PTZ (Pan Tilt Zoom) function via the network 20 and capable of transmitting captured images and captured moving images via the network 20 . The IP camera is a camera that can be operated via the network 20 and that can transmit captured images and captured moving images via the network 20 . A photographed image or photographed moving image photographed by the camera 18 is transmitted to the work process management system 14 via the network 20 .

In the information processing system 12 that adds a new function to the work instruction sheet 800, the work instruction sheet 810 for the information processing system 12 is printed as an example of an intermediate product or material of the job corresponding to the work instruction sheet 810. affixed. The work instruction sheet 810 is pasted on printed matter that can be easily photographed by the camera 18, for example.

The work process management system 14 monitors the progress of the work process of the job based on the work process of the job corresponding to the camera 18 that captured the work instruction sheet 810 and the job ID specified from the color code image 811 of the work instruction sheet 810. (job status). In addition, the work process management system 14 manages the history of the work process of the job, and the photographed image and the photographed moving image representing the situation when the work instruction sheet 810 was photographed.

Note that the configuration of the job management system 1 shown in FIG. 1 is an example. For example, the job management system 1 may include another system, and the work process management system 14 may have a different name. The work process management system 14 may be implemented in a single server environment, or may be implemented in a plurality of server environments.

<Hardware configuration>
The customer system 10 and the work process management system 14 are realized by, for example, a computer 500 having the hardware configuration shown in FIG.

FIG. 3 is a hardware configuration diagram of an example of a computer. A computer 500 in FIG. 3 includes an input device 501, a display device 502, an external I/F 503, a RAM 504, a ROM 505, a CPU 506, a communication I/F 507, an HDD 508, and the like, which are interconnected via a bus B. Note that the input device 501 and the display device 502 may be connected and used when necessary.

An input device 501 includes a keyboard, mouse, touch panel, etc., and is used by the user to input various operation signals. A display device 502 includes a display or the like, and displays processing results by the computer 500 .

A communication I/F 507 is an interface that connects the computer 500 to various networks. Thereby, the computer 500 can perform data communication via the communication I/F 507 .

Also, the HDD 508 is an example of a non-volatile storage device that stores programs and data. The stored programs and data include an OS, which is basic software that controls the entire computer 500, and application software (hereinafter simply referred to as an application) that provides various functions on the OS. Note that the computer 500 may use a drive device (for example, solid state drive: SSD) using flash memory as a storage medium instead of the HDD 508 .

An external I/F 503 is an interface with an external device. The external device includes a recording medium 503a and the like. Thereby, the computer 500 can read and/or write the recording medium 503a through the external I/F 503. FIG. The recording medium 503a includes a flexible disk, CD, DVD, SD memory card, USB memory, and the like.

The ROM 505 is an example of a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 505 stores programs and data such as the BIOS, OS settings, and network settings that are executed when the computer 500 is started. A RAM 504 is an example of a volatile semiconductor memory (storage device) that temporarily holds programs and data.

The CPU 506 is an arithmetic unit that realizes overall control and functions of the computer 500 by reading programs and data from storage devices such as the ROM 505 and the HDD 508 onto the RAM 504 and executing processing. The customer system 10 and the work process management system 14 can realize various processes described later by the hardware configuration of a computer 500 as shown in FIG. 3, for example. A description of the hardware configuration of the printer 16 and the camera 18 is omitted.

<Software configuration>
FIG. 4 is a functional configuration diagram of an example of a work process management system. Note that the functional configuration in FIG. 4 is omitted as appropriate for configurations that are not necessary for the description of the present embodiment. The work process management system 14 of FIG. 4 includes a UI unit 30, a job ID detection unit 32, a job management unit 34, a color code image generation unit 36, a color code work instruction creation unit 38, a print instruction unit 40, and a photographed image acquisition unit. 42, a color code recognition section 44, a color code management table storage section 46, and a job management table storage section 48. FIG.

The UI unit 30 controls the display of various screens such as a screen for receiving various necessary settings from the user, a job status list screen to be described later, and a job detail history screen. The job ID detection unit 32 detects, for example, the job ID displayed in the bar code image 801 or text in the work instruction sheet 800 for the customer system 10 shown in FIG. 2(A).

The job management unit 34 stores and manages available color code IDs in the color code management table storage unit 46 . The job management unit 34 limits the number of available color code IDs and narrows the range of values required to express the color code IDs, thereby maximizing the size of the color code image 811 and producing a color code that will be described later. facilitates recognition.

If the unused color code ID does not remain in the color code management table storage unit 46, the job management unit 34 selects the last updated old color code ID from the color code management table storage unit 46 and reuses it. The job management unit 34 associates the job ID detected by the job ID detection unit 32 with the selected color code ID and manages them in the color code management table storage unit 46 .

Also, the job management unit 34 stores and manages job information corresponding to the job ID and the color code ID in the job management table storage unit 48 . The job management table storage unit 48 manages the progress information and history information of the work process of the job, and the photographed image file and the photographed moving image file representing the state when the work instruction sheet 810 was photographed, and displays the job status list screen described later. It is used to display etc.

The color code image generation unit 36 generates a color code image 811, which will be described later, from the color code ID provided by the job management unit 34. FIG. The color-coded work instruction sheet creating unit 38 converts the work instruction sheet 800 for the customer system 10 shown in FIG. to create The print instruction unit 40 instructs the printer 16 to print the work instruction sheet 810 for the information processing system 12 to which the color code image 811 shown in FIG. 2B is added.

A captured image acquisition unit 42 acquires captured images and captured moving images from the camera 18 . The color code recognition unit 44 decodes the color code ID from the color code image 811 captured in the photographed image or the photographed moving image. The color code recognition unit 44 provides the job management unit 34 with identification information that identifies, for example, the camera 18 that captured the color code image 811 or the work process of the job, and the decoded color code ID. The job management unit 34 refers to the job management table storage unit 48 to identify the job ID corresponding to the decoded color code ID.

As a result, the job management unit 34 manages the job management table storage unit 48 based on the work process of the job corresponding to the camera 18 that captured the color code image 811 and the job ID corresponding to the decoded color code ID. You can update the progress information (job status) of the work process of the job.

<Processing>
FIG. 5 is an image diagram showing an example of the work process of a job in a printing factory. The work process in FIG. 5 includes "printing", "cutting", "folding", "binding", "inspection", "temporary storage 1", and "temporary storage 2". The camera 16a is installed at a gate in front of a place where work processes "printing", "cutting", "folding", "bookbinding" and "inspection" are performed. In addition, the camera 16b is installed at a place where work steps "temporary storage 1" and "temporary storage 2" are performed.

The work instruction sheet 810 for the information processing system 12 is photographed by the cameras 16a and 16b in the process of moving between work processes and in the state of being stored in a temporary storage location. As shown in FIG. 5, in a printing factory, movement between work processes is not constant, and there are cases where work instructions 810 for the information processing system 12 are not photographed and work processes that are not detected or recorded are included depending on the job. be. FIG. 5 shows an arrow representing movement of a job that performs all work processes and an arrow representing movement of a job that skips a part of work processes.

In FIG. 5, after the printed material is output by the work process "printing", the work instruction sheet 810 is pasted on the printed material. As a result, in the example of FIG. 5, the camera 16a and the camera 16b photograph the work instruction sheet 810 pasted on the printed matter while the printed matter passes through the gate and is stored in the temporary storage location.

《Creating work instructions with color codes》
FIG. 6 is a flowchart of an example of processing for creating a color-coded work instruction sheet. In step S11, the job ID detection unit 32 of the work process management system 14 detects the job ID displayed in the barcode image 801 or text in the work instruction sheet 800 for the customer system 10. FIG. The detection frame for detecting the job ID from the work instruction sheet 800 may be set in advance by the operator, or may be automatically set using OCR or the like.

Proceeding to step S12, the job management section 34 selects a color code ID to be used from the color code management table storage section 46, and manages the selected color code ID and the job ID detected by the job ID detection section 32 in association with each other. .

Proceeding to step S13, the color code image generation unit 36 generates the color code image 811 from the color code ID associated with the job ID according to the procedure shown in FIG. It should be noted that the procedure shown in FIG. 7 uses, for example, the technology described in Japanese Patent Application Laid-Open No. 2017-199306.

FIG. 7 is a flowchart of an example of processing for generating a color code image. In step S21, the color code image generator 36 receives an input of a color code ID to be color coded. Proceeding to step S22, the color code image generator 36 decomposes the character string of the color code ID into values of each digit. Proceeding to step S23, the color code image generation unit 36 converts the decomposed digit values into values corresponding to the number of colors assigned to each cell of the optical symbol described in JP-A-2017-199306. For example, if the number of colors assigned to each cell is four, the color code image generator 36 converts the value of each digit into a ternary value according to the coding rule shown in FIG.

FIG. 8 is a diagram for explaining encoding rules that can represent ternary numbers. FIG. 8 shows an example of coding rules when using four colors of R (red), G (green), B (blue), and K (black). When using four colors, it is possible to express three values, that is, a ternary number.

For example, as exemplified in FIG. 8(a), each transition clockwise, i.e., from R color to K color, K color to B color, B color to G color, and G color to R color, has the value "0 ” is expressed. Counterclockwise, that is, each transition from R color to G color, G color to B color, B color to K color, and K color to R color expresses the value "1". Further, the diagonals, that is, bi-directional transitions between R and B colors and bi-directional transitions between K and G colors each represent the value "2".

For example, as shown in FIG. 8(b), in a cell column in which each cell is sequentially connected in the order of G, R, B, K, and G colors, from left to right in FIG. Consider the case when looking at the color transitions of a cell. In this case, the transition from G to R represents the value "0", the transition from R to B represents the value "2", and the transition from B to K represents the value "1". , and the transition from K color to G color represents the value "2" respectively. Thus, the array of FIG. 8(b) represents the value "3d2120", ie the decimal value "69". Note that "3d" at the beginning of the value notation indicates that the following number is a ternary value.

The coding rule using four color transitions is not limited to the example shown in FIG. 8(a), and may be, for example, the example shown in FIG. 8(d). FIG. 8(e) shows an example of a conversion table that associates color transitions and values according to the encoding rule shown in FIG. 8(d). In FIG. 8E, for example, when the color of the transition source cell is red and the value "2" is to be expressed, the color of the transition destination cell adjacent to the transition source cell is set to be blue. Similarly, if the color of the cell at the transition source is K and the value "1" is to be expressed, the color of the cell at the transition destination is set to G.

Proceeding to step S24 following step S23 in FIG. 7, the color code image generation unit 36 converts the color of the transition source cell, the ternary value converted in step S23, and the A color is assigned to each cell of the optical symbol according to a conversion table of encoding rules. It is assumed that the color code image generator 36 stores in advance the color arrangement of each cell in the cell row of the main code of the optical symbol.

A more specific example in which four colors are assigned to each cell of an optical symbol will be described with reference to FIGS. 9 and 10. FIG. FIG. 9 shows an example of information for encoding into optical symbols. FIG. 10 is a diagram showing an example of an optical symbol when four colors are assigned to each cell of the optical symbol.

FIG. 9 shows that each cell string of the sub-code part 301 connected to each cell "d1", "d2", "d3" and "d4" of the main code part 300 has the values "3d1", "3d1" and "3d0". and "3d1".

FIG. 10 shows an example of an optical symbol obtained by encoding the information illustrated in FIG. 9 according to the encoding rule explained using FIG. In this example, the cell column of the main code part 300 includes an even number of cells, with K color being the leading cell, and K color and R color being alternately arranged.

In the sub-code part 301, for example, in the leftmost cell, the cell color is assigned with the K color of the cell of the main code part 300 to which the cell is connected as the color of the first transition source. In the example of FIG. 10, the conversion table of the encoding rule in FIG. Therefore, the R color is assigned to the cell of the leftmost sub-code portion 301 of the optical symbol.

Proceeding to step S14 following step S13 in FIG. 6, the color-coded work instruction sheet creating unit 38 creates a work instruction sheet 810 for the information processing system 12 using the color code image 811 generated in step S13.

FIG. 11 is a diagram showing a processing image for creating a color-coded work instruction sheet. The paper size and layout frame may be set in advance by the operator. The work instruction sheet 800 for the customer system 10 in FIG. 2A is scaled down to generate an empty space. A work instruction sheet 810 for the information processing system 12 in FIG. 2B is obtained by affixing a color code image 811 to an empty space generated by scaling down the work instruction sheet 800 for the customer system 10. .

At least one bar code image 801 used by the customer system 10 is displayed in the work instruction sheet 800 for the customer system 10 in FIG. 2(A). Therefore, simply reducing the work instruction sheet 800 for the customer system 10 may cause the barcode image 801 to become non-functional (cannot be recognized).

Therefore, in order to generate an empty space without impairing the function of the barcode image 801, the color-coded work instruction creating unit 38 checks the direction of the barcode image 801 according to the procedure shown in FIG. Perform scaling reduction in a direction that does not impair the function.

FIG. 12 is a flowchart of an example of processing for reducing an image including a barcode image. In step S31, the color-coded work instruction sheet creating section 38 cuts out the position of the barcode image 801 of the work instruction sheet 800 for the customer system 10 in FIG. 2(A). Proceeding to step S32, the color-coded work instruction sheet creation unit 38 determines whether the bar code image cut out as shown in FIG. 13 is a Bk (monochrome) image or an RGB image. FIG. 13 is an image diagram of an example of a barcode image.

If it is not a Bk (monochrome) image, the color-coded work instruction creating unit 38 proceeds to step S33, converts the RGB image into a Lab image or a Luv image, and creates a monochrome image by extracting only the L component after conversion. , the process proceeds to step S34. If the image is a monochrome image, the color-coded work instruction sheet creating unit 38 skips step S33 and proceeds to step S34.

In step S34, the color-coded work instruction sheet creation unit 38 raster scans all pixels in the barcode image of FIG. Here, the pixel position (x, y) is the position along the X and Y directions shown in FIG. The color-coded work instruction creating unit 38 integrates values obtained by integrating pixels having the same pixel position x, that is, the pixel values are integrated in the Y direction.

Further, the process proceeds to step S35, and the color-coded work instruction sheet creating unit 38 integrates all pixels. The color-coded work instruction sheet creation unit 38 obtains an average value by dividing the integrated value of all pixels by the total number of pixels.

Proceeding to step S36, the color-coded work instruction creating unit 38 compares the integrated value of pixels with the same pixel position x obtained in step S34 and the average value obtained in step S35 as shown in FIG. Check the number of changes. FIG. 18 is an explanatory diagram of an example of the change count confirmation process. For example, the color-coded work instruction creating unit 38 calculates the total number of changes from the integrated value higher than the average value to the integrated value lower than the average value and the number of changes from the integrated value lower than the average value to the integrated value higher than the average value. to confirm.

Proceeding to step S37, the color-coded work instruction creating unit 38 determines whether or not the number of changes confirmed in step S36 is 24 or more. If the number of times of change is 24 or more, the process advances to step S38, and the color-coded work instruction document creation unit 38 changes the barcode image in FIG. Do double reduction. FIG. 14 is an image diagram of an example of a barcode image before being reduced in the vertical direction. FIG. 15 is an image diagram of an example of a barcode image after being reduced in the vertical direction.

For example, if the bar code image shown in FIG. 13 is reduced in the X direction, the black lines become closer, making it difficult to distinguish between black and white. On the other hand, even if the bar code image shown in FIG. 13 is reduced in the Y direction, the distance between the black lines does not change, so there is no effect on black/white discrimination.

On the other hand, if the number of times of change is not 24 or more, the process proceeds to step S39, and the color-coded work instruction creating unit 38, for example, horizontally reduces the barcode image in FIG. 16 to the barcode image in FIG. perform scaling reduction.

The processing of the flowchart of FIG. 12 determines the orientation of the barcode image based on the following considerations. For example, in the case of a vertical bar code as shown in FIG. 13, since the black line has a width, a change from white line to black line and a change from black line to white line occur as a set. Although the number of times of change varies depending on the number of display digits of the barcode, when a general barcode is examined, if the number of times of change is 24 or more, it can be determined to be a vertical barcode as shown in FIG.

Similarly, in the case of the horizontal bar code as shown in FIG. 19, the color-coded work instruction creating unit 38 checks the number of changes in step S36 as shown in FIG. FIG. 19 is an image diagram of an example of a barcode image. FIG. 20 is an explanatory diagram of an example of the change count confirmation process.

In the case of FIG. 20, the total number of changes from the integrated value higher than the average value to the integrated value lower than the average value and the number of changes from the integrated value lower than the average value to the integrated value higher is extremely small. Even if information other than the barcode image is integrated, the number of changes does not exceed 24 times. Therefore, if the number of times of change is 24 or more, it can be determined that the bar code is in the horizontal direction as shown in FIG.

Instead of the method of determining the direction of the barcode image described above, the direction of the barcode image can be determined by Fourier transform, Hough transform, which is one of the feature extraction methods, or the like. However, recent printers perform halftone processing. In particular, electrophotographic printers sometimes use parallel dither.

When the Hough transform is used, line segment components in the image can be extracted. Although the line segment component of the bar code is dominant, it is difficult to eliminate the influence of halftone processing, especially parallel line dither. In order to reduce the influence of line dither, the position of the bar code image 801 must be strictly specified in step S31. Similarly, when using Fourier transform, the problem is whether the influence of halftone processing around the bar code can be strictly eliminated.

On the other hand, in the method of determining the direction of the barcode image of the present embodiment, even if the bar code image cut out in step S31 includes a line dither image or some kind of character or image, it is counted as the number of changes. No problem.

Thus, in the work process management system 14 of the present embodiment, an empty space is created by scaling in a direction that does not impair the function of the barcode image 801, and a remotely readable color code image is created in the empty space. 811 can be added. Even if the work instruction sheet 800 for the customer system 10 is scaled down, the function of the barcode image 801 is not damaged, and the function of the work instruction sheet 800 for the customer system 10 is retained, and the function by the color code image 811 is information. It can be added to the work order 810 for the processing system 12 .

Proceeding to step S15 following step S14 in FIG. 6, the print instruction unit 40 prints a work instruction sheet 810 (work instruction sheet with color code) for the information processing system 12 to which the color code image 811 created in step S14 is added. is instructed to the printer 16 to print . The printer 16 prints a work instruction sheet 810 for the information processing system 12 to which a color code image 811 such as that shown in FIG.

《Updating the job status when passing through the gate》
In the job management system 1 according to the present embodiment, when the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is added is photographed by the camera 18a, the job status in the job management table storage unit 48 is changed as follows. updated as follows.

FIG. 21 is a flowchart of an example of job status update processing when passing through a gate. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image or the photographed moving image from the camera 18a, the process proceeds to step S52.

In step S<b>52 , the color code recognition unit 44 attempts to cut out the color code image 811 from the photographed image or the photographed moving image acquired by the photographed image acquisition unit 42 . Proceeding to step S53, the color code recognition unit 44 performs recognition processing of the color code image 811 according to the procedure described in Japanese Patent Application Laid-Open No. 2017-199306, for example.

When the color code image 811 is recognized, the color code recognition unit 44 detects the image of each cell from the color code image 811 . Proceeding to step S54, the color code recognition unit 44 recognizes the color information of each cell and the connection information of each cell detected in step S53 as symbol information. The color code recognition unit 44 proceeds to step S54, and restores the color code ID encoded in the color code image 811 by decoding the symbol information according to the encoding rule shown in FIG. 8A, for example.

Proceeding to step S55, the color code recognition unit 44 provides the job management unit 34 with the identification information of the camera 18a that captured the color code image 811 and the color code ID restored by decoding, for example. The job management unit 34 refers to the job management table storage unit 48 to identify the job ID corresponding to the color code ID.

The job management unit 34 manages the job management table storage unit 48 based on, for example, the identification information of the camera 18a that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811. You can update the current job status from "Not Detected" to "Passed", etc.

《Updating the job status when storing in the temporary storage location》
In the job management system 1 according to the present embodiment, when the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is added is photographed by the camera 18b, the job status in the job management table storage unit 48 is changed as follows. updated as follows.

FIG. 22 is a flowchart of an example of job status update processing when storing in a temporary storage location. When the photographed image acquisition unit 42 of the work process control system 14 acquires the photographed image from the camera 18b, the process proceeds to step S62.

In step S<b>62 , the color code recognition unit 44 attempts to cut out the color code image 811 from the captured image or moving image acquired by the captured image acquisition unit 42 . Proceeding to step S63, the color code recognition unit 44 performs recognition processing of the color code image 811 according to the procedure described in Japanese Patent Application Laid-Open No. 2017-199306, for example.

If the color code image 811 is recognized in step S63, the color code recognition unit 44 advances from step S64 to step S65, and decodes the symbol information recognized from the color code image 811 to be coded into the color code image 811. restore the color code ID that was

Proceeding to step S66, the color code recognition unit 44 provides the job management unit 34 with, for example, the identification information of the camera 18b that captured the color code image 811 and the color code ID restored by decoding. The job management unit 34 refers to the job management table storage unit 48 to identify the job ID corresponding to the color code ID.

Based on the identification information of the camera 18b that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811, the job management unit 34 determines that the job status of the job ID is unchanged. determines whether or not a predetermined time has passed.

If the job status has not changed for a predetermined period of time, the job management unit 34 performs processing for displaying a retention alert on the job detail history screen, which will be described later, and then proceeds to the processing of step S70. If the job status has not changed and the predetermined time has not elapsed, the job management unit 34 proceeds to step S70. In step S70, the job management unit 34 can update the job status managed by the job management table storage unit 48 from "undetected" to "current process" or the like.

If the color code image 811 is not recognized in step S63, the color code recognition unit 44 proceeds from step S64 to step S68. and the job status is processing for updating the job ID that is supposed to be stored in the temporary storage location.

The color code recognition unit 44 provides the job management unit 34 with identification information of the camera 18b, for example. The job management unit 34 selects jobs for which the color code image 811 has not been recognized from the photographed images for a predetermined number of consecutive times, among the job IDs whose job status in the temporary storage location corresponding to the provided identification information of the camera 18b is "current process". Determine whether or not there is an ID.

If there is a job ID for which the color code image 811 has not been recognized from the photographed images for a predetermined number of consecutive times among the job IDs whose job status in the temporary storage location is "current process", the job management unit 34 proceeds to step S69, and The color code ID associated with the job ID is set to Null, and the process proceeds to step S70.

Moreover, there is a possibility that the work instruction sheet 810 for the information processing system 12 is stored in a state where it cannot be photographed by the camera 18b, for example, printed materials are piled up in the temporary storage location. Considering this point, if there is no job ID whose job status in the temporary storage location is "current process" and the color code image 811 has not been recognized from the photographed images for a predetermined number of consecutive times, the job management unit 34 Skip step S69 and proceed to step S70.

According to the processing of the flowcharts of FIGS. 21 and 22, by automatically updating the job status of the printed matter to which the work instruction sheet 810 for the information processing system 12 is attached, the work instruction sheet 810 for the information processing system 12 is attached. Print tracking becomes possible.

《Job Inquiry》
The operator of the job management system 1 uses various UI screens provided by the work process management system 14 to obtain progress information and history information of the job process in the printing factory, a photographed image file showing how the work instruction sheet 810 was photographed, and the like. Captured video files, etc. can be inquired.

FIG. 23 is a transition diagram of an example of a UI screen displayed by the work process management system. The UI unit 30 of the work process management system 14 causes the display device 502 to display, for example, a job status list screen 1000 . A job status list screen 1000 displays a list of job information including job ID, color code ID, job name, last updated data, and progress information of one or more work steps.

The progress information of one or more work processes indicates whether the progress of the work process is "undetected", "passed", "current process" or "alert". The progress of the work process “undetected” indicates that the work instruction sheet 810 for the information processing system 12 has not been photographed by the camera 18 corresponding to the work process. The progress of the work process "passed" indicates that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to the work process before the final update. The progress of the work process "current process" represents that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to the work process in the last update. The work process progress “alert” indicates that an alert such as a stay alert is occurring.

A key mark 1002 on the job status list screen 1000 indicates that the color code ID associated with, for example, a long-term storage job is locked so as not to be automatically released. In this manner, the work process control system 14 provides the operator with a locking feature that prevents color code ID reuse.

The operator can display a job detail history screen 1010 by selecting one job from the job status list screen 1000 . A job detail history screen 1010 displays a start date and time, an end date and time, and a button for transitioning to a screen displaying a captured image or a captured moving image for each work process. If the work process is "temporary storage 1" or "temporary storage 2", the job detail history screen 1010 also displays an address representing the storage area in the temporary storage location.

Further, when a button for transitioning to a screen 1020 displaying captured images and captured moving images on the job detail history screen 1010 is pressed, the UI unit 30 transitions to a screen 1020 displaying captured images and captured moving images. A screen 1020 for displaying a photographed image and a photographed moving image displays a photographed image file and a photographed moving image file representing the state when the work instruction sheet 810 was photographed by pressing the play button.

When a button for transitioning to the map display screen 1030 of the job corresponding to the work process "temporary storage 1" or "temporary storage 2" is pressed, the UI unit 30 transitions to the map display screen 1030 shown in FIG. do. FIG. 26 is an image diagram of an example of a temporary storage location map display screen. The UI unit 30 displays, for example, a photographed image of the temporary storage location in the background, and then displays the storage area where the printed matter is stored so that it can be identified by a mark “●” or the like.

Note that the job status list screen 1000 in FIG. 23 may be displayed after grouping as shown in FIG. 24, or may receive designation of search conditions as shown in FIG.

FIG. 24 is an explanatory diagram of an example of grouping processing on the UI screen. FIG. 24A is an example of the job status list screen 1000 before grouping processing. 24B and 24C, the progress information of one or more work processes on the job status list screen 1000 after grouping processing is grouped by "1st floor area" and "2nd floor area", and visually displayed. This is an easy-to-understand example.

In FIG. 24C, the grouped "first floor area" is displayed in a folded state. When displaying the progress information of the grouped work items in a collapsed manner, the progress information of the work items included in the group should be ANDed (logical product) as progress information for that group.

FIG. 25 is an explanatory diagram of an example of search condition designation processing on the UI screen. FIG. 25 is an example of a job status list screen 1000 provided with a search line. By specifying search conditions in the search line, the operator can search for jobs that match the search conditions. The search line provided as shown in FIG. 25 has the effect of reducing screen transitions and improving immediacy and visibility. FIG. 25(A) is an example in which search conditions are entered as text in the search line. FIG. 25(B) is an example of selecting search conditions by pull-down.

As described above, according to the work process management system 14 according to the present embodiment, it is possible to check the progress information of the job process in the printing factory in a list form. In addition, according to the work process management system 14 according to the present embodiment, history information of job work processes in a printing factory, a photographed image file and a photographed moving image file representing the situation when the work instruction sheet 810 was photographed can be easily stored. It can be confirmed by operation.

[Second embodiment]
In the first embodiment, the work process management system 14 creates the work instructions 810 for the information processing system 12 . In the second embodiment, the customer system 10 creates a work instruction sheet 810 for the information processing system 12 . The second embodiment is the same as the first embodiment except for some parts. Therefore, description of the same parts as in the first embodiment will be omitted as appropriate.

<System configuration>
FIG. 27 is a functional configuration diagram of another example of the work process control system. The work process control system 14a of FIG. 27 has a configuration in which the color-coded work instruction document creation section 38 and the print instruction section 40 are removed from the work process control system 14 of FIG. On the other hand, the customer system 10a is additionally provided with a color-coded work instruction creating section 60 and a print instruction section 62. FIG.

In the job management system 1 according to the second embodiment, steps up to the generation of the color code image 811 are performed by the work process management system 14a in the same manner as in the first embodiment, and steps S14 and S15 in FIG. This is performed by the attached work instruction creating section 60 and the printing instruction section 62 .

The same effect as the job management system 1 according to the first embodiment can be obtained in the job management system 1 according to the second embodiment.

[Third Embodiment]
The first and second embodiments described above are techniques realized by the work instruction sheet 810 for the information processing system 12 in which a new code (color code image 811) is added to the work instruction sheet 800 for the customer system 10. FIG. This technology can be applied to the technology of transport systems represented by AGVs (Automated Guided Vehicles), for example.

For example, in a transport system that transports an item, a work instruction sheet 810 for the information processing system 12 with a color code image 811 added to the item is pasted on the item, and the item being transported is photographed by the camera 18. It is possible to manage the work process of the goods being transported. In addition, since the position of the conveying device that is conveying the article and the destination of the article can be specified, the conveying system can also control the movement of the conveying device that conveys the article.

[Fourth embodiment]
Although the first and second embodiments described above deal with job process management in a printing factory, they can also be applied to, for example, work process management of articles flowing on a belt conveyor. For example, if the technology of the present embodiment is applied to the management of work processes for articles flowing on a belt conveyor, it will be possible to track the articles flowing on the belt conveyor and control branching of the belt conveyor.

The invention is not limited to the specifically disclosed embodiments above, but various modifications and changes are possible without departing from the scope of the claims. The job ID is an example of the first identification information described in the claims. A color code image is an example of the second identification information. The job ID detection unit 32 is an example of detection means.

The color code image generation unit 36 is an example of generation means. The color-coded work instruction sheet creating unit 38 is an example of creating means. The job management unit 34 is an example of management means. The camera 18 is an example of imaging means. The color code recognition section 44 is an example of recognition means.

1 job management system 10 customer system 12 information processing system 14 work process management system 16 printer 18, 18a, 18b camera 20 network 30 UI section 32 job ID detection section 34 job management section 36 color code image generation section 38, 60 with color code Work instruction sheet creation unit 40, 62 Print instruction unit 42 Photographed image acquisition unit 44 Color code recognition unit 46 Color code management table storage unit 48 Job management table storage unit 800 Work instruction sheet for customer system 801 Barcode image 810 Information processing system 811 Color code image 1000 Job status list screen 1010 Job detailed history screen 1020 Screen for displaying captured images and captured moving images 1030 Job map display screen

Japanese Patent Application Laid-Open No. 2005-100298

Claims (13)

detection means for detecting first identification information used to identify one or more jobs in an existing system;
generating means for generating second identification information associated with the first identification information;
creating means for creating a slip on which the first identification information and the second identification information are displayed;
management means for managing progress information of the work process of the job based on recognition of the second identification information displayed on the slip;
An information processing system having one or more photographing means for photographing the slip;
recognition means for recognizing the second identification information from the photographed image of the slip;
further having
The management means progresses the work process of the job based on the work process corresponding to the photographing means that photographed the slip and the second identification information recognized from the photographed image of the slip. 2. The information processing system according to claim 1, wherein information is managed. 3. An information processing system according to claim 2, wherein said photographing means is installed at a location associated with one or more work steps of said job. 4. The information according to claim 2, wherein said generating means generates a color code image of the second identification information in which values are expressed using color transitions between adjacently connected cells. processing system. The creation means adds the second identification information to a slip for an existing system on which the first identification information created by the existing system is displayed, so that the first identification information and the second identification information are displayed. 5. The information processing system according to any one of claims 1 to 4, wherein said slip is created on which the identification information of is displayed. 6. The information processing system according to claim 5, wherein said detection means detects said first identification information from a slip for said existing system. The creation means determines the direction of the barcode image of the first identification information displayed on the slip for the existing system, and the detection means can detect the barcode image of the first identification information. 7. The information processing system according to claim 5, wherein the slip image for the existing system is scaled down in the direction to provide an area for adding the color code image of the second identification information. The management means updates the work process of the job corresponding to the second identification information of the slip when the slip is photographed by the photographing means corresponding to the work process, thereby enabling the progress of the job. manage information,
The information processing system according to any one of claims 1 to 7. 9. The information processing system according to claim 1, wherein said slip is a work instruction for said job. 10. The information processing system according to any one of claims 1 to 9, wherein the job is a job for producing printed matter in a printing factory. 11. The information processing system according to any one of claims 2 to 10, wherein said photographing means is a camera installed so as to photograph said slip from above. a detecting step of detecting a first identification that is used to identify one or more jobs in an existing system;
a generating step of generating second identification information associated with the first identification information;
a creation step of creating a slip on which the first identification information and the second identification information are displayed;
a management step of managing progress information of the work process of the job based on recognition of the second identification information displayed on the slip;
in an information processing system. the computer,
detecting means for detecting first identification information used to identify one or more jobs in an existing system;
generating means for generating second identification information associated with the first identification information;
creation means for creating a slip on which the first identification information and the second identification information are displayed;
management means for managing progress information of the work process of the job based on recognition of the second identification information displayed on the slip;
A program to function as

Images