JP2023139093A - Information processing system, progress management method and program - Google Patents

Abstract

To provide an information processing system that is easy for a user to check information about progress of a plurality of jobs each of which is composed of a plurality of work processes.SOLUTION: The problem can be solved by an information processing system that manages progress of a job composed of a plurality of work processes and provides a user with information about progress of the jobs. This system comprises: photographing means that, in each of places associated with work processes, photographs a slip on which a code image associated with a job is displayed; recognizing means that recognizes a job from the code image on the slip photographed by the imaging means; managing means that, based on the work process associated with the place where the slip was photographed and based on the job recognized by the recognition means, manages and associates information about progress of the job and photographic data obtained by photographing the slip; and provision means that provides user with information about progress of a plurality of jobs and photographic data obtained by photographing the slip.SELECTED DRAWING: Figure 5

Description

The present invention relates to an information processing system, a progress management method, and a program.

2. Description of the Related Art It has been conventional practice to manage the progress of a job consisting of a plurality of work steps by using barcodes or the like printed on work instructions.

In addition, by attaching RFID tags to the objects to be worked on with workers (materials, work-in-progress, products, etc. at the factory), and reading the RFID tags at the entrance gate at the entrance of the processing plant and the exit gate at the exit of the processing plant, the work can be done easily. 2. Description of the Related Art Systems for managing the working hours of people and the flow of objects to be worked on (entering and leaving the workplace) have been known (for example, see Patent Document 1).

Conventional existing systems that manage the progress of jobs consisting of multiple work steps by using barcodes printed on work instructions, etc. have had the problem that it is difficult for users to check the progress of each job.

The embodiments of the present invention have been developed in view of the above points, and an object of the present invention is to provide an information processing system that allows a user to easily check information regarding the progress of a plurality of jobs consisting of a plurality of work steps.

In order to achieve the above object, claim 1 of the present application provides an information processing system that manages the progress of a job consisting of a plurality of work steps and provides a user with information regarding the progress of the job, a photographing means for photographing a slip on which a code image associated with the job is displayed at each location; and a recognition means for recognizing the job from the code image of the slip photographed by the photographing means; Based on the work process associated with the location where the voucher was photographed and the job recognized by the recognition means, information regarding the progress of the job and photographic data when photographing the voucher are managed in association with each other. and providing means for providing a user with information regarding the progress of the plurality of jobs and photographic data when photographing the slip.

According to the embodiments of the present invention, it is possible to provide an information processing system in which a user can easily check information regarding the progress of a plurality of jobs consisting of a plurality of work steps.

FIG. 1 is a configuration diagram of an example of a job management system according to the present embodiment. FIG. 2 is an image diagram of an example of a work instruction document used in the job management system according to the present embodiment. FIG. 1 is a hardware configuration diagram of an example of a computer. FIG. 1 is a functional configuration diagram of an example of a work process management system. FIG. 2 is an image diagram showing an example of a job process in a printing factory. 12 is a flowchart of an example of a process for creating a color-coded work instruction sheet. 3 is a flowchart of an example of a process for generating a color code image. FIG. 2 is a diagram for explaining encoding rules that can express ternary numbers. FIG. 3 is a diagram showing an example of information to be encoded into an optical symbol. FIG. 7 is a diagram showing an example of an optical symbol when the number of colors assigned to each cell of the optical symbol is four. FIG. 3 is a diagram illustrating a processing image for creating a color-coded work instruction sheet. 12 is a flowchart of an example of a process for reducing an image including a barcode image. It is an image diagram of an example of a barcode image. FIG. 3 is an image diagram of an example of a barcode image before being reduced in the vertical direction. FIG. 3 is an image diagram of an example of a barcode image after being reduced in the vertical direction. It is an image diagram of an example of a barcode image before being reduced in the horizontal direction. FIG. 7 is an image diagram of an example of a barcode image after being reduced in the horizontal direction. FIG. 6 is an explanatory diagram of an example of a change count confirmation process. It is an image diagram of an example of a barcode image. FIG. 6 is an explanatory diagram of an example of a change count confirmation process. 12 is a flowchart of an example of job status update processing when passing through a gate. 12 is a flowchart of an example of job status update processing when storing in a temporary storage location. It is a transition diagram of an example of a UI screen displayed by the work process management system. FIG. 3 is an explanatory diagram of an example of grouping processing on a UI screen. FIG. 3 is an explanatory diagram of an example of search condition specification processing on a UI screen. It is an image diagram of an example of a map display screen of a temporary storage location. FIG. 2 is an explanatory diagram of an example in which progress information of one or more work steps is expressed using markers. FIG. 3 is an explanatory diagram of an example showing how to switch between a job status list screen and a dashboard display screen. It is an image diagram of an example of a dashboard display screen. FIG. 3 is an explanatory diagram of an example of a marker. It is an image diagram of an example of a flow line display screen. It is a functional block diagram of another example of a work process management system.

Embodiments of the present invention will be described below with reference to the drawings. In this embodiment, a job management system that realizes the management of job work processes in a printing factory using a function (work instruction function) using a work instruction sheet (slip) will be described as an example.

[First embodiment]
<System configuration>
FIG. 1 is a configuration diagram of an example of a job management system according to this embodiment. FIG. 2 is an image diagram of an example of a work instruction document used in the job management system according to the present embodiment. In the job management system 1 of FIG. 1, a customer system 10, a work process management system 14, a printer 16, and one or more cameras 18 are connected to enable data communication via a network 20 such as the Internet or a LAN.

The customer system 10 is an example of an existing system used by the customer, and a work instruction sheet 800 for the customer system 10 shown in FIG. 2(A) in which the job ID is displayed is created. The job ID is an example of identification information that identifies a job. Further, in the work instruction sheet 800 for the customer system 10, at least one barcode image 801 used on the customer system 10 side is displayed.

Note that the job ID may be displayed in the work instruction sheet 800 for the customer system 10 as a barcode image 801 or as text. Customer system 10 provides existing functionality to the user that is implemented by work instructions 800 for customer system 10 .

The work process management system 14, the printer 16, and one or more cameras 18 constitute an information processing system 12 that adds new functionality to the work instructions 800. The work process management system 14 uses the work instruction sheet 810 for the information processing system 12 to which the color code image 811 shown in FIG. to manage. Note that the information processing system 12 can identify the job ID from the color code image 811 as described later.

Printer 16 prints work instructions 810 for information handling system 12 . The camera 18 is installed so as to be able to photograph a location associated with a job process within the printing factory. Note that the locations associated with the work steps of a job include places through which printed matter passes during movement between work steps, temporary storage locations where printed matter is temporarily stored, and the like.

The camera 18 can be a PTZ camera or an IP camera. The PTZ camera is a camera that can operate a PTZ (Pan Tilt Zoom) function via the network 20, and is a camera that can transmit captured images and captured videos via the network 20. The IP camera is a camera that can be operated via the network 20 and is a camera that can transmit captured images and captured videos via the network 20. The photographed images and photographed videos taken by the camera 18 are transmitted to the work process management system 14 via the network 20.

In the information processing system 12 that adds a new function to the work instruction 800, the work instruction 810 for the information processing system 12 is added to a printed matter that is an example of an intermediate product or material of the job corresponding to the work instruction 810. It will be pasted. The work instruction sheet 810 is pasted onto a printed matter that is likely to be photographed by the camera 18, for example.

The work process management system 14 tracks the progress of the job process based on the job process corresponding to the camera 18 that captured the work instruction sheet 810 and the job ID specified from the color code image 811 of the work instruction sheet 810. (job status). Further, the work process management system 14 manages the history of the work process of the job, and captured images and captured videos showing the state when the work instruction sheet 810 was photographed.

Note that the configuration of the job management system 1 shown in FIG. 1 is an example. For example, the job management system 1 may include other systems, or the work process management system 14 may have a different name. The work process management system 14 may be implemented in a single server environment or in a multiple server environment.

<Hardware configuration>
The customer system 10 and the work process management system 14 are realized, for example, by a computer 500 having a hardware configuration shown in FIG.

FIG. 3 is a hardware configuration diagram of an example of a computer. The computer 500 in FIG. 3 includes an input device 501, a display device 502, an external I/F 503, a RAM 504, a ROM 505, a CPU 506, a communication I/F 507, an HDD 508, and the like, each of which is interconnected via a bus B. Note that the input device 501 and the display device 502 may be connected and used when necessary.

The input device 501 includes a keyboard, a mouse, a touch panel, etc., and is used by the user to input various operation signals. The display device 502 includes a display and the like, and displays the results of processing by the computer 500.

Communication I/F 507 is an interface that connects computer 500 to various networks. Thereby, the computer 500 can perform data communication via the communication I/F 507.

Furthermore, the HDD 508 is an example of a nonvolatile storage device that stores programs and data. The stored programs and data include an OS, which is basic software that controls the entire computer 500, and application software (hereinafter simply referred to as an application) that provides various functions on the OS. Note that, instead of the HDD 508, the computer 500 may use a drive device (for example, a solid state drive: SSD) that uses a flash memory as a storage medium.

External I/F 503 is an interface with an external device. The external device includes a recording medium 503a and the like. Thereby, the computer 500 can read and/or write to the recording medium 503a via the external I/F 503. The recording medium 503a includes a flexible disk, CD, DVD, SD memory card, USB memory, and the like.

The ROM 505 is an example of a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 505 stores programs and data such as the BIOS, OS settings, and network settings that are executed when the computer 500 is started. The RAM 504 is an example of a volatile semiconductor memory (storage device) that temporarily holds programs and data.

The CPU 506 is an arithmetic unit that implements control and functions of the entire computer 500 by reading programs and data from a storage device such as the ROM 505 and the HDD 508 onto the RAM 504 and executing processing. The customer system 10 and the work process management system 14 can implement various types of processing, which will be described later, by using the hardware configuration of a computer 500 as shown in FIG. 3, for example. Note that a description of the hardware configurations of the printer 16 and camera 18 will be omitted.

<Software configuration>
FIG. 4 is a functional configuration diagram of an example of a work process management system. Note that in the functional configuration of FIG. 4, configurations unnecessary for the description of this embodiment are omitted as appropriate. The work process management system 14 in FIG. 4 includes a UI section 30, a job ID detection section 32, a job management section 34, a color code image generation section 36, a color coded work instruction creation section 38, a print instruction section 40, and a captured image acquisition section. 42, a color code recognition section 44, a color code management table storage section 46, and a job management table storage section 48.

The UI unit 30 controls the display of various screens such as a screen for accepting various necessary settings from the user, a job status list screen (described later), a job detail history screen, a dashboard display screen, and a flow line display screen. The job ID detection unit 32 detects, for example, a job ID displayed in a barcode image 801 or text in the work instruction sheet 800 for the customer system 10 in FIG. 2(A).

The job management unit 34 stores and manages available color code IDs in a color code management table storage unit 46. The job management unit 34 maximizes the size of the color code image 811 by limiting the number of available color code IDs and narrowing the range of values necessary to express the color code ID, and maximizes the size of the color code image 811, which will be described later. making it easy to recognize.

If no unused color code ID remains in the color code management table storage unit 46, the job management unit 34 selects and reuses the last updated color code ID from the color code management table storage unit 46. The job management unit 34 associates the job ID detected by the job ID detection unit 32 with the selected color code ID and manages them in the color code management table storage unit 46.

Further, the job management section 34 stores and manages job information corresponding to the job ID and color code ID in the job management table storage section 48 . Note that the job management table storage unit 48 manages progress information and history information of the work process of the job, photographed image files and photographed video files representing the state when the work instruction sheet 810 was photographed, and displays the job status list screen described later. Used to display etc.

The color code image generation unit 36 generates a color code image 811, which will be described later, from the color code ID provided by the job management unit 34. The color-coded work instruction creation unit 38 creates a work instruction 800 for the customer system 10 in FIG. 2(A) to a work instruction 810 for the information processing system 12 to which the color code image 811 in FIG. 2(B) has been assigned. Create. The print instruction unit 40 instructs the printer 16 to print the work instruction sheet 810 for the information processing system 12 to which the color code image 811 shown in FIG. 2(B) is attached.

The photographed image acquisition unit 42 acquires photographed images and photographed videos from the camera 18. The color code recognition unit 44 decodes the color code ID from the color code image 811 shown in the photographed image or photographed video. The color code recognition unit 44 provides the job management unit 34 with, for example, identification information that identifies the camera 18 that captured the color code image 811 or the work process of the job, and the decoded color code ID. The job management section 34 refers to the job management table storage section 48 and specifies the job ID corresponding to the decoded color code ID.

As a result, the job management section 34 manages the job in the job management table storage section 48 based on the work process of the job corresponding to the camera 18 that captured the color code image 811 and the job ID corresponding to the decoded color code ID. You can update the progress information (job status) of the job's work process.

<Processing>
FIG. 5 is an image diagram showing an example of a job process in a printing factory. The work process in FIG. 5 includes "printing", "cutting", "folding", "binding", "inspection", "temporary storage 1", and "temporary storage 2". The camera 18a is installed at a gate in front of a place where the work steps of "printing", "cutting", "folding", "binding", and "inspection" are performed. Furthermore, the camera 18b is installed at a location where the work processes "temporary storage 1" and "temporary storage 2" are performed.

The work instruction sheet 810 for the information processing system 12 is photographed by the camera 18a or the camera 18b while being moved between work processes or while being stored in a temporary storage location. Note that, as shown in FIG. 5, movement between work processes in a printing factory is not constant, and depending on the job, work instructions 810 for the information processing system 12 may not be photographed, and there may be work processes that are not detected or recorded. be. FIG. 5 shows arrows representing movement of a job that performs all work steps, and arrows representing movement of a job that skips a part of the work steps.

In FIG. 5, after a printed matter is output in the work process "print", a work instruction sheet 810 is pasted on the printed matter. As a result, in the example of FIG. 5, the work instruction sheet 810 pasted on the printed material is photographed by the camera 18a or the camera 18b while the printed material is passing through the gate or while it is being stored in a temporary storage location.

《Creation of color-coded work instructions》
FIG. 6 is a flowchart of an example of a process for creating a color-coded work instruction sheet. In step S11, the job ID detection unit 32 of the work process management system 14 detects the job ID displayed in the barcode image 801 or text in the work instruction sheet 800 for the customer system 10. Note that the detection frame for detecting the job ID from the work instruction document 800 may be set in advance by the operator, or may be set automatically using OCR or the like.

Proceeding to step S12, the job management unit 34 selects a color code ID to be used from the color code management table storage unit 46, and manages the selected color code ID and the job ID detected by the job ID detection unit 32 in association with each other. .

Proceeding to step S13, the color code image generation unit 36 generates a color code image 811 according to the procedure shown in FIG. 7 from the color code ID associated with the job ID. Note that the procedure shown in FIG. 7 uses a technique described in, for example, Japanese Patent Application Publication No. 2017-199306.

FIG. 7 is a flowchart of an example of a process for generating a color code image. The color code image generation unit 36 receives an input of a color code ID to be color coded in step S21. Proceeding to step S22, the color code image generation unit 36 decomposes the character string of the color code ID into values of each digit. Proceeding to step S23, the color code image generation unit 36 converts the decomposed values of each digit into values corresponding to the number of colors to be assigned to each cell of the optical symbol described in JP-A-2017-199306. For example, if the number of colors assigned to each cell is four, the color code image generation unit 36 converts the value of each digit into a ternary value according to a coding rule as shown in FIG. 8, for example.

FIG. 8 is a diagram for explaining encoding rules that can express ternary numbers. FIG. 8 shows an example of the encoding rule when using four colors: R (red), G (green), B (blue), and K (black). When using four colors, it is possible to express in three values, that is, in ternary numbers.

For example, as illustrated in FIG. 8(a), each transition clockwise, that is, from R color to K color, from K color to B color, from B color to G color, and from G color to R color, has a value of "0". ” is expressed. Furthermore, each transition in the counterclockwise direction, that is, from R color to G color, from G color to B color, from B color to K color, and from K color to R color, represents the value "1". Further, the diagonal lines, that is, the bidirectional transition between R and B colors and the bidirectional transition between K and G colors each represent the value "2".

For example, as shown in FIG. 8(b), in a cell row in which cells of G color, R color, B color, K color, and G color are sequentially connected, each cell is connected from left to right in the figure. Consider the case of looking at the color transition of a cell. In this case, the transition from G color to R color represents the value "0", the transition from R color to B color represents the value "2", and the transition from B color to K color represents the value "1". The transition from K color to G color represents the value "2". Therefore, the array in FIG. 8(b) represents the value "3d2120", that is, the decimal value "69". Note that in the notation of the value, the leading "3d" indicates that the following number is a value in ternary notation.

The encoding rule using color transitions of four colors is not limited to the example shown in FIG. 8(a), and may be, for example, the example shown in FIG. 8(d). FIG. 8(e) shows an example of a conversion table that associates color transitions and values according to the encoding rule shown in FIG. 8(d). In FIG. 8E, for example, if the color of the transition source cell is R and the value "2" is to be expressed, the color of the transition destination cell adjacent to the transition source cell is set to B color. Similarly, if the color of the transition source cell is K and the value "1" is to be expressed, the color of the transition destination cell is set to G.

Following step S23 in FIG. 7, the process proceeds to step S24, where the color code image generation unit 36 uses the color of the transition source cell, the ternary value converted in step S23, and the like shown in FIG. 8(a). A color is assigned to each cell of the optical symbol according to the conversion table of the encoding rule. It is assumed that the color code image generation unit 36 stores in advance the color arrangement of each cell in the cell column of the main code of the optical symbol.

A more specific example in which the number of colors assigned to each cell of an optical symbol is four will be described with reference to FIGS. 9 and 10. FIG. 9 is a diagram showing an example of information to be encoded into an optical symbol. FIG. 10 is a diagram showing an example of an optical symbol when the number of colors assigned to each cell of the optical symbol is four.

In FIG. 9, each cell string of the sub code section 301 connected to each cell "d1", "d2", "d3", and "d4" of the main code section 300 has the values "3d1", "3d1", and "3d0". and “3d1”.

FIG. 10 shows an example of an optical symbol obtained by encoding the information illustrated in FIG. 9 according to the encoding rule explained using FIG. 8. In this example, the cell row of the main code section 300 includes an even number of cells, and is configured such that K and R colors are alternately arranged, with the leading cell being K color.

Further, the sub code section 301 is assigned a cell color, for example, in the leftmost cell, with the K color of the cell of the main code section 300 to which the cell is connected as the first transition source color. In the example of FIG. 10, the conversion table of the encoding rule of FIG. 8(a) is referred to according to the K color of the cell of the main code part 300, which is the transition source cell, and the value "3d1" of the cell of the sub code part 301. The R color is assigned to the cell of the leftmost sub-code section 301 of the optical symbol.

Proceeding to step S14 following step S13 in FIG. 6, the color-coded work instruction creation unit 38 creates a work instruction 810 for the information processing system 12 using the color code image 811 created in step S13.

FIG. 11 is a diagram showing a processing image for creating a color-coded work instruction sheet. The paper size and layout frame may be set in advance by the operator. The work instruction document 800 for the customer system 10 in FIG. 2A is scaled down to create an empty space. A work instruction sheet 810 for the information processing system 12 in FIG. 2(B) is obtained by pasting a color code image 811 in an empty space generated by scaling down the work instruction sheet 800 for the customer system 10. .

Note that the work instruction sheet 800 for the customer system 10 in FIG. 2(A) displays at least one barcode image 801 used on the customer system 10 side. Therefore, if the work instruction sheet 800 for the customer system 10 is simply reduced, the barcode image 801 may no longer function (become unrecognizable).

Therefore, in order to create a free space without impairing the function of the barcode image 801, the color-coded work instruction creation unit 38 checks the direction of the barcode image 801 using the procedure shown in FIG. Perform scaling and reduction in a direction that does not impair functionality.

FIG. 12 is a flowchart of an example of a process for reducing an image including a barcode image. In step S31, the color-coded work instruction creation unit 38 cuts out the position of the barcode image 801 of the work instruction 800 for the customer system 10 shown in FIG. 2(A). Proceeding to step S32, the color-coded work instruction creation unit 38 determines whether the extracted barcode image as shown in FIG. 13 is a Bk (monochrome) image or an RGB image. FIG. 13 is an image diagram of an example of a barcode image.

If it is not a Bk (monochrome) image, the color-coded work instruction creation unit 38 proceeds to step S33, converts the RGB image to a Lab image or a Luv image, and after conversion, creates a monochrome image in which only the L component is extracted. , proceed to step S34. If the image is a monochrome image, the color-coded work instruction creation unit 38 skips step S33 and proceeds to step S34.

In step S34, the color-coded work instruction creation unit 38 raster-scans all pixels in the barcode image of FIG. 13. Here, the pixel position (x, y) is a position according to the X direction and Y direction displayed in FIG. 13. The color-coded work instruction creation unit 38 integrates the values of pixels having the same pixel position x, that is, the values of the pixels in the Y direction.

Further, the process proceeds to step S35, and the color-coded work instruction sheet creation unit 38 integrates all pixels. The color-coded work instruction creation unit 38 calculates an average value by dividing the value obtained by integrating all pixels by the total number of pixels.

Proceeding to step S36, the color-coded work instruction creation unit 38 compares the integrated value of the pixels having the same pixel position x determined in step S34 with the average value determined in step S35, as shown in FIG. Check the number of changes. FIG. 18 is an explanatory diagram of an example of the change count confirmation process. For example, the color-coded work instruction creation unit 38 calculates the number of changes that is the sum of the number of changes from an integrated value higher than the average value to an integrated value lower than the average value, and the number of changes from an integrated value lower than the average value to an integrated value higher than the average value. Check.

Proceeding to step S37, the color-coded work instruction creation unit 38 determines whether the number of changes confirmed in step S36 is 24 or more. If the number of changes is 24 or more, the process advances to step S38, and the color-coded work instruction creation unit 38 changes the barcode image in FIG. 14 to a vertically reduced size like the barcode image in FIG. 15, for example. Perform doubling down. FIG. 14 is an image diagram of an example of a barcode image before being reduced in the vertical direction. FIG. 15 is an image diagram of an example of a barcode image after being reduced in the vertical direction.

For example, when the barcode image shown in FIG. 13 is reduced in the X direction, the black lines become closer together, making it difficult to distinguish between black and white. On the other hand, even if the barcode image shown in FIG. 13 is reduced in the Y direction, the interval between the black lines does not change, so there is no effect on black and white discrimination.

On the other hand, if the number of changes is not 24 or more, the process proceeds to step S39, and the color-coded work instruction creation unit 38 reduces the barcode image in FIG. 16 in the horizontal direction, for example, as in the barcode image in FIG. Performs scaling and reduction.

The processing in the flowchart of FIG. 12 determines the direction of the barcode image based on the following idea. For example, in the case of a vertical barcode as shown in FIG. 13, since the black line has a width, a change from a white line to a black line and a change from a black line to a white line occur as a set. The number of changes varies depending on the number of digits displayed in the barcode, but when we investigated common barcodes, we found that if the number of changes is 24 or more, it can be determined that it is a vertical barcode as shown in FIG.

Similarly, in the case of a horizontal barcode as shown in FIG. 19, the color-coded work instruction creation unit 38 checks the number of changes as shown in FIG. 20 in step S36. FIG. 19 is an image diagram of an example of a barcode image. FIG. 20 is an explanatory diagram of an example of the change count confirmation process.

In the case of FIG. 20, the total number of changes from an integrated value higher than the average value to an integrated value lower than the average value and the number of changes from an integrated value lower than the average value to an integrated value higher than the average value is extremely small, so for example Even if information other than the barcode image is integrated, the number of changes will not exceed 24 times. Therefore, if the number of changes is 24 or more, it can be determined that the barcode is in the horizontal direction as shown in FIG.

Note that instead of the above-described method of determining the direction of the barcode image, the direction of the barcode image can also be determined using Fourier transform, Hough transform, which is one of the feature extraction methods, or the like. However, recent printers perform halftone processing. Particularly in electrophotographic printers, line dithering may be used.

When Hough transform is used, line segment components in an image can be extracted. Even though the line segment components of barcodes are dominant, it is difficult to eliminate the effects of halftone processing, especially line dithering. In order to reduce the influence of line dither, the position of the barcode image 801 must be specified precisely in step S31. Similarly, when Fourier transform is used, the problem is whether the influence of halftone processing around the barcode can be strictly eliminated.

On the other hand, in the method of determining the direction of a barcode image according to the present embodiment, even if a dithered line image or some kind of text or image is included in the vicinity of the barcode image cut out in step S31, it is counted as the number of changes. There is nothing wrong with this, and it is not a problem.

In this way, the work process management system 14 of this embodiment creates an empty space by scaling down the barcode image 801 in a direction that does not impair its functions, and fills that empty space with a color code image that can be read remotely. 811 can be added. Even if the work instruction sheet 800 for the customer system 10 is scaled and reduced, the function of the barcode image 801 is not impaired, and the function of the color code image 811 is changed to information while the function of the work instruction sheet 800 for the customer system 10 remains. Work instructions 810 for processing system 12 may be added.

Proceeding to step S15 following step S14 in FIG. 6, the print instruction unit 40 prints a work instruction sheet 810 for the information processing system 12 to which the color code image 811 created in step S14 has been added (color coded work instruction sheet). The printer 16 is instructed to print. The printer 16 prints a work instruction sheet 810 for the information processing system 12 to which a color code image 811 as shown in FIG.

《Job status update when passing through the gate》
In the job management system 1 according to the present embodiment, the job status of the job management table storage unit 48 is changed to the following by photographing the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is attached by the camera 18a. will be updated as follows.

FIG. 21 is a flowchart of an example of job status update processing when passing through a gate. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image or photographed video from the camera 18a, the process proceeds to step S52.

In step S52, the color code recognition unit 44 attempts to cut out the color code image 811 from the photographed image or photographed video acquired by the photographed image acquisition unit 42. Proceeding to step S53, the color code recognition unit 44 performs recognition processing of the color code image 811 in accordance with the procedure described in, for example, Japanese Patent Application Publication No. 2017-199306.

When the color code image 811 is recognized, the color code recognition unit 44 detects the image of each cell from the color code image 811. Proceeding to step S54, the color code recognition unit 44 recognizes the color information of each cell detected in step S53 and the connection information of each cell as symbol information. The color code recognition unit 44 proceeds to step S54 and restores the color code ID encoded in the color code image 811 by decoding the symbol information according to the encoding rule shown in FIG. 8(A), for example.

Proceeding to step S55, the color code recognition unit 44 provides the job management unit 34 with, for example, the identification information of the camera 18a that captured the color code image 811 and the color code ID restored by decoding. The job management section 34 refers to the job management table storage section 48 and identifies the job ID corresponding to the color code ID.

Then, the job management unit 34 manages the information in the job management table storage unit 48 based on, for example, the identification information of the camera 18a that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811. You can update the job status from "not detected" to "current process" or "passed".

《Updating job status when storing to temporary storage location》
In the job management system 1 according to the present embodiment, the job status of the job management table storage unit 48 is set as follows by photographing the work instruction sheet 810 for the information processing system 12 to which the color code image 811 is attached by the camera 18b. will be updated as follows.

FIG. 22 is a flowchart of an example of job status update processing when storing in a temporary storage location. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image from the camera 18b, the process proceeds to step S62.

In step S62, the color code recognition unit 44 attempts to cut out the color code image 811 from the photographed image or photographed video acquired by the photographed image acquisition unit 42. Proceeding to step S63, the color code recognition unit 44 performs recognition processing of the color code image 811 in accordance with the procedure described in, for example, Japanese Patent Application Publication No. 2017-199306.

If the color code image 811 is recognized in step S63, the color code recognition unit 44 proceeds from step S64 to S65, and decodes the symbol information recognized from the color code image 811, thereby decoding the symbol information into the color code image 811. Restore the color code ID that was previously used.

Proceeding to step S66, the color code recognition unit 44 provides the job management unit 34 with, for example, the identification information of the camera 18b that captured the color code image 811 and the color code ID restored by decoding. The job management section 34 refers to the job management table storage section 48 and identifies the job ID corresponding to the color code ID.

Then, based on the identification information of the camera 18b that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811, the job management unit 34 determines that the job status of the job ID remains unchanged. It is determined whether a predetermined period of time has elapsed.

If the predetermined time has not passed without any change in the job status, the job management unit 34 proceeds to step S70. In step S70, the job management section 34 can update the job status managed in the job management table storage section 48 from "undetected" to "current process." If a predetermined period of time has elapsed without any change in the job status, the job management unit 34 performs processing to display a retention alert on a job detailed history screen, which will be described later, and then proceeds to step S70. In step S70, the job management section 34 can update the job status managed in the job management table storage section 48 from "current process" to "alert" or the like.

If the color code image 811 is not recognized in step S63, the color code recognition unit 44 proceeds from step S64 to S68, and if the color code image 811 cannot be recognized from the captured image from the camera 18b installed in the temporary storage location. The job status performs processing to update the job ID that is supposed to be stored in the temporary storage location.

The color code recognition unit 44 provides identification information of the camera 18b to the job management unit 34, for example. The job management unit 34 selects a job whose color code image 811 has not been recognized from the captured images for a predetermined number of consecutive times among the job IDs whose job status of the temporary storage location corresponding to the provided identification information of the camera 18b is "current process". Determine whether or not there is an ID.

If there is a job ID for which the color code image 811 has not been recognized from the captured images for a predetermined number of consecutive times among the job IDs whose temporary storage location job status is "current process", the job management unit 34 proceeds to step S69 and The color code ID associated with the job ID is set to Null, and the process advances to step S70. In step S70, the job management section 34 can update the job status managed in the job management table storage section 48 from "current process" to "passed" or the like.

Furthermore, there is a possibility that the work instruction sheet 810 for the information processing system 12 is stored in a state where it cannot be photographed by the camera 18b, such as because printed materials are piled up in the temporary storage location. Considering this point, the job management unit 34 selects a job ID whose color code image 811 has not been recognized from the captured images for a predetermined number of consecutive times among the job IDs whose job status is "current process" in the temporary storage location. Step S69 is skipped and the process proceeds to step S70. In step S70, the job management section 34 can update the job status managed in the job management table storage section 48 from "current process" to "stacking".

According to the process shown in the flowcharts of FIGS. 21 and 22, the job status of the printed matter to which the work instruction 810 for the information processing system 12 has been affixed is automatically updated, so that the work instruction 810 for the information processing system 12 has been affixed. Printed materials can be tracked.

《Job inquiry》
The operator of the job management system 1 uses various UI screens provided by the work process management system 14 to display progress information and history information of the work process of the job at the printing factory, a photographed image file showing the situation when the work instruction sheet 810 was photographed, etc. You can inquire about captured video files, etc.

FIG. 23 is a transition diagram of an example of a UI screen displayed by the work process management system. The UI unit 30 of the work process management system 14 displays, for example, a job status list screen 1000 on the display device 502. The job status list screen 1000 displays a list of job information including job ID, color code ID, job name, last updated data, and progress information of one or more work steps.

The progress information of one or more work steps indicates whether the progress of the work step is "undetected," "passed," "current process," "alert," or "accumulated." The progress of a work process "not detected" indicates that the work instruction sheet 810 for the information processing system 12 has not been photographed by the camera 18 corresponding to the work process. The progress of a work process "passed" indicates that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to the work process before the final update.

Further, the progress of the work process "current process" indicates that the work instruction sheet 810 for the information processing system 12 was photographed in the last update with the camera 18 corresponding to the work process. The work process progress “alert” indicates that an alert such as a stay alert is occurring. The progress of a work process "stacking" means that the work instruction sheet 810 for the information processing system 12 is photographed by the camera 18 corresponding to the work process before the final update, and also corresponds to that work process and other work processes. This indicates that the camera 18 has not photographed the work instruction document 810 for the information processing system 12 in the last update. The progress of the work process "stacked" indicates a state in which it is expected that the printed matter to which the work instruction sheet 810 is attached cannot be photographed by the camera 18 due to stacking or the like.

Note that a lock mark 1002 on the job status list screen 1000 indicates that, for example, a color code ID associated with a long-term storage job is locked so that it is not automatically released. In this way, the work process management system 14 provides the operator with a locking feature that prevents the color code ID from being reused.

The operator can display a job detail history screen 1010 by selecting one job from the job status list screen 1000. The job details history screen 1010 displays buttons for transitioning to a screen displaying the start date and time, completion date and time, and photographed images and photographed videos for each work process. Note that when the work process is "temporary storage 1" or "temporary storage 2", an address representing the storage area in the temporary storage location is also displayed on the job details history screen 1010. Further, the job details history screen 1010 displays a "flow line display" button for transitioning to a flow line display screen 1050, which will be described later.

Furthermore, when a button on the job details history screen 1010 for transitioning to a screen 1020 that displays captured images and captured videos is pressed, the UI unit 30 transitions to a screen 1020 that displays captured images and captured videos. The screen 1020 for displaying photographed images and photographed videos displays a photographed image file and a photographed video file representing the situation when the work instruction sheet 810 was photographed when the playback button is pressed.

Note that when the button for transitioning to the map display screen 1030 of the job corresponding to the work process "temporary storage 1" or "temporary storage 2" is pressed, the UI unit 30 transitions to the map display screen 1030 shown in FIG. 26. do. FIG. 26 is an image diagram of an example of a temporary storage location map display screen. For example, the UI unit 30 displays a photographed image of a temporary storage location in the background, and then displays the storage area where the printed matter is stored so that it can be identified with a mark "●" or the like.

Note that the job status list screen 1000 in FIG. 23 may be displayed by grouping as shown in FIG. 24, or may accept specification of search conditions as shown in FIG.

FIG. 24 is an explanatory diagram of an example of grouping processing on the UI screen. FIG. 24(A) is an example of a job status list screen 1000 before grouping processing. 24(B) and 24(C) show that the progress information of one or more work processes on the job status list screen 1000 after grouping processing is grouped into "1st floor area" and "2nd floor area" and visually displayed. This is an example that is easy to understand.

In FIG. 24(C), the grouped “first floor areas” are displayed in a collapsed manner. When displaying the progress information of the grouped work processes in a collapsed manner, the AND (logical product) is displayed as progress information for that group. For example, the AND of the progress information of the work process included in the group is determined as "Alert>Current process>Stack>Passed>Not detected."

FIG. 25 is an explanatory diagram of an example of search condition specification processing on the UI screen. FIG. 25 is an example of a job status list screen 1000 with a search line. The search line is displayed, for example, by pressing the "Search" button on the job status list screen 1000. By specifying search conditions in the search line, the operator can search for jobs that match the search conditions. Note that the search line provided as shown in FIG. 25 has the effect of reducing screen transitions and improving immediacy and visibility. FIG. 25(A) is an example in which search conditions are input as text items (partial match) in the search line. FIG. 25(B) is an example in which search conditions are entered in the search line using date and time items (range specification). FIG. 25(C) is an example in which the search condition is selected from a pull-down menu using the work process item (match) in the search line. The pull-down selection may be made so that multiple selections can be made using a control key, for example. Furthermore, when the "clear conditions" button is pressed, the search conditions are cleared all at once and the display returns to all results.

Further, the progress information of one or more work steps on the job status list screen 1000 may be expressed by a marker as shown in FIG. 27, for example. In addition, in FIG. 27, the color of the marker is expressed in kanji. Time passes in the order of FIGS. 27(a) to 27(e). For example, in FIG. 27, the second work process whose progress was "current process" in FIG. 27(c) has become "stacking" in progress in FIG. 27(d).

The progress information of one or more work steps shown in FIG. 27(d) can be changed to one of the states shown on the right side of FIG. becomes.

Further, the operator can display the dashboard display screen 1040 by pressing the "dashboard" button from the job status list screen 1000. FIG. 28 is an explanatory diagram of an example showing how to switch between the job status list screen and the dashboard display screen. When the "dashboard" button is pressed while the job status list screen 1000 is accepting the designation of search conditions, the dashboard display screen 1040 takes over and displays the designation of the search conditions.

Further, the operator can display the job status list screen 1000 by pressing a "return to list" button from the dashboard display screen 1040. Note that the job status list screen 1000 may be displayed while inheriting the original search condition specification before transitioning to the dashboard display screen 1040.

FIG. 29 is an image diagram of an example of a dashboard display screen. The dashboard display screen 1040 displays information regarding the progress of a plurality of jobs using markers (an example of a display object) representing the locations of the jobs on the map and the number of jobs for each location. For example, in FIG. 29, the number of jobs and the number of alerts within the process category are shown for each of "process category A", "process category B", and "process category C".

The dashboard display screen 1040 in FIG. 29 may have process categories surrounded by frames and a factory map embedded as a background image. The location where the marker is displayed represents one or more work steps. Furthermore, the size of the marker represents the number of jobs in that work process. The color of a normal marker (for example, green) that does not include a job with an alert and the color of an alert marker (for example, red) that includes a job with an alert are displayed separately.

FIG. 30 is an explanatory diagram of an example of a marker. The marker in FIG. 30 is an example represented by a bubble (circle mark), and a designated work process is represented by a circle with five levels of size depending on the number of jobs. The parameters of the marker in FIG. 30 include the job number range, center coordinates, radius (size), and color (normal marker/alert marker). Note that the color of the normal marker may be different for each of the five levels.

According to the dashboard display screen 1040, the number of jobs accumulated in each work process and the work process including the job in which an alert has occurred can be visually displayed in an easy-to-understand manner.

Further, the operator can display the flow line display screen 1050 by pressing the "flow line display" button on the job detail history screen 1010. FIG. 31 is an image diagram of an example of the flow line display screen. The flow line display screen 1050 displays a flow line by connecting the job history with a curved line on a map based on the information regarding the job history displayed on the job detail history screen 1010. An example of a curve is a Bezier curve. A Bezier curve is an N-1 order curve obtained from N control points.

The flow line display screen 1050 in FIG. 31 displays points in the work process as circles. The circle is displayed by specifying the center coordinates, radius, color, and transparency. Work steps that the job has not passed are hidden. Further, on the flow line display screen 1050 in FIG. 31, the center coordinates of the work processes through which the job has passed are connected by a Bezier curve, so that the flow line of the job can be visually represented. On the flow line display screen 1050 in FIG. 31, by mousing over a circle, information such as the process name/passing time (all if there are multiple) of the work process corresponding to the circle may be displayed.

As described above, according to the work process management system 14 according to the present embodiment, it is possible to check the progress information of the work process of a job in a printing factory in a list. Further, according to the work process management system 14 according to the present embodiment, history information of the work process of a job in a printing factory, a photographed image file and a photographed video file representing the situation when the work instruction sheet 810 was photographed, and a dashboard display are displayed. The screen 1040, the flow line display screen 1050, etc. can be checked with simple operations.

[Second embodiment]
In the first embodiment, a work instruction sheet 810 for the information processing system 12 is created by the work process management system 14. In the second embodiment, a work instruction 810 for the information processing system 12 is created by the customer system 10. Note that the second embodiment is the same as the first embodiment except for some parts. Therefore, description of the same parts as in the first embodiment will be omitted as appropriate.

<System configuration>
FIG. 32 is a functional configuration diagram of another example of the work process management system. The work process management system 14a shown in FIG. 32 has the same configuration as the work process management system 14 shown in FIG. On the other hand, the customer system 10a has a color-coded work instruction creation section 60 and a print instruction section 62 added thereto.

In the job management system 1 according to the second embodiment, the process up to the generation of the color code image 811 is performed by the work process management system 14a as in the first embodiment, and steps S14 and S15 in FIG. This is performed by the attached work instruction creation section 60 and the print instruction section 62.

The job management system 1 according to the second embodiment can also obtain the same effects as the job management system 1 according to the first embodiment.

[Third embodiment]
The first and second embodiments described above are techniques realized by a work instruction sheet 810 for the information processing system 12 in which a new code (color code image 811) is added to the work instruction sheet 800 for the customer system 10. This technology can be applied, for example, to transport system technology represented by AGV (automated guided vehicle).

For example, in a conveyance system that conveys articles, a work instruction sheet 810 for the information processing system 12 to which a color code image 811 has been added is attached to the article, and the article being conveyed is photographed by the camera 18, so that the conveyance device can It is possible to manage the work process of goods being transported. Furthermore, since the position of the conveyance device that is conveying the article and the destination of the article can be specified, the conveyance system can also control the movement of the conveyance device that conveys the article.

[Fourth embodiment]
In the first and second embodiments described above, the management of the work process of a job in a printing factory has been described, but the present invention can also be applied to, for example, the management of the work process of articles flowing on a belt conveyor. For example, if the technology of this embodiment is provided to manage the work process of articles flowing on a belt conveyor, it becomes possible to track the articles flowing on the belt conveyor, and it is also possible to control branching of the belt conveyor.

The present invention is not limited to the above-described specifically disclosed embodiments, and various modifications and changes can be made without departing from the scope of the claims. The color code image 811 is an example of a code image associated with a job described in the claims. A work instruction sheet 810 for an information processing system is an example of a slip.

The camera 18 is an example of a photographing means. The color code recognition unit 44 is an example of recognition means. The job management unit 34 is an example of management means. The UI unit 30 is an example of providing means. The photographed image file and the photographed video file are examples of photographed data. The job status list screen 1000 is an example of a list screen. The job details history screen 1010 is an example of a details screen.

1 Job management system 10 Customer system 12 Information processing system 14 Work process management system 16 Printer 18, 18a, 18b Camera 20 Network 30 UI section 32 Job ID detection section 34 Job management section 36 Color code image generation section 38, 60 With color code Work instruction creation unit 40, 62 Print instruction unit 42 Photographed image acquisition unit 44 Color code recognition unit 46 Color code management table storage unit 48 Job management table storage unit 800 Work instruction for customer system 801 Barcode image 810 Information processing system 811 Color code image 1000 Job status list screen 1010 Job detailed history screen 1020 Screen for displaying captured images and videos 1030 Job map display screen 1040 Dashboard display screen 1050 Flow line display screen

Japanese Patent Application Publication No. 2005-100298

Claims (12)

An information processing system that manages the progress of a job consisting of a plurality of work steps and provides a user with information regarding the progress of the job,
photographing means for photographing a slip displaying a code image associated with the job at each location associated with the work process;
recognition means for recognizing the job from a code image of the slip photographed by the photographing means;
Based on the work process associated with the location where the voucher was photographed and the job recognized by the recognition means, information regarding the progress of the job and photographic data when photographing the voucher are managed in association with each other. management means to
providing means for providing a user with information regarding the progress of the plurality of jobs and photographic data when photographing the slip;
An information processing system with The recognition means recognizes the job from a color code image in which values are expressed using color transitions between adjacently connected cells, which is displayed on the slip photographed by the photographing means. The information processing system according to claim 1, characterized in that: The providing means causes the display device to display a list screen that displays a list of information regarding the progress of the plurality of jobs, and also displays a detail screen that displays information regarding the history of one of the jobs selected by the user from the list screen. 3. The information processing system according to claim 1, wherein the information processing system is displayed on a display device. The information processing according to claim 3, wherein the providing means displays the history of the job as a flow line on a map based on information regarding the history of one of the jobs selected by the user from the list screen. system. The providing means is characterized in that, based on the work process selected by the user on the detailed screen, the display device displays photographic data when the slip is photographed at a location associated with the work process. The information processing system according to claim 3 or 4. The providing means displays information on the progress of the plurality of jobs on the list screen using display objects that represent the locations of the jobs on the map and the number of jobs for each location. An information processing system according to any one of claims 3 to 5. 7. The information processing system according to claim 1, wherein a slip displaying a code image associated with the job is attached to an intermediate product or material of the job. When the work process is to store intermediate products or materials of the job in a temporary storage location, the provision means stores the temporary storage by superimposing it on the background using photographic data when photographing the slip as a background. 8. The information processing system according to claim 1, wherein a position of an intermediate product or material of the job at a location is displayed on a display device. When the information regarding the progress of the job is the work process of storing intermediate products or materials of the job in a temporary storage location, the management means may be configured to determine whether a predetermined period of time has elapsed without any change in the information regarding the progress of the job. 9. The information processing system according to claim 8, wherein said providing means then displays an alert. When the information regarding the progress of the job is the work step of storing an intermediate product or material of the job in a temporary storage location, the management means may be configured to control the management means to record a photograph taken by the photographing means for photographing the temporary storage location, when the information regarding the progress of the job is the work step of storing intermediate products or materials of the job in a temporary storage location. There is a predetermined state in which even if the code image associated with the job cannot be recognized from the data, the code image associated with the job cannot be recognized from the photographed data taken by the photographing means that photographs the temporary storage location. 10. The information processing system according to claim 8, wherein information regarding the progress of the job is not updated until the job has occurred a number of consecutive times. A progress management method executed by an information processing system that manages the progress of a job consisting of a plurality of work steps and provides a user with information regarding the progress of the job, the method comprising:
a photographing step of photographing a slip displaying a code image associated with the job at each location associated with the work process;
a recognition step of recognizing the job from the code image of the slip photographed in the photographing step;
Based on the work process associated with the location where the voucher was photographed and the job recognized in the recognition step, information regarding the progress of the job and photographic data when photographing the voucher are managed in association with each other. administrative steps to
a providing step of providing a user with information regarding the progress of the plurality of jobs and photographic data when photographing the slip;
A progress management method having An information processing system that manages the progress of a job consisting of multiple work processes and provides information about the progress of the job to a user,
photographing means for photographing a slip displaying a code image associated with the job at each location associated with the work process;
recognition means for recognizing the job from a code image of the slip photographed by the photographing means;
Based on the work process associated with the location where the voucher was photographed and the job recognized by the recognition means, information regarding the progress of the job and photographic data when photographing the voucher are managed in association with each other. management measures to
providing means for providing a user with information regarding the progress of the plurality of jobs and photographic data when photographing the slip;
A program to function as

Images