JP2014146181A - Operation information recording device, display system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation information recording device, a display system, and a program capable of suitably creating and recording information related to operators engaged in operation in a workplace, and the type of the operation.SOLUTION: An operation information recording device acquires an image created by imaging means taking an image of a workplace, and identifies operators and the type of operation carried out by the operators on the basis of color information on the acquired image. The operation information recording device then records, in a storage unit, identification information on the identified operators and identification information on the identified type of the operation, together with date information indicating the date on which the image is taken.

Description

  The present invention relates to a technique for managing work records in a work place.

  2. Description of the Related Art Conventionally, there is known a system that manages work time for each work type by accepting work result input from an operator at the end of the work. Patent Document 1 discloses a technique for recognizing a worker's work site by detecting a work marker copied in a camera image.

Japanese Patent No. 4135332

  In order to automatically generate work information without input by the worker and manage work time, etc., the worker who is working in the workplace and the work type that the worker is working on are appropriately selected. Need to identify. On the other hand, Patent Document 1 does not disclose any method for identifying the worker who is working in the workplace and the type of work that the worker is working on. SUMMARY OF THE INVENTION Accordingly, it is a primary object of the present invention to provide a work information recording apparatus, a display system, and a program capable of suitably generating and recording information on a worker working at a work place and a work type. .

  In one aspect of the present invention, the work information recording apparatus includes an image acquisition unit that acquires an image generated by an imaging unit that captures a workplace, and an operator or a work based on color information of the image acquired by the image acquisition unit. A date and time indicating the date and time when the image was photographed as image identification means for identifying at least one of the work types executed by the worker, and at least one of the worker identification information or work type identification information identified by the image identification means Work information recording means for recording in a storage unit together with information. Here, “color information” refers to information that quantitatively represents a color, and may be an index used in various color spaces such as an RGB color space, an HSV color space, and a Lab color space.

  In another aspect of the present invention, there is provided a program executed by a work information recording apparatus having a storage unit, an image acquisition unit that acquires an image generated by a shooting unit that images a work place, and an image acquired by the image acquisition unit Image identification means for identifying at least one of the worker or the work type executed by the worker based on the color information, and at least one of the worker identification information or the work type identification information identified by the image identification means, The work information recording device is made to function as work information recording means for recording in a storage unit together with date information indicating the date and time when the image was taken.

  According to the present invention, the work information recording device can suitably generate and record information on the worker who works at the workplace and the work type based on the image photographed by the photographing means, and the work time can be favorably recorded. Can be calculated. In addition, the terminal device can display various analysis results based on the worker and the work time for each work type calculated by the work information recording device.

1 shows a schematic configuration of a display system. It is a flowchart which shows the procedure of a work record production | generation process. The data structure of work record DB is shown. It is an example of the color histogram with respect to each pixel in an operator display area. The data structure of a 1st color information table is shown. The data structure of a 2nd color information table is shown. It is an example of the table relevant to worker evaluation. It is a bar graph which shows evaluation of a plurality of workers. It is a bar graph which shows the time-sequential change of evaluation of a designated worker. (A) is a table showing the work ability of each worker for each work type. (B) is a graph relating to the personnel plan calculated from the work ability table shown in (A). The data structure of work record DB concerning a modification is shown.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[System configuration]
FIG. 1 is a diagram showing a schematic configuration of a display system 10 according to the present embodiment. The display system 10 is a system for totalizing the work records of each worker 2 in the work place 1 that performs plant cultivation such as a greenhouse or a farm field, and visualizing information based on the work records. As shown in FIG. 1, the display system 10 includes a camera 3, a terminal device 4, and a server device 5. The camera 3 and the terminal device 4 are connected to the server device 5 via the network 9, respectively.

  The camera 3 is a camera installed toward the work place 1. The camera 3 generates a still image or a moving image (also referred to as “captured image Im”) captured at predetermined intervals, and transmits the captured image Im to the server device 5.

  The terminal device 4 is a personal computer (for example, a notebook personal computer) including a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like. The terminal device 4 transmits information requesting predetermined information based on the work record of each worker 2 (also referred to as “request information Ir”) to the server device 5, whereby a predetermined display corresponding to the request information Ir is displayed. Information (also referred to as “display information Id”) is received from the server device 5 and displayed based on the display information Id.

  The server device 5 includes a processor such as a CPU and a memory such as a ROM and a RAM. The server device 5 recognizes the worker 2 and the work type of the worker 2 based on the captured image Im transmitted from the camera 3. The server device 5 corresponds to the recognized identification information of the worker 2 (also referred to as “worker ID”), the identification information of the work type (also referred to as “work type ID”), and the generation date and time of the captured image Im. A set of date / time information indicating the date / time to be stored is stored in the memory. Hereinafter, a database that uses a set of worker ID, work type ID, and date / time information as one piece of data (also referred to as “record”) is also referred to as “work record DB”. When the server device 5 receives the request information Ir from the terminal device 4, the server device 5 refers to the work record DB, generates display information Id corresponding to the request information Ir, and transmits the display information Id to the terminal device 4.

  The worker 2 wears work clothes 21 having a color corresponding to his / her worker ID and a work cap 22 having a color corresponding to the work type executed by the worker 2. The work clothes 21 have a different color for each worker ID, and the work cap 22 has a different color for each work type ID. Furthermore, the work clothes 21 and the work cap 22 have colors that do not overlap each other.

  Preferably, the color of the work clothes 21 and the color of the work cap 22 are the plant and soil photographed in the photographed image Im (also referred to as “default image”) generated when the worker 2 is not in the workplace 1. The color other than the color of the device (also simply referred to as “existing color”) is determined. That is, the color of the work clothes 21 and the color of the work cap 22 are set to colors corresponding to the space obtained by removing the existing color and its approximate color space from the color space. The above approximate color of the existing color refers to a color that the server device 5 may misrecognize as the existing color, and is determined in advance based on, for example, experiments. Preferably, the space obtained by removing the existing color and its approximate color space from the color space is equally divided by the number of colors used (that is, the total number of worker IDs and work type IDs). In addition, the color of each work clothes 21 for each worker ID and the color of each work cap 22 for each work type ID are determined as the colors indicated by the representative points for each space.

[Work Record Generation Processing]
Next, a work record generation process that is a process of generating each record in the work record DB will be specifically described.

(1) Process Overview FIG. 2 is a flowchart showing a procedure of work record generation processing. The process of the flowchart shown in FIG. 2 is repeatedly executed at a predetermined cycle (for example, every one minute).

  First, the camera 3 generates a captured image Im obtained by capturing the work place 1 and transmits it to the server device 5 (step S101). And the server apparatus 5 receives the picked-up image Im from the camera 3 (step S201).

  Next, the server device 5 extracts an area where the worker 2 is displayed (also referred to as “worker display area Td”) from the captured image Im (step S202). For example, the server device 5 stores in advance a default image captured when the worker 2 does not exist in the workplace 1 and refers to the default image so that the captured image Im acquired in step S201 is referred to. A pixel group that becomes the worker display area Td is extracted. In this case, for example, the server device 5 performs pixel-by-pixel difference processing between the captured image Im and the default image, thereby extracting pixels having different pixel values between the captured image Im and the default image, and extracting the extracted pixels. Each adjacent group of pixels is recognized as an operator display area Td.

  Next, the server device 5 recognizes the worker ID for each worker display area Td (step S203). Furthermore, the server device 5 recognizes the work type ID for each worker display area (step S204). Details of step S203 and step S204 will be described later.

  Then, the server device 5 stores in the work record DB a set of the worker ID recognized in step S203, the work type ID recognized in step S204, and date / time information indicating the date and time when the captured image Im was captured (step S205). ).

  FIG. 3 shows the data structure of the work record DB. As shown in FIG. 3, the work record DB stores the date and time, the worker ID, and the work type ID in association with each other. In the example of FIG. 3, at 12:00 on November 9, 2012, worker 2 with worker ID “P01” enters workplace 1 and starts work corresponding to work type ID “W01”. . Furthermore, at 12:05 on November 9, 2012, worker 2 with worker ID “P02” enters work place 1 and starts work corresponding to work type ID “W01”. Further, at 12:06 on November 9, 2012, the worker 2 with the worker ID “P01” changes his / her work cap 22 and starts work corresponding to the work type ID “W02”.

  The server device 5 can preferably calculate the work time for each worker ID and work type ID by referring to the work record DB. For example, when the server device 5 calculates the execution time of the work of the work type ID of the worker having the predetermined worker ID, first, the number of records in the work record DB corresponding to the worker ID and the work type ID. Count. Then, the server device 5 calculates the work time corresponding to the target worker ID and work type ID by multiplying the counted number of records by the time interval for generating the record of the work record DB. In the example of FIG. 3, for example, the server device 5 records the time when the worker with the worker ID “P01” performed the work with the work type ID “WO1” as the work record corresponding to the worker ID and the work type ID. It is recognized that the time is “6 minutes” obtained by multiplying the number of records “6” in the DB by the record generation interval “1 minute”. As described above, the server device 5 can preferably calculate the work time for each work type of each worker with reference to the work record DB.

(2) Recognition of worker ID and work type ID Next, a specific example of processing executed by the server device 5 in steps S203 and S204 will be described.

  The server device 5 generates a color histogram that is a frequency distribution of the number of pixels for each color for each worker display area Td in the captured image Im recognized in step S202. FIG. 4 is an example of a color histogram for each pixel in one worker display area Td of the captured image Im. In the example of FIG. 4, the server device 5 generates a color histogram indicating the number of corresponding pixels for each value representing the hue. In the worker display area Td, there are a pixel indicating the work clothes 21 and a pixel indicating the work cap 22. Therefore, in the color histogram of FIG. 4, there are two hues “H1” and “H2”. There is a maximum value of the number of pixels corresponding to the value.

  Next, the server device 5 refers to the color information table (also referred to as “first color information table”) of the work clothes 21 corresponding to each worker ID, and based on the generated histogram, displays each worker display area. An operator ID corresponding to Td is determined. Similarly, the server device 5 refers to a table of color information of the work cap 22 corresponding to each work type ID (also referred to as “second color information table”) based on the generated histogram, and displays each worker display area. A work type ID corresponding to Td is determined.

  FIG. 5 shows the data structure of the first color information table, and FIG. 6 shows the data structure of the second color information table. As shown in FIG. 5, in the first color information table, each worker ID is associated with a hue value that is color information of the corresponding work clothes 21. In the example of FIG. 5, hues “Ha” to “Hd” are associated with the worker IDs “P01” to “P04”. Similarly, in the second color information table of FIG. 6, the color information of the corresponding work cap 22 is associated with each work type ID. In the example of FIG. 6, hues “Hx” to “Hv” are associated with the work type IDs “W01” to “W04”.

  Accordingly, in the examples of FIGS. 4 to 6, the server device 5 first recognizes hues H1 and H2 corresponding to the maximum values of the number of pixels in the color histogram of FIG. The server device 5 refers to the first color information table shown in FIG. 5 and the second color information table shown in FIG. 6, and determines the worker ID or work type ID associated with the color information closest to the hue H1. decide. Similarly, the server apparatus 5 determines the worker ID or the work type ID associated with the color information closest to the hue H2. Thereby, the server apparatus 5 can determine suitably worker ID and work type ID for every worker display area Td.

[Display example]
Next, display information Id generated by the server device 5 with reference to the work record DB will be described. The server device 5 performs an analysis on the work time of each worker 2 calculated with reference to the work record DB according to the request information Ir, and generates display information Id that is an analysis result. Below, a specific example is demonstrated for every kind of display information Id.

(1) Worker Evaluation The server device 5 refers to the work record DB and determines the work time for each work type ID for the worker 2 specified by the request information Ir (also referred to as “designated worker”). Based on the evaluation (also referred to as “worker evaluation”), the worker evaluation can be displayed on the terminal device 4. This will be described with reference to FIG.
7A to 7C are examples of tables related to worker evaluation. Specifically, FIG. 7A is a table showing the scheduled work time for each work type ID for each month and year for the designated worker. FIG. 7B is a table showing the actual work time for each work type ID for each month and year for the designated worker. FIG. 7C shows a table of evaluation of designated workers for each work type displayed by the terminal device 4 based on the display information Id.

  Here, the table generation processing shown in FIGS. 7B and 7C will be described. First, the terminal device 4 receives input of the worker ID of the designated worker, and transmits request information Ir including the input worker ID to the server device 5. In this case, the server device 5 extracts a record corresponding to the worker ID of the designated worker from the work record DB. And the server apparatus 5 produces | generates the table shown to FIG. 7 (B) by calculating the working time for every month of each work type ID.

  Next, the server device 5 refers to the tables shown in FIGS. 7A and 7B, and based on the relationship between the scheduled work time and the actual work time throughout the year, the work type ID shown in FIG. 7C. Determine the evaluation for each. In FIG. 7C, the server apparatus 5 gives the highest evaluation “A” to the work type ID whose actual work time is shorter than the scheduled work time, and the work type in which the scheduled work time and the actual work time are equal. An intermediate evaluation “B” is assigned to the ID, and a minimum evaluation “C” is given to the work type ID having a longer actual work time than the fixed work time. The server device 5 stores in advance a table of scheduled work times shown in FIG.

  Then, the server device 5 transmits the display information Id of the worker evaluation table shown in FIG. 7C to the terminal device 4 and causes the terminal device 4 to display the worker evaluation table. Thereby, the user of the terminal device 4 can suitably check the evaluation for each work type of the designated arbitrary worker 2. In the example of FIG. 7, the server device 5 calculates worker evaluations for one year, but instead, it may calculate worker evaluations for a plurality of years.

(2) Inter-worker evaluation The server device 5 refers to the work record DB, determines worker evaluations for a plurality of designated workers specified by the request information Ir, and displays these worker evaluations in a comparable manner. Display information Id can be generated. This will be described with reference to FIG.

  FIG. 8 is a bar graph showing the evaluation of a plurality of workers 2 displayed by the terminal device 4 based on the display information Id. Specifically, FIG. 8 is a bar graph showing the total points for all work type IDs “W01” to “W10” when the above-described evaluation A is 3 points, evaluation B is 2 points, and evaluation C is 1 point. Are displayed for each of the worker IDs “P01” to “P04” of the designated worker. In the bar graph of FIG. 8, for convenience, areas corresponding to the scores of the work type IDs “W01” to “W10” are separated by lines, and each of the areas is given a code of the work type ID.

  When the display shown in FIG. 8 is performed, first, the terminal device 4 accepts input of worker IDs corresponding to a plurality of designated workers, and requests information Ir including the plurality of inputted worker IDs is sent to the server device 5. Send to. Then, the server device 5 determines the evaluations A to C for each work type of each designated worker, similarly to the above-mentioned “(1) Worker evaluation”. And the server apparatus 5 digitizes each evaluation AC, respectively, and produces | generates the display information Id of the bar graph shown in FIG. And the server apparatus 5 transmits the produced | generated display information Id to the terminal device 4, and displays the bar graph shown in FIG. Thereby, the user of the terminal device 4 can specify an arbitrary worker 2 and suitably compare evaluations based on the actual work time.

(3) Worker time-series evaluation The server device 5 refers to the work record DB, determines worker evaluation and points for each unit period within a predetermined period for the designated worker designated by the request information Ir, and designates the designated work. It is possible to generate display information Id indicating a time series change of the evaluation of the person. This will be described with reference to FIG.

  FIG. 9 is a bar graph showing a time series change of the evaluation of the designated worker displayed by the terminal device 4 by the display information Id. In the example of FIG. 9, as in the example of FIG. 8, the total points for all work type IDs “W01” to “W10” when the evaluation A is 3 points, the evaluation B is 2 points, and the evaluation C is 1 point. The bar graph shown is displayed for four years every year. In the bar graph of FIG. 9, for convenience, areas corresponding to the scores of the work type IDs “W01” to “W10” are separated by lines, and each of the areas is given a code of the work type ID.

  When the display shown in FIG. 9 is performed, first, the terminal device 4 receives an input of a worker ID corresponding to an arbitrary designated worker, and, if necessary, a period to be displayed (four years in FIG. 9) and An input of a unit period (1 year in FIG. 9) is accepted, and request information Ir including the input information is transmitted to the server device 5. Then, the server device 5 determines the evaluations A to C for each work type of the designated worker for each unit period in the period to be displayed. And the server apparatus 5 digitizes each evaluation AC, respectively, and produces | generates the display information Id of the bar graph shown in FIG. And the server apparatus 5 transmits the produced | generated display information Id to the terminal device 4, and displays the bar graph shown in FIG. Thereby, the user of the terminal device 4 can specify the arbitrary worker 2 and can suitably confirm the transition of evaluation in time series.

(4) Personnel optimization The server device 5 refers to the work record DB, calculates a work plan with the smallest number of workers 2 within a range in which the work plan can be appropriately executed with respect to an arbitrary work plan, The calculation result can be displayed on the terminal device 4 by the display information Id.

  First, calculation of work ability necessary for calculation of a personnel plan will be described with reference to FIG. FIG. 10A is a table showing the work capabilities of the worker IDs “P01” to “P04” for the work types of the respective work type IDs. The work ability indicates the ratio of the actual work time to the planned work time. In this case, first, the server device 5 receives from the terminal device 4 the worker ID of the designated worker (here, “P01” to “P04”) and the work type ID and period information related to the target work plan. The request information Ir including it is received. Then, similarly to the processing described in the section “(1) Worker evaluation”, the server device 5 recognizes the planned work time and the actual work time for each work type with respect to each designated worker. The work ability for each work type of the worker is calculated.

  FIG. 10B is a graph related to the personnel plan calculated from the work ability table shown in FIG. The graph “G1” in FIG. 10B shows the expected work hours when all the four workers with the worker IDs “P01” to “P04” are employed all year and work 8 hours a day. “G2” indicates a planned work time based on the work plan. The graph “G3” indicates the working time of the optimum personnel calculated by the server device 5.

  In FIG. 10B, the server device 5 uses, for example, one to four of the worker IDs “P01” to “P04” for the period employment and changes the number of workers for each period. The graph G3 is determined by simulating the working time. Here, the server device 5 determines the graph G3 so as to satisfy the work time obtained by adding a margin to the planned work time shown in the graph G2. Here, a region “T1” sandwiched between the graphs G1 and G3 indicates an excessive work time that occurs when all four persons are employed throughout the year, and a region “T2” sandwiched between the graphs G2 and G3. "Indicates a time corresponding to a margin for the planned work time of the work time with the optimum personnel. The server device 5 may set the time width corresponding to the remaining power to a predetermined value or a value based on a user input. In this case, for example, the server device 5 sets the remaining capacity to 20% of the scheduled work time for all work. In another example, the server device 5 is set to 50% of the scheduled work time for specific important work, and is set to 20% of the scheduled work time for other work.

  Accordingly, the server device 5 transmits the display information Id including the display shown in FIG. 10B and the detailed breakdown for each optimum personnel period corresponding to the graph G3 to the terminal device 4 to optimize the personnel. It is possible to allow the user of the terminal device 4 to appropriately recognize the necessity for optimization, the optimum personnel, and the like. In addition, when determining the graph G3, the server device 5 may be able to select a work time per day for each person, satisfy the planned work time based on the hourly wage information of each person, and the total salary The combination that minimizes may be recognized as the optimum personnel.

[Operation and effect of this embodiment]
According to the present embodiment, the server device 5 recognizes the worker and the work type at the work place 1 based on the captured image Im acquired from the camera 3, and generates a work record DB. Thereby, the server device 5 can calculate the work time for each period and work type for any worker with reference to the work record DB. In addition, the server device 5 analyzes the calculated work time of each worker according to the request information Ir of the terminal device 4 to perform worker evaluation and personnel optimization, and the analysis result is displayed on the terminal device 4. The user can be preferably recognized.

[Modification]
Below, the modification of above-described embodiment is demonstrated. Note that the following modifications can be applied to the embodiment in any combination.

(Modification 1)
The server device 5 may further execute processing for determining the color of the work clothes 21 for each worker ID and the color of the work cap 22 for each work type ID.

  In this case, the server device 5 recognizes the existing color based on the default image, and determines the color of the work clothes 21 and the color of the work cap 22 from the colors indicated by the space obtained by excluding the existing color and its neighboring space from the color space. To do. For example, the server device 5 equally divides the space obtained by removing the existing color and its neighboring space from the color space by the number of colors to be used (that is, the total number of worker IDs and work type IDs). From the colors indicated by the representative points for each space, the color of each work clothes 21 for each worker ID and the color of each work cap 22 for each work type ID are selected. In addition, when the color candidate of the work clothes 21 and the work cap 22 is determined in advance, and the color of the work clothes 21 and the work cap 22 is selected from the candidate colors, the server device 5 is, for example, equally divided as described above. For each color indicated by the representative point for each space, a candidate color closest to the color is selected.

  By doing in this way, the server apparatus 5 determines the color of the work clothes 21 and the color of the work cap 22 suitable for recognizing the worker ID and the work type ID from the worker display area Td of the photographed image Im. be able to. Therefore, the server device 5 can preferably improve the accuracy of recognizing the worker ID and the work type ID from the worker display area Td of the captured image Im.

(Modification 2)
When the server device 5 recognizes the worker ID and the work type ID from the worker display area Td, the server device 5 calculates an index indicating the accuracy of the recognition, and if the index does not reach a predetermined threshold, the work record DB The worker ID and the work type ID stored in the memory may not be immediately determined, but may be determined based on the recognition result of the worker ID and the work type ID in the previous and subsequent times.

  For example, the server device 5 further stores color histogram information as color information in the first color information table and the second color information table. Then, after determining the worker ID and the work type ID in step S203 and step S204 of FIG. 2, the server device 5 matches the color histogram corresponding to these with the color histogram of the worker display area Td shown in FIG. The ratio to perform is further calculated as an index indicating the accuracy of recognition. And the server apparatus 5 determines the said worker ID and work type ID with reference to the record corresponding to the time before and behind work record DB, when the above-mentioned ratio does not reach a predetermined threshold value.

  Here, a method for determining the undetermined worker ID and work type ID from records corresponding to times before and after the work record DB will be described. For example, the server device 5 first detects from the work record DB a set of worker IDs and work type IDs registered at both the immediately preceding and immediately following times. When the detected set is not yet registered in the work record DB at the time when the worker ID and the work type ID are not yet determined, the server device 5 determines the set of the worker ID and the work type ID as undecided. It is recognized as the worker ID and the work type ID. For example, in FIG. 3, when the worker ID and the work type ID of the record generated at time 12: 3 are undecided, the server device 5 performs both at time 12: 2 and at time 12: 4. It is recognized after time 12: 4 that there is a set of worker ID “P01” and work type ID “W01”. In this case, the server device 5 determines the set of the worker ID and the work type ID of the record registered at 12:03 as “P01” and “WO1”. Thereby, the server device 5 can accurately determine an undecided worker ID and work type ID.

(Modification 3)
The server device 5 may store the first color information table shown in FIG. 5 and the second color information table shown in FIG. 6 for each pixel region in the shooting time, shooting time, and / or the shot image Im.

  In general, even when photographing the same work clothes 21 and work cap 22, due to the characteristics of the camera 3, it is caused by a decrease in the amount of sunlight after the evening, a change in the color of sunlight at sunset, or the like. Thus, the display color in the captured image Im may change. It is also conceivable that the above-described change in display color is noticeable only in a specific pixel region in the captured image Im such as a pixel region that displays a place where sunset is inserted.

  Accordingly, the server device 5 stores the first color information table shown in FIG. 5 and the second color information table shown in FIG. 6 for each shooting area, shooting time, and / or pixel area in the shot image Im. In this case, the color information registered in the first color information table and the second color information table at each shooting time is determined in advance based on, for example, experiments and stored in the memory of the server device 5. Then, when determining the worker ID and the work type ID in steps S203 and S204 in FIG. 2, the server device 5 should refer to the current date and time, the position of the worker display area Td in the captured image Im, and the like. A first color information table and a second color information table are selected. Accordingly, the server device 5 can recognize the worker ID and the work type ID with high accuracy regardless of the shooting time, the shooting time, the shooting position, and the like.

(Modification 4)
In order to distinguish personnel such as visitors other than the worker 2, when the personnel enters the workplace 1, a mark having a predetermined color or shape may be attached to the personnel. In this case, the server device 5 stores in advance characteristic information related to the color of the mark and the like, and performs the mark detection process in the worker display area Td after the worker display area Td detection process. And the server apparatus 5 records ID which shows that it is personnel other than the date information and worker 2 in work record DB, for example, when a mark is detected. In another example, when the server device 5 detects the above-described mark, the server device 5 does not record information corresponding to the worker display area Td in the work record DB. In addition, the above-mentioned mark may be worn items such as clothes and a hat.

(Modification 5)
The server device 5 may limit the range in which the worker display area Td is detected in the captured image Im to a predetermined range. Depending on the installation location and the installation angle of the camera 3, an area where the operator 2 should not be detected may be displayed in the captured image Im. Accordingly, the server device 5 stores a range in the captured image Im for detecting the worker display area Td in advance, and performs a detection process for the worker display area Td only within the range, thereby detecting the erroneous detection of the worker 2. Can be suppressed.

(Modification 6)
The server device 5 may further provide position information as an item of the work record DB. FIG. 11 shows the data structure of the work record DB according to the modification. In FIG. 11, the work record DB stores position information in addition to date information, worker ID, and work type ID. In FIG. 11, the position information is set in any of “base A”, “base B”, “base C”, and “base X” indicating the work place. In this case, the server device 5 stores in advance a table indicating the relationship between the position in the captured image Im and these work places, and the captured image Im in the worker display area Td extracted in step S202 of FIG. Based on the inside position, position information to be stored in the work record DB is determined. Note that the server device 5 may store coordinate information indicating position coordinates in the work place 1 instead of the work place as the position information.

  Thus, by further adding position information to the work record DB, for example, when a plurality of crops are cultivated in the work place 1, the server device 5 calculates which position information described above, and for which crop It can be suitably determined whether it is work. Moreover, the server apparatus 5 can also recognize detailed work content by the set of work type ID and position information.

(Modification 7)
In the embodiment, the worker 2 wears the work clothes 21 of a different color for each worker ID as a marker (worker identification object) for identifying the worker ID, and identifies the work type ID. As work markers (work type identification objects), different work caps 22 were worn for each work type ID. However, the worker identification object and the work type identification object to which the present invention is applicable are not limited to these. Instead of these, the worker 2 may wear any wearable item such as a shoe or a batch of a different color for each worker ID or work type ID as a worker identification item or a different type identification item. Good.

(Modification 8)
4 to 6, the server device 5 recognizes the worker ID and the work type ID using the hue of each pixel in the worker display area Td as an index. Instead, the server device 5 may recognize the worker ID and the work type ID using various color information such as luminance and RGB values as indices. Even in this case, the first color information table stores in advance values of predetermined color information representing colors assigned to the work clothes 21 for each worker ID, and the second color information table stores the work color. A predetermined color information value representing the color assigned to the work cap 22 for each seed ID is stored in advance. As a result, the server device 5 refers to the first and second color information tables based on the color information indicated by each pixel in the worker display area Td using any predetermined color information as an index, and sets the worker ID. And the work type ID can be recognized.

(Modification 9)
In the embodiment, the server device 5 recognizes the worker ID and the work type ID for the worker display area Td detected from the captured image Im. Instead, the server device 5 recognizes either the worker ID or the work type ID with respect to the worker display area Td detected from the captured image Im, and uses the recognized worker ID or work type ID. You may memorize | store in work record DB. Even in this case, the server device 5 can preferably calculate the work time for each worker ID or the work time for each work type ID for an arbitrary period by referring to the work record DB. it can.

3 Camera (photographing means)
4 Terminal device 5 Server device (work information recording device)
9 Network 10 Display system

Claims (11)

Image acquisition means for acquiring an image generated by the imaging means for imaging the workplace;
Based on the color information of the image acquired by the image acquisition means, an image identification means for identifying at least one of a worker or a work type executed by the worker;
Work information recording means for recording in the storage unit at least one of the worker identification information or work type identification information identified by the image identification means together with date and time information indicating the date and time when the image was captured;
A work information recording apparatus comprising:   Work time calculation for calculating work time for each worker or work type in a predetermined period based on at least one of worker identification information or work type identification information stored in the storage unit and date and time information The work information recording apparatus according to claim 1, further comprising means. The worker wears a worker identification object colored differently for each worker or a work type identification object colored differently for at least one of the work types,
The storage unit stores color information for each worker of the worker identification object or color information for at least one of the work types of the work type identification object,
The image identifying means refers to color information stored in the storage unit, and identifies at least one of an operator or an operation type executed by the operator based on the color information of the image. The work information recording device according to 1 or 2.   The color of the worker identification object or the work type identification object is determined as a color excluding the color displayed in the image captured by the photographing unit and the approximate color of the color when there is no worker in the workplace 4. The work information recording apparatus according to claim 3, further comprising color determination means for performing the operation. The storage unit stores the color information for each of at least one of a time zone, a period, or a pixel area of the image,
5. The work information according to claim 3, wherein the image identification unit changes the color information referred to from the storage unit according to at least one of a time zone, a time period, or a pixel region of the image. Recording device.   6. The image identification unit according to claim 1, wherein the display area of the worker is extracted from the image, and at least one of the worker or the work type is identified for each display area. The work information recording device according to one item.   The work information recording means records at least one of the identification information of the worker and the identification information of the work type in the storage unit together with position information indicating a position where the work is performed. The work information recording device according to claim 6.   The image identification means includes the identification information of the worker or the identification information of the work type to be recorded in the storage unit when an index related to the accuracy of identification of at least one of the worker or the work type is a predetermined threshold value or less. The work information recording according to claim 1, wherein at least one of them is determined based on an identification result of at least one of a worker and a work type for the image generated at the preceding and succeeding times. apparatus.   The said image identification means identifies at least one of the said operator or the said work classification based on the pixel area of the predetermined range among the images acquired by the said image acquisition means, Any one of Claim 1 thru | or 8 characterized by the above-mentioned. The work information recording device according to claim 1. A display system comprising: the work information recording device according to any one of claims 1 to 9; and a terminal device that communicates with the work information recording device,
The work information recording device includes:
Work time calculation for calculating work time for each worker or work type in a predetermined period based on at least one of worker identification information or work type identification information stored in the storage unit and date and time information Means,
Analysis means for performing analysis based on the working time;
A result transmitting means for transmitting display information indicating an analysis result of the analyzing means to the terminal device;
The terminal device
A display system comprising display means for displaying display information received from the work information recording device. A program executed by a work information recording apparatus having a storage unit,
Image acquisition means for acquiring an image generated by the imaging means for imaging the workplace;
Based on the color information of the image acquired by the image acquisition means, an image identification means for identifying at least one of a worker or a work type executed by the worker;
The work information recording means as work information recording means for recording at least one of worker identification information or work type identification information identified by the image identification means in the storage unit together with date and time information indicating the date and time when the image was taken. A program for causing a device to function.

Images