JP2022036419A - Data acquisition system - Google Patents

Abstract

To provide a data acquisition system that, in a facility having therein a space in which an imaging unit is difficult to install, can suitably acquire data concerning an operation of a target person.SOLUTION: The data acquisition system includes: a camera 10 (imaging unit) capable of imaging a doorway of a predetermined space (banquet hall 110) and a backside corridor 160 (passage) that provides access to the space via the doorway; an image acquisition unit (control unit 23) that acquires an image captured by the camera 10 (imaging unit); an operation determination unit (control unit 23) that can recognize a predetermined target person, and determines which of the operation of work in the space or the movement at the backside corridor 160 (passage) the target person is performing, based on a determination area D which is a region including the doorway in the image; and a determination result acquisition unit (control unit 23) that acquires a determination result obtained by the operation determination unit (control unit 23).SELECTED DRAWING: Figure 1

Description

The present invention relates to a data acquisition system for acquiring data related to a subject's business.

Conventionally, the technology of a system for acquiring data related to the work of a target person has been known. For example, as described in Patent Document 1.

Patent Document 1 describes work improvement support that analyzes work video data taken by a camera of the situation at a work site and extracts work video data related to the work when a work corresponding to a predetermined work to be improved is detected. The system is described.

Here, for example, in a facility having a private space such as a room used by a customer, it is assumed that it is difficult to install a photographing unit such as a camera in the space and it is difficult to acquire data related to the work in the facility.

Japanese Unexamined Patent Publication No. 2019-23803

The present invention has been made in view of the above situations, and the problem to be solved is that it is possible to suitably acquire data on the work of the subject in a facility having a space in which it is difficult to install a photographing unit. It provides a simple data acquisition system.

The problem to be solved by the present invention is as described above, and next, the means for solving this problem will be described.

That is, in claim 1, a photographing unit capable of photographing an entrance / exit of a predetermined space and a passage capable of entering / exiting the space through the entrance / exit, an image acquisition unit that acquires an image photographed by the photographing unit, and an image acquisition unit. A predetermined target person can be recognized, and the target person can perform either work in the space or movement in the passage based on a determination area which is an area including the entrance / exit in the image. It is provided with a business determination unit for determining whether or not the operation is performed, and a determination result acquisition unit for acquiring the determination result by the business determination unit.

In claim 2, the business determination unit can determine whether the subject enters or leaves the space based on the determination area, and the subject can determine whether the subject enters or leaves the space from the entry to the exit. It is determined that the above work is being performed.

In claim 3, the business determination unit can recognize the predetermined article, and the target person who has determined that the object is moving moves without holding the article. It is possible to determine which of the second movement, which is the movement with the article, is being performed.

In claim 4, when the business determination unit does not recognize the article moving with the target person who has determined that the movement is being performed, the business determination unit determines that the target person is performing the first movement. When the article moving with the subject who is determined to be moving is recognized, it is determined that the subject is performing the second movement.

In claim 5, when the subject who has invaded the determination area becomes unrecognizable, the business determination unit determines that the subject has entered the room, and the determination area is unrecognizable. When the subject becomes recognizable, it is determined that the subject has left the room.

In claim 6, when the business determination unit recognizes that the target person who has invaded the determination area has left the determination area, the business determination unit determines that the target person has passed through the determination area. Is.

The seventh aspect further includes an output information generation unit that outputs a result of collating the determination result by the business determination unit with the business schedule of the target person registered in advance.

As the effect of the present invention, the following effects are exhibited.

In claim 1, it is possible to suitably acquire data related to the work of the target person in a facility having a space in which it is difficult to install a photographing unit.

In claim 2, it is possible to suitably determine the business of the target person.

In claim 3, the types of work of the subject can be classified in more detail.

In claim 4, it is possible to more preferably determine the business of the subject.

In claim 5, it is possible to suitably determine the entry and exit of the subject.

In claim 6, it is possible to more preferably determine the entry and exit of the subject.

In claim 7, based on the determination result by the business determination unit, an output result that can be used for examining the improvement of the business can be shown.

The plan view which showed the facility where the data acquisition system which concerns on one Embodiment of this invention is installed. A block diagram showing the configuration of a data acquisition system. (A) Schematic diagram showing an example of image data of the first camera. (B) Schematic diagram showing an example of image data of the second camera. A flowchart showing the processing performed by the data acquisition system. (A) Schematic diagram showing a determination area of image data of the first camera. (B) The schematic diagram which shows the determination area of the image data of a 2nd camera. The schematic diagram which shows an example of the image data of the 1st camera which shows the state that an employee enters a room. The schematic diagram which shows an example of the image data of the 1st camera which shows the appearance of an employee passing through. The schematic diagram which shows an example of the image data of the 1st camera which shows the state that an employee holding an article enters a room. The schematic diagram which shows an example of the image data of the 1st camera which shows the state that an employee holding an article passes by. The schematic diagram which shows an example of the image data of the 2nd camera which shows the state that an employee holding an article passes by. A table showing an example of the judgment result by the business judgment process. A table showing an example of the output result of output processing. A table showing an example of the judgment result by the business judgment processing in other facilities.

Hereinafter, the data acquisition system 1 according to the embodiment of the present invention will be described. First, the facility 100 in which the data acquisition system 1 shown in FIG. 1 is installed will be described.

At the facility 100, a space for a meeting, food and drink, and the like are provided to a large number of customers. Facility 100 has a space for banquets and dinners (banquet hall 110, which will be described later). In this embodiment, the facility 100 is a hotel (accommodation facility). The facility 100 is not limited to a hotel, and various facilities having a space for a banquet (dining) such as a restaurant or a wedding hall can be adopted. The facility 100 includes a banquet hall 110, a front corridor 120, a kitchen 130, a pantry 140, a warehouse 150, and a back corridor 160.

The banquet hall 110 is a space for banquets and dinners. Tables and chairs are installed in the banquet hall 110. The banquet hall 110 includes a first banquet hall 111, a second banquet hall 112, and a third banquet hall 113. That is, the banquet halls 110 are provided at three locations.

The first banquet hall 111 is located on the west side of the banquet halls 110 provided at the three locations. The first banquet hall 111 is formed in a rectangular space elongated in the north-south direction in a plan view. The first banquet hall 111 is divided by walls on all sides. The first banquet hall 111 includes a front doorway 111a and a back doorway 111b.

The front doorway 111a is mainly for customers to enter and exit the first banquet hall 111. As shown in FIG. 1, the front entrances and exits 111a are provided at both ends in the north-south direction of the western wall of the first banquet hall 111, respectively.

The back doorway 111b is mainly for employees of the facility 100 to enter and exit the first banquet hall 111. As shown in FIG. 1, the back doorway 111b is provided at both ends of the east side wall of the first banquet hall 111 in the north-south direction.

The second banquet hall 112 is located on the north side of the first banquet hall 111. The second banquet hall 112 is formed in a rectangular space elongated in the east-west direction in a plan view. The second banquet hall 112 is partitioned by walls on all sides. The second banquet hall 112 includes a front doorway 112a and a back doorway 112b.

The front doorway 112a is mainly for customers to enter and exit the second banquet hall 112. The front doorway 112a is provided at the western end of the south wall of the second banquet hall 112.

The back doorway 112b is mainly for employees of the facility 100 to enter and exit the second banquet hall 112. The back doorway 112b is provided in the middle of the south side wall of the second banquet hall 112 in the east-west direction.

The third banquet hall 113 is located on the east side of the first banquet hall 111. The third banquet hall 113 is formed in a rectangular space elongated in the north-south direction in a plan view. The third banquet hall 113 is divided by walls on all sides. The third banquet hall 113 includes a front doorway 113a and a back doorway 113b.

The front doorway 113a is mainly for customers to enter and exit the third banquet hall 113. The front doorway 113a is provided at the northern end of the western wall of the third banquet hall 113.

The back doorway 113b is mainly for employees of the facility 100 to enter and exit the third banquet hall 113. The back doorway 113b is provided at the southern end of the western wall of the third banquet hall 113.

The front corridor 120 is a passage mainly used for guests to enter and exit the banquet hall 110. The front corridor 120 is arranged so as to be accessible to the front entrance 112a and the front entrance 113a. In the illustrated example, the front corridor 120 is arranged so as to extend along the wall provided with the front entrance 112a.

The kitchen 130 is a space for cooking the food provided in the banquet hall 110. The kitchen 130 is located on the south side of the first banquet hall 111. The kitchen 130 includes a kitchen entrance / exit 131.

The kitchen entrance / exit 131 is for entering / exiting the kitchen 130. The kitchen entrance / exit 131 is provided on the eastern wall of the kitchen 130.

The pantry 140 is a space for storing tableware, glasses, etc. used in the banquet hall 110. The pantry 140 is located on the east side of the kitchen 130. The pantry 140 includes a pantry doorway 141.

The pantry entrance / exit 141 is for entering / exiting the pantry 140. The pantry entrance / exit 141 is provided on the western wall of the pantry 140.

The warehouse 150 is a space for storing the equipment of the banquet hall 110. Warehouse 150 is located on the north side of the pantry 140. Further, the warehouse 150 is located on the south side of the third banquet hall 113. The warehouse 150 includes a warehouse entrance / exit 151.

The warehouse entrance / exit 151 is for entering / exiting the warehouse 150. The warehouse entrance 151 is provided on the western wall of the warehouse 150.

The back corridor 160 is a passage mainly used by the employees of the facility 100 for the work performed in the banquet hall 110 and the preparation for the banquet. The back corridor 160 is arranged so as to be accessible to the back doorway 111b of the first banquet hall 111, the back doorway 112b of the second banquet hall 112, and the back doorway 113b of the third banquet hall 113. Further, the back corridor 160 is arranged so as to be accessible to the kitchen entrance / exit 131 of the kitchen 130, the pantry entrance / exit 141 of the pantry 140, and the warehouse entrance / exit 151 of the warehouse 150.

The back corridor 160 is provided so as to extend in the north-south direction. In the illustrated example, the back corridor 160 is provided so as to separate the kitchen 130, the pantry 140, and the warehouse 150 from each other in the east-west direction. Further, the back corridor 160 is provided so as to separate the first banquet hall 111 and the third banquet hall 113 with a space in the east-west direction. The back corridor 160 is provided so that the northern end abuts on the back doorway 112b of the second banquet hall 112. The back corridor 160 includes a back corridor entrance / exit 161.

The back corridor entrance / exit 161 can partition the back corridor 160 in the north-south direction. The back corridor entrance / exit 161 is provided in the middle of the north-south direction. With the back corridor entrance 161 closed, the kitchen 130, pantry 140, and warehouse 150 can be hidden from customers.

Next, the work of the employee performed at the facility 100 will be described. Employees prepare for the banquet held at the banquet hall 110, perform work during the banquet, clean up, change the layout, and perform other backyard work.

For example, in preparation for a banquet, an employee transports various items stored in a pantry 140, a warehouse 150, or the like to a banquet hall 110. In addition, the employee performs the work of arranging the above-mentioned articles at a predetermined position in the banquet hall 110. Examples of the above-mentioned articles include jugs, racks, glasses, plates, and other tableware.

In addition, as a cleanup or layout change, the employee collects items such as glasses and plates in a predetermined place in the banquet hall 110, and changes the arrangement of tables and chairs. In addition, the employee transports the goods in the banquet hall 110 to the pantry 140, the warehouse 150, and the like.

In addition, as a business during the banquet, employees transport food and drinks from the kitchen 130 to the banquet hall 110, and transport empty plates and glasses to the kitchen 130 and the pantry 140. In addition, the employee performs the work of serving and serving food and the like in the banquet hall 110. In addition, the employee moves between the plurality of banquet halls 110 as needed.

Next, the data acquisition system 1 will be described. The data acquisition system 1 shown in FIG. 2 acquires data related to the work of employees of the facility 100. The data acquisition system 1 includes a camera 10 and a control device 20.

The camera 10 shown in FIGS. 1 and 2 acquires image data captured through a predetermined lens unit (not shown). The camera 10 is arranged in the back corridor 160, and can acquire image data of the back corridor 160. The image data may be a moving image or a plurality of still images captured at predetermined intervals. The camera 10 is fixed to the ceiling or wall via an appropriate member. As the camera 10, a general surveillance camera (security camera) or a video camera can be adopted. The image data captured by the camera 10 is transmitted to the communication unit 21 described later via a predetermined communication means. The camera 10 includes a first camera 11 and a second camera 12.

The first camera 11 mainly acquires image data in the north-south direction of the back corridor 160. The first camera 11 is installed in the back corridor 160 on the south side of the back corridor entrance / exit 161. The first camera 11 is arranged so that the lens portion faces the north side.

FIG. 3A is a diagram showing an example of image data acquired by the first camera 11. The image data includes images of the back entrance / exit 111b of the first banquet hall 111 and the back entrance / exit 113b of the third banquet hall 113 on the front side (south side). Further, in the image data, on the back side (rear side), an image of the back entrance / exit 111b of the first banquet hall 111, the back entrance / exit 112b of the second banquet hall 112, and the front entrance / exit 113a of the third banquet hall 113. Is included. The figure showing an example of the image data is a schematic diagram, and some images (walls, doorways, etc.) are omitted as appropriate. Further, in the figure example, an example of image data in which an employee or an article is recognized by a business determination process (step S10) described later is shown.

The second camera 12 mainly acquires image data on the north side of the back corridor 160. The second camera 12 is installed in the back corridor 160 on the north side of the back corridor entrance / exit 161. The second camera 12 is arranged so that the lens portion faces the north side.

FIG. 3B is a diagram showing an example of image data acquired by the second camera 12. The image data includes images of the back doorway 111b of the first banquet hall 111, the back doorway 112b of the second banquet hall 112, and the front doorway 113a of the third banquet hall 113. The figure showing an example of the image data is a schematic diagram, and some images are omitted as appropriate.

The control device 20 shown in FIG. 2 is capable of processing various types of information. The control device 20 mainly includes a communication unit 21, a storage unit 22, a control unit 23, a display unit 24, and an input unit 25.

The communication unit 21 receives the image data acquired by the camera 10.

The storage unit 22 stores various programs, information received by the communication unit 21, and the like. The storage unit 22 is composed of an HDD, a RAM, a ROM, and the like. Information indicating a predetermined employee, an article, or the like is registered (stored) in the storage unit 22.

The control unit 23 executes the program stored in the storage unit 22. The control unit 23 is composed of a CPU.

The display unit 24 displays various types of information. The display unit 24 is composed of a liquid crystal display or the like.

The input unit 25 is for inputting various information. The input unit 25 is composed of a keyboard, a mouse, and the like.

As described above, a general personal computer or the like can be used as the control device 20. The control device 20 is installed at an appropriate place (for example, an office or the like) in the facility 100.

In the present embodiment, the storage unit 22 of the control device 20 stores (registers) the contents of the “schedule” of the work of the predetermined employee shown in FIG. The schedule of the above work can be input via the input unit 25. The details of the contents of the "calendar" will be described later. Further, in the present embodiment, the storage unit 22 of the control device 20 stores the distance between the entrances and exits of each space (for example, the first banquet hall 111 and the kitchen 130).

As shown in FIG. 4, the data acquisition system 1 as described above can execute the business determination process (step S10) for determining the type of business performed by the employee of the facility 100. Further, the data acquisition system 1 can execute an output process (step S20) for outputting a result of collating the determination result obtained by the above-mentioned business determination process with the employee's business schedule.

Hereinafter, the business determination process (step S10) will be described.

The work determination process is a process of determining the type of work performed by the employee of the facility 100 based on the image data of the back corridor 160 acquired by the camera 10.

In the business determination process, the control unit 23 identifies the image of the employee by comparing the image of the employee included in the image data with the information of the employee registered in advance in the storage unit 22. The identification of the employee's image is performed by an image authentication process such as a known face recognition process. For example, as shown in FIG. 3A, the control unit 23 compares the images of the predetermined employees A and B included in the image data with the information of the employees registered in the storage unit 22. As a result, it is recognized that the person in the image is an employee registered in advance as "Person: A" or "Person: B", respectively.

Further, in the business determination process, the control unit 23 identifies the image of the article by comparing the image of the article included in the image data with the information of the article registered in the storage unit 22 in advance. The image of the article is identified by a known image authentication process. For example, as shown in FIG. 3A, the control unit 23 compares the image of the predetermined article C (for example, rack, glass, etc.) included in the image data with the information of the article registered in the storage unit 22. As a result, it is recognized that the article of the image is an article registered in advance as "Object: C".

Further, the control unit 23 is a process of showing a predetermined frame (a frame shown by a broken line in FIG. 3A) that surrounds the entire image recognized as “Person: A”, “Person: B”, and “Object: C”. I do.

Further, in the business determination process, the control unit 23 allows the employee of the back corridor 160 to use a predetermined space (for example, the banquet hall 110 or the kitchen 130) based on the determination area D set in the image data of the back corridor 160. It is possible to determine whether the operation of entering, leaving, or passing through the room is performed.

Hereinafter, the details of the determination area D will be described first. The determination area D shown in FIG. 5 is an area set at an arbitrary position of the image data in order to determine whether a predetermined employee has entered, exited, or passed through the room. The determination area D is set as an area surrounded by a boundary line between a predetermined doorway and a wall provided with the doorway. For example, FIG. 5A shows an example in which the boundary line (line shown by a thick line) between the back side entrance / exit 111b and the wall is set as the determination area D. Further, FIG. 5B shows an example in which the boundary line (line shown by a thick line) between the back side entrance / exit 112b and the wall is set as the determination area D. In the present embodiment, the determination area D is set not only in the above-mentioned example but also in each entrance / exit (kitchen entrance / exit 131, pantry entrance / exit 141, warehouse entrance / exit 151, etc.) that can be accessed from the back corridor 160. The determination area D can be set, for example, by an operation via the input unit 25.

Next, the details of the determination of entry, exit, and passage based on the determination area D will be described. When the recognized employee becomes unrecognizable in the determination area D, the control unit 23 determines that the employee has entered the room. Hereinafter, an example of a case where the control unit 23 determines that the room has been entered will be described with reference to FIG.

FIG. 6 shows an example of image data acquired by the first camera 11. 6 (a) and 6 (b) show an example in which employee A passing through the back corridor 160 comes to the front of the back doorway 111b of the first banquet hall 111. In this example, the employee A comes from the kitchen 130 side. The control unit 23 recognizes that the employee A is a pre-registered “Person: A”. Further, in FIG. 6B, the control unit 23 detects that the employee A has invaded the determination area D set in the back side entrance / exit 111b. The control unit 23 detects that the employee A has invaded, for example, when the entire image of the employee A (the frame surrounding the image of the employee A) overlaps with the determination area D.

Further, as shown in FIGS. 6 (c) and 6 (d), when almost the entire body of the employee A is hidden in the back side entrance / exit 111b, the control unit 23 cannot recognize the employee A in the determination area D. .. When the employee A who has invaded the determination area D becomes unrecognizable in this way, the control unit 23 determines that the employee A has entered the first banquet hall 111.

Further, when the unrecognizable employee is recognized in the determination area D, the control unit 23 determines that the employee has left the room. That is, contrary to the procedure shown in FIG. 6 described above, when the body of the employee A appears from the back side entrance / exit 111b, the control unit 23 can recognize the employee A in the determination area D. In this case, the control unit 23 determines that the employee A has left the first banquet hall 111.

Further, when the employee who has invaded the determination area D exits the determination area D, the control unit 23 determines that the employee has passed the doorway in which the determination area D is set. Hereinafter, an example of a case where the control unit 23 determines that the passage has been passed will be described with reference to FIG. 7.

FIG. 7 shows an example of image data acquired by the first camera 11. 7 (a) and 7 (b) show an example in which employee A passing through the back corridor 160 comes to the front of the back doorway 111b of the first banquet hall 111. In this example, the employee A comes from the kitchen 130 side. The control unit 23 recognizes that the employee A is a pre-registered “Person: A”. In FIG. 7B, the control unit 23 detects that the employee A has invaded the determination area D set in the back side entrance / exit 111b.

Further, as shown in FIGS. 7 (c) and 7 (d), when the employee A who has invaded the determination area D passes through the back side corridor 160 without entering the back side entrance 111b, the employee A passes through the back side corridor 160. Get out of. In this case, the control unit 23 recognizes that the employee A who has invaded the determination area D is located outside the area of the determination area D. In this case, the control unit 23 determines that the employee A has passed the back side entrance 111b without entering the first banquet hall 111.

When the control unit 23 determines that an employee enters or leaves the room, the control unit 23 stores the time of entering the room and the time of leaving the room in the storage unit 22.

Further, the control unit 23 uses the above-mentioned determination of entry, exit, and passage based on the determination area D, and the work performed by the employee is performed in a predetermined space (“work”), an article. It is determined whether the work is a movement without a person (“movement only for people”) or a movement with goods (“transportation”). Hereinafter, the details of the determination of "work", "movement of only people", and "transportation" by the control unit 23 will be described.

"Work" is a work performed by an employee in a predetermined space (for example, a banquet hall 110 or a kitchen 130). "Work" includes preparation for a banquet (arrangement of goods, etc.), tidying up and layout changes (tidying up of goods, changing the arrangement of tables and chairs, etc.), and work during the banquet (serving, serving, etc.).

The control unit 23 determines that the employee is performing "work" in the predetermined space from the time when the employee enters the room to the time when the employee leaves the room. In the example shown in FIG. 6, the control unit 23 determines that the employee A has performed "work" in the first banquet hall 111 from the time when the employee A enters the first banquet hall 111 to the time when the employee A leaves the first banquet hall 111.

"Move only people" means that an employee without goods moves from a predetermined space (for example, kitchen 130) to another space (for example, second banquet hall 112). The control unit 23 does not recognize the article moving with the employee, and the employee "moves only a person" from the time when the employee leaves the predetermined space to the time when the employee enters another space. It is determined that it is.

In the example shown in FIG. 7, an employee A who does not have an article leaving the kitchen 130 passes through the first banquet hall 111 and moves to the north side. At this time, the control unit 23 does not recognize the article. In this case, if the employee A enters, for example, the back entrance 112b of the second banquet hall 112, the control unit 23 causes the employee A to "move only people" from the kitchen 130 to the second banquet hall 112. Judged as

"Transportation" means that an employee holding an article moves from a predetermined space (for example, kitchen 130) to another space (for example, first banquet hall 111). The control unit 23 recognizes an article that moves with an employee, and the employee is "transporting" from the time when the employee leaves a predetermined space to the time when the employee enters another space. Is determined. Hereinafter, an example of a case where the control unit 23 determines that the employee is performing "transportation" will be described with reference to FIG.

FIG. 8 shows an example of image data acquired by the first camera 11. 8 (a) and 8 (b) show an example in which an employee B holding an article C comes to the front of the back entrance 111b of the first banquet hall 111 after leaving the kitchen 130. The control unit 23 recognizes that the employee B is a pre-registered "Person: B" and recognizes that the article C recognized as "Object: C" is moving together with the employee B. do. The control unit 23 is, for example, when the employee B and the article C are moving at the same time in a state where at least a part of the frame surrounding the employee B and the frame surrounding the article C overlap. Recognize that C is working with employee B.

Further, as shown in FIGS. 8B and 8C, when the body of the employee B who has invaded the determination area D and the article C are hidden in the back doorway 111b, the control unit 23 causes the employee in the determination area D. B and article C become unrecognizable. In this case, the control unit 23 determines that the employee B and the article C have entered the first banquet hall 111. In this case, the control unit 23 determines that the employee B has "transported" from the kitchen 130 to the first banquet hall 111.

Further, in the following, another example in the case where the control unit 23 determines that the employee is performing "transportation" will be described with reference to FIGS. 9 and 10. In this example, the control unit 23 determines that the employee is "carrying" using the image data of the first camera 11 and the image data of the second camera 12.

FIG. 9 shows an example of image data acquired by the first camera 11. 9 (a) and 9 (b) show the back entrance 111b of the first banquet hall 111 after the employee B holding the article C leaves the kitchen 130, as in the case of FIGS. 8 (a) and 8 (b). Here is an example that came before. The control unit 23 recognizes that the article C is moving together with the employee B. Further, in FIG. 9B, the control unit 23 detects that the employee B and the article C have invaded the determination area D.

Further, as shown in FIG. 9C, when the employee B and the article C that have invaded the determination area D come out of the determination area D, the control unit 23 has the employee B and the article C as the first banquet. It is determined that the vehicle has passed without entering the field 111.

FIG. 10 shows an example of image data acquired by the second camera 12. FIG. 10A shows an example in which an employee B holding an article C passes through the first banquet hall 111 and heads for the back doorway 112b of the second banquet hall 112. Similar to the image data of the first camera 11, the control unit 23 recognizes that the employee B is a pre-registered “Person: B” and the article C recognized as “Object: C”. , Recognize that they are working with employee B.

As shown in FIG. 10B, when the entire body of the employee B and the article C are hidden in the back doorway 112b, the control unit 23 cannot recognize the employee B and the article C in the determination area D. .. In this case, the control unit 23 determines that the employee B and the article C have entered the second banquet hall 112. In this case, the control unit 23 determines that the employee B has "transported" from the kitchen 130 to the second banquet hall 112.

Further, the control unit 23 acquires the type of work performed by the predetermined employee determined by the work determination process as described above and the data related to the type of the work. The table shown in FIG. 11 shows an example of data (recording) acquired by the control unit 23. In the "acquired record" in the upper table of FIG. 11, the records of the work performed by the predetermined employee are shown in chronological order. Specifically, the "acquired record" indicates a "start time", a "end time", a "person", a "type", an "article", a "start place", and a "end place". In the above "acquired record", a record of work is shown for each registered employee. The figure shows a record of the work of employee A among the registered employees.

The "person" is information on a predetermined employee (target person) who is the target of the business determination process. In the figure example, an example in which "person" is employee A is shown.

The “type” is the type of work performed by the employee A, which is determined by the work determination process. The "type" indicates any of "work", "moving only people", and "transportation".

The "start time" is the time when the work performed by the predetermined employee is started. Here, when the "type" of the work performed by the predetermined employee is "work", the "start time" is the time when the employee enters the predetermined space. Further, when the "type" of the work performed by the predetermined employee is "moving only people" or "transportation", the "start time" is the time when the employee leaves the predetermined space.

The "end time" is the time when the work performed by the predetermined employee is completed. Here, when the "type" of the work performed by the predetermined employee is "work", the "end time" is the time when the employee leaves the predetermined space. Further, when the "type" of the work performed by the predetermined employee is "moving only people" or "transportation", the "end time" is the time when the employee enters the predetermined space.

An "article" is information about an article that has been moved with a given employee. When the type of work performed by a predetermined employee is "transportation", the "article" indicates the type of article (rack, glass, etc.) recognized by the control unit 23. If the type of work performed by a given employee is "work" or "moving only people", "goods" is indicated as "none".

The "starting place" is a space (first banquet hall 111, kitchen 130, etc.) where the work performed by the predetermined employee is started. Here, when the "type" of the work performed by the predetermined employee is "work", the "starting place" is the space in which the employee enters. Further, when the "type" of the work performed by the predetermined employee is "moving only people" or "transporting", the "starting place" is the space where the employee has left the room.

The "end place" is a space where the work performed by a predetermined employee is started. Here, when the "type" of the work performed by the predetermined employee is "work", the "end place" is the space where the employee has left the room. Further, when the "type" of the work performed by the predetermined employee is "moving only people" or "transportation", the "end place" is the space where the employee has entered.

The "calendar", which is the lower table of FIG. 11, shows the work schedule of a predetermined employee registered in advance. Specifically, the "schedule" shows the "start time", "end time", and "plan".

"Schedule" is the content of the scheduled work of a predetermined employee (employee A). In the figure example, the contents of "preparation", "banquet", "cleanup / preparation", "banquet", and "cleanup / preparation" are shown as an example of "planning".

The "start time" is the time when the work indicated in the "scheduled" is scheduled to start. Further, the "end time" is the time when the work indicated in the "scheduled" is scheduled to be completed.

The control unit 23 records the work recognized within the time from the "start time" to the "end time" of the schedule (for example, "preparation") shown in the above "schedule" in the "schedule". Recognize that it was done as the work shown. Specifically, it is recognized that the upper record of the "acquired record" shown in FIG. 11 was performed as "preparation" located at the uppermost stage of the "calendar". In addition, it is recognized that the record at the bottom of the "acquired record" was performed as "cleanup / preparation" located at the bottom of the "calendar".

Further, the output process (step S20) shown in FIG. 4 will be described below.

The output process is a result of collating the judgment result (“acquired record”) obtained by the work judgment process shown in FIG. 11 with the work schedule (“plan”) of the pre-registered employee (shown in FIG. 12). Output result) is output. The output result of the output process is displayed on the display unit 24, for example.

FIG. 12 shows an example of the output result by the output processing. The output result includes the contents of "plan", "work analysis", "time" and "distance".

"Schedule" is a band graph showing the work schedule of a predetermined employee (employee A). In the "schedule", the contents of the work of the "schedule" of the employee A shown in FIG. 11 are shown in chronological order.

"Work analysis" classifies the details of the contents of the work shown in "Schedule" based on the classification of the type of work by the work judgment process ("work", "moving only people" and "transportation"). It is shown in a band graph. Specifically, in "work analysis", the details of the work contents are described in "work in the first banquet hall", "work in the second banquet hall", "work in other areas", and "work in other areas". It is classified into "work in the pantry", "transportation" and "moving only people", and is shown in chronological order. In the figure example, the details of the work of "preparation" shown at the left end of "plan" are shown as "work analysis".

"By time" organizes the contents shown in "Work analysis" (details of the contents of the work shown in "Schedule") by type of work, and shows the ratio to each time and the total time. It is a thing.

"By distance" calculates the distance traveled by "transportation" and "movement of only people" from the contents shown in "work analysis" and organizes them by type of work, and for each distance and total travel distance. It shows the ratio. The moving distance is calculated by the control unit 23 based on the distance between the entrances and exits of each space stored in the storage unit 22 in advance and the determination result of the business determination process. In the figure example, the types of work "by distance" are classified into "transportation" and "moving only people". Further, in the figure example, movements that are not classified into "transportation" and "movement only by people" are shown as "others".

According to the output results as described above, based on the data related to the work shown as "plan", "work analysis", "time" and "distance" of the specified employee, consideration of work improvement etc. is considered. It can be carried out. For example, in general, in the work related to the banquet hall 110, it is desirable from the viewpoint of efficiency that the number and time of "moving only people" and "transportation" and the moving distance are small. According to the output results as shown in FIG. 12, the tasks classified into "work", "moving only people" and "transportation" are organized from the viewpoints of "work analysis", "time" and "distance". By showing the collected data, it is possible to facilitate the examination of business improvement.

Further, according to the data acquisition system 1 as described above, it is possible to suitably acquire data related to the work of employees in the facility 100 having the banquet hall 110. That is, since the space used by guests such as the banquet hall 110 is a private space, it is difficult to install the camera 10 inside. According to the present embodiment, image data is acquired by a camera 10 provided in the back corridor 160 outside the banquet hall 110, and work determination processing is performed based on the image data to determine the type of work of the employee. You can get the data. Thereby, even if the camera 10 is not provided in the banquet hall 110, it is possible to acquire the data of the type of work of the employee including the work in the banquet hall 110.

As described above, the data acquisition system 1 according to the embodiment of the present invention is
A camera 10 (photographing unit) capable of photographing an entrance / exit of a predetermined space (banquet hall 110) and a back corridor 160 (passageway) capable of entering / exiting the space through the entrance / exit.
An image acquisition unit (control unit 23) that acquires an image captured by the camera 10 (photographing unit), and
Based on the determination area D, which is an area including the entrance / exit in the image, which can recognize a predetermined target person, the target person works in the space and moves in the back corridor 160 (passage). A business determination unit (control unit 23) that determines which of these operations is being performed, and
The judgment result acquisition unit (control unit 23) for acquiring the judgment result by the business judgment unit (control unit 23),
Is provided.

With such a configuration, it is possible to suitably acquire data related to the work of the target person in the facility 100 having a space (banquet hall 110) in which it is difficult to install the camera 10 (shooting unit). That is, in a private space (banquet hall 110) by acquiring image data with a camera 10 (shooting unit) capable of photographing the back corridor 160 (passage) and determining the work of the target person based on the image data. It is possible to suitably acquire data on the work of the target person including the work in the space (banquet hall 110) without taking a picture of the subject.

Further, the business determination unit (control unit 23) may be used.
Based on the determination area D, it is possible to determine whether the subject enters or leaves the space.
From the time of entering the room to the time of leaving the room, it is determined that the subject is performing the work.

With such a configuration, it is possible to suitably determine the work of the target person.

Further, the business determination unit (control unit 23) may be used.
The subject, who is recognizable of the predetermined article and is determined to be moving, moves with the article in the first movement (“moving only a person”) in which the subject moves without holding the article. It is possible to determine which of the second movement (“transportation”) is being performed.

With such a configuration, the types of work of the target person can be classified in more detail. That is, by further classifying the movement of the target person into the first movement (“movement of only people”) and the second movement (“transportation”), the types of work of the target person can be classified in more detail. Can be done.

Further, the business determination unit (control unit 23) may be used.
When the article that moves with the subject who is determined to be moving is not recognized, it is determined that the subject is performing the first movement (“moving only a person”).
When the article moving with the subject who is determined to be moving is recognized, it is determined that the subject is performing the second movement (“transportation”).

With such a configuration, it is possible to more preferably determine the work of the target person.

Further, the business determination unit (control unit 23) may be used.
When the subject who has invaded the determination area D becomes unrecognizable, it is determined that the subject has entered the room.
When the subject who was unrecognizable in the determination area D becomes recognizable, it is determined that the subject has left the room.

With such a configuration, it is possible to suitably determine the entry and exit of the subject.

Further, the business determination unit (control unit 23) may be used.
When the target person who has invaded the determination area D recognizes that he / she has left the determination area D, it is determined that the target person has passed the determination area.

With such a configuration, it is possible to more preferably determine the entry and exit of the subject. That is, it is possible to more preferably determine the entry and exit of the subject by determining the pattern of the movement of the subject that does not correspond to the entry and exit of the room.

Further, the data acquisition system 1 is
It further includes an output information generation unit (control unit 23) that outputs a result of collating the determination result by the business determination unit (control unit 23) with the pre-registered business schedule of the target person. ..

With such a configuration, it is possible to show an output result that can be used for examining the improvement of the business based on the judgment result by the business judgment unit.

The control unit 23 according to the present embodiment is a form of an image acquisition unit, a business determination unit, a determination result acquisition unit, and an output information generation unit according to the present invention.
Further, the camera 10 according to the present embodiment is an embodiment of the photographing unit according to the present invention.
Further, the banquet hall 110 according to the present embodiment is a form of the space according to the present invention.
In addition, the employee according to the present embodiment is one form of the subject person according to the present invention.
Further, the "movement of only a person" according to the present embodiment is one form of the first movement according to the present invention.
Further, the "transportation" according to the present embodiment is one form of the second movement according to the present invention.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above configuration, and various modifications can be made within the scope of the invention described in the claims.

For example, in the present embodiment, an example in which the data acquisition system 1 is installed in a facility 100 having a space for a banquet (dining) such as a hotel is shown, but the present invention is not limited to such an embodiment. For example, the data acquisition system 1 may be installed in a facility such as a long-term care facility.

The table shown in FIG. 13 shows an example of the determination result acquired by the business determination process when the data acquisition system 1 is installed in the long-term care facility. In the figure example, as an example of the contents of the scheduled work shown in the "calendar" at the bottom of FIG. 13, the contents of "diaper change", "recreation", "rehabilitation", "toilet assistance", and "meal" are scheduled. Is shown. Even in such an example, it is possible to determine whether the employee's work is "work", "moving only people", or "transportation" by the work determination process of the data acquisition system 1.

Since many of the above-mentioned long-term care facility work schedules (schedules shown in the “schedule” in FIG. 13) are set at predetermined times, they are shown in the schedules and the “learned records”. By comparing the data with the data, it is possible to confirm the work contents of the employees of the nursing care facility. The facility in which the data acquisition system 1 is installed is not limited to the above-mentioned example, and various facilities having a predetermined space can be adopted.

Further, in the present embodiment, an example in which the camera 10 is installed in the back corridor 160 is shown, but the present invention is not limited to such an embodiment. For example, the camera 10 may be installed in the front corridor 120 or the like. As the installation place of the camera 10, various places other than the private space such as the banquet hall 110 can be adopted.

Further, in the present embodiment, an example in which two cameras 10 (first camera 11 and second camera 12) are installed is shown, but the present invention is not limited to such an embodiment. The number of cameras 10 may be one or three or more.

Further, the output result of the output process according to the present embodiment is an example, and is not limited to the configuration of the above-described embodiment. As the output result of the output process, various output results indicating the judgment result of the business judgment can be adopted.

1 Data acquisition system 10 Camera 23 Control unit 100 Facility 110 Banquet hall

Claims (7)

An imaging unit capable of photographing an entrance / exit of a predetermined space and a passage that allows entry / exit to the space through the entrance / exit.
An image acquisition unit that acquires an image captured by the imaging unit, and an image acquisition unit.
Based on the determination area that can recognize a predetermined target person and includes the entrance / exit in the image, the target person can perform either work in the space or movement in the passage. The business judgment unit that determines whether or not
The judgment result acquisition unit that acquires the judgment result by the above business judgment unit,
Equipped with
Data acquisition system. The business judgment unit
Based on the determination area, it is possible to determine whether the subject enters or leaves the space.
It is determined that the subject is performing the work from the entry to the exit.
The data acquisition system according to claim 1. The business judgment unit
The first movement in which the subject, who is able to recognize the predetermined article and is determined to be moving, moves without holding the article, and the second movement in which the subject moves with the article. It is possible to determine which of these movements is being performed.
The data acquisition system according to claim 1 or 2. The business judgment unit
When the article moving with the subject who is determined to be moving is not recognized, it is determined that the subject is performing the first movement.
When the article moving with the subject who is determined to be moving is recognized, it is determined that the subject is performing the second movement.
The data acquisition system according to claim 3. The business judgment unit
When the subject who has invaded the determination area becomes unrecognizable, it is determined that the subject has entered the room.
When the subject who was unrecognizable in the determination area becomes recognizable, it is determined that the subject has left the room.
The data acquisition system according to any one of claims 2 to 4. The business judgment unit
When the target person who has invaded the determination area recognizes that he / she has left the determination area, it is determined that the target person has passed the determination area.
The data acquisition system according to claim 5. Further provided is an output information generation unit that outputs a result of collating the determination result by the business determination unit and the business schedule of the target person registered in advance.
The data acquisition system according to any one of claims 1 to 6.

Images