JP2019106582A - Information processing apparatus, method for controlling information processing apparatus, and program - Google Patents

Abstract

To provide a mechanism that can easily manage a group to which a single person captured in an image belongs.SOLUTION: An image processing apparatus manages in advance specification information for specifying a group to which people belong, detects the people from moving images and associates the detected people with each other, specifies a group to which a person not associated with the other people belongs by using the specification information managed in advance, and registers information indicating the presence of the person not associated with the other people in the specified group in association with the group.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an information processing apparatus, a control method of the information processing apparatus, and a program, and more particularly to a mechanism capable of easily managing a group to which a single person appearing in an image belongs.

  Heretofore, for example, in a field where data to be prevented from leakage are handled, a rule has been imposed which prohibits working alone.

JP, 2014-199506, A

  In a site that imposes a rule that prohibits working alone, the work monitor monitors the workers through the imaging device, and for a single worker who is working alone isolated from the group There are times when you want to draw attention. Also, in a company that outsources work to an outside company, it is necessary to understand which company is performing single work and how much work is done to a company with many independent work. I want to do it.

  According to the technology disclosed in Patent Document 1 described above, it is possible to indicate the position of a person in an image. For example, in the above technology, the person present in the image can be circled to present the position of the person to the user. However, only by indicating the position of a person based on the above-mentioned technology, does the user work independently with the person detected from the group alone, or does it work at a position close to another person? There were issues that could not be determined at a glance. In addition, since it was not possible to determine whether a single operation was being performed, it was also difficult to grasp which contractor was performing only a single operation.

  An object of the present invention is to provide a mechanism capable of easily managing a group to which a single person appearing in an image belongs.

  The present invention relates to management means for managing specific information for specifying a group to which a person belongs, detection means for detecting a person from a moving image, association means for associating persons detected by the detection means, and the association. A identification means for identifying a group to which a person who is not associated with another person by the means belongs using the identification information managed by the management means, and a person who is not associated with the other person with the group identified by the identification means The information processing apparatus is characterized by further comprising: registration means for registering information indicating existence, in association with the group.

  Further, the present invention is a control method of an information processing apparatus including management means for managing specific information for specifying a group to which a person belongs, and the detection step detects a person from a moving image, and the detection step detects An associating step of associating the determined persons with each other, a identifying step of identifying a group to which a person not associated with another person belongs in the associating step using the specific information managed by the managing means, the group identified in the identifying step And a registration step of registering information indicating that there is a person not associated with another person in association with the group.

  Further, the present invention is a program that can be read and executed by an information processing apparatus including management means for managing specific information for specifying a group to which a person belongs, and the information processing apparatus detects a person from a moving image. Specification that specifies a detection unit, an association unit that associates persons detected by the detection unit, and a group to which a person who is not associated with another person by the association unit belongs using the specific information managed by the management unit The information processing apparatus is characterized in that it functions as a registration unit that registers information indicating that there is a person not associated with another person in the group specified by the means and the identification unit in association with the group.

According to the present invention, a group to which a single person appearing in an image belongs can be easily managed.

FIG. 1 is a diagram showing an example of a system configuration of a monitoring system in the present embodiment. FIG. 2 is a block diagram showing an example of the hardware arrangement of an information processing apparatus applicable to the client PC 101 and the server 102 in the embodiment. FIG. 2 is a block diagram showing an example of the hardware arrangement of an imaging apparatus 103 according to this embodiment. FIG. 6 is a view showing an example of a captured image 400 acquired by the server 102 from the imaging apparatus 103 in the present embodiment. The figure which shows an example of a pending | holding image screen in this embodiment. The figure which shows an example of the count process of a single operation | work in this embodiment. The figure which shows an example of the selection reception process of the trader who performed single work in this embodiment. The figure which shows an example of the various data table in this embodiment. The figure which shows an example of the notification screen in this embodiment. FIG. 2 is a functional configuration diagram showing an example of a functional configuration of a monitoring system according to the present embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific embodiments of the configuration described in the claims.

  In the present embodiment, each worker in the captured image is used as a single worker (a worker in a captured image at a site handling data that is required to prevent a leak by two or more workers. A process of presenting whether a person is not associated with another person or a collaborator (a person associated with another person) will be described. Such a situation is an example of a situation in which the present embodiment can be used, and can be used in various situations where it is desired to determine whether a person is single or plural. For example, the present invention can be used in a situation where it is used for marketing, solution of social problems, etc. by judging whether a passer-by or an attendee is single or group.

  An example of a system configuration of the system in the present embodiment is shown in FIG. FIG. 1 is a diagram showing an example of a system configuration of a monitoring system according to an embodiment of the present invention.

  In FIG. 1, an imaging apparatus (network camera) 103 is provided in a room where a worker works, and performs imaging. The server 102 drives the imaging device 103 and acquires an image captured by the imaging device 103.

  The PC 101 displays the screen generated by the server 102. Although FIG. 1 shows the server 102 and the PC 101 as independent devices, the server 102 and the PC 101 may be integrated.

  A network 104 connects the imaging apparatus 103, the server 102, and the PC 101. The network 104 is composed of, for example, a plurality of routers, switches, cables, and the like that satisfy communication standards such as a local network.

  In the present embodiment, the communication standard, the scale, and the configuration are not limited as long as communication between the imaging apparatus and the client can be performed. For example, the network 104 may be configured by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like. Further, the number of imaging devices connected to the server 102 is not limited to one, and may be plural.

  Next, the hardware configuration of the information processing apparatus applicable to the PC 101 and the server 102 shown in FIG. 1 will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU, which centrally controls devices and controllers connected to the system bus 204. Further, the ROM 202 or the external memory 211 may be a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter referred to as an OS), and various kinds of functions described later. Programs and the like are stored.

  A RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs necessary for execution of processing from the ROM 202 or the external memory 211 to the RAM 203, and implements various operations by executing the loaded programs.

  An input controller 205 controls an input from a pointing device such as a keyboard (KB) 209 or the like. Reference numeral 206 denotes a video controller which controls display on a display such as a display 210 (whether liquid crystal or CRT).

  A memory controller 207 is an external storage device (hard disk (HD)) for storing a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. It controls access to external memory 211 such as Compact Flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 210 by executing, for example, outline font rasterization processing on a display information area in the RAM 203. In addition, the CPU 201 enables user instruction with a mouse cursor (not shown) or the like on the display 210.

  Various programs to be described later for realizing the present invention are stored in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, setting files and the like used at the time of execution of the program are also stored in the external memory 211, and a detailed description of these will be described later. This is the end of the description of FIG.

  Next, an example of the hardware configuration of the imaging device 103 illustrated in FIG. 1 will be described using FIG. 3.

  FIG. 3 is a diagram showing an example of a hardware configuration of the imaging device 103 according to the embodiment of the present invention.

  The CPU 301 centrally controls the devices and controllers connected to the system bus 304. Further, the ROM 302 or the external memory 305 is required to realize a function that is executed by the image processing server 108 such as a BIOS (Basic Input / Output System) which is a control program of the CPU 301, an operating system program (OS). Various programs to be described later are stored. The RAM 303 functions as a main memory, a work area, and the like of the CPU 301.

  The CPU 301 loads various programs and the like necessary for execution of processing into the RAM 303 and executes various programs to realize various operations.

  A memory controller (MC) 306 is a CF connected via an adapter to a hard disk (HD) that stores a boot program, various applications, font data, user files, editing files, various data, image data, etc. and a PCMCIA card slot. It controls access to the external memory 305 such as memory and smart media (registered trademark).

  The camera unit 307 is connected to the image processing unit 308, and photoelectrically converts light obtained by transmitting light through a lens directed to a monitoring target by a light receiving cell such as a CCD or CMOS, and then converts the light into an RGB signal. And a complementary color signal to the image processing unit 308.

  The image processing unit 308 performs white balance adjustment, gamma processing, and sharpness processing based on the RGB signal and the color capture signal, and further performs YC signal processing to generate a luminance signal Y and a chroma signal (hereinafter, YC signal). The YC signal is compressed in a predetermined compression format (for example, JPEG format or Motion JPEG format etc.), and this compressed data is temporarily stored in the external memory 305 as image data.

  A communication I / F controller (communication I / FC) 309 is for connecting and communicating with an external device via a network, executes communication control processing in the network, and stores the image stored in the external memory 305. The data is transmitted by the communication I / F controller 309 to an external device. This is the end of the description of FIG. 3, and then FIG. 4 will be described.

  FIG. 4 is a diagram illustrating an example of a captured image 400 acquired by the server 102 from the imaging apparatus 103 in the present embodiment. In FIG. 4, workers 401 and 402 represent collaborators who work in pairs. On the other hand, the worker 403 represents a single worker who is working alone.

  At this time, it is preferable that the position, attachment angle, and angle of view of the imaging device 103 be adjusted in advance so that the captured images acquired by the server 102 do not overlap as much as possible by the worker. In the present embodiment, the server 102 performs a process of specifying a single worker on a captured image acquired from the imaging device 103. By this, it is possible to process real-time live video. However, it is not limited to this. For example, the server 102 may obtain a moving image stored in the imaging apparatus 103 and perform processing on each frame, or perform processing on each frame of the moving image stored in the server 102. May be Alternatively, the server 102 may access the recording server or the like and perform processing on each frame of the moving image stored in the recording server. Further, in the present embodiment, although the joint worker is a pair, it is not limited to this. The server 102 may have three or more collaborators.

  The identification of a single worker is performed, for example, by using the techniques described in JP-A-2017-84289 and JP-A-2017-85507.

  As shown in FIG. 8, the server 102 manages which vendor is scheduled to work at what time, as shown in the single task count list 802. Therefore, when a single worker is identified, the vendor who is working at that time Count the number of independent tasks.

  By doing so, it becomes possible for the work monitor to easily know which contractor has performed single work. The number of single work is counted once when a single worker is identified once, and after the single worker is not present, a single plus is counted when a single worker is identified again.

  In addition, when a single work is detected while a plurality of traders are working in the same room, the user is allowed to select which trader is to be counted via the hold image screen shown in FIG.

  By doing so, even when a plurality of vendors are working in the same room, it is possible to count single jobs for the appropriate vendor.

  Although the number of single work is counted in the present embodiment, the single work time may be counted as another embodiment.

  Now, the process executed in the present invention will be described using FIG. 6 to FIG. 7 from here. The process shown in each flowchart is executed by the CPU 201 of the server 102. Note that, as another embodiment, the CPU 201 of the PC 101 may execute it.

  First, FIG. 6 will be described. FIG. 6 is a diagram showing an example of the counting process of single work in the present embodiment.

  In step S601, the server 102 acquires vendor information input by the work monitor via the PC 101. The vendor information includes the date and time that the vendor plans to visit, the name of the vendor scheduled to visit, the work place indicating the place where the vendor works, and the face image of the worker of the vendor.

  In step S602, the server 102 registers the vendor information acquired in step S601 in the schedule list 801 of FIG. 8 stored in the external memory 211 of the server 102.

  More specifically, the date and time when the vendor plans to visit is registered in the "visit date and time" of the schedule list 801, and the name of the vendor scheduled to visit is registered in the "visitor" of the schedule list 801, and the place where the work is performed The information of is registered in the "work place", and the face image of the worker is registered in the "worker image path".

  In step S603, the server 102 acquires a captured image (also referred to as a moving image) from the imaging device 103.

  In step S604, the server 102 analyzes the captured image acquired in step S603 in order to identify whether a single task has occurred. More specifically, for example, by executing the process of FIG. 2 of JP-A-2017-84289, it is specified whether a single operation is occurring. That is, each person is identified from the captured image, and the persons are associated with each other based on at least one of the position of each person, the direction of the face of the person, and the distance between the persons. When there is a person (a single worker), it is identified that a single operation has occurred.

  Step S604 is an example of detection means for detecting a person from a moving image and association means for associating the persons detected by the detection means in the present invention.

  In step S605, the server 102 determines whether a single task has occurred as a result of the process of step S604. If the single task has occurred, the server 102 transfers the process to step S606, and otherwise transfers the process to step S610.

  In step S606, the server 102 refers to the visit date and time included in the vendor information acquired in step S601, and determines the vendor whose work was performed on the captured date and time of the captured image when it is determined in step S605 that a single task has occurred. Identify.

  In this embodiment, the vendor is specified using the visit date and time of the vendor and the shooting date and time of the captured image, but as another embodiment, the vendor is identified by the face image of the worker and the face image reflected in the captured image. It is also possible to identify. However, in the case of using such a mechanism, if it is possible to identify a vendor if a single operation is detected when the worker turns his back to the imaging device 103, in this case, the vendor is specified by the method of this embodiment. Do. However, since it is necessary to register a face image in advance when registering a trader by a face image, this embodiment is more preferable when it is desired to reduce the load of a work monitor or a trader involved in registration of a face image. preferable.

  Step S606 is an example of specifying means for specifying, in the present invention, a group to which a person who is not associated with another person by the association means belongs using the specific information managed by the managing means.

  In step S607, the server 102 determines whether the vendor identified in step S606 is one vendor. If the contractor identified in step S606 is one contractor, if the contractor identified in step S606 is not one contractor, that is, two or more contractors, the server 102 shifts the process to step S609.

  In step S608, the server 102 stores the "number of independent operations" of the row in which the "visitor" in the single operation count list 802 in FIG. 8 stored in the external memory 211 of the server 102 is the vendor specified in step S606. Count to one.

  Step S608 and step S704 described later are registration means for registering information indicating that there is a person not associated with another person in the group specified by the specifying means in the present invention in association with the group. An example of

  In the case where it is determined that a single work has occurred in a situation where two workers are working, each of the workers is doing a single work, but at that time It is possible for the work monitor to arbitrarily set in advance whether to use one count or one count.

  In step S609, the server 102 stores the captured image as a hold image in the external memory 211 of the server 102 without counting it by any vendor in the single work count list 802 in FIG. 8.

  In step S610, the server 102 determines whether an operation monitoring end instruction has been received from the operation monitoring staff via the PC 101. If the server 102 receives the termination instruction, the process proceeds to step S611. If the server 102 does not receive the termination instruction, the process returns to step S603.

  In step S611, the server 102 generates a notification screen shown in FIG. 9 using the results (registration results) of the processing in step S608 and step S609, transmits the notification screen to the PC 101, and ends this processing.

  This is the end of the description of FIG. 6, and next, the notification screen of FIG.

  FIG. 9 is a diagram showing an example of a notification screen transmitted from the server 102 to the PC 101 in step S611 and displayed on the display 210 of the PC 101.

  In 901, based on the information on the single work count list 802, the number of single works of each vendor at a certain work date and time is displayed.

  In 902, the details of the date and time when the single operation was performed are displayed for each vendor.

  When the hold image acquisition button 903 is selected in accordance with the instruction of the work monitor, an acquisition request for the captured image stored as the hold image in step S609 is issued to the server 102, and the hold image screen of FIG. It is generated by the server 102 and transmitted to the PC 101.

  The update button 904 receives the selection of the contractor to be counted from a plurality of traders from the work monitor via the hold image screen, and the information 901 is updated when the button is selected according to the instruction of the work monitor. Ru.

  An end button 905 ends the display of this screen when the button is selected in accordance with the instruction of the work monitor.

  This is the end of the description of FIG. 9, and next, FIG. 7 will be described. FIG. 7 is a diagram showing an example of selection acceptance processing of a trader who has performed a single operation in the present embodiment.

  In step S701, the server 102 receives a held image acquisition instruction by accepting the selection of the held image acquisition button 903 from the work monitor via the notification screen of FIG. 9 transmitted from the server 102 to the PC 101 in step S611.

  In step S702, the server 102 generates the hold image screen (selection screen) of FIG. 5 and transmits the screen to the PC 101 to be displayed on the PC 101. The holding image screen of FIG. 5 includes the captured image (501) stored as the holding image in step S609, and a list (502) of vendors who have been working on the shooting date and time of the holding image. In addition, when the cursor is placed on the vendor, the face image (505) of the worker of the vendor is displayed. The face image (505) makes it possible to easily identify to which trader the worker appearing in the captured image (501) belongs. The list of vendors (502) and the face image (505) are specified and displayed based on the information managed in the schedule list 801.

  The work monitor confirms which operator the worker shown in the captured image (501) is from, and selects the relevant contractor from the contractor list (502) and presses the registration button 503. Is transmitted to the server 102, and the server 102 counts 1 as the “number of independent operations” of the selected vendor in the single operation count list 802 in FIG. 8 (step S704 described later). Further, when the cancel button 504 is selected in accordance with the instruction of the work monitor, this screen is ended.

  In step S703, the server 102 receives the information on the trader selected from the work monitor via the hold image screen of FIG.

  In step S704, the server 102 counts one in the “number of independent operations” of the vendor specified by the vendor information received in step S704 in the single task count list 802 in FIG. 8. This is the end of the description of FIG.

  Next, various lists stored in the external memory 211 of the server 102 will be described with reference to FIG.

  The schedule list 801 includes “visit date and time” indicating the date and time of visit by the vendor, “visitor” indicating the name of the visiting vendor, “working place” indicating the place where the vendor works, and a face image of the worker of the vendor The storage destination is indicated, and the “worker image path” displayed in the face image 505 of FIG. 5 is included.

  The single work count list 802 includes “visit date and time” indicating the date and time the worker visited, “visitor” indicating the name of the visited vendor, “single work count” indicating the number of times the trader has performed single work, and The “single work time” indicating the time at which the work was performed, and the “captured image path” indicating the storage destination of the captured image when the single work is performed are included. This is the end of the description of FIG. 8, and next, FIG. 10 will be described. .

  FIG. 10 is a functional configuration diagram showing an example of a functional configuration of the monitoring system in the present embodiment.

  The monitoring system has the functions of a management unit 1001, a detection unit 1002, an association unit 1003, an identification unit 1004, and a registration unit 1005.

  The management unit 1001 manages identification information for identifying a group to which a person belongs. The detection unit 1002 detects a person from a moving image (captured image) captured by the imaging device 103.

  The associating unit 1003 associates the persons detected by the detecting unit 1002 with each other. The identifying unit 1004 identifies a group to which a person who is not associated with another person by the associating unit 1003 belongs, using the specific information (visit date and time of the schedule list 801) managed by the managing unit 1001.

  The registration unit 1005 registers information indicating that there is a person not associated with another person in the group identified by the identification unit 1004 in association with the group (individual work count list 802). This is the end of the description of FIG.

  As described above, according to the present invention, a group to which a single person appearing in an image belongs can be easily managed.

  The present invention is also applicable to, for example, an embodiment as a system, an apparatus, a method, a program, a storage medium, etc. Specifically, the present invention may be applied to a system composed of a plurality of devices. The present invention may be applied to an apparatus consisting of two devices.

  Note that the present invention includes one that directly or remotely supplies a program of software that implements the functions of the above-described embodiments to a system or an apparatus. The present invention is also included in the present invention if the computer of the system or apparatus reads out and executes the supplied program code.

  Therefore, the program code itself installed in the computer to realize the functional processing of the present invention by the computer also implements the present invention. That is, the present invention also includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of an object code, a program executed by an interpreter, script data supplied to an OS, or the like.

  Examples of recording media for supplying the program include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, and a CD-RW. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROMs, DVD-Rs) and the like.

  In addition, as a program supply method, a browser on a client computer is used to connect to an Internet home page. Then, the program can be supplied by downloading the computer program of the present invention itself or a compressed file including an automatic installation function from the home page to a recording medium such as a hard disk.

  The present invention can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different home pages. That is, the present invention also includes a WWW server which allows a plurality of users to download program files for realizing the functional processing of the present invention by a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, and distributed to users, and the user who has cleared predetermined conditions downloads key information that decrypts encryption from the homepage via the Internet. Let Then, it is possible to execute the program encrypted by using the downloaded key information and install it on a computer.

  Also, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiment can be realized by the processing.

  Furthermore, the program read from the recording medium is written to a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is also realized by the processing.

  The embodiments described above merely show examples of implementation in practicing the present invention, and the technical scope of the present invention should not be interpreted in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical concept or the main features thereof.

101 PC
102 server 103 imaging device

Claims (8)

Management means for managing specific information for specifying a group to which a person belongs;
Detection means for detecting a person from a moving image;
Association means for associating the persons detected by the detection means;
Specifying means for specifying a group to which a person who is not associated with another person by the association means belongs using the specific information managed by the managing means;
An information processing apparatus comprising: registration means for registering information indicating that there is a person not associated with another person in the group specified by the specifying means, in association with the group.   The association unit associates the persons with each other based on at least one of the position of the person detected by the detection unit, the direction of the face of the person, and the distance between the persons. The information processing apparatus according to claim 1.   A display control unit configured to control to display a selection screen for receiving selection of a group to which the person belongs when the association unit can not specify a group to which a person not associated with another person belongs by the association unit; The information processing apparatus according to claim 1 or 2, characterized in that The specific information includes information on the date and time when a person belonging to the group visits a predetermined place,
The specifying unit specifies a group to which a person not associated with another person belongs by the association unit, using the information on the date and time and the information on the imaging date and time of the moving image in which the person is detected by the detection unit. The information processing apparatus according to claim 3, characterized in that   5. The information processing apparatus according to claim 4, wherein the display control means displays the selection screen when a plurality of persons belonging to different groups visit the predetermined place in the same time zone. .   The information processing apparatus according to any one of claims 1 to 5, further comprising notification means for notifying a registration result by the registration means. A control method of an information processing apparatus, comprising: management means for managing specific information for specifying a group to which a person belongs.
A detection step of detecting a person from a moving image;
Associating the persons detected in the detecting step with each other;
A specifying step of specifying a group to which a person not associated with another person belongs in the associating step using the specific information managed by the managing means;
A control method of an information processing apparatus, comprising: a registration step of registering information indicating that there is a person not associated with another person in the group specified in the identification step in association with the group. . It is a program that can be read and executed by an information processing apparatus including management means for managing specific information for specifying a group to which a person belongs.
The information processing apparatus
Detection means for detecting a person from a moving image;
Association means for associating the persons detected by the detection means;
Specifying means for specifying a group to which a person who is not associated with another person by the association means belongs using the specific information managed by the managing means;
A program characterized by causing information indicating that a person not associated with another person exists in the group specified by the specifying means, as a registration means for registering the information in association with the group.

Images