JP2021149368A - Information processing apparatus and program - Google Patents

Abstract

To provide an information processing apparatus and program capable of assisting improvement of work efficiency by appropriately calling employees' attention.SOLUTION: According to one embodiment of the present invention, an information processing apparatus for assisting improvement of work efficiency includes an acquisition section, a specification section, a determination section, and a notification section. The acquisition section is configured to acquire moving image information from at least one imaging device for capturing an image of a prescribed range, the specification section is configured to specify an employee included in the moving image information by face recognition processing, the determination section is configured to determine the employee as an object person when behavior of the employee included in the moving image information is different from basic behavior, and the notification section is configured to notify a portable terminal associated with the object person of calling his/her attention.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device and a program.

For employees engaged in work in stores, factories, etc., work procedures, etc. are often set, and by following these work procedures, the work efficiency of employees is improved. However, due to low proficiency, the behavior of the employee may differ from the work procedure, and it is necessary for the manager or the like to call attention to the employee.

In order for the manager to call attention to the employee, the manager needs to pay close attention to the behavior of the employee, which puts a heavy burden on the manager and bears the psychological burden on the employee who is being watched. become. Therefore, it is desirable to take measures that can draw attention to employees regardless of the manager. A technique for identifying the behavior of a clerk from an image captured by a camera has been proposed (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-071414

By the way, when calling attention to an employee, it is desirable to pay attention to the employee when the employee violates the basic behavior.

In view of the above circumstances, the present invention has decided to provide an information processing device and a program capable of appropriately calling attention to employees and supporting the efficiency of work.

According to one aspect of the present invention, it is an information processing device that supports the efficiency of business, and includes an acquisition unit, a specific unit, a determination unit, and a notification unit, and the acquisition unit covers a predetermined range. The specific unit is configured to be able to acquire moving image information from at least one photographing device for shooting, the specific unit is configured to be able to identify an employee included in the moving image information by face recognition processing, and the determination unit is configured to be able to identify the employee included in the moving image information. When the included behavior of the employee is different from the basic behavior, the employee can be determined to be the target person, and the notification unit can notify the mobile terminal associated with the target person of attention. The information processing device to be processed is provided.

According to one aspect of the present invention, since the attention is notified not to the manager such as the store manager or the superior, but to the employee himself / herself, it is possible to contribute to the construction of an autonomous organization.

It is a figure which showed the connection structure of the information processing apparatus 1 which concerns on embodiment of this invention, and other apparatus. It is a figure which showed the structure of the information processing apparatus 1. It is a block diagram which shows the functional structure of the information processing apparatus 100. It is a figure which showed the example of the display screen of the mobile terminal 3 which received the notification by the notification unit 105. It is an activity diagram which shows the operation flow of the information processing apparatus 100. It is an activity diagram which shows the operation flow of the information processing apparatus 100. It is a block diagram which shows the functional structure of the information processing apparatus 110. It is a figure which showed the example of the display screen of the mobile terminal 3 which received the notification by the notification unit 116. It is an activity diagram which shows the operation flow of the information processing apparatus 110. It is an activity diagram which shows the operation flow of the information processing apparatus 110.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The various features shown in the embodiments shown below can be combined with each other.

By the way, the program for realizing the software appearing in the present embodiment may be provided as a non-temporary recording medium that can be read by a computer, may be provided as a downloadable form from an external server, or may be provided. It may be provided so that the program is started by an external computer and the function is realized (so-called cloud computing) by the client terminal.

Further, in the present embodiment, the "part" may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software that can be concretely realized by these hardware resources. .. In addition, various information is handled in this embodiment, and these information include physical values of signal values such as voltage and current, high and low signal values as a binary bit set composed of 0 or 1. Alternatively, it is represented by a quantum superposition (so-called qubit), and communication / calculation can be executed on a circuit in a broad sense.

A circuit in a broad sense is a circuit realized by at least appropriately combining a circuit, a circuit, a processor, a memory, and the like. That is, an integrated circuit for a specific application (Application Special Integrated Circuit: ASIC), a programmable logic device (for example, a simple programmable logic device (Simple Programmable Logical Device: SPLD), a composite programmable logic device (Complex Program)) It includes a programmable gate array (Field Programmable Gate Array: FPGA) and the like.

1. 1. Overall Configuration FIG. 1 is a diagram showing a connection configuration between the information processing apparatus 1 according to the embodiment of the present invention and another apparatus. As shown in the figure, the information processing device 1 is communicably connected to each of the photographing device 2-1 to the photographing device 2-n and the mobile terminal 3-1 to the mobile terminal 3-m via the network 4. NS. The photographing devices 2-1 to the photographing device 2-n all capture a moving image of the working place of the employee, and may be a dedicated one, or a security camera or the like may be diverted. The mobile terminal 3-1 to the mobile terminal 3-m are communicable devices such as smartphones and tablets, and are carried by each employee.

2. Configuration of Information Processing Device 1 FIG. 2 is a diagram showing a configuration of the information processing device 1. As shown in the figure, the information processing device 1 includes a processing unit 11, a storage unit 12, a temporary storage unit 13, an external device connection unit 14, and a communication unit 15, and these components are included. Is electrically connected to the inside of the information processing device 1 via the communication bus 16.

The processing unit 11 is realized by, for example, a central processing unit (CPU), operates according to a predetermined program stored in the storage unit 12, and realizes various functions.

The storage unit 12 is a non-volatile storage medium that stores various information. This is realized by a storage device such as a hard disk drive (Hard Disk Drive: HDD) or a solid state drive (Solid State Drive: SSD). The storage unit 12 can be arranged in another device capable of communicating with the information processing device 1.

The temporary storage unit 13 is a volatile storage medium. This is realized by, for example, a memory such as a random access memory (Random Access Memory: RAM), and temporarily stores information (arguments, arrays, etc.) required when the processing unit 11 operates.

The external device connection unit 14 is a connection unit conforming to a standard such as a universal serial bus (USB) or a high-definition multimedia interface (HDMI), and may be an input device such as a keyboard or the like. A display device such as a monitor can be connected.

The communication unit 15 is, for example, a communication means conforming to a local area network (LAN) standard, and realizes communication between the information processing device 1 and a local area network or a network 4 such as the Internet via the information processing device 1. do.

As the information processing device 1, a computer for a general-purpose server, a personal computer, or the like can be used, and the information processing device 1 can be configured by using a plurality of computers.

3. 3. Example 1
In the first embodiment, a case of supporting an employee engaged in work in a factory, a store, or the like will be described. The employee in the first embodiment works according to the business procedure specified in the manual or the like. For this reason, the behavior when the employee follows the business procedure is the basic behavior.

3-1. Functions of Information Processing Device 100 First, the functions of the information processing device 100 will be described. The information processing device 100 is realized by operating a program on the information processing device 1.

FIG. 3 is a block diagram showing a functional configuration of the information processing apparatus 100. The information processing device 100 supports the efficiency of business, and includes an acquisition unit 101, a specific unit 102, an information storage unit 103, a determination unit 104, and a notification unit 105. The information storage unit 103 is a part of the storage unit 12, and is not realized by operating the program. However, for convenience of explanation, the information processing device 100 includes the information storage unit 103. do.

The acquisition unit 101 is configured to be able to acquire moving image information from at least one imaging device that captures a predetermined range, for example, imaging device 2-1. Of course, moving image information may be acquired from all of the photographing devices 2-1 to the photographing device 2-n.

The identification unit 102 is configured to be able to identify an employee included in the moving image information by face recognition processing. In the face recognition process, the employee feature information stored in advance in the information storage unit 103 is used.

The information storage unit 103 stores employee feature information required for face recognition processing by the specific unit 102, information on basic actions used by the determination unit 104 for determination, and the like.

When the behavior of the employee included in the moving image information is different from the basic behavior, the determination unit 104 is configured to be able to determine the employee as the target person. The behavior of the employee is specified based on, for example, the flow line of the employee, and specifies that the employee has moved from one place to another. In addition, the behavior may be specified by the movement of the employee's hand or arm. The basic behavior is a flow line or a feature when operating according to a business procedure or a business procedure. The business procedure is, for example, a procedure for providing food and drink at a restaurant. The determination unit 104 compares the behavior of the specified employee with the basic behavior, and if there is a difference, determines the employee as the notification target by the notification unit 105.

The notification unit 105 is configured to be able to notify attention to the mobile terminal 3 associated with the target person determined by the determination unit 104. The mobile terminal 3 is one of the mobile terminals 3-1 to 3-m carried by the target person.

The notification by the notification unit 105 is performed, for example, by displaying a character string such as "Did you make a mistake in the procedure?" On the mobile terminal 3, as shown in FIG. FIG. 4 is a diagram showing an example of a display screen of the mobile terminal 3 that has received the notification from the notification unit 105. Further, as shown in FIG. 4, the notification unit 105 may notify the mobile terminal 3 of a manual in which a business procedure such as "opening a manual" or a link to the manual is described.

In order to realize such an information processing device 100, a program for operating the information processing device 1 which is a computer as the information processing device 100 which supports the efficiency of business is such that the information processing device 1 is acquired by the acquisition unit 101 and the specific unit 102. And the information processing device 100 including the determination unit 104 and the notification unit 105. The acquisition unit 101 is configured to be able to acquire moving image information from at least one photographing device 2-1 or the like that photographs a predetermined range. The identification unit 102 is configured to be able to identify an employee included in the moving image information by face recognition processing. When the behavior of the employee included in the moving image information is different from the basic behavior, the determination unit 104 is configured to be able to determine the employee as the target person. The notification unit 105 is configured to be able to notify the attention to the mobile terminal associated with the target person.

3-2. Operation of Information Processing Device 100 Next, the operation of the information processing device 100 will be described. 5 and 6 are activity diagrams showing an operation flow of the information processing apparatus 100.

When the information processing device 100 starts operating, the acquisition unit 101 first starts acquiring moving image information (A101). The moving image information is acquired from at least one of the photographing devices 2-1 to the photographing device 2-n. The acquisition of the moving image information is continued until the information processing apparatus 100 stops operating due to maintenance or the like.

Next, when the specific unit 102 detects an unspecified person from the moving image information, the face recognition process of the person is performed (A102) to identify the person. Then, when the specified person is an employee as a result of the face recognition process, the determination unit 104 and the notification unit 105 provide support to the specified employee (A103). Support for this employee is provided for each identified employee, and the processing is performed in parallel. This support will be described later. On the other hand, if the specified person is a non-employee as a result of the face recognition processing, no processing is performed, but the face recognition processing is not performed thereafter with the person as the specific person. However, if the specified person is either an employee or a non-employee and cannot be detected from the video information and can be detected again, the face recognition process is performed as an unspecified person. The specific unit 102 repeats these processes.

Next, support for the identified employees will be described. The determination unit 104 identifies the behavior of the employee from the moving image information (A131). Employee behavior is characterized by the employee's flow lines and hand and arm movements. Then, the determination unit 104 compares the identified action with the basic action (A132). As a result of the comparison, if there is no difference between the two, the determination unit 104 repeats the identification and comparison of the actions.

On the other hand, if there is a difference between the behavior of the identified employee and the basic behavior, the determination unit 104 certifies the employee as the target person (A133). Then, the notification unit 105 notifies the employee certified as the target person of caution (A134). The notice of caution is given in the form shown in FIG.

In addition, if there is a difference between the behavior of the identified employee and the basic behavior, and if the difference is due to the employee leaving the workplace such as a factory or store, the employee will take a break. Or, as leaving work, end the support for the employee without notifying the attention.

In this way, the information processing device 100 notifies the employee himself / herself of the attention, not the manager such as the store manager or the superior, which leads to the construction of an autonomous organization.

4. Example 2
In the second embodiment, a case of supporting an employee engaged in work in a store, particularly in a store where products are displayed in the whole store, or the like will be described. The employees in the second embodiment have different operations depending on the presence or absence of customers, and if there are no visitors, they patrol the store, organize products, etc., and if there are customers, they serve customers. For this reason, the basic behavior shall change depending on the presence or absence of customers.

4-1. Functions of Information Processing Device 110 First, the functions of the information processing device 110 will be described. The information processing device 110 is realized by operating a program on the information processing device 1.

FIG. 7 is a block diagram showing a functional configuration of the information processing device 110. The information processing device 110 supports the efficiency of business, and includes an acquisition unit 111, a specific unit 112, an information storage unit 113, a customer information acquisition unit 114, a determination unit 115, and a notification unit 116. .. The information storage unit 113 is a part of the storage unit 12, and is not realized by operating the program. However, for convenience of explanation, the information processing device 110 includes the information storage unit 113. do.

The acquisition unit 111 is configured to be able to acquire moving image information from at least one imaging device that captures a predetermined range, for example, imaging device 2-1. Of course, moving image information may be acquired from all of the photographing devices 2-1 to the photographing device 2-n.

The identification unit 112 is configured to be able to identify the employee included in the moving image information by face recognition processing. In addition, the identification unit 112 identifies non-employees included in the moving image information by face recognition processing. In the face recognition process, the employee feature information stored in advance in the information storage unit 113 is used.

The information storage unit 113 stores employee and non-employee feature information required for face recognition processing by the specific unit 112, information on basic actions used by the determination unit 115 for determination, and the like.

The customer information acquisition unit 114 is configured to be able to acquire customer information based on the purchase history of the non-employee recognized by the specific unit 112 as a customer. In addition, the customer information acquisition unit 114 changes the basic behavior stored in the specific unit 112 when a non-employee visits the store. In other words, the basic behavior changes depending on the presence or absence of non-employees.
When there are no non-employees, that is, when the customer does not visit the store, the basic behavior is patrol in the store, organizing products, etc., and when there are non-employees, that is, the customer visits the store. If so, the basic action is to serve customers.

When the behavior of the employee included in the moving image information is different from the basic behavior, the determination unit 115 is configured to be able to determine the employee as the target person. The behavior of the employee is specified based on, for example, the flow line of the employee, and specifies that the employee has moved from one place to another. In addition, the behavior may be specified by the movement of the employee's hand or arm. The determination unit 115 compares the behavior of the specified employee with the basic behavior, and if there is a difference, determines the employee as the notification target by the notification unit 116.

The notification unit 116 is configured to be capable of notifying the mobile terminal 3 associated with the target person determined by the determination unit 115. The mobile terminal 3 is one of the mobile terminals 3-1 to 3-m carried by the target person.

The notification by the notification unit 116 is performed by displaying a character string such as "Please serve customers" or "You are visiting the store" on the mobile terminal 3, as shown in FIG. 8, for example. FIG. 8 is a diagram showing an example of a display screen of the mobile terminal 3 that has received the notification from the notification unit 116. Further, as shown in FIG. 8, the notification unit 116 may notify the mobile terminal 3 of customer information such as preferences based on the purchase history of the corresponding customer (non-employee) as “customer information”.

In order to realize such an information processing device 110, a program for operating the information processing device 1 which is a computer as an information processing device 110 which supports the efficiency of business is such that the information processing device 1 is acquired by the acquisition unit 111 and the specific unit 112. The information processing device 110 includes the customer information acquisition unit 114, the determination unit 115, and the notification unit 116.

The information processing device 110 can be used not only for supporting employees of stores and the like, but also for supporting reception operations of companies and the like.

4-2. Operation of Information Processing Device 110 Next, the operation of the information processing device 110 will be described. 9 and 10 are activity diagrams showing the flow of operation of the information processing device 110.

When the information processing device 110 starts operating, the acquisition unit 111 first starts acquiring moving image information (A201). The moving image information is acquired from at least one of the photographing devices 2-1 to the photographing device 2-n. The acquisition of the moving image information is continued until the information processing apparatus 110 stops operating due to maintenance or the like.

Next, when the specific unit 112 detects an unspecified person from the moving image information, the face recognition process of the person is performed (A202) to identify the person. Then, when the specified person is an employee as a result of the face recognition process, the determination unit 115 and the notification unit 116 provide support to the specified employee (A203). Support for this employee is provided for each identified employee, and the processing is performed in parallel. This support will be described later.

On the other hand, when the specified person is a non-employee as a result of the face recognition process, the customer information acquisition unit 114 acquires the specified non-employee customer information from the information storage unit 113 (A204). When the customer information of the non-employee specified in the information storage unit 113 is not stored, the acquisition of the customer information is omitted. Then, the customer information acquisition unit 114 changes the basic action stored in the information storage unit 113 to support customer service (A205). At this time, if it is desired to have a predetermined employee serve the non-employee, the customer information acquisition unit 114 changes only the basic behavior corresponding to the employee to the customer service.

The specific unit 112 does not perform the face recognition process thereafter with the person who has performed the face recognition process as the specific person. However, if the specified person is either an employee or a non-employee and cannot be detected from the video information and can be detected again, the face recognition process is performed as an unspecified person. The specific unit 112 repeats these processes.

Next, support for the identified employees will be described. The determination unit 115 identifies the behavior of the employee from the moving image information (A231). Employee behavior is characterized by the employee's flow lines and hand and arm movements. Then, the determination unit 115 compares the identified action with the basic action (A232). As a result of the comparison, if there is no difference between the two, the determination unit 104 repeats the identification and comparison of the actions.

On the other hand, if there is a difference between the behavior of the identified employee and the basic behavior, the determination unit 115 certifies the employee as the target person (A233). Then, the notification unit 116 notifies the employee certified as the target person of caution (A234). The notice of caution is given in the form shown in FIG. Since the basic behavior is changed when a non-employee customer visits the store, there will be a difference between the employee's behavior and the basic behavior when the customer visits the store.

In addition, if there is a difference between the behavior of the identified employee and the basic behavior, and if the difference is due to the employee leaving the work place such as a store, the employee takes a break or leaves work. As a result, the support for the employee is terminated without giving notice.

In this way, the information processing device 100 notifies the employee himself / herself of the attention, not the manager such as the store manager or the superior, which leads to the construction of an autonomous organization.

5. Others The present invention may be provided in each of the following aspects.
In the information processing device, the basic action is an information processing device which is a business procedure.
In the information processing device, the notification unit is an information processing device that notifies the mobile terminal of a manual in which the business procedure is described or a link to the manual.
In the information processing device, the business procedure is an information processing device that is a procedure for providing food and drink.
In the information processing device, the specific unit identifies a non-employee included in the moving image information by face recognition processing, and the basic action is an information processing device that changes depending on the presence or absence of the non-employee.
In the information processing device, the basic action is an information processing device that supports customer service.
The information processing device includes a customer information acquisition unit, the customer information acquisition unit is configured to be able to acquire customer information based on the purchase history of the non-employee recognized by the specific unit, and the notification unit is the notification unit. An information processing device that notifies customer information to the mobile terminal.
A program that operates a computer as an information processing device that supports business efficiency. The information processing device includes an acquisition unit, a specific unit, a determination unit, and a notification unit, and the acquisition unit is predetermined. The moving image information can be acquired from at least one photographing device that shoots the range of the above, the specific unit is configured to be able to identify the employee included in the moving image information by face recognition processing, and the determination unit is the said. When the behavior of the employee included in the video information is different from the basic behavior, the employee can be determined to be the target person, and the notification unit notifies the mobile terminal associated with the target person of attention. A program that is configured to be possible.
Of course, this is not the case.

It may also be provided as a computer-readable non-temporary recording medium that stores the above program.

1: Information processing device 2-1: Imaging device 2-n: Imaging device 3: Mobile terminal 3-1: Mobile terminal 3-m: Mobile terminal 4: Network 11: Processing unit 12: Storage unit 13: Temporary storage unit 14 : External device connection unit 15: Communication unit 16: Communication bus 100: Information processing device 101: Acquisition unit 102: Specific unit 103: Information storage unit 104: Judgment unit 105: Notification unit 110: Information processing device 111: Information processing unit 112: Acquisition unit 112: Specific unit 113: Information storage unit 114: Customer information acquisition unit 115: Judgment unit 116: Notification unit

Claims (8)

An information processing device that supports operational efficiency
It has an acquisition unit, a specific unit, a judgment unit, and a notification unit.
The acquisition unit is configured to be able to acquire moving image information from at least one photographing device that photographs a predetermined range.
The specific unit is configured to be able to identify the employee included in the moving image information by face recognition processing.
The determination unit is configured to be able to determine the employee as a target person when the behavior of the employee included in the moving image information is different from the basic behavior.
The notification unit is an information processing device configured to be able to notify attention to a mobile terminal associated with the target person. In the information processing apparatus according to claim 1,
The basic action is an information processing device, which is a business procedure. In the information processing apparatus according to claim 2,
The notification unit is an information processing device that notifies the mobile terminal of a manual in which the business procedure is described or a link to the manual. In the information processing apparatus according to claim 2 or 3.
The business procedure is an information processing device that is a procedure for providing food and drink. In the information processing apparatus according to claim 1,
The specific unit identifies a non-employee included in the moving image information by face recognition processing, and then identifies the non-employee.
The basic action is an information processing device that changes depending on the presence or absence of the non-employee. In the information processing apparatus according to claim 5,
The basic action is an information processing device that supports customer service. In the information processing apparatus according to claim 6,
Equipped with a customer information acquisition department
The customer information acquisition unit is configured to be able to acquire customer information based on the purchase history of the non-employee recognized by the specific unit.
The notification unit is an information processing device that notifies the mobile terminal of the customer information. A program that operates a computer as an information processing device that supports operational efficiency.
The information processing device
It has an acquisition unit, a specific unit, a judgment unit, and a notification unit.
The acquisition unit is configured to be able to acquire moving image information from at least one photographing device that photographs a predetermined range.
The specific unit is configured to be able to identify the employee included in the moving image information by face recognition processing.
The determination unit is configured to be able to determine the employee as a target person when the behavior of the employee included in the moving image information is different from the basic behavior.
The notification unit is a program configured to be able to notify attention to a mobile terminal associated with the target person.

Images