JP2023098485A - Shop management support system and method for supporting shop management - Google Patents

Abstract

To provide a shop management support system and a method for supporting shop management which allow a manager to properly manage whether work to be done in a shop has been done.SOLUTION: A shop management system includes: storage means for storing plural types of tasks showing work to be done in shops; setting means for setting a stored task to be in a completion state when a manual operation completion condition based on operation input from a user or an automatic operation completion condition not based on the operation input is satisfied; and display control means for displaying the stored task. The setting means selects a different one to use between the manual operation completion condition and the automatic operation completion condition depending on the type of the task for setting the task in the completion state.SELECTED DRAWING: Figure 19

Description

The present invention relates to a store operation support system and a store operation support method.

2. Description of the Related Art In stores such as convenience stores, employees perform various tasks such as inspection of product shelves, replenishment of products, and cleaning. In order to operate the store efficiently, it is preferable that such work be performed in a timely manner according to the situation of the store.

Patent Literature 1 describes a management system that registers work to be performed in a store in a table when a detection value of a state detection device satisfies a registration condition, and displays the contents of the table on an electronic device carried by a worker. It is According to the management system of Patent Literature 1, the work to be performed in the store is automatically registered in the table, so it is expected that the work will be performed in a timely manner by the employee who checked the table.

Japanese Unexamined Patent Application Publication No. 2020-115271

In such a management system, it is desired to more efficiently manage whether or not the work to be done in the store has been completed.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems, and is a store operation support system and a store operation support method that enable appropriate management of whether work to be performed in a store has been completed. intended to provide

A store operation support system according to the present invention includes storage means for storing a plurality of types of tasks each representing work to be performed in the store, manual completion conditions based on user operation input, or automatic completion conditions not based on operation input. and display control means for displaying the stored task, wherein the setting means completes the task according to the task type. It is characterized by differentiating whether manual completion conditions or automatic completion conditions are used to set the state.

In addition, the store operation support system according to the present invention further includes generation means for generating a plurality of types of tasks by a manual generation method based on user operation input or an automatic generation method not based on operation input, and setting means , whether the task was created by the manual or automatic generation method, the type of task determines whether the manual completion condition or the automatic completion condition is used to set the task to the completed state. It is preferable to let

In addition, the store operation support system according to the present invention further includes generation means for generating a plurality of types of tasks by a manual generation method based on user operation input or an automatic generation method not based on operation input, and setting means , whether a manual completion condition or an automatic completion condition is used to set a task to a completed state, depending on the type of task and whether the task was created by said manual creation method or said automatic creation method. Different is preferred.

In addition, the store operation support system according to the present invention further includes acquisition means for acquiring sensor information indicating the status of the store, and the setting means determines whether the type of the generated task is the work indicated by the task based on the sensor information. If the task is of a type specified in advance that it can be determined that the task has been completed, as an automatic completion condition, if the sensor information satisfies a predetermined completion condition, the task generated based on the sensor information will be placed in the completion state. is preferably set to

Further, in the store operation support system according to the present invention, the setting means may set the task generated based on the sensor information to a completed state when both the manual completion condition and the automatic completion condition are satisfied. preferable.

Preferably, the store operation support system according to the present invention further includes notification means for outputting a notification prompting the user to input an operation when the automatic completion condition is satisfied and the manual completion condition is not satisfied. .

Further, in the store operation support system according to the present invention, the storage means stores a plurality of tasks in association with the type of each task, and the generation means, when an operation input is made as a manual generation method, the operation input Preferably, it generates a task of a type identified based on the contents of the .

A store operation support method according to the present invention is a store operation support method executed by a store operation support system, and includes a storage step of storing a plurality of types of tasks indicating work to be performed in the store, and a store operation input by a user. a setting step of setting the stored task to a completed state when a manual completion condition based on or an automatic completion condition not based on an operational input is satisfied, depending on the type of task, setting the task to a completed state. It is characterized in that whether to use manual completion conditions or automatic completion conditions is differentiated.

INDUSTRIAL APPLICABILITY The store operation support system and the store operation support method according to the present invention make it possible to appropriately manage whether or not the work to be done in the store is completed.

1 is a functional block diagram of a store operation support system 1; FIG. 3 is a functional block diagram of a management device 6; FIG. 6 is a diagram showing the data structure of a video table 611; FIG. 6 is a diagram showing the data structure of a task table 612; FIG. 6 is a diagram showing the data structure of a type table 613; FIG. FIG. 10 is a diagram showing a task display screen 100; FIG. (A) is a diagram showing a task addition screen 200, and (B) is a diagram showing a report addition screen 300. FIG. 4 is a diagram showing a live video display screen 400. FIG. 5 is a diagram showing a recorded video display screen 500. FIG. FIG. 10 is a flowchart showing the flow of task manual generation processing; FIG. 10 is a flowchart showing the flow of task display processing; FIG. 11 is a flow diagram showing a flow of completion state setting processing; FIG. 10 is a flowchart showing the flow of automatic determination processing; FIG. 10 is a flow diagram showing the flow of notification processing; FIG. 10 is a flowchart showing the flow of image display processing; FIG. 10 is a flowchart showing the flow of image display processing; 3 is a functional block diagram of a management device 16; FIG. FIG. 16 is a diagram showing the data structure of a task table 1612; FIG. 16 is a diagram showing the data structure of a type table 1613; FIG.

Various embodiments of the present invention will now be described with reference to the drawings. It should be noted that the scope of the present invention is not limited to those embodiments, but rather extends to the invention recited in the claims and equivalents thereof.

FIG. 1 is a functional block diagram of a store management support system 1 according to an embodiment. The store operation support system 1 supports the operation of the store by allowing employees to appropriately perform the work that should be done in the store T, and also allows the manager in the management facility K to easily grasp the store's work status. It is a system that enables Stores T are convenience stores, clothing stores, other retail stores, commercial facilities, and the like. When an administrator manages a plurality of stores T, the management facility K is, for example, a management center provided at a remote location from the stores T. FIG. When the administrator manages only one store T, the management facility K may be the backyard of the store T or the like. The store operation support system 1 has a photographing device 2, a sensor 3 and a store terminal 4 arranged in a store T, and an administrator terminal 5 and a management device 6 arranged in a management facility K. FIG. The photographing device 2, the sensor 3, the store terminal 4, the manager terminal 5 and the management device 6 are connected via a network N so as to be able to communicate with each other.

The photographing device 2 is a device for photographing a store, such as a surveillance camera. The photographing device 2 is installed in the shop or around the shop, photographs the situation of the shop, and generates a moving image including a plurality of frame images. The imaging device 2 transmits the generated video to the management device 6 .

The sensor 3 is a device for generating various types of information indicating store conditions, and is, for example, an ultrasonic sensor, an infrared sensor, a weight sensor, or the like. Here, the status of the store is the status related to the generation factor of the task indicating the work to be done in the store. or whether the sanitary conditions in the store are appropriate, such as the dirt on the floor of the store and the state of trash cans.

For example, an ultrasonic sensor is placed at a predetermined height inside a trash can of a store, and by irradiating ultrasonic waves in the horizontal direction and detecting the reflected waves, it is possible to detect whether or not garbage has accumulated to a predetermined height. generate the information shown. This information can be used as information indicating whether the trash can is full.

The infrared sensor is installed, for example, in front of or above the product shelf, and generates information indicating the distance to the product displayed on the product shelf by irradiating infrared rays in the direction of the product shelf and detecting the reflected wave. . This information can be used as information indicating whether or not the products on the product shelf are properly advanced.

A weight sensor is arranged, for example, on a shelf surface of a product shelf and generates information indicating the weight of an object placed on the product shelf. This information can be used as information indicating whether or not the product shelves are appropriately replenished with products.

The sensor 3 is not limited to the example described above, and may be any sensor capable of generating information indicating the status of the store, such as a temperature sensor, a humidity sensor, a motion sensor, and a sound sensor. The sensor 3 transmits to the management device 6 information indicating the situation of the store as described above. The image generated by the photographing device 2 is also used as information indicating the situation of the store. Hereinafter, the image generated by the imaging device 2 and the information generated by the sensor 3 may be collectively referred to as sensor information.

The store terminal 4 is a terminal used by an employee of the store T, such as a mobile phone, a smart phone, or a tablet carried by the employee. The store terminal 4 may be a device such as a PC (Personal Computer) installed in the store T. FIG. The shop terminal 4 displays the work to be done in the shop to the employee, and accepts the employee's operation input regarding the work. The store terminal 4 has a store terminal storage unit 41 , a store terminal communication unit 42 , a store terminal display unit 43 , a store terminal operation unit 44 and a store terminal processing unit 45 .

The store terminal storage unit 41 is configured to store programs or data, and includes, for example, a semiconductor memory device. The store terminal storage unit 41 stores an operating system program, a driver program, an application program, data, etc. used for processing by the processing unit. The program is installed from a computer-readable and non-temporary portable storage medium such as a CD (Compact Disc)-ROM (Read Only Memory) or a DVD (Digital Versatile Disc)-ROM. Alternatively, the program may be downloaded as a package file from a storage area on the Internet such as a web server and installed. Such a program is installed in the management device 6 and executed by the management device 6, and the store terminal 4 receives an operable display screen by communicating with the management device 6 via a display operation application such as a web browser, and displays an operation screen. The result may be sent to the management device 6 as appropriate.

The store terminal communication unit 42 is configured to enable communication with other devices, and includes a communication interface circuit. The communication interface circuit is a communication interface circuit such as a mobile phone network (carrier network), a wired LAN (Local Area Network), or a wireless LAN provided by a communication carrier. The store terminal communication unit 42 receives data from other devices and supplies the data to the processing unit, and transmits the data supplied from the processing unit to the other devices.

The store terminal display unit 43 is configured to display an image, and includes, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The store terminal display section 43 displays an image based on the display data supplied from the processing section.

The store terminal operation unit 44 is configured to receive user operations, and includes, for example, a keypad, keyboard, or mouse. The store terminal operation unit 44 may have a touch panel. The store terminal operation unit 44 generates a signal according to the user's operation and supplies it to the processing unit.

The store terminal processing unit 45 is a device that controls the overall operation of the device, and includes one or more processors and their peripheral circuits. The store terminal processing unit 45 includes, for example, a CPU (Central Processing Unit). The store terminal processing unit 45 may include a GPU (Graphics Processing Unit), DSP (Digital Signal Processor), LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), and the like. The store terminal processing unit 45 controls the operation of each unit based on the stored programs and data supplied from each unit, and executes various processes.

The manager terminal 5 is a terminal used by the manager of the store T, such as a smart phone or a tablet carried by the manager. The administrator terminal 5 may be a device such as a PC installed in the management facility K. FIG. The manager terminal 5 displays a picture of the working situation to the manager. The administrator terminal 5 has an administrator terminal storage unit 51 , an administrator terminal communication unit 52 , an administrator terminal display unit 53 , an administrator terminal operation unit 54 and an administrator terminal processing unit 55 . The configuration of the administrator terminal storage unit 51, the administrator terminal communication unit 52, the administrator terminal display unit 53, the administrator terminal operation unit 54, and the administrator terminal processing unit 55 includes the store terminal storage unit 41, the store terminal communication unit 42, Since the configurations are the same as those of the store terminal display unit 43, the store terminal operation unit 44, and the store terminal processing unit 45, description thereof will be omitted.

The management device 6 is a device for managing work to be performed in the store, and is a device such as a PC or a server installed in the management facility K, for example. Note that the functions of the management device 6 may be realized by a cloud (cloud computing).

FIG. 2 is a functional block diagram of the management device 6. As shown in FIG. The management device 6 has a storage section 61 , a communication section 62 and a processing section 63 .

The storage unit 61 is configured to store programs or data, and includes, for example, a semiconductor memory device. The storage unit 61 stores an operating system program, a driver program, an application program, data, and the like used for processing by the processing unit 63 . The program is installed in the storage unit 61 from a computer-readable non-temporary portable storage medium such as a CD-ROM, DVD-ROM, or the like. Note that the storage unit 61 is an example of storage means.

The storage unit 61 stores a video table 611, a task table 612, and a type table 613, which will be described later, as data.

The communication unit 62 is configured to enable the management device 6 to communicate with other devices, and includes a communication interface circuit. The communication interface circuit is, for example, a communication interface circuit such as a wired LAN or wireless LAN. The communication unit 62 receives data from another device, supplies the data to the processing unit 63, and transmits the data supplied from the processing unit 63 to the other device.

The processing unit 63 is a device that centrally controls the operation of the management device 6, and includes one or more processors and their peripheral circuits. The processing unit 63 includes, for example, a CPU. The processing unit 63 may include a GPU, DSP, LSI, ASIC, FPGA, or the like. The processing unit 63 controls the operation of each unit based on the programs stored in the storage unit 61 and the data supplied from each unit, and executes various processes.

The processing unit 63 has an acquisition unit 631 , a generation unit 632 , a display control unit 633 , a setting unit 634 , a specification unit 635 , a calculation unit 636 and a notification unit 637 . The acquisition unit 631, the generation unit 632, the display control unit 633, the setting unit 634, the identification unit 635, the calculation unit 636, and the notification unit 637 are the acquisition means, the generation means, the display control means, the setting means, the identification means, the estimation means, and the It is an example of notification means. Each of these units is a functional module implemented by a program executed by the processing unit 63 . Each of these units may be implemented in the management device 6 as firmware.

FIG. 3 is a diagram showing the data structure of the video table 611 stored in the storage unit 61. As shown in FIG. The image table 611 is a table for managing information about images acquired from the imaging device 2, and stores image IDs, file names, shooting locations, imaging devices, start times, end times, etc. in association with each other.

The video ID is information for identifying each of a plurality of videos that are moving images. The file name is a character string indicating the file name of each video. A file name may include a path and the like. The shooting location is the shooting location of each image when the shooting devices 2 are installed at a plurality of locations in the store. The shooting device is information for identifying the shooting device 2 that shot the corresponding video. The start time and end time are the times at which each video starts and ends.

As will be described later, the photographing device 2 transmits to the management device 6 a live image showing the situation inside the store in real time. The management device 6 sequentially stores the frame images included in the acquired live video in the storage unit 61 . When frame images corresponding to a predetermined period of time (30 minutes in the example shown in FIG. 3) are stored, the management device 6 stores them as one video file, associates them with the above-described information, and stores them in the video table 611. Remember. Note that the method of generating an image is not limited to such an example, and an image file may be transmitted at predetermined intervals in addition to live images from the photographing device 2 .

FIG. 4 is a diagram showing the data structure of the task table 612 stored in the storage unit 61. As shown in FIG. The task table 612 is a table for managing information related to tasks indicating work to be performed in the store, including task ID, work content, type, generation method, completion condition, sensor information, deadline, priority, status, completion time, and the like. are associated with each other and stored.

A task ID is information for identifying each of a plurality of tasks. The work content is a character string indicating the content of the work indicated by each task. By displaying this character string on the store terminal display section 43 and manager terminal display section 53, employees and managers can grasp the work to be done in the store. The type is information indicating the classification of work indicated by each task, and is set based on a type table 613 to be described later.

The generation method is information indicating whether each task is generated by a manual generation method based on user's (employee or manager's) operation input or by an automatic generation method not based on user's operation input. .

Each task is generated by a manual generation method based on user's operation input. For example, when the manager determines that there is work to be done at the store, the manager can generate a task by operating the manager terminal 5 . An employee can also generate a task by inputting an operation to the store terminal 4 when determining that there is work to be done at the store. In these cases, the task is associated with information indicating that it was generated by a manual generation method.

Each task is also generated by an automatic generation method based on sensor information without being based on user's operation input. For example, when a weight sensor installed on a product shelf generates information indicating that products have not been properly replenished, a task is generated to indicate the task of replenishing the product shelf with products. When information indicating that the floor of the store is dirty is detected from the image generated by the imaging device 2, a task indicating work of cleaning the floor is generated. When an ultrasonic sensor installed in a trash can generates information indicating that the trash can is full, a task is created to indicate the task of inspecting the trash can. In these cases, the task is associated with information indicating that it was generated by an automatic generation method.

The completion condition is information indicating when each task is set to a completed state when either a manual completion condition based on a user's operation input or an automatic completion condition not based on a user's operation input is satisfied. The sensor information is information indicating on which sensor information the task associated with the automatic completion condition is set to the completed state.

A task associated with a manual completion condition is set to a completed state based on the employee's operation input to the store terminal 4 . After performing the work corresponding to each task, the employee performs an operation input to the store terminal 4 indicating that the work has been completed. A task associated with a manual completion condition may be set to the completed state based on the administrator's operation input to the administrator terminal 5 .

A task associated with an automatic completion condition is set to a completed state when sensor information satisfies a predetermined condition without being based on an employee's operation input. In the example shown in FIG. 4, when the information generated by the weight sensor installed on "product shelf B" continuously indicates that the product has been replenished for a predetermined time or longer, "product shelf B , that is, the task indicating the task of replenishing the product on the product shelf B is set to the completed state. Further, when the information detected from the image generated by the imaging device 2 of "camera C" continuously indicates that the floor of the store is clean for a predetermined time or longer, "cleaning the floor", i.e. , the task indicating the task of cleaning the floor of the store is set to a completed state. If the information generated by the ultrasonic sensor installed in "Trash Bin A" continuously indicates that the trash can is not full for a predetermined time or longer, "Check Trash A", that is, inspect the state of Trash A. A task indicating the work to do is set to a completed state.

Each task is generated by a manual generation method based on a user's operation input or an automatic generation method not based on a user's operation input. On the other hand, depending on whether each task was created by a manual or automatic creation method, whether a manual completion condition or an automatic completion condition is used to set the task to the completed state is different. For example, a manual completion condition is used to set a task generated by a manual generation method to a completed state, and an automatic completion condition is used to set a task generated by an automatic generation method to a completed state. be done.

Thereby, it is appropriately managed whether or not the work to be done in the store is completed. In other words, by setting the task to the completed state based on the automatic completion condition, the employee who performed the work does not need to perform any operation input. Avoid being left unattended. On the other hand, when a task that can be generated by the automatic generation method is generated by the manual generation method, it is considered that an abnormal situation occurs in the store that requires the work. In this case, it is preferable to determine whether or not the work is completed based on the user's operation input rather than sensor information.

For example, if the shelf is replenished with a product that is different from the original product, the weight of the product on the shelf is normal, so the product is replenished based on the information from the weight sensor installed on the shelf. No task is generated to indicate the work of In this case, the user who notices this generates a task of replenishing the product shelf with the product by the manual generation method. In such a case, it is not possible to determine whether or not the wrong merchandise has been removed from the merchandise shelf and the appropriate merchandise has been replenished based on the information from the weight sensor installed on the merchandise shelf. Therefore, a manual completion condition is associated with this task, and the task is set to a completed state based on the employee's operational input that replenished the appropriate merchandise. Thereby, it is appropriately managed whether or not the work to be done in the store is completed.

Also, if the floor is not dirty but wet and slippery, or if the trash can is not full but the entrance is blocked making it difficult to throw in trash, the task will be automatically generated. is not generated, so it is generated by the manual generation method. In this case as well, it is preferable to determine whether or not the work has been completed based on the user's operation input instead of sensor information.

The deadline is information indicating the time at which the work indicated by each task should be performed. Priority is information indicating the priority of each task. In the example shown in FIG. 4, the priority is set in three stages of "high", "medium", and "low", but it is not limited to such an example, and may be set in two stages or four stages or more. It may be set by a numerical value. The priority is used to determine the work to be done by the employee, and is also used to output a notification prompting the execution of the work indicated by the task, as will be described later. Due dates and priorities for tasks generated by the manual generation method are specified by the user who generated the task. Due dates and priorities of tasks generated by the automatic generation method are set based on the task type. The status is information indicating whether or not the work indicated by the task has been completed. The completion time is the time when the work was set to the completed state. For a task associated with a manual completion condition, the completion time may be the time at which the employee makes an operational input indicating that the task has been completed.

FIG. 5 is a diagram showing the data structure of the type table 613 stored in the storage unit 61. As shown in FIG. The type table 613 is a table for managing information about types of tasks, and stores types, manually generated keywords, automatic generation methods, automatic completion conditions, deadlines, priorities, work times, etc. in association with each other.

The type is information indicating the classification of work indicated by each task, and is set in advance according to the work to be performed at the store. A manual generation keyword is a phrase for generating each type of task by the manual generation method. In the example shown in FIG. 5, "replenishment, stocking" is set as the manually generated keyword for the "replenishment of goods" type task. When the user who creates the task designates a character string including the words "replenishment" or "stocking out" as the work content of the task, the type of "merchandise replenishment" is set for the task to be generated. Also, if the work content does not include any manually generated keywords, the type of "other" is set for the generated task.

The automatic generation method is information indicating sensor information used when the task is generated by the automatic generation method. In the example shown in FIG. 5, the "product shelf sensor" is set as the automatic generation method for the task of the "product replenishment" type. is generated. "Video" is set as the automatic generation method of the "cleaning" type task, and it is shown that the "cleaning" task is generated based on the video generated by the imaging device 2 . "Trash can sensor" is set as the automatic generation method of the "Trash can inspection" type of task, and the "Trash bin inspection" task is generated based on the information generated by the ultrasonic sensor installed in the trash can. It is shown. The auto-generation method is not set for tasks of type 'Inspect shelf', 'Replace bulletin board' and 'Miscellaneous', indicating that these types of tasks are not generated by the auto-generation method. there is

The automatic completion condition is information indicating sensor information used when the task is set to the completed state based on the automatic completion condition. In the example shown in FIG. 5, "product shelf sensor" is set as the automatic completion condition for the "product replenishment" type task, and the information generated by the weight sensor installed on the product shelf satisfies the predetermined completion condition. It is shown that a task of the type "replenishment of goods" is set to the completed state when Completion conditions are set in advance for each sensor information. For example, the completion condition for the information generated by the weight sensor installed on the product shelf is that the weight of the product placed on the product shelf continues to be equal to or less than a predetermined weight for a predetermined time or longer.

An automatic generation method is set for the type of work that can be determined to be performed based on sensor information. Also, an automatic completion condition is set for a type that can determine that the work has been completed based on sensor information. A user such as an administrator designates in advance the type of work for which it can be determined that the work should be performed based on the sensor information and the type for which it can be determined that the work has been completed based on the sensor information.

As described above, tasks generated by manual generation methods have associated manual completion conditions, and tasks generated by automatic generation methods have automatic completion conditions associated with them. Therefore, automatic completion conditions are not set for types for which the automatic generation method is not set, that is, types that can be generated only by the manual generation method.

The sensor information set as the automatic generation method and the sensor information set as the automatic completion condition may be different from each other. For example, "merchandise shelf sensor" may be set as the automatic generation method of the task of the "merchandise replenishment" type, and "camera" may be set as the automatic completion condition. In this case, if the information generated by the weight sensor installed on the product shelf indicates that the weight of the product that has been placed on the product shelf continuously for a predetermined time or longer is equal to or less than the predetermined weight, A task of the type "replenishment of goods" is generated. Then, when the information detected from the image of the product shelf acquired from the photographing device 2 indicates that a predetermined amount or more of products have been placed on the product shelf continuously for a predetermined time or longer, the "product Tasks of type Replenishment are set to a completed state.

The deadline is the deadline by which the work indicated by the generated task should be performed when the task is generated by the automatic generation method. Priority is the priority set to the generated task when the task is generated by the automatic generation method. In the example shown in FIG. 5, the type of "product replenishment" is associated with a deadline of "15 minutes" and a priority of "high". Therefore, when a task of the type "replenishment of goods" is generated by the automatic generation method, the time 15 minutes after the time of generation is set as the deadline, and the priority is set to "high". It is shown.

The work time is a method of calculating the time at which the manager wants to check the video among the times when the work indicated by the task is performed. As will be described later, the administrator terminal 5 displays an image of the state of work indicated by the task set to the completed state. At that time, the administrator terminal 5 uses the work time to display an image of the state of the work indicated by the task from among the images captured by the imaging device 2 . In general, what kind of video the administrator wants to check as the status of the work differs depending on the type of work, so the work time differs based on the completion time when the work was set to the completed state and the type of task. set to the value

For example, for the task of "inspection of product shelves", the manager does not display images of the product shelves after the inspection, but images showing whether the employees are patrolling the store and inspecting the product shelves appropriately. I would like to see a video of the work in progress. Therefore, the time before the completion time is set as the work time for the type of "product shelf inspection". On the other hand, for the "Replenishment" task, the manager wants to check the image of the shelf where the product is replenished, that is, the image when the work is completed, not the image of the employee replenishing the product. I think. Therefore, the completion time is set as the work time for the type of "product replenishment". In this way, the work time is set in advance according to what kind of video the manager wants to check as the status of each type of work.

Various screens displayed on the store terminal display unit 43 and the administrator terminal display unit 53 will be described below. These screens are displayed based on display data supplied from the store terminal processing section 45 or the administrator terminal processing section 55 to the store terminal display section 43 or the administrator terminal display section 53 .

FIG. 6 is a diagram showing a task display screen 100 displayed on the store terminal display section 43. As shown in FIG. The task display screen 100 is displayed based on the display data of the task display screen 100 transmitted from the management device 6 to the store terminal 4 . The task display screen 100 includes a task list 110 , a complete button 120 , an add task button 130 and an add report button 140 .

The task list 110 is an object that lists information about generated tasks. The task list 110 displays whether or not the task is completed, the contents of the task, the due date, and the priority as information about the task. In the example shown in FIG. 6, whether or not the task is completed is indicated depending on whether or not the left side of each row of the task list 110 is checked. In addition, the priority is displayed on the right side of each line of the task list 110. When "immediately" is written, the priority is "high", and when "handy" is written, the priority is "high". The priority is "low", and unless otherwise specified, the priority is "medium".

A completion button 120 is an object for setting a task to a completed state. When the employee operates the store terminal operation unit 44 to select the completion button 120 , the store terminal 4 transmits a task completion instruction to the management device 6 .

The completion button 120 is displayed so as to correspond to a task, among the tasks included in the task list 110, which is not set to a completed state and for which an automatic completion condition is not set. Therefore, in the example shown in FIG. 6, the completion buttons 120 for the tasks "inspection of product shelf A" and "replenishment of product shelf B", which are set to the completed state, are not displayed. Also, the completion buttons 120 for the tasks "cleaning the floor" and "inspecting trash can A" for which automatic completion conditions are set are not displayed. Only the completion button 120 of the task "inspection of trash box B", which is not set to the completed state and the automatic completion condition is not set, is displayed. Note that the completion button 120 may be displayed in response to a task selection operation on the task list.

A task addition button 130 is an object for creating a new task. When the employee operates the store terminal operation unit 44 to select the task addition button 130, a task addition screen 200, which will be described later, is displayed. The add report button 140 is an object for creating a new report. When the employee operates the store terminal operation unit 44 to select the add report button 140, the add report screen 300, which will be described later, is displayed.

FIG. 7A is a diagram showing a task addition screen 200 displayed on the store terminal display section 43. As shown in FIG. The task addition screen 200 is displayed based on the display data of the task addition screen 200 transmitted from the management device 6 to the store terminal 4 . Task addition screen 200 includes text box 210 , add button 220 and cancel button 230 .

The text box 210 is an object for the employee to operate the store terminal operation unit 44 to input work content, deadline and priority. The text box 210 may also allow the type of task to be entered. The add button 220 is an object for creating tasks. When the employee operates the store terminal operation unit 44 to select the add button 220, the store terminal 4 issues a task generation instruction including the work content, deadline, and priority entered in the text box 210. to the management device 6. A cancel button 230 is an object for canceling task generation. When the employee operates the store terminal operation unit 44 to select the cancel button 230, the task display screen 100 is displayed.

FIG. 7B is a diagram showing a report addition screen 300 displayed on the shop terminal display unit 43. As shown in FIG. Add report screen 300 includes text box 310 , add button 320 and cancel button 330 .

The text box 310 is an object for the employee to operate the store terminal operation unit 44 to input report content and time. Add button 320 is an object for generating a report. When the employee operates the store terminal operation unit 44 to select the add button 320, the store terminal 4 sends a report generation instruction including the report content and time entered in the text box 310 to the management device. Send to 6. Cancel button 330 is an object for canceling report generation. When the employee operates the store terminal operation unit 44 to select the cancel button 330, the task display screen 100 is displayed.

Reports are generated by employees when they have something to communicate to management. As will be described later, by selecting a report, the manager terminal 5 displays an image showing the situation of the store at the time when the selected report was made. Therefore, the employee only needs to input the time when the situation to be reported occurred and the brief content of the report, which reduces the burden of reporting work on the employee. In addition, the manager can more specifically grasp the content of the report from the employee from the video. Note that the input of the time may be omitted. In this case, the time at which the report was made may be the time at which the event to be reported occurred.

FIG. 8 is a diagram showing a live video display screen 400 displayed on the administrator terminal display section 53. As shown in FIG. The live image display screen 400 is a screen for displaying a live image showing the situation of the store in real time, and is displayed based on the display data of the live image display screen 400 transmitted from the management device 6 to the administrator terminal 5. be. Live video display screen 400 includes switching tab 410 , time display 420 , live video 430 , completed task list 440 , and add button 450 . The live video 430 is an example of a video display area, and the completed task list 440 is an example of a task display area.

The switching tab 410 is an object for switching between the live video display screen 400 and the recorded video display screen 500, which will be described later. When the administrator operates the administrator terminal operation unit 54 and selects "recorded video" of the switching tab 410, the recorded video display screen 500 is displayed instead of the live video display screen 400. FIG. The time display 420 is an object that displays a character string indicating the current time.

The live image 430 is an image obtained from the photographing device 2 and showing the situation of the store in real time. In the example shown in FIG. 8, the images obtained from the six photographing devices 2 are displayed in real time. The completed task list 440 is an object that displays in a selectable list information on only tasks that have been set to the completed state among the generated tasks. An add button 450 is an object for creating a new task. When the administrator operates the administrator terminal operation unit 54 to select the add button 450, a screen similar to the task addition screen 200 described above is displayed. The administrator can generate a task by inputting an operation on the displayed screen.

FIG. 9 is a diagram showing a recorded video display screen 500 displayed on the administrator terminal display section 53. As shown in FIG. The recorded video display screen 500 is a screen for displaying a recorded video showing the past situation of the store, and is displayed based on the display data of the recorded video display screen 500 transmitted from the management device 6 to the administrator terminal 5. be. Recorded video display screen 500 includes switching tab 510 , video information display 520 , recorded video 530 , seek bar 540 , completed task information 550 , completed task list 560 and add button 570 . The recorded video 530 is an example of a video display area, and the completed task information 550 and the completed task list 560 are examples of a task display area.

A switching tab 510 is an object for switching between the recorded video display screen 500 and the live video display screen 400 . When the administrator operates the administrator terminal operation unit 54 and selects the "live video" of the switching tab 510, the live video display screen 400 is displayed instead of the recorded video display screen 500. FIG. The video information display 520 is an object for displaying information about the displayed recorded video. In the example shown in FIG. 9, the video ID and the start time and end time of the video are shown as the information about the recorded video.

The recorded video 530 is a video showing the past situation of the store, stored in the management device 6 . In the example shown in FIG. 8, images captured by six image capturing devices 2 and stored in the management device 6 are displayed. The seek bar 540 is an object for indicating the playback part of the displayed recorded video 530 . The seek bar 540 indicates the time when the frame image displayed as the recorded video 530 was captured by its position on the recorded video display screen 500 . When the administrator operates the administrator terminal operation unit 54 to operate the seek bar 540, the playback position of the recorded video is changed. Recorded video 530 is displayed as a moving image, but may be displayed as a still image.

The completed task information 550 is an object that displays a selectable list of information on only tasks set to the completed state among the generated tasks. The completed task information 550 is displayed so that the position of the work time of each task on the seek bar 540 can be identified. In the example shown in FIG. 9 , the task “replenishment of product shelf B” is arranged below the current reproduction position of the seek bar 540 . That is, it is shown that the image of the working time of the task "replenishment of product shelf B" is currently being displayed. On the right side of the task "replenishment of product shelf B", the task "inspection of product shelf A" is arranged. That is, it is shown that the image of the work time of "inspection of product shelf A" is displayed after the image of the work time of "replenishment of product shelf B". When the seek bar 540 is operated and the playback position is moved to the position of the task "inspection of product shelf A", the image of the work time of "inspection of product shelf A" is displayed.

In addition, the completed task information 550 displays a selectable list of the contents of the report generated based on the employee's operation input. In the example shown in FIG. 9, a report on "suspicious person" is displayed on the right side of the task "inspection of product shelf A". In other words, it is shown that the image of the reporting time of the "suspicious individual" is displayed after the image of the working time of the "inspection of the product shelf A". As a result, the manager can confirm the report from the employee together with the video at the time of the report, so that the manager can easily and accurately grasp the situation of the store.

The completed task list 560 is a list that displays in a selectable manner information about only tasks that have been set to the completed state among the generated tasks. An add button 570 is an object for creating a new task. When the administrator operates the administrator terminal operation unit 54 to select the add button 570, a screen similar to the task addition screen 200 described above is displayed.

When one of the tasks displayed in the completed task list 440 of the live video display screen 400 is selected, the recorded video display screen 500 is displayed instead of the live video display screen 400 . At this time, the recorded video display screen 500 is displayed such that the playback location indicated by the seek bar 540 is the working time of the selected task. Then, in the recorded video 530, the video following the frame image at the working time of the selected task is displayed. For example, when the task "replenishment of product shelf B" in the completed task list 440 of the live video display screen 400 shown in FIG. 8 is selected, as shown in FIG. The recorded video display screen 500 is displayed in a state where the work time for "Replenishment" has come. Also, in the recorded video 530, a video following the frame image at the work time of "replenishment of product shelf B" is displayed. This makes it possible for the manager to easily grasp the status of the completed work.

Even when one of the tasks displayed in the completed task list 560 of the recorded video display screen 500 is selected, the playback location indicated by the seek bar 540 is the working time of the selected task. Also, in the recorded video 530, a video following the frame image at the working time of the selected task is displayed.

Also, when any task is selected from among the tasks displayed in the completed task information 550, the playback location indicated by the seek bar 540 becomes the working time of the selected task. Also, in the recorded video 530, a video following the frame image at the working time of the selected task is displayed. Even if one of the reports displayed in the completed task information 550 is selected, the playback location indicated by the seek bar 540 becomes the time of the selected report, and the recorded video 530 shows the frame image of the time of the selected report. The image that follows is displayed.

In the above description, the completed task information 550 of the recorded video display screen 500 displays tasks in a selectable manner, but the tasks displayed in the completed task information 550 may not be selectable. In this case as well, since the completed task information 550 indicates the position of the work time of each task on the seek bar 540, the administrator can set the playback position of the seek bar 540 to the position where each task is displayed (in the example shown in FIG. 9, , position of the flag mark), the work status of the store can be easily grasped.

Also, part of the completed task list 440 on the live video display screen 400 and the completed task information 550 and completed task list 560 on the recorded video display screen 500 may not be displayed. Instead of completed task lists 440 and 560, a list containing tasks that have not been set to a completed state may be displayed.

The flow of processing executed by the management device 6 will be described below. The management device 6 executes task manual generation processing, task display processing, completion state setting processing, automatic determination processing, notification processing, and image display processing. These processes are realized by the processing unit 63 cooperating with each component of the management device 6 based on the programs stored in the storage unit 61 . Also, these processes are executed in parallel.

FIG. 10 is a flowchart showing the flow of task manual generation processing. The task manual generation process is executed in response to the store terminal 4 or the administrator terminal 5 transmitting a task generation instruction to the management device 6 . The store terminal 4 transmits a task generation instruction via the store terminal communication unit 42 in response to the selection of the add button 220 on the task addition screen 200 . The administrator terminal 5, based on the operation input to the task addition screen displayed when the add button 450 of the live video display screen 400 or the add button 570 of the recorded video display screen 500 is selected, the administrator terminal communication unit 52 to send task creation instructions.

First, the acquisition unit 631 acquires a task generation instruction via the communication unit 62 (step S11). The task generation instruction includes the work content, deadline and priority based on the employee's operation input to the store terminal operation unit 44 or the manager's operation input to the manager terminal operation unit 54 .

Next, the generation unit 632 identifies the task type based on the content of the generation instruction (step S12). The generation unit 632 acquires the work content included in the generation instruction. The generation unit 632 refers to the type table 613 and identifies the type of task based on the manually generated keyword included in the acquired work content.

Next, the generation unit 632 generates a task of the identified type (step S13). The generation unit 632 generates the identified type, information indicating that the manual generation method has been used, information indicating that the completion state is set based on the manual completion condition, and the work content, deadline, and Set priorities and store tasks in task table 612 . With this, the task manual generation processing ends.

FIG. 11 is a flowchart showing the flow of task display processing. The task display process is executed in response to the shop terminal 4 transmitting a request to display the task display screen 100 to the management device 6 . The store terminal 4 transmits a request to display the task display screen 100 via the store terminal communication unit 42 in response to the store terminal operation unit 44 being operated to execute an application program for displaying the task display screen 100 . .

First, the acquisition unit 631 acquires a display request for the task display screen 100 via the communication unit 62 (step S21).

Next, the display control unit 633 generates display data for the task display screen 100 (step S22). The display control unit 633 acquires information about tasks displayed in the task list 110 of the task display screen 100 from the task table 612 . The display control unit 633 refers to the task table 612 and determines whether or not to display each completion button 120 based on whether or not manual completion conditions are set for each task. The display control unit 633 generates display data for the task display screen 100 that displays each object such as the task list 110 and the completion button 120 based on a preset layout.

Next, the display control unit 633 causes the store terminal 4 to display the task display screen 100 by transmitting the display data of the task display screen 100 to the store terminal 4 via the communication unit 62 (step S23). . With this, the task display processing ends.

FIG. 12 is a flow chart showing the flow of completion state setting processing. The completion state setting process is executed in response to the store terminal 4 transmitting a task completion instruction to the management device 6 . The store terminal 4 instructs the completion of the task for which the completion button 120 is selected via the store terminal communication unit 42 in response to the operation input for selecting the completion button 120 of the task display screen 100 to the store terminal operation unit 44. Send.

First, the acquisition unit 631 acquires a task completion instruction via the communication unit 62 (step S31). The task completion instruction includes the task ID of the task for which the completion button 120 was selected.

Next, the setting unit 634 sets the task to the completed state based on the completion instruction (step S32). The setting unit 634 sets the task indicated by the task ID included in the completion instruction to the completed state in the task table 612 . The setting unit 634 stores the current time as the task completion time in the task table 612 . The setting unit 634 may store the time when the completion button 120 was selected or the time when the task completion instruction was sent as the task completion time.

Next, the specifying unit 635 calculates the work time based on the completion time and type of the task set to the completed state (step S33). The identifying unit 635 acquires from the task table 612 the types of tasks set to the completed state. The identifying unit 635 acquires from the type table 613 the work time calculation method corresponding to the acquired type. The identifying unit 635 calculates the work time from the task completion time based on the acquired calculation method.

Next, the identification unit 635 identifies an image at work time from among the images stored in the storage unit 61 (step S34). The specifying unit 635 refers to the video table 611 and specifies the video including the frame image at the work time. The identifying unit 635 identifies the frame image at the work time from among the identified videos. The frame image at the work time is specified, for example, based on the time stamp added to the frame image included in the video. The identifying unit 635 associates the identified frame image with information indicating that the image is an image of the work status of the task set to the completed state. In this way, the identifying unit 635 identifies the position on the time axis of the video corresponding to the work time. This completes the completion status setting process.

FIG. 13 is a flowchart showing the flow of automatic determination processing. The automatic determination process is executed by the management device 6 at predetermined time intervals.

First, the acquisition unit 631 acquires sensor information via the communication unit 62 (step S41). The acquisition unit 631 acquires, as sensor information, an image of the situation of the store from the imaging device 2 via the communication unit 62 . In addition, the acquisition unit 631 acquires various kinds of information indicating the situation of the store generated by the sensor 3 from the sensor 3 via the communication unit 62 as sensor information. The acquisition unit 631 stores the acquired sensor information in the storage unit 61 .

Next, the generation unit 632 determines whether or not generation conditions for generating tasks by the automatic generation method are satisfied (step S42). Based on the sensor information stored in the storage unit 61, the generation unit 632 determines whether various generation conditions stored in the type table 613 are satisfied.

For example, if the information generated by the weight sensor installed on the product shelf indicates that the weight of the product placed on the product shelf has been below the threshold continuously for a predetermined time or longer, the generation unit 632 determines that the generation condition for the "product shelf sensor" is satisfied. Further, when the information generated by the ultrasonic sensor installed in the trash can indicates that the content of the trash can is equal to or greater than the threshold continuously for a predetermined time or longer, the generating unit 632 generates It is judged that the generation condition is satisfied.

Further, when the image generated by the photographing device 2 continuously indicates that the floor of the store is dirty for a predetermined time or longer, the generation unit 632 determines that the generation condition regarding the “image” is satisfied. For example, the generation unit 632 applies a method such as a background subtraction method to the frame images included in the video generated by the imaging device 2, and specifies a difference region having different pixel values from a preset background image. The generation unit 632 determines whether or not the difference area includes dirt on the floor by extracting the feature amount of the specified difference area. The generation unit 632 applies such processing to a plurality of images captured at consecutive times, thereby determining whether or not the image continuously indicates that the floor of the store is dirty for a predetermined time or longer. do.

If any task generation condition is satisfied (step S42-Yes), the generation unit 632 generates a task of the type that satisfies the generation condition (step S43). The generation unit 632 sets the work content of the task to be generated based on the sensor information that satisfies the generation condition. For example, when the sensor information that satisfies the generation condition is the weight sensor installed on the “merchandise shelf B” and the type of task to be generated is “merchandise replenishment”, the generation unit 632 Based on the given rule, the work content of "replenishment of product shelf B" is set. The generation unit 632 refers to the type table 613 and sets the deadline and priority of the task to be generated. Moreover, the generation unit 632 sets the content of the automatic completion condition of the task to be generated based on the sensor information that satisfies the generation condition. For example, when the sensor information that satisfies the generation condition is the weight sensor of "product shelf B", the generation unit 632 sets the automatic completion condition as the completion condition of the generated task. Further, the generation unit 632 sets that the task to be generated is set to the completed state based on the sensor information generated by the weight sensor of "merchandise shelf B". The generation unit 632 stores the task associated with the set work content, completion condition, sensor information, deadline, and priority in the task table 612 .

If none of the task automatic generation conditions are satisfied (step S42-No), the automatic determination process proceeds to step S44.

Next, the setting unit 634 determines whether or not the automatic task completion condition is satisfied (step S44). The setting unit 634 determines whether or not the completion condition of each task stored in the task table 612 is satisfied based on the sensor information stored in the storage unit 61 .

If it is determined that the task automatic completion condition is satisfied (step S44-Yes), the setting unit 634 sets the task satisfying the automatic completion condition to the completed state (step S45). The specifying unit 635 also calculates the work time of the task set to the completed state (step S46), and specifies the image of the work time from among the images stored in the storage unit 61 (step S47). The processing of steps S45-S47 is the same as the processing of steps S32-S34 of the completion state setting processing. With the above, the automatic determination processing ends.

FIG. 14 is a flowchart showing the flow of notification processing. The notification process is executed by the management device 6 at predetermined time intervals.

First, the calculation unit 636 determines whether or not a task that has not been set to the completed state is stored in the task table 612 (step S51). If there are no stored tasks that have not been set to the completed state (step S51-No), the notification process ends.

If a task that is not set to the completed state is stored (step S51-Yes), the calculation unit 636 estimates by calculating the busyness of the store (step S52). For example, the calculation unit 636 calculates the degree of busyness based on the number of employees in the store, the number of customers in the store, and the number of tasks not set to the completed state.

The number of employees of the store is calculated, for example, based on the number of employees for each time period stored in advance in the storage unit 61 and the current time. The number of customers in the store is calculated based on the image of the store generated by the imaging device 2, for example. In this case, the person area is extracted from the plurality of frame images of the video generated by the photographing device 2 based on the feature amount. Then, the number of people in the store is calculated by associating the same person between a plurality of frame images using a known tracking technology or the like. The number of customers at the store is calculated by subtracting the number of employees from the calculated number of people. The number of tasks not set to completed is calculated based on task table 612 .

The calculation unit 636 calculates the degree of busyness based on whether or not the number of employees at the store, the number of customers at the store, and time information (time zone, date, time, etc.) satisfy predetermined conditions. For example, the calculation unit 636 determines that the busyness degree is calculated as high. The calculation unit 636 satisfies one or more of the conditions that the busyness is not calculated to be high, the number of staff is two, the number of customers is three or more, and it is nighttime. If the conditions are satisfied, the busyness is calculated as medium. The calculation unit 636 calculates that the busyness is low when the busyness is not high or medium.

The method of calculating the degree of busyness is not limited to the example described above. For example, the busyness level may be calculated further based on the status (eg, priority) of tasks that are not set to the completed state. Also, the degree of busyness may be calculated based on the number of customers waiting for checkout instead of or in addition to the number of customers at the store. Also, the busyness may be calculated further based on weather information. Also, as the time period, a time period in which an employee changes, a time period in which specific work is performed (for example, delivery of goods), or a time period in which an event such as a sale is held may be used.

Also, the busyness may be calculated using only one or two of the number of employees of the store, the number of customers of the store, and time information. The degree of busyness may be calculated by comprehensively considering the number of employees at the store, the number of customers at the store, and time information. For example, if the number of employees is 1, the number of customers is 10 or more, and the daytime is 3 points, the number of staff is 2, the number of customers is 3 to 9, and the night is 3 points. 2 points are given for each time period, and 1 point is given for each time period where the number of staff is 3 or more, the number of customers is 2 or less, and the time period in the morning. When the total points are 7 points or more, it is calculated that the busyness degree is high;

Next, the notification unit 637 determines whether or not the conditions for notifying the employee are satisfied (step S53). The condition for notifying the employee is based on the store's busyness. For example, the condition for notifying the employee is that the degree of busyness is equal to or less than a predetermined value.

If the condition for notifying the employee is not satisfied (step S53-No), the process proceeds to step S55.

If the conditions for notifying the employee are satisfied (step S53-Yes), the notification unit 637 outputs a notification prompting execution of the work indicated by the task to the store terminal 4 (step S54). For example, the notification unit 637 transmits, via the communication unit 62, an instruction to notify a notification server (not shown) of a message including the work content of the task that has not been set to the completed state. Upon receiving the notification instruction, the notification server transmits to the store terminal 4 a notification including a message prompting execution of the work indicated by the task whose elapsed time from the deadline is equal to or longer than a predetermined time. Upon receiving the notification, the store terminal 4 pops up a message prompting the execution of the work. The message prompting the execution of the work is, for example, "Please execute the replenishment of product shelf B." The notification server may be a mail server, a push notification server, or the like. Note that the notification server may transmit the notification to a mobile terminal or the like carried by the employee, in addition to the store terminal 4 .

Next, the notification unit 637 determines whether or not the conditions for notifying the administrator are satisfied (step S55). The condition for notifying the administrator is, for example, that the task indicated by the notification has not been set to the completed state even after a predetermined period of time has passed since the notification was output to the store terminal 4 .

If the conditions for notifying the administrator are not satisfied (step S55-No), the notification process ends.

If the conditions for notifying the administrator are satisfied (step S55-Yes), the notification unit 637 outputs a notification prompting execution of the work indicated by the task to the administrator terminal 5 (step S54). For example, the notification unit 637 transmits to the administrator terminal 5 via the notification server a message prompting execution of the work indicated by the task not set to the completed state. With the above, the notification process ends.

15 and 16 are flowcharts showing an example of the flow of video display processing. The image display process is executed when the administrator terminal 5 transmits a display request for the live image display screen 400 . The administrator terminal 5 executes the application program for displaying the live video display screen 400. In response to an operation input to the administrator terminal operation unit 54, the administrator terminal 5 performs live A display request for the image display screen 400 is transmitted.

Referring to FIG. 15, acquisition unit 631 first acquires a display request for live video display screen 400 via communication unit 62 (step S61).

Next, the display control unit 633 generates display data for the live video display screen 400 (step S62). The display control unit 633 acquires from the task table 612 information about tasks set to the completed state, which are displayed in the completed task list 440 of the live video display screen 400 . The display control unit 633 generates display data for the live video display screen 400 that displays each object including the completed task list 440 based on a preset layout.

Next, the display control unit 633 causes the administrator terminal 5 to display the live image display screen 400 by transmitting the display data of the live image display screen 400 to the administrator terminal 5 via the communication unit 62 (step S63).

Next, the display control unit 633 transmits the latest frame image among the images stored in the storage unit 61 to the administrator terminal 5 via the communication unit 62 (step S64). The transmitted image is displayed as live video 430 on live video display screen 400 on administrator terminal 5 .

Next, the display control unit 633 determines whether or not a task selection instruction has been received from the administrator terminal 5 (step S65). When one of the tasks displayed in the completed task list 440 of the live video display screen 400 is selected, the administrator terminal 5 transmits a task selection instruction via the administrator terminal communication unit 52. do. The task selection instruction includes the task ID of the selected task.

If a task selection instruction has been received (step S65-Yes), the display control unit 633 sets the frame image associated with the information indicating that the work status of the selected task has been captured as the playback portion of the recorded video. Set (step S65a). The video display process proceeds to step S71 to display the recorded video display screen 500. FIG.

If no task selection instruction has been received (step S65-No), the display control unit 633 determines whether or not a switching instruction has been received from the administrator terminal 5 (step S66). The administrator terminal 5 transmits a switching instruction via the administrator terminal communication unit 52 when the switching tab 410 on the live video display screen 400 is selected.

If a switching instruction has been received (step S66-Yes), the video display process proceeds to step S71 to display the recorded video display screen 500. FIG.

If no switching instruction has been received (step S66-No), the display control unit 633 determines whether or not an end instruction has been received from the administrator terminal 5 (step S67). The administrator terminal 5 transmits an end instruction via the administrator terminal communication unit 52 when an operation input to end the display of the live image display screen 400 is performed to the administrator terminal operation unit 54 .

If the end instruction has been received (step S67-Yes), the video display process ends.

If the end instruction has not been received (step S67-No), the process returns to step S64, and the display control unit 633 transmits the latest frame image among the images stored in the storage unit 61 to the administrator terminal 5 again. . That is, the display control unit 633 sequentially transmits the latest frame images acquired from the imaging device 2 and stored in the storage unit 61 to the administrator terminal 5 until a task selection instruction, switching instruction, or end instruction is received. . As a result, the situation of the store is displayed on the manager terminal 5 in real time.

Referring to FIG. 16, when a task selection instruction or switching instruction is received, display control unit 633 generates display data for recorded video display screen 500 (step S71). When the playback position of the recorded video is set, the display control unit 633 sets the seek bar 540 of the recorded video display screen 500 so as to indicate the set playback position. When the playback position of the recorded video is not set, the display control unit 633 sets the playback position of the seek bar 540 so as to indicate the start point of a predetermined video (for example, the video of the latest generated video file). . The display control unit 633 also acquires from the task table 612 information about tasks set to the completed state, which are displayed in the completed task list 560 of the recorded video display screen 500 . The display control unit 633 generates display data for the recorded video display screen 500 that displays each object including the seek bar 540 and the completed task list 560 based on a preset layout.

Next, the display control unit 633 causes the administrator terminal 5 to display the recorded image display screen 500 by transmitting the display data of the recorded image display screen 500 to the administrator terminal 5 via the communication unit 62 (step S72).

Next, the display control unit 633 transmits a frame image of the video stored in the storage unit 61 that follows the current playback position to the administrator terminal 5 via the communication unit 62 (step S73). The transmitted image is displayed as the recorded video 530 on the recorded video display screen 500 on the administrator terminal 5 .

Next, the display control unit 633 determines whether or not a task selection instruction has been received from the administrator terminal 5 (step S74). When one of the tasks displayed in the completed task list 560 of the recorded video display screen 500 is selected, the administrator terminal 5 transmits a task selection instruction via the administrator terminal communication unit 52. do. The task selection instruction includes the task ID of the selected task.

If a task selection instruction has been received (step S74-Yes), the display control unit 633 sets the playback location to the working time of the selected task (step S74a). The display control unit 633 sets the frame image associated with the information indicating that the work status of the selected task has been captured as the playback portion. Thereafter, the process proceeds to step S73, and the display control unit 633 transmits to the administrator terminal 5 the frame image following the set playback position in the video stored in the storage unit 61. FIG. As a result, the manager terminal 5 displays an image of the state of work indicated by the selected task.

If no task selection instruction has been received (step S74-No), the display control unit 633 determines whether or not a seek bar operation instruction has been received from the administrator terminal 5 (step S75). The administrator terminal 5 transmits a seek bar operation instruction via the administrator terminal communication unit 52 when the seek bar on the recorded video display screen is operated and the playback position is changed. The seek bar operation instruction includes information indicating the changed playback location.

If the seek bar operation instruction has been received (step S75-Yes), the display control unit 633 identifies the frame image at the time designated by the seek bar operation based on the time stamp, and displays the identified frame image in the recorded video. It is set as a playback location (step S75a). Thereafter, the process proceeds to step S73, and the display control unit 633 transmits to the administrator terminal 5 the frame image following the set playback position in the video stored in the storage unit 61. FIG. As a result, the manager terminal 5 displays the image of the situation of the store at the time corresponding to the specified reproduction point.

If a seek bar operation instruction has not been received (step S75-No), the display control unit 633 determines whether or not a switching instruction has been received (step S76). The administrator terminal 5 transmits a switching instruction via the administrator terminal communication unit 52 when the switch tab 510 on the recorded video display screen 500 is selected.

If a switching instruction has been received (step S76-Yes), the video display process proceeds to step S62 to display the live video display screen 400. FIG.

If no switching instruction has been received (step S76-No), the display control unit 633 determines whether or not an end instruction has been received (step S77). The administrator terminal 5 transmits an end instruction via the administrator terminal communication unit 52 when an operation input to end the display of the live image display screen 400 is performed to the administrator terminal operation unit 54 .

If the end instruction has been received (step S77-Yes), the video display process ends.

If the end instruction has not been received (step S77--No), the process returns to step S73, and the display control unit 633 reproduces the frame image following the current playback position from the video stored in the storage unit 61 again on the administrator terminal. 5. That is, the display control unit 633 sequentially sends the frame images acquired from the imaging device 2 and stored in the storage unit 61 to the administrator terminal 5 until a task selection instruction, a seek bar operation instruction, a switching instruction, or an end instruction is received. Send. As a result, an image of the state of the store is displayed on the manager terminal 5 .

As described above, the management device 6 uses either the manual completion condition or the automatic completion condition to set the task to the completed state depending on whether the task was created by the manual creation method or the automatic creation method. make the dolphins different. This allows the management device 6 to appropriately manage whether or not the work to be done at the store has been completed.

In addition, the management device 6 calculates the busyness of the store, and based on the busyness, outputs a notification prompting the execution of the work indicated by the task that is not set to the completed state. As a result, the management device 6 can appropriately prompt the execution of the work that should be done at the store while considering the burden on the employee.

Preferably, the management device 6 calculates the degree of busyness based on the number of customers in the store, the number of employees in the store, and time information. As a result, the busyness level can be calculated appropriately based on various factors of the store, so that the management device 6 can appropriately execute the work to be done at the store while considering the burden on the employees from various angles. make it possible to encourage

In addition, the management device 6 outputs a notification to the store terminal 4, and if the task indicated by the notification has not been set to the completed state even after a predetermined time has elapsed since the output of the notification, the management device 6 output more notifications. As a result, the manager is notified only when the work that should be done at the store is not executed for a predetermined period of time. It is possible to encourage

In addition, the management device 6 causes the administrator terminal 5 to selectably display the tasks set to the completed state, and when one of the displayed tasks is selected, the operation indicated by the selected task is performed. The administrator terminal 5 is caused to display a frame image obtained by photographing the situation. As a result, the management device 6 enables the manager to easily grasp the work status of the store.

Preferably, the management device 6 calculates the work time based on the completion time of the task and the type of task, specifies the frame image of the work time, and when any task is selected on the administrator terminal 5 , to display the specified frame image. As a result, the management device 6 enables the manager to easily grasp the status of the work appropriately according to the type of work.

Preferably, the management device 6 causes the administrator terminal 5 to display a completed task list in which only the tasks set to the completed state are displayed in a selectable manner. As a result, it is possible to select only tasks set to the completed state, that is, tasks for which a video of the work situation is specified. make it possible to comprehend

Preferably, the management device 6 displays, on the administrator terminal 5, a seek bar indicating the playback position of the video displayed on the administrator terminal 5, and also displays the position of the work time of the task on the seek bar in an identifiable manner. . As a result, the management device 6 allows the manager to operate the seek bar and intuitively grasp the work status of the store.

In addition, the management device 6 causes the administrator terminal 5 to display a live image, and when any task is selected on the administrator terminal 5, instead of the live image, a frame image of the work time of the selected task is displayed. display. As a result, the management device 6 allows the manager to grasp the situation of the store in real time while also grasping the situation of the work.

Various modifications as described below may be applied to the management device 6 .

In the above description, the setting unit 634 uses either the manual completion condition or the automatic completion condition to set the task to the completed state, but it is not limited to this example. The setting unit 634 may set the task generated by the automatic generation method to the completed state when both the manual completion condition and the automatic completion condition are satisfied.

In this case, in step S43 of the automatic determination process, the generation unit 632 sets both the manual completion condition and the automatic completion condition as completion conditions for the task to be generated. Also, in step S44, the setting unit 634 determines whether or not the automatic completion condition and the manual completion condition are satisfied.

If both the automatic completion condition and the manual completion condition are satisfied, the setting unit 634 sets the task to the completed state, calculates the work time of the task, and identifies the image of the work time (steps S45-S47). . Satisfaction of the manual completion condition means that the acquisition unit 631 has already acquired a task completion instruction. If both the automatic completion condition and the manual completion condition are not satisfied, the automatic determination process ends. If only one of the automatic completion condition and the manual completion condition is satisfied, the setting unit 634 stores information indicating that one of the conditions is satisfied in association with the task, and the automatic determination process ends. .

In addition, in step S32 of the completion state setting process, the setting unit 634 determines whether information indicating that the automatic completion condition is satisfied is associated with the task for which the completion instruction has been acquired. The setting unit 634 sets the task to the completed state only when information indicating that the automatic completion condition is satisfied is associated with the task.

By doing this, the task is set to the completed state based on both the employee's operation input and the sensor information, so whether or not the work to be done in the store is completed can be managed more accurately. be.

Further, when it is determined in step S44 that the automatic completion condition is satisfied but the manual completion condition is not satisfied, the notification unit 637 notifies the store terminal 4 or the administrator terminal 5 of a notification prompting the user to input an operation. You may make it output. As a result, it is possible to prevent the employee from forgetting to input an operation indicating that the work has been completed and whether or not the work has been completed is not appropriately managed.

In the above description, the generation unit 632 generates a task based on sensor information as an automatic generation method in step S42 of the automatic determination process, but the present invention is not limited to this example. As an automatic generation method, the generation unit 632 may generate a task at predetermined time intervals based on a schedule.

In this case, in step S42, the generation unit 632 generates a preset type of task when the current time is a preset predetermined time. If an automatic completion condition is associated with the type of task to be generated in the type table 613, the generation unit 632 sets the automatic completion condition as the completion condition of the task to be generated, and determines the type of task to be generated. is not associated with an automatic completion condition, set the manual completion condition as the completion condition of the generated task.

The work indicated by the task generated at predetermined time intervals is often related to routine work. In this case, unlike the case where tasks are generated by the manual generation method, it is possible to appropriately determine whether or not the work has been completed based on sensor information. Therefore, as an automatic generation method, by associating an automatic completion condition with a task generated at predetermined time intervals, it is possible to appropriately determine whether or not the work is completed.

In the above description, in step S12 of the task generation process, the generation unit 632 identifies the task type based on the manually generated keyword included in the work content input by the user. Not limited. The generation unit 632 applies known morphological analysis and semantic analysis to the character string of the work content, and generates the type most closely related to the character string of the work content from among a plurality of preset types. It may be specified as a type of task. The generation unit 632 may also specify the type of task to be generated by applying a learned model generated by machine learning to the character string of the work content.

In the above description, in steps S53-S54 of the notification process, the notification unit 637 outputs a notification prompting the execution of the work indicated by the task that is not set to the completed state based on the busyness of the store. It is not limited to such examples. The notification unit 637 may output a notification prompting execution of the work indicated by each task, further based on the status of each task that is not set to the completed state.

The task status is, for example, the elapsed time from the deadline of the task. In this case, in step S54, the notification unit 637 outputs a notification only for tasks whose elapsed time from the deadline is equal to or longer than a predetermined time. The task status may be the elapsed time since the task was created. In this case, in step S54, the notification unit 637 outputs a notification only for tasks for which the elapsed time since the task was created is equal to or longer than a predetermined time. The task status may be the number of tasks that are not set to a completed state. In this case, the notification unit 637 outputs a notification when the number of tasks not set to the completed state is equal to or greater than a predetermined number in step S54. The task status may be the priority of the task. In this case, in step S54, the notification unit 637 outputs a notification only for tasks whose priority is equal to or higher than a predetermined value. Also, the task status may be both the elapsed time from the deadline or the elapsed time since the task was created and the priority. In this case, in step S54, the notification unit 637 outputs a notification only for tasks for which the elapsed time from the deadline or the elapsed time since the task was generated is equal to or longer than a predetermined time that differs depending on the priority.

In the above description, the notification unit 637 outputs a notification to the shop terminal 4 in steps S53-S54 of the notification process, and outputs a notification to the manager terminal 5 in steps S55-S56. is not limited to The notification unit 637 may output notifications to the store terminal 4 and the manager terminal 5 at the same time when a condition common to the employee and the manager is satisfied.

In the above description, the specifying unit 635 specifies the frame image at the work time in steps S33-S34 of the completion state setting process and steps S46-S47 of the automatic determination process. do not have. The identifying unit 635 may identify the frame image at the completion time of the task without calculating the work time. In this case, steps S33 and S46 are not executed, and the specifying unit 635 adds information indicating that the frame image specified in steps S34 and S46 is an image at the completion time of the task set to the completed state. associate.

In steps S65a and S74a of the video display process, the display control unit 633 shoots the work status indicated by the selected task based on the frame image, which is the image of the completion time, and the type of the selected task. Display an image. For example, the display control unit 633 acquires the work time calculation method associated with the selected task type from the type table 613 . The display control unit 633 acquires the time stamp of the frame image associated with the information indicating that the selected task completion time image. The display control unit 633 sets the frame image to which the time stamp corresponding to the work time of the selected task is added as the reproduction portion based on the acquired time stamp and the calculation method of the work time. Even in this way, the manager can grasp the situation of the store in real time and further grasp the situation of the work.

The display control unit 633 may cut out and reproduce only the video from the start of work to the completion of work. In this case, the start time of the work may be set, for example, to a time that is a predetermined amount of time before the completion of the work depending on the task, or may be set based on the captured image. The work start time may be set by an employee or manager performing a work start operation on the store terminal 4 at the start of work. This prevents the administrator from unnecessarily continuing to check the video after the completion of the work.

The display control unit 633 reproduces the video of the task at a high playback speed (eg, 1.5x speed) in the case of a task that requires a certain amount of time or longer (eg, 10 minutes or longer). may As a result, the manager can efficiently check the work status.

FIG. 17 is a functional block diagram of a management device 16 according to another embodiment. The management device 16 has the same configuration as the management device 6 except for the differences described below. The management device 16 differs from the management device 6 in that it has a storage unit 161 instead of the storage unit 61 and the processing unit 63 .

Storage unit 161 differs from storage unit 61 in that it stores task table 1612 and type table 1613 instead of task table 612 and type table 613 .

18 shows the data structure of the task table 1612, and FIG. 19 shows the data structure of the type table 1613. As shown in FIG. The task table 1612 differs from the task table 612 in that the creation method and completion conditions are not stored. Also, the type table 1613 differs from the type table 1613 in that it stores information (manual/automatic) indicating whether to use the manual completion condition or the automatic completion condition. That is, in the management device 16, which of the manual completion condition and the automatic completion condition is used to set the task to the completed state differs according to the type of task.

Among the processes executed by the management device 16, differences from the processes executed by the management device 6 will be described below.

In step S13 of the task generation process, the generation unit 632 refers to the type table 1613 and determines whether the manual completion condition or the automatic completion condition is used for the task of the type identified in step S12. When the automatic completion condition is used, the generation unit 632 identifies sensor information used to determine the automatic completion condition based on the work content and the identified type included in the generation instruction. For example, if the work content includes the character string "merchandise shelf B" and the type is "merchandise replenishment", the weight sensor installed on the merchandise shelf B is used to determine the automatic completion condition. The generation unit 632 generates information indicating whether the completed state is set based on the manual completion condition or the automatic completion condition, sensor information used for determining the automatic completion condition, the work content included in the generation instruction, and the deadline. and priority, and stores the task in task table 1612 . This creates a task of the specified type.

Also, in step S43 of the automatic determination process, the generation unit 632 sets the work content and type of the generated task based on the sensor information that satisfies the generation conditions. The generation unit 632 refers to the type table 1613 and determines whether the manual completion condition or the automatic completion condition is used for the set type of task. When an automatic completion condition is used, the generation unit 632 sets sensor information that satisfies the generation condition as sensor information used to determine the automatic completion condition of the task to be generated. The generation unit 632 refers to the type table 1613 to set the deadline and priority of the task to be generated. The generation unit 632 stores the task associated with the set work content, completion condition, sensor information, deadline, and priority in the task table 1612 .

As described above, the management device 16 stores a plurality of types of tasks, and determines which of the manual completion condition and the automatic completion condition is used to set the task to the completed state according to the task type. . This enables the management device 16 to appropriately manage whether or not the work to be done at the store is completed.

Also, depending on the type of task and whether the task was generated by a manual or automatic generation method, the management device 16 may use either manual completion conditions or automatic completion conditions to set the task to a completed state. may be used differently. In this case, the type table 1613 stores information indicating whether to use the manual completion condition, the automatic completion condition, or the completion condition based on the generation method, instead of the information indicating manual/automatic.

In this case, in step S13 of the generation process, the generation unit 632 refers to the type table 1613 to determine whether the manual completion condition or the automatic completion condition is used for the task of the type identified in step S12. Determines if a method-based completion condition is used. When information indicating that a manual completion condition is used or information indicating that a completion condition based on the generation method is used is stored in the type table 1613, the generation unit 632 determines that the manual completion condition is used. . When information indicating that the automatic completion condition is used is stored in the type table 1613, the generation unit 632 determines that the automatic completion condition is used. When the automatic completion condition is used, the generation unit 632 identifies sensor information used to determine the automatic completion condition based on the work content and the identified type included in the generation instruction. The generation unit 632 generates information indicating whether the completed state is set based on the manual completion condition or the automatic completion condition, sensor information used for determining the automatic completion condition, the work content included in the generation instruction, and the deadline. and priority, and stores the task in task table 1612 .

Also, in step S43 of the automatic determination process, the generation unit 632 sets the work content and type of the generated task based on the sensor information that satisfies the generation conditions. The generation unit 632 refers to the type table 1613 and determines whether a manual completion condition, an automatic completion condition, or a generation method-based completion condition is used for the set type of task. When information indicating that the manual completion condition is used is stored in the type table 1613, the generation unit 632 determines that the manual completion condition is used. When information indicating that an automatic completion condition is used or information indicating that a completion condition based on a generation method is used is stored in the type table 1613, the generation unit 632 determines that the automatic completion condition is used. . When the automatic completion condition is used, the generation unit 632 identifies sensor information used to determine the automatic completion condition based on the work content and the identified type included in the generation instruction. The generation unit 632 generates information indicating whether the completed state is set based on the manual completion condition or the automatic completion condition, sensor information used for determining the automatic completion condition, the work content included in the generation instruction, and the deadline. and priority, and stores the task in task table 1612 .

By doing so, the management device 16 can more appropriately manage whether or not the work to be done in the store is completed. In other words, depending on the type of task, whether or not to use the completion condition according to the type may differ. For example, automatic completion conditions are set for types of tasks such as "replenishment of merchandise" and "cleaning", since it is possible to determine that the task has been completed based on sensor information. However, the "replenishment of goods" task generated by the manual generation method when the shelf is replenished with products different from the original, and the manually generated task when the floor is not dirty but wet and slippery For the "cleaning" task generated by the method, it may not be properly determined that the task is complete based on the sensor information. In addition to the type of task, by setting the completion conditions in consideration of the task generation method, the completion of the work can be determined appropriately even in such cases, so it is possible to check whether the work that should be done at the store is completed. whether or not is better managed.

Also in the management device 16, similarly to the management device 6, the setting unit 634 may set the completed state when both the manual completion condition and the automatic completion condition are satisfied. In this case, in the type table 1613, information indicating that either one or both of the manual completion condition and the automatic completion condition are used is set in advance according to the type of task. The notification unit 637 may output a notification to the shop terminal 4 when the automatic completion condition is satisfied but the manual completion condition is not satisfied.

It should be understood by those skilled in the art that various changes, substitutions and modifications can be made thereto without departing from the spirit and scope of the present invention. For example, the above-described embodiments and modifications may be combined as appropriate within the scope of the present invention.

1 store operation support system 6 management device 631 acquisition unit 632 generation unit 633 display control unit 634 setting unit 635 identification unit 636 calculation unit 637 notification unit

Claims (8)

storage means for storing a plurality of types of tasks, each of which indicates work to be done in the store;
setting means for setting the stored task to a completed state when a manual completion condition based on a user's operation input or an automatic completion condition not based on the operation input is satisfied;
display control means for displaying the stored tasks;
The setting means differentiates which of the manual completion condition and the automatic completion condition is used to set the task to a completed state, according to the type of the task;
A store operation support system characterized by: further comprising generating means for generating the plurality of types of tasks by a manual generation method based on a user's operation input or an automatic generation method not based on the operation input;
The setting means sets the manual completion condition and the Differentiating which of the automatic completion conditions is used,
The store management support system according to claim 1. further comprising generating means for generating the plurality of types of tasks by a manual generation method based on a user's operation input or an automatic generation method not based on the operation input;
The setting means sets the manual completion condition and the Differentiate which of the auto-completion conditions is used,
The store management support system according to claim 1. further comprising acquisition means for acquiring sensor information indicating the status of the store;
The setting means sets the automatic completion condition as setting a task generated based on the sensor information to a completed state when the sensor information satisfies a predetermined completion condition;
The store operation support system according to any one of claims 1-3. The setting means sets the task generated based on the sensor information to a completed state when both the manual completion condition and the automatic completion condition are satisfied.
The store management support system according to claim 4. further comprising notification means for outputting a notification prompting a user to input an operation when the automatic completion condition is satisfied and the manual completion condition is not satisfied;
The store management support system according to claim 5. the storage means associates and stores a plurality of tasks and types of each task;
When the operation input is performed as the manual generation method, the generation means generates a task of a type specified based on the content of the operation input.
The store management support system according to claim 2 or 3. A store operation support method executed by a store operation support system, comprising:
a storage step of storing multiple types of tasks indicating work to be done in the store;
a setting step of setting the stored task to a completed state when a manual completion condition based on a user operation input or an automatic completion condition not based on the operation input is met;
Differentiating between the manual completion condition and the automatic completion condition to set the task to a completed state according to the type of the task;
A store operation support method characterized by:

Images