JP2021114045A - Information processing system and information processing method - Google Patents

Abstract

To provide an information processing system allowing for easy confirmation of past transaction information in a POS terminal, and an information processing method.SOLUTION: An information processing system (monitoring apparatus 1) includes: a transaction information acquisition unit 111 which acquires transaction information in a POS terminal; an image acquisition unit 112 which acquires captured images from an imaging apparatus which images an area corresponding to the POS terminal; a transaction display unit 114 which displays a time bar having a length corresponding to transaction time corresponding to the transaction information acquired by the transaction information acquisition unit on a display screen, and displays, on the display screen, transaction information corresponding to the time bar when the time bar is selected on the display screen; and an image display unit 115 which displays a captured image corresponding to the transaction information acquired by the transaction information acquisition unit on the display screen.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing system and an information processing method.

Conventionally, a system has been proposed that can search transaction information and videos related to past transactions by storing transaction information on the POS terminal and images taken by a camera around the POS terminal in association with time information. (See, for example, Patent Document 1).

Japanese Patent No. 4283080

However, in the conventional technique, when searching for past transaction information, the user has to input information such as a transaction number and a transaction date and time on the search screen. Therefore, the convenience of user operation is low, and it is difficult for the user to easily search for the transaction information that he / she wants to confirm.

An object of the present invention is to provide an information processing system and an information processing method capable of easily confirming past transaction information on a POS terminal.

The information processing system according to one aspect of the present invention includes a transaction information acquisition unit that acquires transaction information in a POS terminal, an image acquisition unit that acquires an image captured from an image pickup device that images an area corresponding to the POS terminal, and an image acquisition unit. A time bar having a length corresponding to the transaction time corresponding to the transaction information acquired by the transaction information acquisition unit is displayed on the display screen, and when the time bar is selected on the display screen, the time bar is displayed. A transaction display unit that displays the transaction information corresponding to the above on the display screen, and an image display unit that displays the captured image corresponding to the transaction information acquired by the transaction information acquisition unit on the display screen. ..

The information processing method according to another aspect of the present invention includes a transaction information acquisition step of acquiring transaction information in a POS terminal, an image acquisition step of acquiring an image captured from an imaging device that images an area corresponding to the POS terminal, and the like. A time bar having a length corresponding to the transaction time corresponding to the transaction information acquired by the transaction information acquisition step is displayed on the display screen, and when the time bar is selected on the display screen, the time bar is displayed. A transaction display step for displaying the transaction information corresponding to the above on the display screen, and an image display step for displaying the captured image corresponding to the transaction information acquired by the transaction information acquisition step on the display screen. Or run on multiple processors.

According to the present invention, it is possible to easily confirm the past transaction information on the POS terminal.

FIG. 1 is a block diagram showing a configuration of a monitoring system according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of a receipt output from the POS terminal according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of transaction information used in the monitoring device according to the embodiment of the present invention. FIG. 4 is a diagram showing an example of bookmark information used in the monitoring device according to the embodiment of the present invention. FIG. 5 is a diagram showing an example of a display screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 6 is a diagram showing an example of transaction information displayed on the monitoring device according to the embodiment of the present invention. FIG. 7 is a diagram showing an example of a bookmark editing screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 8 is a diagram showing an example of a display screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 9 is a flowchart showing an example of a transaction processing procedure executed by the monitoring device according to the embodiment of the present invention. FIG. 10 is a flowchart showing an example of a procedure of bookmark registration processing executed by the monitoring device according to the embodiment of the present invention. FIG. 11 is a flowchart showing an example of the procedure of the reproduction process executed by the monitoring device according to the embodiment of the present invention. FIG. 12 is a flowchart showing an example of a procedure of bookmark editing processing executed by the monitoring device according to the embodiment of the present invention. FIG. 13 is a diagram showing an example of identification information used in the monitoring device according to the embodiment of the present invention. FIG. 14 is a diagram showing an example of transaction information used in the monitoring device according to the embodiment of the present invention. FIG. 15 is a diagram showing an example of a display screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 16 is a diagram showing an example of a bookmark editing screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 17 is a diagram showing an example of a color setting screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 18 is a flowchart showing an example of a procedure of bookmark editing processing executed by the monitoring device according to the embodiment of the present invention. FIG. 19 is a diagram showing an example of a display screen displayed on the monitoring device according to the embodiment of the present invention. FIG. 20 is a diagram showing an example of a display screen displayed on the monitoring device according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings for the purpose of understanding the present invention. The following embodiments are examples that embody the present invention, and do not limit the technical scope of the present invention.

The information processing system according to the present invention monitors an area around a POS terminal installed in a store (facility) such as a retail store or a restaurant. For example, the information processing system captures a monitoring area including the vicinity of a POS terminal installed at a cash register of a store with one or a plurality of cameras, and detects suspicious behavior by a user, an employee, or the like. In addition, the information processing system reproducibly records the captured image captured by the camera.

In the present embodiment, the monitoring device 10 alone corresponds to the information processing system according to the present invention. However, the information processing system according to the present invention may be composed of the POS terminal 20 alone, or may be composed of the monitoring device 10 and the POS terminal 20. For example, when a plurality of components of the monitoring device 10 and the POS terminal 20 collaborate to share and execute various processes (see FIGS. 9 to 12) described later, a plurality of configurations for executing the processes. The system including the elements corresponds to the information processing system according to the present invention.

[Monitoring system 1]
As shown in FIG. 1, the monitoring system 1 according to the embodiment of the present invention includes a monitoring device 10, a POS terminal 20, and a camera 30. The monitoring device 10, the POS terminal 20, and the camera 30 can communicate with each other via a communication network N1 such as the Internet, LAN, WAN, or a public telephone line. For example, the camera 30 is composed of a network camera. The POS terminal 20 and the camera 30 may be installed one by one or a plurality of cameras 30 in the store. Further, at least one camera 30 is installed corresponding to one POS terminal 20. In FIG. 1, as an example, one POS terminal 20 installed in the cash register area R1 of a store, one camera 30 capable of photographing the cash register area R1, and one POS installed in the cash register area R2. The terminal 20 and one camera 30 capable of photographing the cash register area R2 are shown.

[POS terminal 20]
The POS terminal 20 processes transactions for products sold by retail stores and manages transaction information such as product information and accounting information. The POS terminal 20 includes an operation display unit that displays product information and accounting information. The operation display unit displays an operation screen or the like that accepts operations by a user (for example, a clerk). Further, the POS terminal 20 outputs the transaction information to the monitoring device 10. Further, the POS terminal 20 generates journal data (receipt data) corresponding to the transaction and prints the receipt. FIG. 2 shows an example of the receipt. The transaction information includes at least one of receipt information, customer information, operator (clerk) information of the POS terminal 20, transaction type, and transaction date and time.

Specifically, the control unit of the POS terminal 20 executes a transaction process (see FIG. 9) described later by executing a control program stored in the storage unit of the POS terminal 20.

[Camera 30]
The camera 30 is an example of the image pickup apparatus of the present invention. The camera 30 includes an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and images a subject. The camera 30 continuously captures a subject at a predetermined frame rate, generates a frame image having a predetermined resolution, and sequentially transmits the frame image to the monitoring device 10. A well-known configuration can be applied to the camera 30. The camera 30 is installed at a predetermined position where a cash register area (surveillance area) around the corresponding POS terminal 20 can be photographed. The camera 30 may be included in the components of the monitoring device 10 or may be included in the components of the POS terminal 20. Further, the camera 30 may be an existing one in the store.

[Monitoring device 10]
As shown in FIG. 1, the monitoring device 10 includes a control unit 11, an operation display unit 12, a storage unit 13, a communication unit 14, and the like.

The operation display unit 12 is a user interface including a display unit such as a liquid crystal display or an organic EL display that displays various information, and an operation unit such as a mouse, keyboard, or touch panel that accepts operations. For example, the administrator (user) of the monitoring device 10 performs a bookmark editing operation (described later) corresponding to the transaction information, a captured image reproduction operation (described later), and the like on the operation display unit 12. The operation display unit 12 is an example of the display screen of the present invention.

The communication unit 14 connects the monitoring device 10 to the communication network N1 by wire or wirelessly, and performs data communication according to a predetermined communication protocol with an external device such as the POS terminal 20 and the camera 30 via the communication network N1. A communication interface for execution.

The storage unit 13 is a non-volatile storage unit such as a flash memory or an HDD that stores various types of information. For example, the storage unit 13 has a bookmark registration program for causing the control unit 11 to execute the bookmark registration process (see FIG. 10) described later, a reproduction program for causing the control unit 11 to execute the reproduction process (see FIG. 11), and a bookmark editing process (see FIG. 11). A control program such as a bookmark editing program for executing (see FIG. 12) is stored. For example, the bookmark registration program, the playback program, and the bookmark editing program are non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and are electrically connected to the monitoring device 10 in a CD drive or DVD. It is read by a reading device (not shown) such as a drive and stored in the storage unit 13.

Further, data such as transaction information D1 and bookmark information D2 are stored in the storage unit 13. Further, the storage unit 13 stores the image data of the captured image captured by the camera 30. FIG. 3 is a diagram showing an example of transaction information D1. FIG. 4 is a diagram showing an example of bookmark information D2.

As shown in FIG. 3, the transaction information output from the POS terminal 20 is registered in the transaction information D1. Specifically, information such as "ID", "transaction start date and time", "transaction end date and time", "title", "details", and "type" corresponding to each transaction is registered in the transaction information D1. .. The "ID" is transaction identification information, and information such as a number is registered for each transaction (for example, accounting). The “transaction start date and time” indicates the date and time when the transaction was started, and the “transaction end date and time” indicates the date and time when the transaction was completed. For example, the time when the information code of the first product among the products to be purchased by the user is read (scanned) at the cash register is registered as the transaction start date and time. Further, for example, the time when the accounting process of the product to be purchased by the user is completed at the cash register and the journal data is generated is registered as the transaction end date and time. That is, the transaction start date and time is information on the date and time when the transaction operation is started for one transaction, and the transaction end date and time is information on the date and time when the transaction operation is completed for one transaction.

Various information related to the transaction information is registered in the "title". For example, information about the store where the transaction was made (store name, store ID, etc.), information about the POS terminal 20 where the transaction was made (terminal name, terminal ID, etc.), information about the person in charge of the transaction (information about the person in charge of the transaction). The clerk name, clerk ID, etc.) are registered. "Details" are product information (product name, price, etc.) and accounting information related to transaction details. The product information listed in "Details" is registered, for example, in the order in which the product information code is read at the cash register. The "type" is information indicating the type (type) of the transaction. The types include sales processing, return processing, cancellation processing, exchange processing, and the like. The type is specified, for example, by the clerk selecting sales processing, return processing, cancellation processing, exchange processing, or the like on the operation screen displayed on the POS terminal 20.

Each piece of transaction information D1 is registered by the control unit 11 after the transaction information output from the POS terminal 20 is received by the monitoring device 10 each time a transaction is performed on the POS terminal 20.

As shown in FIG. 4, in the bookmark information D2, the transaction information acquired from the POS terminal 20 and the image information of the captured image acquired from the camera 30 are registered in association with each other. Specifically, information such as "ID", "transaction start date and time", "transaction end date and time", and "image ID" corresponding to each transaction is registered in the bookmark information D2. The "ID" is the identification information of the transaction and corresponds to the ID included in the transaction information D1. The "transaction start date and time" and the "transaction end date and time" correspond to the transaction start date and time and the transaction end date and time included in the transaction information D1. The "image ID" is identification information of image data from the transaction start date and time to the transaction end date and time. Here, date and time information such as the imaging date and time is added to the image data captured by the camera 30. The control unit 11 can extract image data from the transaction start date and time to the transaction end date and time from the image data. The control unit 11 sets identification information in the image data from the transaction start date and time to the transaction end date and time, and registers it in the image ID.

Each piece of bookmark information D2 is output from the transaction information and the camera 30 by the control unit 11 after the transaction information output from the POS terminal 20 is received by the monitoring device 10 each time a transaction is performed on the POS terminal 20. The information of the image data to be processed is registered in association with each other. That is, the transaction information corresponding to each transaction is registered in association with the captured image taken around the POS terminal 20 where the transaction was performed.

As another embodiment, even if a part or all of the information such as the transaction information D1, the bookmark information D2, and the image data is stored in another server accessible from the monitoring device 10 via the communication network N1. good. In this case, the control unit 11 of the monitoring device 10 may acquire the information from the other server and execute each process such as each control process described later.

The control unit 11 includes a CPU, a ROM, a RAM, and the like. The CPU is a processor that executes various arithmetic processes. The ROM stores in advance a control program such as a BIOS and an OS for causing the CPU to execute various processes. The RAM stores various information and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 11 controls the monitoring device 10 by executing various control programs stored in advance in the ROM or the storage unit 13 on the CPU.

Specifically, as shown in FIG. 1, the control unit 11 includes various types such as a transaction information acquisition unit 111, an image acquisition unit 112, a recording processing unit 113, a transaction display unit 114, an image display unit 115, and a reproduction processing unit 116. Includes processing unit. The control unit 11 functions as the various processing units by executing various processes according to the bookmark registration program, the reproduction program, and the bookmark editing program on the CPU. Further, a part or all of the processing units included in the control unit 11 may be composed of an electronic circuit. The bookmark registration program, the playback program, and the bookmark editing program on the CPU may be programs for causing a plurality of processors to function as the various processing units.

The transaction information acquisition unit 111 acquires the transaction information on the POS terminal 20. The transaction information acquisition unit 111 is an example of the transaction information acquisition unit of the present invention. Specifically, the transaction information acquisition unit 111 acquires the transaction information output from the POS terminal 20 each time a transaction is performed on the POS terminal 20.

The image acquisition unit 112 acquires an captured image from the camera 30 that images the region corresponding to the POS terminal 20. The image acquisition unit 112 is an example of the image acquisition unit of the present invention. For example, the image acquisition unit 112 acquires the image data of the captured image captured by the camera 30 in the cash register area R1 from the camera 30. Further, for example, the image acquisition unit 112 acquires the image data of the captured image captured by the camera 30 in the cash register area R2 from the camera 30. The image acquisition unit 112 stores the acquired image data in the storage unit 13.

The recording processing unit 113 records the transaction start date and time, the transaction end date and time, and the transaction content indicating the transaction content in association with each other. The recording processing unit 113 is an example of the recording processing unit of the present invention. Specifically, the recording processing unit 113 corresponds to the transaction with the transaction start date / time, the transaction end date / time, the title, the details, the type, etc. included in the transaction information acquired by the transaction information acquisition unit 111. The ID is assigned and registered in the transaction information D1 (see FIG. 2).

Further, the recording processing unit 113 sets identification information (image ID) corresponding to the image data from the transaction start date and time to the transaction end date and time among the image data acquired by the image acquisition unit 112, and bookmark information D2. Register in (see Fig. 3). In this way, the recording processing unit 113 registers information (bookmark information) including the transaction information and the image information associated with each other as bookmarks.

The transaction display unit 114 causes the operation display unit 12 (display screen) to display a time bar having a length corresponding to the transaction time corresponding to the transaction information acquired by the transaction information acquisition unit 111. Specifically, the transaction display unit 114 causes the operation display unit 12 to display a time bar having a length from the transaction start date and time to the transaction end date and time. Specifically, the transaction display unit 114 displays a reference time bar TB having a predetermined length on the operation display unit 12, and refers to one or more time bars corresponding to one or more of the transactions in chronological order. It is displayed overlaid on the time bar TB. The transaction display unit 114 is an example of the transaction display unit of the present invention.

For example, as shown in FIG. 5, the transaction display unit 114 displays a reference time bar TB having a length corresponding to the display area of the operation display unit 12. The total length (width) of the reference time bar TB shown in FIG. 5 corresponds to the length of "13:50 to 14:00" for 10 minutes. Further, the transaction display unit 114 includes a time bar T1 corresponding to the transaction of ID "0001", a time bar T2 corresponding to the transaction of ID "0002", and a time bar T3 corresponding to the transaction of ID "0003". Is superimposed on the reference time bar TB according to the time series. Further, the transaction display unit 114 displays the time bar T1 with a length corresponding to the transaction time (13:50:15 to 13:50:58), and displays the time bar T2 with the transaction time (13:55: 10-10: 13). : 56: 25) is displayed in a length corresponding to the transaction time (13:57: 10 to 13:59:53), and the time bar T3 is displayed in a length corresponding to the transaction time (13:57: 10 to 13:59:53).

Further, the transaction display unit 114 causes the operation display unit 12 to display the transaction information corresponding to the time bar when the time bar corresponding to the transaction is selected in the operation display unit 12. For example, on the display screen shown in FIG. 5, when the user specifies the time bar T2 with the mouse pointer MP, a finger, or the like (mouseover operation, touch operation, etc.), as shown in FIG. 6, the transaction display unit 114 sets the time. The transaction information F1 corresponding to the bar T2 is displayed on the operation display unit 12. In the transaction information F1, the transaction content of the ID "0002" corresponding to the time bar T2 and the transaction type "sales processing" are displayed.

Further, the transaction display unit 114 corresponds to the edit button K2 for editing the transaction information corresponding to the time bar when the time bar corresponding to the transaction is selected in the operation display unit 12, and the transaction. The play button K1 for playing back the captured image as a moving image is displayed. The transaction display unit 114 may display either the edit button K2 or the play button K1. Further, as shown in FIG. 6, the transaction display unit 114 may further display the delete button K3 for deleting the transaction information F1. The transaction display unit 114 is an example of the transaction display unit of the present invention.

Here, for example, in the transaction information F1 shown in FIG. 6, when the user selects (touches) the edit button K2, the transaction display unit 114 displays the bookmark edit screen F2 shown in FIG. 7. On the bookmark edit screen F2, the user can edit transaction information such as bookmark name (the title), details (transaction content), and type. In addition, the user can overwrite and save the edited contents by pressing the save button K4. When the transaction information is edited, the recording processing unit 113 updates the transaction information D1 (see FIG. 2).

The image display unit 115 causes the operation display unit 12 to display the captured image. Specifically, the image display unit 115 causes the operation display unit 12 to display the captured image corresponding to the transaction information acquired by the transaction information acquisition unit 111. More specifically, when the time bar is selected in the operation display unit 12, the image display unit 115 causes the operation display unit 12 to display the captured image corresponding to the transaction information corresponding to the time bar. The image display unit 115 is an example of the image display unit of the present invention.

For example, when the time bar is selected in the operation display unit 12, the image display unit 115 causes the operation display unit 12 to display the captured image of the date and time corresponding to the selected position of the time bar. For example, on the display screen shown in FIG. 5, when the user specifies the time bar T2 with the mouse pointer MP, a finger, or the like, as shown in FIG. 6, the image display unit 115 has an ID “0002” corresponding to the time bar T2. Of the captured images (captured images of 13:55: 10 to 13:56:25) of the associated image ID "P0002" (see FIG. 4), the captured images of the date and time corresponding to the selected position are displayed on the operation display unit 12. To display.

The reproduction processing unit 116 reproduces the captured image as a moving image. Specifically, when the time bar is selected in the operation display unit 12, the reproduction processing unit 116 operates and displays the captured image from the transaction start date and time to the transaction end date and time corresponding to the time bar. Let 12 play the moving image. For example, in the transaction information F1 shown in FIG. 6, when the user selects (touches) the play button K1, the playback processing unit 116 receives the captured image (13:55:10 to 13:56:25) corresponding to the transaction information F1. The captured image) is reproduced as a moving image on the operation display unit 12. The regeneration processing unit 116 is an example of the regeneration processing unit of the present invention.

Further, as shown in FIG. 8, the reproduction processing unit 116 causes the operation display unit 12 to display information indicating the date and time (imaging position date and time) during movie reproduction. In FIG. 8, the reproduction pointer SP points to the transaction start date and time.

[Transaction processing]
Next, with reference to FIG. 9, an example of a transaction processing procedure executed by the control unit of the POS terminal 20 will be described. The control unit starts the execution of the transaction process by starting the execution of the control program by reading the information code of the first product among the products to be purchased by the user at the cash register. Here, steps S11, S12, ... Represent the number of the processing procedure (step) executed by the control unit.

It should be noted that one or a plurality of steps included in the transaction processing described here may be omitted as appropriate. Further, the execution order of each step in the transaction processing may be different within the range in which the same action and effect are produced. Further, here, a case where each step in the transaction processing is executed by the control unit of the POS terminal 20 will be described as an example, but in other embodiments, each step in the transaction processing is performed by a plurality of other processors. May be distributed and executed. Further, the present invention can be regarded as an invention of a transaction method for executing one or a plurality of steps included in the transaction processing.

When the transaction operation (the reading operation) is started (S11: Yes), the control unit of the POS terminal 20 acquires the transaction start date and time (S12).

The control unit performs the reading operation until the transaction operation (the reading operation) is completed, that is, until the reading operation of all the products to be purchased is completed (S13).

When the transaction operation is completed, the control unit generates journal data (S14). Further, the control unit outputs a receipt (see FIG. 2) based on the journal data.

Next, the control unit acquires the transaction end date and time (S15). Next, the control unit outputs the transaction information including information such as the transaction start date and time, the transaction end date and time, the title, the details, and the type to the monitoring device 10 (S16).

The control unit executes the above-mentioned transaction processing for each transaction. The transaction includes sales processing related to product purchase, return processing of purchased products, sales cancellation processing, exchange processing, and the like.

[Bookmark registration process]
Next, an example of the procedure of the bookmark registration process executed by the control unit 11 of the monitoring device 10 will be described with reference to FIG. The control unit 11 starts the execution of the bookmark registration process by starting the execution of the bookmark registration program by starting the recording (imaging) of the monitoring area (for example, the cash register area around the POS terminal 20).

In addition, one or a plurality of steps included in the bookmark registration process described here may be omitted as appropriate. Further, the execution order of each step in the bookmark registration process may be different within the range in which the same effect is produced. Further, a case where each step in the bookmark registration process is executed by the control unit 11 of the monitoring device 10 will be described here as an example, but in another embodiment, the bookmark registration process is performed by a plurality of other processors. Each step may be performed in a distributed manner. Further, the present invention can be regarded as an invention of a bookmark registration method for executing one or a plurality of steps included in the bookmark registration process.

In step S21, the control unit 11 causes the camera 30 to start shooting the monitoring area. Next, in step S22, the control unit 11 acquires the image data of the captured image from the camera 30 and starts recording in the storage unit 13. Step S22 is an example of the image acquisition step of the present invention.

Next, in step S23, the control unit 11 determines whether or not the transaction information has been acquired from the POS terminal 20. When the control unit 11 acquires the transaction information from the POS terminal 20 (S23: Yes), the process proceeds to step S24. Further, the control unit 11 registers the transaction information in the transaction information D1 (see FIG. 2). Step S23 is an example of the transaction information acquisition step of the present invention.

In step S24, the control unit 11 registers the bookmark information in which the transaction information acquired from the POS terminal 20 and the image information of the captured image acquired from the camera 30 are associated with each other in the bookmark. For example, the control unit 11 registers the bookmark information in the bookmark information D2 (see FIG. 3).

The control unit 11 executes the bookmark registration process every time the transaction information is acquired from the POS terminal 20 (S23, S24).

[Playback process]
Next, an example of the procedure of the reproduction process executed by the control unit 11 of the monitoring device 10 will be described with reference to FIG. The control unit 11 executes the reproduction process by starting the execution of the reproduction program by designating the time bar corresponding to the transaction displayed on the operation display unit 12 by the mouse pointer MP or the like. Start.

It should be noted that one or a plurality of steps included in the reproduction process described here may be omitted as appropriate. Further, the execution order of each step in the reproduction process may be different within a range in which the same action and effect are produced. Further, here, a case where each step in the reproduction process is executed by the control unit 11 of the monitoring device 10 will be described as an example, but in other embodiments, each step in the reproduction process is performed by a plurality of other processors. May be distributed and executed. Further, the present invention can be regarded as an invention of a regeneration method for executing one or a plurality of steps included in the regeneration process.

When the time bar corresponding to the transaction is designated in the operation display unit 12 (S31: Yes), the control unit 11 acquires the transaction information and the bookmark information corresponding to the transaction (S32). For example, on the display screen shown in FIG. 5, when the user specifies the time bar T2 by the mouse pointer MP (mouseover operation), the control unit 11 performs a transaction corresponding to the time bar T2 from the transaction information D1 (see FIG. 2). The information is acquired, and the bookmark information is acquired from the bookmark information D2 (see FIG. 3).

Next, in step S33, the control unit 11 causes the operation display unit 12 to display the transaction information F1 (see FIG. 6) and the captured image corresponding to the time bar T2. Step S33 is an example of the transaction display step of the present invention, and is an example of the image display step.

Next, in step S34, the control unit 11 causes the transaction information F1 to display an edit button K2 for editing the transaction information F1 and a play button K1 for reproducing a moving image of the captured image corresponding to the transaction. (See FIG. 6).

When the play button K1 is pressed in the transaction information F1 (S35: Yes), the process proceeds to step S36, and when the edit button K2 is pressed in the transaction information F1 (S38: Yes), the process proceeds to step S39. do.

When the play button K1 is pressed by the user, the control unit 11 displays the play pointer SP at the transaction start date and time (S36), and starts playing the moving image of the captured image (S37).

When the edit button K2 is pressed by the user, the control unit 11 executes the bookmark editing process described later (S39).

Each time the user specifies a time bar, the control unit 11 executes the reproduction process.

[Bookmark editing process]
Next, an example of the procedure of the bookmark editing process executed by the control unit 11 of the monitoring device 10 will be described with reference to FIG. The control unit 11 starts the execution of the bookmark editing process by starting the execution of the bookmark editing program by the user selecting the edit button K2 in the transaction information F1 displayed on the operation display unit 12.

Note that one or a plurality of steps included in the bookmark editing process described here may be omitted as appropriate. Further, the execution order of each step in the bookmark editing process may be different within the range in which the same effect is produced. Further, a case where each step in the bookmark editing process is executed by the control unit 11 of the monitoring device 10 will be described here as an example, but in another embodiment, the bookmark editing process is performed by a plurality of other processors. Each step may be performed in a distributed manner. Further, the present invention can be regarded as an invention of a bookmark editing method for executing one or a plurality of steps included in the bookmark editing process.

In step S41, the control unit 11 acquires the transaction information included in the transaction information F1 (see FIG. 6) from the transaction information D1 (see FIG. 2).

Next, in step S42, the control unit 11 causes the operation display unit 12 to display the bookmark editing screen F2 (see FIG. 7) and the transaction information. For example, the control unit 11 displays the bookmark name (title) in the display field B1 of the bookmark edit screen F2, displays the detailed information (transaction content) in the display field B2, and displays the transaction type in the display field B3.

Next, in step S43, the control unit 11 displays the save button K4 and the cancel button K5 on the bookmark editing screen F2 (see FIG. 7). The user changes the display contents of the display fields B1 to B3 as necessary on the bookmark edit screen F2 (see FIG. 7).

When the save button K4 is pressed on the bookmark edit screen F2 (S44: Yes), the process proceeds to step S45. On the other hand, when the cancel button K5 is pressed on the bookmark edit screen F2 (S48: Yes), the process proceeds to step S47.

When the save button K4 is pressed on the bookmark edit screen F2 (S44: Yes), the control unit 11 updates the transaction information if the transaction information has been changed (edited) (S45: Yes). (S46). Specifically, the control unit 11 updates the edited information in the transaction information D1 (see FIG. 2).

In step S47, the control unit 11 hides the bookmark editing screen F2.

As described above, the monitoring device 10 according to the present embodiment displays a time bar having a length corresponding to the transaction time corresponding to the transaction information on the POS terminal 20 on the display screen, and the time bar is displayed on the display screen. When is selected, the transaction information corresponding to the time bar is displayed on the display screen. In addition, the monitoring device 10 displays the captured image corresponding to the transaction information on the display screen. As a result, the user can easily confirm the desired transaction information by selecting the time bar on the display screen when confirming the past transaction information.

The monitoring device of the present invention is not limited to the above-described embodiment. The monitoring device of the present invention may have the form shown below.

As another embodiment, the monitoring device 10 may display the time bar corresponding to each transaction displayed on the operation display unit 12 in a display mode in which the transaction type can be identified. Specifically, the storage unit 13 stores the identification information D3 in which the transaction type and the identification information (for example, color information) are associated with each other. Further, when the recording processing unit 113 acquires the transaction information from the POS terminal 20, the recording processing unit 113 identifies the identification information corresponding to the transaction type included in the transaction information from the identification information D3, and identifies the identified identification information in the transaction information D1. Register in (see FIG. 14). The identification information is not limited to color information, and may be pattern information, character information, graphic information, symbol information, and the like.

The transaction display unit 114 displays the time bar corresponding to each transaction displayed on the operation display unit 12 in a display mode according to the transaction type. For example, as shown in FIG. 15, the transaction display unit 114 sets the time bars T1 and T2 to the operation display unit 12 in "blue" (an example of the first display color of the present invention) when the transaction type is sales processing. When the transaction type is return processing (or cancellation processing), the time bar T3 of "red" (an example of the second display color of the present invention) is displayed on the operation display unit 12. Further, for example, the transaction display unit 114 normally displays the time bars T1 and T2 when the transaction type is sales processing, and blinks the time bar T3 when the transaction type is return processing (or cancellation processing). You may.

Here, for example, when the user selects (touches) the edit button K2 in the transaction information F1, the transaction display unit 114 displays the bookmark edit screen F2 shown in FIG. Further, the transaction display unit 114 displays the color information display field B4 on the bookmark editing screen F2. The user can edit transaction information such as bookmark name (the title), details (transaction content), type, and color information on the bookmark edit screen F2.

Here, when the user presses the color information display field B4, the transaction display unit 114 displays the color setting screen F3 shown in FIG. The color setting screen F3 includes, for example, a plurality of color palettes and RGB value input fields. When the user selects a desired color on the color setting screen F3, the recording processing unit 113 updates the color information (see FIG. 14) associated with the transaction information to the selected color.

In this way, when the time bar is selected in the operation display unit 12, the transaction display unit 114 displays a screen (for example, a color setting screen F3) that accepts a change in the display mode of the time bar.

[Bookmark registration process]
FIG. 18 shows an example of the procedure of the bookmark registration process executed by the control unit 11 of the monitoring device 10 according to the other embodiment.

In step S51, the control unit 11 causes the camera 30 to start shooting the monitoring area. Next, in step S52, the control unit 11 acquires the image data of the captured image from the camera 30 and starts recording in the storage unit 13.

Next, in step S53, the control unit 11 determines whether or not the transaction information has been acquired from the POS terminal 20. When the control unit 11 acquires the transaction information from the POS terminal 20 (S53: Yes), the process proceeds to step S54. Further, the control unit 11 registers the transaction information in the transaction information D1 (see FIG. 2).

In step S54, the control unit 11 specifies the transaction type. Specifically, the control unit 11 specifies the transaction type based on the transaction information.

Next, in step S55, the control unit 11 determines the color corresponding to the transaction type. Specifically, the control unit 11 determines the color corresponding to the transaction type with reference to the identification information D3 (see FIG. 13).

In step S56, the control unit 11 registers bookmark information in which the transaction information (including color information) acquired from the POS terminal 20 and the image information of the captured image acquired from the camera 30 are associated with each other in the bookmark.

According to the above-described embodiment, the transaction type can be easily grasped for each time bar displayed on the display screen. Therefore, for example, it is possible to grasp at a glance the processing that is likely to cause fraud (for example, return processing, cancellation processing, etc.).

Further, as another embodiment of the present invention, the monitoring device 10 may display the captured image corresponding to each transaction on the operation display unit 12 in the thumbnail format. For example, as shown in FIG. 19, the transaction display unit 114 includes a captured image corresponding to the transaction of the time bar T1 (ID “0001”), a captured image corresponding to the transaction of the time bar T1 (ID “0002”), and a captured image. The captured image corresponding to the transaction (ID "00022") of the time bar T1 is displayed on the operation display unit 12 in thumbnail format. Each thumbnail image may be a captured image of the transaction start date and time of each transaction, or may be a captured image of a predetermined time between the transaction start date and time and the transaction end date and time.

Further, as another embodiment of the present invention, the monitoring device 10 may display the corresponding reference time bar TB and the captured image side by side on the operation display unit 12 for each POS terminal 20. For example, as shown in FIG. 20, the transaction display unit 114 has a reference time bar TB1 corresponding to a transaction in the POS terminal 20 installed in the cash register area R1 (see FIG. 1) of the store A and the store B of the store. The reference time bar TB2 corresponding to the transaction in the POS terminal 20 installed in the cash register area R2 (see FIG. 1) is displayed side by side on the operation display unit 12.

Further, as shown in FIG. 20, the transaction display unit 114 has a transaction of the time bar T1 corresponding to the transaction of the ID "0001" in the store A and a transaction of the time bar T2 and the ID "0003" corresponding to the transaction of the ID "0002". The time bar T3 corresponding to is displayed on the reference time bar TB1 in chronological order, and the time bar T4 corresponding to the transaction of ID "0004" at the B store and the time bar T5 corresponding to the transaction of ID "0005" are displayed. The time bar T6 corresponding to the transaction with the ID "0005" and the time bar T7 corresponding to the transaction with the ID "0007" are displayed on the reference time bar TB2 in chronological order. The transaction display unit 114 displays, for example, the time bars T1, T2, T4, T6, and T7 in a display mode (for example, "blue") corresponding to "sales processing", and displays the time bars T3 and T5 in "return processing". Is displayed in a display mode (for example, “red”) corresponding to “”.

Further, as another embodiment of the present invention, the monitoring device 10 may display the time bar according to the priority of the transaction. For example, the monitoring device 10 may set a priority according to the content of the product included in the transaction information and display the time bar according to the priority. For example, the monitoring device 10 sets the priority of the high-priced product high and the priority of the low-priced product low. Then, the monitoring device 10 may display only the time bar of the time zone in which the reading operation of the product having a high priority is performed, or the time bar may be displayed in the time zone in which the reading operation of the product having a low priority is performed. It may be displayed in a display mode different from that of the time bar of.

Further, the monitoring device 10 sets a high priority of the time bar corresponding to the transaction when the transaction includes a high-priced product, and sets the priority of the time bar corresponding to the transaction high when the transaction does not include the high-priced product. The priority of may be set low. In this case, the monitoring device 10 may display only the time bar having a high priority, or may display the time bar in a display mode different from that of the time bar having a low priority.

Further, as another embodiment of the present invention, the monitoring device 10 may display a predetermined time bar based on a user's instruction. For example, when the user inputs a predetermined product on the search screen, the monitoring device 10 displays the time bar and the captured image corresponding to the transaction including the product on the search result screen.

In the information processing system according to the present invention, within the scope of the invention described in each claim, each of the above-described embodiments can be freely combined, or each embodiment may be appropriately modified or partially omitted. It is also possible to configure by doing.

1: Monitoring system 10: Monitoring device 20: POS terminal 30: Camera 111: Transaction information acquisition unit 112: Image acquisition unit 113: Recording processing unit 114: Transaction display unit 115: Image display unit 116: Reproduction processing unit

Claims (10)

The transaction information acquisition department that acquires transaction information on POS terminals,
An image acquisition unit that acquires an image from an image pickup device that images an area corresponding to the POS terminal, and an image acquisition unit.
A time bar having a length corresponding to the transaction time corresponding to the transaction information acquired by the transaction information acquisition unit is displayed on the display screen, and when the time bar is selected on the display screen, the time bar is displayed. A transaction display unit that displays the transaction information corresponding to the above on the display screen, and
An image display unit that displays the captured image corresponding to the transaction information acquired by the transaction information acquisition unit on the display screen.
Information processing system equipped with. When the time bar is selected on the display screen, the image display unit causes the display screen to display the captured image corresponding to the transaction information corresponding to the time bar.
The information processing system according to claim 1. A recording processing unit that records a transaction start date and time indicating the transaction start date and time, a transaction end date and time indicating the transaction end date and time, and a transaction content indicating the transaction content in association with each other is further provided.
The transaction display unit displays the time bar having a length from the transaction start date and time to the transaction end date and time on the display screen.
When the time bar is selected on the display screen, the image display unit causes the display screen to display the captured image of the date and time corresponding to the selected position of the time bar.
The information processing system according to claim 2. A reproduction processing unit for reproducing the captured image as a moving image is further provided.
When the time bar is selected on the display screen, the reproduction processing unit causes the display screen to reproduce a moving image of the captured image from the transaction start date and time to the transaction end date and time corresponding to the time bar.
The information processing system according to claim 3. The transaction display unit displays at least one of an edit button for editing the transaction information and a play button for reproducing the captured image as a moving image when the time bar is selected on the display screen. Let me
The information processing system according to claim 4. The transaction display unit displays the time bar in a display mode according to the transaction type on the display screen.
The information processing system according to any one of claims 1 to 5. The transaction display unit displays the time bar on the display screen in the first display color when the transaction type is sales processing, and the time in the second display color when the transaction type is return processing or cancellation processing. Display the bar on the display screen,
The information processing system according to claim 6. The transaction information displayed on the display screen includes at least one of receipt information, customer information, operator information of the POS terminal, transaction type, and transaction date and time.
The information processing system according to any one of claims 1 to 7. The transaction display unit displays a reference time bar having a predetermined length on the display screen, and superimposes one or a plurality of the time bars corresponding to the transaction on the reference time bar in chronological order. Display,
The information processing system according to any one of claims 1 to 8. Transaction information acquisition step to acquire transaction information on POS terminal,
An image acquisition step of acquiring an captured image from an imaging device that images an area corresponding to the POS terminal, and
A time bar having a length corresponding to the transaction time corresponding to the transaction information acquired by the transaction information acquisition step is displayed on the display screen, and when the time bar is selected on the display screen, the time bar is displayed. A transaction display step for displaying the transaction information corresponding to the above on the display screen, and
An image display step of displaying the captured image corresponding to the transaction information acquired by the transaction information acquisition step on the display screen, and an image display step.
An information processing method that is executed by one or more processors.

Images