JP2022187787A - Sales processor, program, and control method - Google Patents

Abstract

To improve visibility of an operator.SOLUTION: A sales processor includes: display means for displaying information relating to a transaction; and display control means for displaying a part of a display area in the display means and an area different from the part of the display area in such a way that visibility thereof is different from that of the part of the display area.SELECTED DRAWING: Figure 16

Description

Application for application of Article 30, Paragraph 2 of the Patent Act [1] Date of sale/implementation (publication date) July 7, 2020 Sales destination Headquarters Fresco Co., Ltd. (17 Utagawa-cho, Nakamura, Soma City, Fukushima Prefecture) Implementation destination (store) ) Higashiharamachi store (186 Kitahara Honyashiki, Haramachi-ku, Minamisoma-shi, Fukushima) (Web site URL: http://fresco-k.com/store_higashihara.html) [2] Sales/implementation date (release date) 2020 July 30 Sales destination: Nishimta Co., Ltd. Head Office (1-10-1 Yojiro, Kagoshima City, Kagoshima Prefecture) Destination (store) Nishimta Ijuin Store (802 Inoshikakura, Ijuincho, Hioki City, Kagoshima Prefecture) (Website URL: https:// /nishimuta.co.jp/shop/post_18) [3] Sales/implementation date (release date) August 26, 2020 Sales destination Head office M&M Marunaka Mart Co., Ltd. (10-2 Yagura, Otsu-cho, Naruto-shi, Tokushima) Destination (store) Otsu store (10-2 Ura Yagura, Otsu-cho, Naruto City, Tokushima Prefecture) (Destination HP URL: https://nishimuta.co.jp/shop/post_18) [4] Sales/implementation date (released) Date) October 8, 2020 Sales destination Maruto Co., Ltd. (3-1 Kubota Jujo, Nakoso-cho, Iwaki-shi, Fukushima) Destination (store) Hitachi SC Moriyama store (5-9-1 Moriyama-cho, Hitachi-shi, Ibaraki) (Destination HP URL: https://www.maruto-gp.co.jp/shop/hitachi/1291/) [5] Sales/implementation date (release date) March 9, 2021 Sales destination Maruto Co., Ltd. (3-1 Kubota Jujo, Nakoso-cho, Iwaki-shi, Fukushima) Destination (store) Yotsukura store (2-9-2 Aza Nishi, Yotsukura-cho, Iwaki-shi, Fukushima) (Website URL: https://www.maruto-gp .co.jp/shop/iwaki/7917/) [6] Sales/implementation date (release date) April 6, 2021 Sales destination Maruto Co., Ltd. (3-1 Kubota Jujo, Nakoso-cho, Iwaki City, Fukushima Prefecture) Implementation destination (Store) SC Joto store (3-1-2 Taira Joto, Iwaki City, Fukushima Prefecture) (Web site URL: https://www.maruto-gp.co.jp/shop/iwaki/1268/)

Patent Act Article 30, Paragraph 2 application filed [7] Date of sale/implementation (publication date) April 22, 2021 Sales destination Maruto Co., Ltd. (3-1 Kubota Jujo, Nakoso-cho, Iwaki City, Fukushima Prefecture) Store) SC Taira Amago Store (3-1-1 Taira Amago-cho, Iwaki City, Fukushima Prefecture) (Website URL: https://www.maruto-gp.co.jp/shop/iwaki/2152/) [8 ] Date (release date) February 17, 2021-February 19, 2021 Exhibition name, venue 55th Supermarket Trade Show 2021 General Incorporated Association National Supermarket Association Sponsored by Makuhari Messe (Chiba City 2-1 Nakase, Mihama-ku <Reference> Overview of the 55th Supermarket Trade Show 2021 <Reference> Exhibitor Information for the 55th Supermarket Trade Show 2021

The present invention relates to a sales processing device, program, and control method.

There is a POS (Point Of Sales) provided with a display (see Patent Document 1, for example).

Japanese Patent No. 5559252

In recent years, displays have become larger. A large display increases the amount of information that can be displayed, and thus presents a new problem that it is difficult for customers and staff to understand where to look on the display.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and an object of the present invention is to improve the visibility of an operator.

One aspect of the present invention for solving the above-described problems is a display unit that displays information about transactions, a partial area of the display area of the display unit, and an area different from the partial area. are displayed with different visibility.

According to another aspect of the present invention, there is provided a program for causing a computer to function as a sales processing device having display means for displaying information on transactions, wherein the computer is configured to operate as a sales processing device in one of the display areas of the display means. The program functions as display control means for displaying a partial area and an area different from the partial area with different visibility.

According to another aspect of the present invention, there is provided a control method for a sales processing apparatus having display means for displaying information on transactions, comprising: a part of a display area of the display means; and a display control step of displaying regions different from and with different visibility.

It is a figure which shows the structural example of the shopping system in this embodiment. It is a figure which shows the example of installation of the settlement apparatus in this embodiment. It is a figure which shows the example of an external appearance of the payment|settlement apparatus in this embodiment. It is a figure which shows the structural example of the settlement apparatus in this embodiment. It is a figure which shows the structural example of the customer terminal device in this embodiment. It is a figure which shows the structural example of the transaction management apparatus in this embodiment. It is a figure which shows the structural example of the transaction status management apparatus in this embodiment. It is a figure which shows an example of customer information, store information, and cart information in this embodiment. It is a figure which shows the definition example of the pending|holding goods in this embodiment. FIG. 4 is a sequence diagram showing an example of a processing procedure executed by the customer terminal device, the settlement device, and the transaction management device according to the present embodiment in response to accounting for one transaction in self-operation; It is a figure which shows the example of a screen of the shopping application in this embodiment. It is a figure which shows an example of the registration goods presentation screen in this embodiment, a goods registration screen, and a guidance image. It is a figure which shows an example of the settlement screen in this embodiment. It is a figure which shows an example of the pending|holding goods process screen in this embodiment. It is a figure which shows an example of the situation confirmation screen in this embodiment. It is a figure which shows an example of the product information input screen in this embodiment. 6 is a flow chart showing an example of a processing procedure executed by a customer terminal device and a transaction management device in relation to product registration according to the present embodiment; 7 is a flow chart showing an example of a processing procedure executed by the settlement device in the present embodiment in relation to the cancellation of the reservation of the reserved product. It is a figure which shows an example of the situation confirmation screen in a 2nd modification. It is a figure which shows an example of the settlement screen in a 3rd modification. It is a figure which shows the example of a screen display. It is a figure which shows a settlement screen. It is a figure which shows a product information input screen and a settlement method selection screen. It is a figure which shows the example of a screen which carries out a darkening display in steps. It is a figure for demonstrating lower side or upper side. It is a figure for demonstrating right side or left side. FIG. 10 is a diagram showing a display example in which a partial area and a peripheral area of the partial area have different visibility. FIG. 10 is a diagram showing a display example of a darkened area; It is a figure which shows an example which changes an attention area dynamically.

<Embodiment>
[Configuration example of shopping system]
FIG. 1 shows a configuration example of a shopping system (an example of a merchandise sales data processing system) according to this embodiment. In the shopping system shown in the figure, for example, while a customer takes out a product to be purchased from a product shelf, the customer registers the taken product using the customer terminal device 50, and the same customer registers the registered product. It corresponds to the accounting (accounting corresponding to the customer terminal) which is performed using the settlement device 40 . Accounting here includes the registration of merchandise and the settlement of the registered merchandise, and refers to the procedure performed in response to one transaction.
The shopping system of this embodiment includes a management device 10 , a transaction management device 60 , a settlement device 40 , a customer terminal device 50 , a transaction status management device 80 and a credit card settlement server 70 .

The management device 10, the settlement device 40, and the transaction status management device 80 are installed in the store, and are communicably connected via a LAN 19 (which may be wired or wireless). The management device 10 is a business terminal used by a store clerk for store management and the like, and can communicate with the transaction management device 60 .

The transaction status management device 80 is a business terminal that monitors the status of transactions performed by customers using the customer terminal device 50 at the store, and can communicate with the transaction management device 60 .
Although four settlement devices 40 are illustrated in FIG. 1, the number of settlement devices 40 in one store is not particularly limited.

The customer terminal device 50 is operated by a customer (such as a shopper who is a member of the store, hereinafter simply referred to as a customer). The customer terminal device 50, in addition to the general communication function and imaging function (camera), scans the barcode attached to the product to read the product code, that is, recognizes the barcode attached to the product. It has functions. Note that the recognition function provided in the customer terminal device 50 may be capable of reading the product code, and may not be capable of recognizing which product the read product code is. That is, the customer terminal device 50 can read the product code from the barcode when there is a barcode as an object in the captured image captured by the imaging function (the image acquired as the through image). It should be like this.

Such a customer terminal device 50 may be a smart phone, a tablet terminal, or the like owned by a customer. A shopping application having a function of performing product registration corresponding to the shopping system of the present embodiment is installed in a smartphone, a tablet terminal, or the like as the customer terminal device 50 .

Also, the customer terminal device 50 may be, for example, a terminal lent to a customer from a store. An application having a function of performing product registration corresponding to the shopping system of the present embodiment is also installed on the customer terminal device 50 lent to the customer by the store. The customer terminal device 50 lent to the customer by the store may be held in the customer's hand, or may be attached to a shopping cart and used by the customer. It may be of any aspect.

In addition, the customer terminal device 50 takes an image of the product (for example, the peripheral portion to which the barcode is attached) (for example, releases the shutter) to generate a captured image (image data). The customer terminal device 50 may perform imaging by releasing the shutter according to the operation of the customer who is the operator, but in the present embodiment, it is preferable that the customer terminal device 50 itself determines to release the shutter.

Moreover, the customer terminal device 50 may be equipped with an image recognition technology for extracting feature points from an image (through image, captured image) and recognizing an imaged target (object or the like). For example, the customer terminal device 50 may specify (estimate) the imaged product using image recognition technology.

The settlement device 40 is a settlement device that allows at least cash payment as a settlement method. The settlement device 40 is configured to be communicable with the transaction management device 60 . Note that the settlement device 40 may be configured to be able to communicate with the transaction management device 60 through a relay of the management device 10, for example.

The transaction management device 60 manages transactions performed in correspondence with the shopping system of this embodiment.

The credit card settlement server 70 executes settlement processing corresponding to the credit card in response to transmission of a credit card settlement request from the settlement device 40, the customer terminal device 50, or the like.

[About payment device]
FIG. 2 is a diagram showing an installation example of the settlement device 40. As shown in FIG. FIG. 2A is a perspective view of the settlement device 40 and the like as viewed from the customer side. FIG. 2B is a perspective view of the checkout device 40 and the like as seen from the store clerk side.
As shown in FIG. 2A, a counter is placed on the right side of the settlement device 40 as viewed from the customer side.

FIG. 3 is a diagram showing an example of the appearance of the settlement device 40. As shown in FIG. FIG. 3A is a perspective view of the settlement device 40 viewed from the customer side. FIG. 3B is a perspective view of the settlement device 40 as seen from the store clerk side.
FIG. 4 is a diagram showing a configuration example of the settlement device 40. As shown in FIG. 3 and 4, the same reference numerals are given to the same parts.

Hereinafter, a configuration example of the settlement device 40 shown in FIG. 4 will be described with reference to FIG. The settlement device 40 includes a CPU 401, a ROM 402, a RAM 403, a hard disk 404, a customer-side display unit 405, a customer-side scanner unit 406, a card settlement unit 408, a change machine 409, a clerk-side display unit 410, A key operation unit 411 , a store clerk side scanner unit 412 , a printing unit 413 , an audio output unit 414 , and a communication unit 415 are provided. They can communicate with each other via a bus.

The CPU 401 is a central processing unit, and controls the operation of the settlement device 40 by reading and executing programs stored in the ROM 402 .
The ROM 402 is a read-only memory, and stores various information used by the CPU 401 including programs.

A RAM 403 is a read/write memory and stores various information. For example, the RAM 403 stores information read from the ROM 402 or the hard disk 404, information acquired from the outside, information generated during processing, and the like.

The hard disk 404 stores various information. The hard disk 404 may store programs executed by the CPU 401 instead of the ROM 402, for example. Also, instead of the RAM 403, information read from the ROM 402, information acquired from the outside, information generated during processing, and the like may be stored.

The customer-side display unit 405 is a touch display for customers, which displays various information to the customer and receives various inputs from the customer.
The customer-side scanner unit 406 is a scanner unit for customers, and for example, scans a code attached to a product (for example, a code other than a barcode such as a bar code or a two-dimensional code) to scan the product code. to read. Further, the customer-side scanner unit 406 may scan a code (bar code, two-dimensional code, etc.) printed on an accounting ticket (registered trademark) to read information necessary for settlement. Further, the customer-side scanner unit 406 may scan a code (two-dimensional code, bar code, etc.) displayed on the display unit of the customer terminal device 50 to read information necessary for payment.

The customer-side scanner unit 406 is used when the customer registers the product, but the customer may register the product by another method. For example, when a preset key corresponding to a product (a button for ordering a product) is displayed on the customer-side display unit 405, the customer may operate (press) the preset key to register the product.

The card settlement unit 408 is a settlement mechanism using various cards (credit cards, prepaid cards such as transportation cards, etc.). The card settlement unit 408 of this embodiment includes a card recognition unit (reading unit), a display unit, and an operation unit. Note that the card recognition unit may recognize various types of cards (for example, membership cards, point cards, etc.) that are not directly used for payment (settlement).

The change machine 409 (cash settlement unit) is a settlement mechanism using cash, and has an insertion slot for banknotes and coins and a discharge port for banknotes and coins. The amount of change, which is the difference, is calculated, and the change is discharged from the discharge port. The change dispenser 409 is directed toward the customer and operated by the customer. Note that when banknotes or coins are inserted into the slot, they are detected by a sensor (detection of insertion, detection of the number of coins by denomination, etc.).

In other words, the change machine 409 is used in the settlement device 40 when the payment for the registered product is settled in cash (money). The change dispenser 409 includes a banknote slot for inserting banknotes, a coin slot for inserting coins, a banknote ejection slot for ejecting banknotes, a coin ejection slot for ejecting coins, and a slot for inserting or ejecting coins. It has a counting unit for counting money, a mechanism for transporting money between the inlet or outlet and the storage unit, the above-described sensor, and the like. Note that the banknote slot and coin slot are also referred to as a deposit slot. The banknote ejection opening and the coin ejection opening are also referred to as change ejection openings. Note that the banknote slot and the banknote ejection slot may be common, and the coin slot and coin ejection slot may be common.

In addition, the change machine 409 counts the amount of money replenished during the closing process and stores it in the storage unit. In addition, the change machine 409 counts the amount of money to be dispensed during the closing process, and releases the money from the change outlet. The closing process is a process of adjusting the amount (cash balance/cash balance) stored in the change machine 409 after the store is closed or before the store is opened to the reference amount.

The clerk-side display unit 410 is a touch display for the clerk, which displays various information to the clerk and receives various inputs from the clerk.
The key operation unit 411 is composed of various keys (buttons) and receives various inputs from the store clerk.
The salesclerk-side scanner unit 412 is a scanner unit for salesclerks, and for example, scans a bar code attached to a product to read the product code. Further, the clerk-side scanner unit 412 scans a bar code or the like attached to the clerk's name tag to read the clerk code.

Note that the clerk-side scanner unit 412 is used when the clerk registers products, but the clerk may register the products by other methods. For example, if a key corresponding to a product (for example, a key corresponding to a sports newspaper) is arranged in the key operation unit 411, the store clerk can operate (press) the key to register the product. good. In addition, when a preset key corresponding to a product is displayed on store clerk-side display unit 410, the store clerk may operate the preset key to register the product.

The printing unit 413 prints and issues various media (receipts, accounting coupons, etc.). The printing unit 413 can be rotatably changed from the clerk side to the customer side and from the customer side to the clerk side (the direction of the medium issuing port). The orientation of the printing unit 413 may be manually changed, or may be automatically changed (mechanically controlled, etc.) according to, for example, transition (switching) of operation modes, which will be described later. Note that whether the orientation of the printing unit 413 is correct or incorrect may be detected by a sensor or the like.

Audio output unit 414 outputs audio. For example, the audio output unit 414 outputs audio guidance and the like.
The communication unit 415 executes communication with other devices (other settlement devices 40 and management device 10).

The settlement device 40 of the present embodiment has two operation modes: a customer terminal compatible settlement mode set to perform settlement processing under customer terminal compatible settlement, and three different patterns of settlement (product registration, It is possible to switch between a total of four operating modes, including three checkout modes (first to third checkout modes) corresponding to settlement).
The first checkout mode is an operation mode in which a store clerk performs an operation corresponding to product registration and an operation corresponding to checkout on the checkout device 40 . The second checkout mode is an operating mode in which the store clerk performs an operation corresponding to product registration on the settlement device 40 and the customer performs an operation corresponding to settlement on the same settlement device 40 . The third checkout mode is an operation mode in which the customer performs an operation corresponding to product registration and an operation corresponding to checkout on the checkout device 40 .
As a result, in a store where the shopping system of the present embodiment is introduced, some of the plurality of settlement devices 40 are set to the settlement mode corresponding to the customer terminal, thereby supporting the settlement corresponding to the customer terminal, and the other settlement devices. As for 40, for example, by setting the first checkout mode or the second checkout mode, it is possible for the clerk to deal with the customer and checkout. It should be noted that the settlement device 40 may include one in which the third checkout mode is set.
Such mode switching may be performed, for example, according to a predetermined time slot within the business hours of the store.
Note that the settlement device 40 of the present embodiment may be configured as a dedicated device specialized for the settlement mode corresponding to the customer terminal.

[Configuration example of customer terminal device]
FIG. 5 shows a configuration example of the customer terminal device 50. As shown in FIG. The customer terminal device 50 shown in FIG.
The CPU 501 is a central processing unit, and controls operations of the customer terminal device 50 by reading and executing programs stored in the storage unit 502 .
A storage unit 502 is an auxiliary storage device for the CPU 501 and stores various kinds of information used by the CPU 501 including programs.
A RAM 503 is a main storage device of the CPU 501 .
A display unit 504 displays an image according to the display control of the CPU 501 . The display unit 504 may be configured as a touch panel that allows an operation on the screen.
An operation unit 505 collectively indicates various operators provided in the customer terminal device 50 and various input devices connected to the customer terminal device 50 .
The imaging unit 506 performs imaging under the control of the CPU 401 . The imaging unit 506 of this embodiment can also function as a part that reads a two-dimensional code in a code reader that processes two-dimensional codes.
A network compatible communication unit 507 is a part that performs wireless communication via a network. The customer terminal device 50 can communicate with the transaction management device 60 through the network compatible communication unit 507 .

[Configuration example of transaction management device]
FIG. 6 shows a configuration example of the transaction management device 60. As shown in FIG. The transaction management device 60 in FIG.
CPU 601 is a central processing unit, and controls the operation of transaction management device 60 by reading and executing programs stored in storage unit 602 .
A storage unit 602 is an auxiliary storage device for the CPU 601 and stores various kinds of information used by the CPU 501 including programs.
A RAM 603 is the main storage device of the CPU 601 .
A network compatible communication unit 604 is a part that performs communication via a network.

The storage unit 602 of the transaction management device 60 stores customer information, store information, merchandise master (merchandise information), and cart information.

[Configuration example of transaction status management device]
FIG. 7 shows a configuration example of the transaction status management device 80. As shown in FIG. The transaction status management device 80 shown in FIG.
The CPU 801 is a central processing unit, and controls the operation of the transaction status management device 80 by reading and executing programs stored in the storage unit 802 .
A storage unit 602 is an auxiliary storage device for the CPU 801 and stores various kinds of information used by the CPU 801 including programs.
A RAM 803 is a main storage device of the CPU 801 .
The in-store correspondence communication unit 804 communicates with terminals such as the settlement device 40 and the management device 10 in the store via the LAN 19 .
A network compatible communication unit 805 is a part that communicates with the outside via a network.
In the case of the transaction status management device 80, the network compatible communication section 805 can communicate with the transaction management device 60 on the cloud.
A display unit 806 displays an image under the control of the CPU 801 . The display unit 806 may be configured as a touch panel.
The operation unit 807 collectively indicates the operators provided in the transaction status management device 80 and the input devices connected to the transaction status management device 80 .

[Information stored by the transaction management device]
The customer information stored in the storage unit 602 is information for managing individual customers. The transaction management device 60 generates customer information at the time of customer registration (it may be understood that the customer is registered when the customer information of a certain customer is stored). In addition, the transaction management device 60 appropriately updates the customer information based on the cart information and the like. The transaction management device 60 may, for example, refer to the cart information at a predetermined time every day and update the customer information.

FIG. 8A shows an example of customer information stored in the storage unit 602 of the transaction management device 60. FIG. The customer information in the figure includes customer identification information, customer name, customer registration date, cancellation information, customer rank, number of points, and the like.
Customer identification information is identification information that uniquely identifies a customer.
The customer identification information may be application identification information uniquely assigned to each installed shopping application when the shopping application of the present embodiment is installed, for example. The application identification information may be, for example, a number uniquely (eg, sequentially) attached to each installed shopping application. Alternatively, the application identification information may be terminal identification information specific to the customer terminal device 50 in which the shopping application is installed. The terminal identification information is attached so as to be unique to the hardware of the customer terminal device 50, such as a telephone number assigned to a customer who is the user of the customer terminal device 50, a MAC (Media Access Control) address, or the like. It may be hardware identification information.
The customer name is the customer's name, nickname, or the like. The customer registration date is the date and time when the customer was registered. Cancellation information is information regarding cancellation of a registered product after registration. The customer rank is a rank according to the customer's purchase record. When generating customer information for a new customer, customer identification information, customer name, and customer registration date are generated, but since the actual transaction (product registration) has not yet started, other information (cancellation information, etc.) is not generated.

The transaction management device 60, for example, uses the shopping service provided by the transaction management device 60 at the time of customer registration (for example, when the customer terminal device 50 externally (eg, a predetermined server that provides general applications, the transaction management device 60)). to generate and store customer-identifying information when you download or install a shopping application). Further, the transaction management device 60 acquires information entered in the name column of the registration form (input form) using the customer terminal device 50 at the time of customer registration, for example, and stores the information as the customer name. Also, the transaction management device 60 acquires, for example, the current date and time at the time of customer registration, and stores it as the customer registration date.

Transaction management device 60 stores part or all of the customer information in another device (such as a file server that transaction management device 60 can access) in place of or in addition to storing the customer information in its own storage unit. You can memorize all of them.

FIG. 8B shows an example of store information stored in the storage unit 602 of the transaction management device 60. As shown in FIG. The store information in the figure includes store identification information, store name (branch name), store identification information 1, and store identification information 2. FIG.
The store identification information is identification information that uniquely identifies the store. The store identification information shown in FIG. 8B is composed of a store (store name) or company code and a branch code.
The store name is the name of the store. The store name shown in FIG. 8B is composed of a store (store name) or company and a branch name.
The shop identification information 1 is information of a two-dimensional code (QR code (registered trademark), etc.) for identifying a shop to trade (a shop where merchandise is bought and sold).
The store identification information 2 is store location information (GPS information) for specifying the store to trade with.
In the example shown in FIG. 8B, the store identification information and the store identification information 1 are different, but the store identification information and the store identification information 1 may be the same.

The transaction management device 60 may acquire and store store information and the like from an external source (such as a server (not shown) at the headquarters that controls each store). In addition, transaction management device 60 stores a portion of the store information or store it in another device (such as a file server that transaction management device 60 can access) instead of or in addition to storing the store information in its own storage unit. You can memorize all of them.

Cart information is information for managing individual transactions. Transaction management device 60 generates cart information at the start of a transaction. In addition, the transaction management device 60 updates the cart information (when the product is stored in the cart information, it means that the product has been registered) as the transaction progresses (each time the product is registered). may be resolved).

FIG. 8C is an example of cart information stored in the storage unit 602 of the transaction management device 60. As shown in FIG.
The cart information in the figure includes cart identification information, transaction start date and time, transaction end date and time, customer identification information, product information in the cart (registered product information, pending product information), cancellation information, and the like.

The cart identification information is identification information that uniquely identifies the cart information. For example, cart identification information includes store identification information, dates, and serial numbers (eg, serial numbers by store and date).
The transaction start date and time is the date and time when the transaction started. The transaction start date and time may be, for example, the date and time when the cart information is generated. The transaction start date and time may be the registration date and time of one product (the date and time when the registered product information (registered product 1) in FIG. 8C is stored). Both the date and time of cart information generation and the date and time of registration of one product item may be stored separately.

The transaction end date and time is the end date and time of the transaction. For example, the trading end date and time may be the settlement date and time. The customer identification information is customer identification information that identifies the customer of the transaction. When cart information is generated, cart identification information, transaction start date and time, and customer identification information are generated, but since the actual transaction (product registration) has not yet started, other information (transaction end date and time, etc.) is generated. not. The settlement date and time may be the settlement start date and time, or may be the settlement end date and time. Both the settlement start date and settlement end date and time may be separately stored as the transaction end date and time.

The registered product information (total) is information updated each time a product is registered. The registered product information (total) includes the number of products (number of products), approximate subtotal amount (for example, subtotal amount before discounts are reflected), subtotal amount, and the like. The registered product information (registered product 1) is registered information of one item of product.
The registered product information (registered product 2) is registered information of two items of products. In the example shown in FIG. 8C, illustration of registered product information (registered product 3) to registered product information (registered product 5) is omitted. The registered product information (N; N is an integer) includes product code, product name (product name), price, and the like.

The registered product information (N) may include the registration date and time of the N item product. In other words, the transaction management device 60 may store the registration date and time of the registered product as the registered product information. The registration date and time of each product may be used as a criterion for judging the necessity of application of services such as time service and the effect after application.

The pending product information (total) is information updated each time a pending product is registered.
A pending product is a product that has been registered in a temporarily held state because it was not registered normally due to a predetermined factor.
The reserved product information (total) includes the number of reserved products (number of products), the number of NON-FILE products among the reserved products, the number of read NG (unauthorized operation confirmation required) products among the reserved products, and the like.

NON-FILE refers to a product (the product information is unregistered goods).

Scanning NG is one aspect of a case in which scanning of the product code failed at the store (failure to read the product code), or failure in scanning the product code at the store. In other words, reading NG refers to time-out processing when it is possible to determine a case in which, for example, an image of a product is captured for a certain period of time by image recognition technology, but the barcode cannot be recognized, or an event in which time-out processing has been performed.
For example, due to wrinkles on the package, faint or dirty barcode printing, barcode printed on transparent film, etc. cannot be acquired (recognized), it is determined that reading is NG.

Reserved product information (reserved product 1) is information on one item of reserved product. Reserved product information (reserved product 2) is information on two items of reserved products. The reserved product information (reserved product 3) is information of three reserved products.

Reserved product information (reserved product N; N is an integer) includes the reserved product type (information indicating whether the relevant reserved product is NON-FILE or read NG), and image data (image data captured when reading is NG). including. For example, if the N item product is a NON-FILE reserved product, the reserved product information (reserved product N) includes the reserved product type “1 (NON-FILE)”, product code, and image data. Further, when the product of the N item is a pending product due to reading NG, the pending product information (reserved product N) includes the pending product type “2 (reading NG)” and image data.

FIG. 9 shows an example of the definition of pending products corresponding to the cart information of this embodiment. The figure shows an example in which pending products are classified into eight categories. A classification number of "1" to "8" is assigned to each of the eight reserved product classifications.
The classification of the pending product with classification number 1 is "NON-FILE" described in FIG.
The classification of the pending product with classification number 2 is "reading NG" described in FIG.

The classification of the pending product with classification number 3 is "pseudo scan input". The "pseudo scan input" pending product is a product for which the customer terminal device 50 has not been able to read the code normally, although the customer has attempted to have the customer terminal device 50 read the code of the product.

As a specific example, "pseudo scan input" corresponds to a situation in which a product is placed within the image capturing range of the image capturing unit 506, but the code of the product is not included within the image capturing range of the image capturing unit 506.
"Pseudo scan input" corresponds to a situation in which a product is placed within the imaging range of the imaging unit 506, but a portion without a code is imaged.
Also, "putting in a pseudo scan" corresponds to a situation in which a commodity is put into the imaging range of the imaging unit 506 with the code portion hidden by a finger or the like.
In the case of "pseudo scan input", the code of the product is imaged by the imaging unit 506, but the product is passed through the imaging range of the imaging unit 506 at a speed at which the customer terminal device 50 cannot read the code. situation applies.

The classification of the pending product with classification number 4 is "non-scanned input". A “non-scanning input” pending product is a product that has been placed in a shopping cart without performing an operation to position the product in the imaging range of the imaging unit 506 .
This non-scanning input may occur, for example, when the customer terminal device 50 is fixedly attached to a shopping cart so that the inside of the shopping cart placed on the shopping cart can be imaged. For example, when the customer terminal device 50 determines, based on the captured image, that a product has been placed in the shopping cart even though the code of the product has not been scanned, the non-scanned input is detected. can be determined to have been done.

The classification of the pending product with classification number 5 is "age verification product". "Age confirmation products" are products such as alcoholic beverages and cigarettes that require the salesclerk to confirm the customer's age when selling the product.

The classification of pending goods with classification number 6 is "pharmaceuticals". A “pharmaceutical product” is a product that requires a purchaser's confirmation, for example, by a qualified pharmacist or the like.

The classification of the pending product with classification number 7 is "crime prevention tag product". A "crime prevention tag product" is a product that has a security tag attached to it and therefore requires a store clerk to remove the security tag from the product at the time of sale.

The classification of the pending product with classification number 8 is "cancelled product". A “cancelled product” is a product that has been registered once but canceled by a customer's cancellation operation on the customer terminal device 50 . A "cancelled product" is, for example, picked up from a customer by a store clerk at checkout.

The product master is stored by the management device 10, for example. The product master stores product information for each product sold at the store. Product information corresponding to one product includes a plurality of predetermined information items such as product code and product name.
Transaction management device 60 stores the product master acquired from management device 10 . The transaction management device 60 uses the stored product master for processing related to product registration.

For pending products that fall under category number 1 "NON-FILE", the product code was acquired by code scanning in response to the product registration operation, but the product information associated with the acquired product code was registered in the product master. It has not been. For this reason, it is not specified which of the products registered in the product master is the reserved product that corresponds to "NON-FILE" of classification number 1.
Reserved products that fall under any of the three classifications of classification numbers 2 to 4: "Reading NG", "Pseudo scan input", and "Non-scan input" will receive the product code as a result of the code scanning according to the product registration operation. failed to get the For this reason, pending products that fall into one of the three classifications of classification numbers 2 to 4: “Reading NG,” “Pseudo-scan input,” and “Non-scan input,” are any of the products registered in the product master. It is not specified whether

Reserved products that fall under any of the four categories of classification numbers 1 to 4: "NON-FILE", "Reading NG", "Pseudo scan input", and "Non-scan input" It is a specific product. An unspecified product is, for example, a product for which the registration result is incomplete because it has not been specified which one of the products registered in the product master.
Unspecified products are further divided into code acquired products whose product code is acquired by product registration operation, such as “NON-FILE” of classification number 1, and “reading NG” of classification numbers 2 to 4, “pseudo scan input” ”, and “Non-scan input”, and code-unacquired products for which the product code was not acquired by the product registration operation.

Transaction management device 60 stores part or all of the cart information in another device (such as a file server that transaction management device 60 can access) in place of or in addition to storing the cart information in its own storage unit. You can memorize all of them.

[Example of basic processing procedure for self-operation]
The sequence diagram of FIG. 10 shows an example of a processing procedure executed by the customer terminal device 50, the settlement device 40, and the transaction management device 60 in response to accounting for one transaction in self-operation. Specifically, the process shown in FIG. An example of processing of the device 40 and the transaction management device 60 is shown.

Step S1: The customer terminal device 50 acquires information specifying a store (store specifying information).
For example, a two-dimensional code for identifying the store is displayed near the entrance of the store (output the two-dimensional code on the display screen, affix a medium on which the two-dimensional code is printed, etc.) so that customers who visit the store can By scanning (reading) the two-dimensional code with the terminal device 50, the customer terminal device 50 may acquire the shop specific information. When a customer visiting the store activates the shopping application, a screen for instructing the customer to scan the two-dimensional code may be displayed as an activation screen. is scanned, the shopping application is activated, and a screen for informing the customer that the transaction management device 60 is being connected may be displayed as the activation screen.

Further, for example, since a store is specified by its location, a customer who visits the store may acquire location information (GPS information) using the customer terminal device 50 at the store (i.e., acquire location information of the store as store specification information). may be used). It should be noted that when a customer visiting the store activates the shopping application, the location information may be acquired and a screen notifying the customer that the transaction management device 60 is being connected may be displayed as the activation screen. If a plurality of stores are detected from the position information and one cannot be identified, a selection screen may be displayed for the customer to select.
Alternatively, the mode may be switched to forcibly acquire the two-dimensional code.

FIG. 11A shows an example of a shopping application activation screen displayed on the display unit 504 of the customer terminal device 50 . The store name is displayed on the startup screen in FIG. This store name is displayed based on the store identification information acquired in step S1.
When the customer starts product registration for shopping, the customer operates a transaction start instruction button BT10 arranged on the startup screen.
In response to the operation of the transaction start instruction button BT10, the customer terminal device 50 transmits a transaction start request including the acquired shop identification information and customer identification information to the transaction management device 60. FIG. The transaction start request may be transmitted in response to the customer's operation on the customer terminal device 50 as described above, or may be transmitted in response to acquisition of the shop specific information without receiving any particular operation. You may do so.
As for the customer identification information, the information entered in the name column of the registration form using the customer terminal device 50 at the time of customer registration (when downloading or installing a shopping application to the customer terminal device 50) is stored in the transaction management device 60. Although it may be stored in the customer information, it may also be stored in the storage unit of the customer terminal device 50 in addition to the transaction management device 60 . In addition, when the store is specified (when the product registration initial screen described later) is acquired, the store name of the store, the service in progress (flyer information distributed on that day), and available coupon information It may be displayed on a screen (a product registration initial screen or a screen different from the product registration initial screen). Information on services and coupons may be acquired from the transaction management device 60 as screen information, for example.

Also, the destination information (the address of the transaction management device 60) is acquired at the time of customer registration (when the shopping application is downloaded or installed in the customer terminal device 50) and stored in the storage unit of the customer terminal device 50. You can leave it. In the case of scanning a two-dimensional code, in addition to the store identification information, the destination information is also converted into a two-dimensional code. By scanning the two-dimensional code with the customer terminal device 50, The device 50 may also acquire destination information together with the store identification information.

Step S2: The transaction management device 60, which receives the customer identification information and the shop identification information from the customer terminal device 50 as a transaction start request, generates cart information for the transaction. In the initial state of cart information, cart identification information, transaction start date and time, and customer identification information are stored. Date and time, product information (registered product information, reserved product information, etc.) are not stored.

As described above, the transaction management device 60 stores store information such as that shown in FIG. However, if the received shop identification information is a two-dimensional code, the shop identification information is obtained by referring to the shop identification information 1, and the received shop identification information is location information (GPS information). If there is, the store identification information is obtained by referring to the store identification information 2 . If the store identification information received from the customer terminal device 50 is two-dimensionally coded store identification information, the transaction management device 60 may acquire the information as it is.

That is, the transaction management device 60, which has received the customer identification information and the shop identification information as the transaction start request from the customer terminal device 50, acquires the shop identification information from the shop identification information received from the customer terminal device 50, and furthermore, sets the current date. It acquires, issues (numbers) a serial number, combines the store identification information, the current date and the serial number, and stores it as cart identification information in the cart information.
In addition, the transaction management device 60, which receives the shop identification information and the customer identification information as the transaction start request from the customer terminal device 50, acquires the current date and time and stores it as the transaction start date and time (generated date and time) in the cart information. In addition, the transaction management device 60 that receives the store identification information and the customer identification information from the customer terminal device 50 as a transaction start request stores the customer identification information received from the customer terminal device 50 as the customer identification information in the cart information.

Step S3: The transaction management device 60 that has generated the cart information of the transaction generates product registration initial screen information (screen information of the product registration screen that is the initial screen) and transmits it to the customer terminal device 50 . Specifically, the transaction management device 60 generates product registration initial screen information, for example, and transmits the generated product registration initial screen information to the customer terminal device 50 together with the cart identification information.

Step S4: The customer terminal device 50 that has received the cart identification information and product registration initial screen information from the transaction management device 60 stores the cart identification information and displays the registration screen on the display unit. Specifically, the customer terminal device 50 displays, for example, a product registration initial screen as shown in FIG. 11(B).

Step S5: By the customer's operation, the customer terminal device 50 scans the bar code attached to the product to read the product code. In the figure, it is assumed that the bar code has been successfully scanned. Steps S5 to S9 are repeatedly executed each time the bar code attached to the product is scanned.

The customer terminal device 50 that has acquired the bar code transmits the cart identification information and product registration information including the product code obtained by scanning to the transaction management device 60 .

Step S6: The transaction management device 60, which has received the product registration information (cart identification information and product code) from the customer terminal device 50, identifies the cart information of the transaction from the cart identification information included in the received product registration information. do.

Step S7: The transaction management device 60 updates product data in the specified cart information.
Specifically, when the received product registration information includes a product code for item N, the transaction management device 60 adds the product code to the registered product information (registered product N) in the specified cart information. ), the product name and price corresponding to the product code are acquired from the product information, and stored as the product and price of the registered product information (registered product N). The transaction management device 60 also updates the registered product information (total) in the specified cart information.

Step S8: After updating the product data in the cart information, the transaction management device 60 generates product registration update screen information (screen information of the product registration screen, which is an update screen to which the registered product is added), and the customer terminal device 50 Send to Specifically, the transaction management device 60 displays, on the customer terminal device 50, a product registration update screen to which the list item of the product registered this time is added to the registered product list, as shown in FIG. 11C, for example. The generated product registration update screen information is transmitted to the customer terminal device 50 together with the cart identification information.

The product registration screen (product registration update screen) shown in FIG. 11(C) is displayed on the customer terminal device 50 after "00 bread" is registered as the third product. That is, when the transaction management device 60 stores "XX yogurt" as one item in the cart information, the customer terminal device 50 generates and generates product registration update screen information such that "XX yogurt" is displayed. When the product registration update screen information and the cart identification information are sent to the customer terminal device 50, and "XX chocolate" is stored in the cart as the second item, the customer terminal device 50 stores "XX yogurt" and "XX chocolate." ” is displayed, the generated product registration update screen information is transmitted to the customer terminal device 50 together with the cart identification information, and “○○ bread” is stored in the cart information as the third item. Then, as shown in FIG. 11(C), the customer terminal device 50 generates product registration update screen information such that "XX yogurt", "XX chocolate" and "XX bread" are displayed. , the generated product registration update screen information is transmitted to the customer terminal device 50 together with the cart identification information.

Incidentally, in response to the registration of one product, for example, as shown in FIG. 12A, a registered product presentation screen WD1 showing the product registered this time may be displayed. In addition, on the registered product presentation screen WD1 in the same figure, a "Yes" button BT1 and a "No" button BT1 and a "No" button are used to confirm with the customer whether or not to eat and drink with eat-in in response to the fact that the target product supports eat-in. An example in which BT2 is arranged is shown. In this case, the product price is calculated so that the consumption tax rate for the target product differs depending on whether the "Yes" button BT1 is operated or the "No" button BT2 is operated. become.

Step S9: The customer terminal device 50 that has received the cart identification information and product registration update screen information from the transaction management device 60 adds the product to the registration screen. Specifically, the customer terminal device 50 displays, for example, a product registration update screen as shown in FIG. 11(C). As mentioned above, the product registration screen (product registration update screen) shown in FIG. is.

Step S10: The customer terminal device 50 accepts an instruction to shift to settlement as a customer's operation. For example, the touch of the "proceed to checkout" button shown in FIG. 11(C) is accepted.

Step S11: The customer terminal device 50 that has received the payment transfer instruction operation generates a two-dimensional code. In other words, the customer terminal device 50 two-dimensionally encodes information (for example, cart identification information) necessary for executing settlement processing for the purchased product by the customer terminal device 50 .
The customer terminal device 50 that has generated the two-dimensional code displays the generated two-dimensional code on the display unit.
For example, a code display screen on which two-dimensional codes are arranged as shown in FIG. 11(D) is displayed on the display unit.

Step S<b>12 : The settlement device 40 scans (reads) the two-dimensional code displayed on the display section of the customer terminal device 50 . For example, the settlement device 40 scans a two-dimensional code displayed on the display section of the customer terminal device 50 that is directed within the recognition range of the customer-side scanner section 406 by the customer.

Step S13: After reading the two-dimensional code displayed on the display of the customer terminal device 50, the settlement device 40 requests the transaction management device 60 to calculate the subtotal amount. For example, the settlement device 40 transmits to the transaction management device 60 a calculation request (subtotal calculation request information) requesting calculation of a subtotal amount together with the cart identification information acquired from the two-dimensional code.

Step S14: The transaction management device 60, which has received the cart identification information and the small calculation request information from the customer terminal device 50, identifies the cart information of the transaction from the cart identification information.

Step S15: The transaction management device 60 that has specified the cart calculates the subtotal amount using the information such as the price in the registered product information included in the cart information corresponding to the specified cart information.

Step S16: The transaction management device 60 that has calculated the subtotal amount updates the cart information (stores the subtotal amount (calculated subtotal amount)) and sends the subtotal information indicating the calculated subtotal amount to the settlement device 40 together with the cart identification information. Send.

Step S17: After receiving the cart identification information and the subtotal information (settlement information) from the transaction management device 60, the settlement device 40 displays the subtotal amount on the customer side display section 405. FIG.

Step S18: The settlement device 40, which has displayed the subtotal amount on the customer-side display section 405, executes payment (settlement). Specifically, the settlement device 40 accepts selection of a settlement type. In the case of cash, the deposit is accepted, the amount of change is calculated, and if there is change, the change is released and a receipt is issued. Further, when the settlement is completed, the settlement device 40 transmits settlement completion information together with the cart information to the transaction management device 60, and the transaction management device 60 stores the transaction end date and time (settlement date and time) of the cart.

After scanning the product, the customer terminal device 50 transmits the product code to the transaction management device 60 (S5). It is also possible not to transmit the product code for products other than the above (for example, products scanned by moving to another store). For example, the customer terminal device 50 acquires and stores location information (GPS information) when visiting the store (or when displaying the product registration initial screen). In addition, the customer terminal device 50 acquires position information when scanning each product, and stores the position information acquired when scanning the product and the position information acquired when visiting the store (or when displaying the initial screen for product registration). compare. Then, the customer terminal device 50 permits the transmission of the product code of the product to the transaction management device 60 if both match (or approximately match), and if they do not match (or approximately match), the corresponding product code. Transmission of the product code of the product to the transaction management device 60 may be prohibited.
This makes it possible to prevent inappropriate product registration (for example, product registration for a cart generated at another store or the like).

When the settlement device 40 prohibits the transmission of the product code as described above, after scanning the product, an error message (for example, "Registration is not possible because it is not in the XX store") is displayed on the customer-side display unit 405. may be displayed. Further, the settlement device 40 may display the message on the clerk side display section 410 instead of or in addition to the customer side display section 405 .

Also, after reading the two-dimensional code displayed on the display unit of the customer terminal device 50, the settlement device 40 requests the transaction management device 60 to calculate the subtotal amount (S13). Calculation of the subtotal amount may not be requested for products other than the above (for example, products scanned at other stores). For example, the settlement device 40 refers to the store identification information of the store (the store identification information of the store may be stored and referred to in the settlement device 40 itself, or may be stored in another accessible device). may refer to the store identification information of the store), when the two-dimensional code displayed on the display unit of the customer terminal device 50 is read, the cart identification information obtained from the two-dimensional code and the store identification of the store Compare with information. Then, if the store identification information included in the cart identification information includes the store identification information of the store, the settlement device 40 permits the request for calculation of the subtotal amount and includes the store identification information of the store. If not, the request to calculate the subtotal amount may be prohibited.
In this way, it is possible to prevent inappropriate settlements (for example, settlements of products registered as products at other stores, etc.).

When the settlement device 40 prohibits the request for the subtotal amount as described above, after reading the two-dimensional code, the settlement device 40 displays an error message (e.g., "The settlement cannot be made because the product is not from XX store.") to the customer side. It may be displayed on the display unit 405 . Further, the settlement device 40 may display the message on the clerk side display section 410 instead of or in addition to the customer side display section 405 .

In addition, in the example of the processing procedure of FIG. 10, the transaction management device 60 calculates the subtotal amount. However, for example, the settlement device 40 may acquire the cart information from the transaction management device 60 and calculate the subtotal amount based on the acquired cart information. Alternatively, the transaction management device 60 transmits the cart information to the management device 10 to request calculation of the subtotal amount, the management device 10 uses the received cart information to calculate the subtotal amount, and the calculated subtotal amount is , to the settlement device 40 via the transaction management device 60 .

[Regarding the operation of the customer terminal device when an unspecified product is registered]
In FIG. 10, step S5 is processing corresponding to the case where the product code has been successfully read and the product corresponding to the read product code has been specified.
However, at the stage where the customer terminal device 50 is reading the product code corresponding to step S5, as a product registration result, registration as an unspecified product by any of the classification numbers 1 to 4 in FIG. may have consequences (unspecified consequences).

As a specific example, FIG. 12B shows a captured image of a product registration screen for a case where the customer terminal device 50 determines that an unspecified result has occurred as a pseudo scan of classification number 3. ing. The figure shows a product registration screen displayed on the customer terminal device 50 . In the product registration screen of FIG. 1, a photographed image of a customer trying to make the customer terminal device 50 read the barcode of the product with the barcode part hidden by the finger is displayed. It is shown.

In such a case, the customer terminal device 50 recognizes the existence of the barcode from the captured image, but obtains the processing result that the code could not be extracted from the barcode. Since such a processing result is included in one type of processing result in the pseudo scan, the customer terminal device 50 detects that the pseudo scan has occurred. In this case, the customer terminal device 50 transmits to the transaction management device 60 product registration information indicating that the product is an unspecified product for which the pseudo scanning of the classification number 3 has been performed.

Further, when transmitting product registration information in response to occurrence of an unidentified result as described above, the customer terminal device 50 transmits a captured image corresponding to the generated unidentified result. The captured image to be transmitted is extracted from the buffered captured image after the captured image captured by the imaging unit 506 is buffered for a certain period of time, for example, in order to read the product code. you can Also, the captured images to be transmitted may be, for example, a predetermined number of still images, or may be a moving image of a predetermined period according to the occurrence of the unspecified result.

Further, when the product to be registered is determined to be an unspecified product due to the occurrence of the unspecified result as described above, the customer terminal device 50 treats the unspecified product as a reserved product. In this case, when the customer terminal device 50 determines that an unspecified result has occurred, as shown in FIG. may be displayed. Specifically, in the guidance image WD2 in the figure, a message is displayed that reads, "If scanning is not possible, please put the product in the dedicated bag." Note that the mode of the guide image WD2 is not particularly limited.
The guide image WD2 in the figure is displayed so as to be superimposed on the product registration screen. A confirmation button BT3 is arranged in the guide image WD2 in the figure. In this case, the guidance image WD2 is erased when the confirmation button BT3 is operated. Alternatively, the guide image WD2 may be erased after a certain period of time has elapsed since the start of display. After the guide image WD2 is erased, for example, the product registration screen shown in FIG. 11B or 11C may be displayed again.

Unspecified products are treated as pending products as described above. On the product registration screen, the registered product list is displayed as shown in FIG. 11(C), but for products classified as unspecified products among the pending products, list items are not displayed in the registered product list. It's good. Reserved products that are not classified as unspecified products are displayed as list items in the registered product list. It should be noted that an unspecified product may also be displayed as a list item in the registered product list so as to indicate that it is an unspecified product.

When the customer completes the registration of all the products to be purchased, the customer performs an instruction operation to move to settlement, and causes the settlement device 40 to read the two-dimensional code displayed on the customer terminal device 50 . After reading the two-dimensional code, the settlement device 40 requests the transaction management device 60 to calculate the subtotal amount, as shown as step S13 in FIG. Here, the settlement device 40 of the present embodiment requests settlement information used for settlement processing when requesting calculation of the subtotal amount.

The transaction management device 60 identifies corresponding cart information in response to the request for settlement information, and generates settlement information based on the specified cart information. The settlement information includes registered product information in the cart information and information such as a subtotal amount corresponding to the registered product. Further, among the registered product information included in the settlement information, the registered product information corresponding to the failed registration product includes the captured image corresponding to the unspecified result. Transaction management device 60 transmits the generated settlement information to settlement device 40 .
When receiving the settlement information, the settlement device 40 causes the customer-side display unit 405 to display a settlement screen reflecting the content of the received settlement information.

Next, control for displaying a part of the display area and an area different from the part so that the visibility is different will be described. FIG. 13 shows an example of a settlement screen displayed on the customer-side display section 405 of the settlement device 40. As shown in FIG.
A registered product list area AR3 is arranged on the checkout screen of FIG. The registered product list area AR3 is an area for presenting a list of products registered by the customer terminal device 50. FIG.

In the following description, product information (registered product information, pending product information) corresponding to each product list item in the registered product list area AR3 may also be referred to as a record.
In addition, with regard to registered product information and pending product information corresponding to classification by age verification products (classification number 5), pharmaceuticals (classification number 6), and crime prevention tag products (classification number 7), the products must be specified. Therefore, it is also called a product specific record. Among the product identification records, the registered product information is also called a normal registration record because it corresponds to a product that has been registered normally, not as a pending product. Among reserved product information, those corresponding to unspecified products (classification numbers 1 to 4) are also called unspecified records.

If reserved products are included in the registered products, the list items of the reserved products are prioritized and arranged from the upper part of the left column in the registered product list area AR3. That is, in the registered product list area AR3, the list items of the reserved products are arranged in order from the top.
In the example shown in the figure, in response to the fact that five reserved products are included in the registered products, the registered product list area AR3 includes a reserved product list area AR31 containing the list items of the five reserved products from the upper left. is formed. The list items in the reserved product list area AR31 are different from the list items of other products in terms of, for example, the background color.

In this way, the settlement device 40 divides a part of the display area in which the list items of the reserved product list area AR31 are displayed and an area different from the part so that the visibility is different. indicate. Further, the settlement device 40 displays the area AR32 including the number of pending products and the approximate total, which are information that assists the pending product list area, with the same visibility as the pending product list area AR31. As a result, visibility for customers can be improved.
When the products are specified and the pending products are canceled, the amount of each product can be specified. Therefore, the approximate total display is changed to the total amount that is the amount actually required for settlement.

In addition, in the reserved product list area AR31, list items corresponding to product identification records whose products are specified among the reserved products are arranged in order, followed by unspecified products whose products are not specified. list items are arranged in order. In other words, in the reserved product list area AR31, the list items corresponding to the product identification records whose products are specified among the reserved products and the list items corresponding to the unspecified products whose products are not specified are classified. It is an array.

In the registered product list area AR3, list items corresponding to the normal registration records are arranged following the reserved product list area AR31. This figure shows an example in which list items corresponding to normal registration records are arranged in descending order of product price in the registered product list area AR3.
Of the list items in the registered product list area AR3, the list item corresponding to the product identification record indicates the product name of the specified product, the registered quantity, the price corresponding to the registered quantity, and the like.

In the list item for each reserved product in the reserved product list area AR31, a reserve cancellation declaration button BT31 is arranged. The reserve cancellation declaration button BT31 is a button for declaring cancellation of the reserve of the corresponding product. However, the hold release declaration button BT31 cannot be operated on the checkout screen of FIG. On the checkout screen, the reserve release declaration button BT31 has a function as an icon indicating that the corresponding list item corresponds to the reserved product.

The reserved product classification name to which the corresponding product corresponds is indicated in each reserved release declaration button BT31.
Specifically, for example, for age verification products (classification number 5), pharmaceuticals (classification number 6), crime prevention tag products (classification number 7), and canceled products (classification number 8), respectively, the corresponding hold release declaration button BT31 A name indicating the classification is displayed. In addition, unspecified products (classification numbers 1 to 4) are collectively displayed under the name of "reserved product".
In the same figure, as a display on the hold release declaration button BT31, the list item on the first line is displayed as "age confirmation" corresponding to the age confirmation product (classification number 5), and the list on the second line The item is displayed as "Security Tag" corresponding to the security tag product (classification number 7), and the list item on the third line is displayed as "Security Tag" corresponding to the drug (classification number 6). An example labeled "pharmaceutical" is shown. In addition, the list items on the fourth and fifth lines each show an example of "reserved product".
Thumbnail images TN are arranged in the list items on the fourth and fifth lines. The thumbnail image TN is a captured image obtained by capturing an image with the customer terminal device 50 while the product registration operation is being performed for the corresponding unspecified product. The thumbnail image TN may be a still image or a moving image.
The store clerk visually distinguishes between the list items corresponding to the unspecified products and the list items corresponding to the reserved products whose products have been specified, for the list items of the reserved products, depending on whether or not the thumbnail image TN is arranged. can. Also, the store clerk can grasp what the product registered as the unspecified product actually was from the content displayed in the thumbnail image TN.
It should be noted that the display indicating the corresponding classification in the hold cancellation declaration button BT31 may be a pattern such as an icon indicating the classification.

Among the list items of pending products, the list items corresponding to specified products such as age verification products (classification number 5), pharmaceuticals (classification number 6), security tag products (classification number 7), etc. The product name, the registered quantity, the price corresponding to the registered quantity, etc., of the purchased product are shown.
On the other hand, in the list item corresponding to the unspecified product, the content corresponding to the classification of the corresponding reserved product is displayed. Specifically, in the case of an unspecified product as NON-FILE (classification number 1), as shown in the list item on the fifth line in the same figure, it indicates that it is NON-FILE, and the read product Code may be shown. In addition, in the case of unspecified products (code unacquired products) of reading NG (classification number 2), pseudo-scanning input (classification number 3), and non-scanning input (classification number 4), the 4th line in the same figure Like a list item, a message may be displayed indicating that the product code could not be read.

As shown in the figure, when a reserved product list area AR31 is formed in the registered product list area AR3 of the checkout screen, it is necessary for the clerk to perform an operation to process the reserved product. When the settlement screen on which the reserved product list area AR31 is thus formed is displayed, the settlement device 40 executes a clerk call to make the clerk perform the operation of processing the reserved product. For calling a clerk, the settlement device 40 is configured, for example, to display a display device such as a sign pole in a predetermined manner, or to transmit a clerk call notification to a terminal device owned or monitored by the clerk. good.
In addition, as shown in the figure, in the state where the settlement screen in which the pending commodity list area AR31 is formed is displayed because the pending commodity is included in the registration result, the settlement device 40 does It is designed not to accept operations. Further, for example, in the area above the registered product list area AR3 on the checkout screen of FIG. there is

A clerk who goes to the settlement device 40 in response to the call of the clerk performs a login operation to log in to the settlement device 40 as a clerk. The login operation in this case is, for example, an operation of causing the scanner section (customer side scanner section 406 or clerk side scanner section 412) to read a code (two-dimensional code or bar code) printed on the salesclerk ID. good. Alternatively, for example, it may be an operation of inputting a store clerk number or the like by entering numbers.
In response to the log-in by the store clerk, the display on the customer-side display unit 405 transitions from the checkout screen to the pending product processing screen.

FIG. 14 shows an example of the pending product processing screen. In the figure, the same parts as those in FIG. 13 are denoted by the same reference numerals.
On the reserved product processing screen, the contents of the registered product list area AR3 are displayed in a state inherited from the settlement screen (FIG. 13). Therefore, in the initial display of the pending product processing screen, the list items corresponding to the registered product information in the registered product list area AR3 are arranged in order of price. In addition, the contents such as characters displayed on the reservation release declaration button BT31 arranged in the list item for each reserved product in the reserved product list area AR31 are inherited from the settlement screen (FIG. 13). In addition, the fact that a part of the reserved product list area AR31 displaying the list items and an area different from the part of the area are displayed with different visibility is inherited. Furthermore, the visibility of the area AR32 is inherited to be displayed with the same visibility as the reserved product list area AR31. As a result, the visibility of the store clerk can also be improved.

On the left side of the area above the registered product list area AR3 of the reserved product processing screen in the figure, it is indicated that the screen is for product management, and an instruction is given to the store clerk to release the reserved product. message is displayed.

Sort buttons BT32 (price order button BT32-1, registration order button BT32-2, department order button BT32-3) are arranged on the right side of the area above the registered product list area AR3.
The sort button BT32 is a button for sorting the list items corresponding to the registered product information in the registered product list area AR3 according to the corresponding sort order. Of the sort buttons BT32, the price order button BT32-1 is a button for sorting the list items corresponding to the registered product information in order of price. The registration order button BT32-2 is a button for sorting the list items corresponding to the registered product information in the order in which the customer registered using the customer terminal device 50. FIG. The department order button BT32-3 is a button for sorting the list items corresponding to the registered product information in units of departments to which the products correspond.

When the clerk cancels the reservation of the suspended products in the category that can be identified (age confirmation products (category number 5), medicines (category number 6), crime prevention tag products (category number 7)) After performing a predetermined response work according to each classification, performs an operation (for example, a tap operation) on the hold release declaration button BT31 arranged in the corresponding list item in the held product list area AR31. , the entire list of items on hold may be made tappable.
When the product to be released from the hold is an age-confirmed product, the clerk confirms that the customer is an adult as a service work, and operates the release declaration button BT31 arranged in the corresponding list item.
In addition, when the product to be released from the hold is a pharmaceutical product, the clerk, if he/she is qualified as a pharmacist, explains it himself, or explains it to another clerk who is qualified as a pharmacist. , and then operate the hold cancellation declaration button BT31 arranged in the corresponding list item.
In addition, if the product to be released from the hold is a product with a crime prevention tag, the store clerk removes the crime prevention tag attached to the target product and presses the release declaration button BT31 placed in the corresponding list item as a handling operation. Manipulate.
When the hold release is performed for the held product of the category in which the product can be specified as described above, the display on the operated hold release declaration button BT31 changes from the state indicating the corresponding category as shown in FIG. , for example, changes to a state indicating that the hold has been released, such as "confirmed" (or may be "released") shown in FIG.

In addition, the clerk selects pending products classified as unspecified products (NON-FILE (classification number 1), reading NG (classification number 2), pseudo-scanning input (classification number 3), non-scanning input (classification number 4)). In order to cancel the hold, first, the hold release declaration button BT31 arranged in the list item corresponding to the held product to be released from the hold in the held product list area AR31 is operated.
A status confirmation screen is displayed on the customer-side display unit 405 in response to the operation of the hold release declaration button BT31 corresponding to the unspecified product.

FIG. 15 shows an example of the situation confirmation screen P10. The status confirmation screen P10 is a screen showing the status when the unspecified product corresponding to the operated hold release declaration button BT31 is registered by the customer's operation of the customer terminal device 50. FIG. The status confirmation screen P10 may be displayed so as to be superimposed on the pending product processing screen of FIG. 14, for example.
The situation confirmation screen P10 in the figure shows an example in which an unspecified product to be processed for release of hold is classified as pseudo-scan input (classification number 3).
In addition, the situation confirmation screen P10 in the same figure is shown in the state that the customer terminal device 50 is held by the holder portion provided in the cart. corresponds to the case where it is possible to image the The customer causes the customer terminal device 50 held in the holder to scan the product code.

On the situation confirmation screen P10 in the figure, the captured images G11, G12, and G13 are arranged in order from left to right. The captured images G11, G12, and G13 are captured images obtained when the customer terminal device 50 is trying to scan the product code of the corresponding unspecified product.

The arrangement order of the captured images G11, G12, and G13 from left to right corresponds to the passage of time when the images were captured.
First, the second (center) captured image G12 is a captured image captured when the product to be processed is within the imaging range of the customer terminal device 50 in the product registration operation.
The first captured image G11 is captured before the second captured image G12, and is a captured image captured before the product to be processed falls within the imaging range.
A third captured image G13 is captured after the second captured image G12, and is a captured image captured when the product to be processed is out of the imaging range.

In this case, the store clerk can grasp the situation at the time of the product registration operation in which the unspecified result occurs by looking at the captured images G11, G12, and G13.
Specifically, in the example of FIG. 1, the clerk first moves from the captured image G11 to the captured image G12 so that the product to be processed is placed in the shopping cart before the product registration operation is performed. You can figure out what you didn't.
In addition, since the product code portion of the product is hidden by the hand in the captured image G12, the store clerk can understand that an unspecified result of pseudo scan input (classification number 3) has occurred.
Also, the store clerk can grasp what the product to be processed is from the captured image G12. Specifically, in the example shown in the figure, the store clerk understands that the product to be processed is "canned yakitori".
Further, the store clerk can grasp that the product to be processed has been placed in the shopping cart after the product registration operation is performed by the transition from the captured image G12 to the captured image G13.

After grasping the situation at the time of product registration operation as described above, the clerk operates the screen transition button BT35 to display the product information input screen. In response to the operation of the screen transition button BT35, a product information input screen is displayed instead of the situation confirmation screen P10.
In addition, while the status confirmation screen P10 is being displayed, the clerk scans the product code of the product to be processed in the shopping cart with the scanner unit (customer side scanner unit 406, clerk) of the checkout device 40. An operation for reading by the side scanner unit 412) may be performed. When the settlement device 40 has successfully read the product code, a product information input screen is displayed.

FIG. 16 shows an example of the product information input screen P40. The product information input screen P40 is a screen on which a store clerk inputs product information of a product to be processed as an unspecified product. The product information input screen P40 may also be displayed so as to be superimposed on the pending product processing screen, for example, similar to the situation confirmation screen P10.

In the product information input screen P40, a product information area AR41, an input operation area AR42, a registration button BT41, a cancel button BT42, and a captured image area AR43 (target captured image area AR43-1, next captured image area AR43-2) are arranged. be.

The product information area AR41 is an area in which product information related to corresponding unspecified products is displayed. A product information area AR41 in the figure shows the product name, product code, price, registered quantity, and the like. The registration quantity can be input (registered) by operating the plus button and minus button arranged in the product information area AR41.

The input operation area AR42 is an area in which a software keyboard and buttons for inputting product information in the product information area AR41 are arranged.
In the input operation area AR42, it is possible to switch between a keyboard having a key layout corresponding to numerical input and a keyboard having a key layout corresponding to character input according to the operation.

A preset call button BT421 is arranged in the input operation area AR42. By operating the preset call button BT421, a preset key screen in which preset keys corresponding to each product are arranged is displayed.
For example, when the unspecified product to be processed is either read NG (classification number 2), pseudo-scanned input (classification number 3), or non-scanned input (classification number 4), the clerk selects the product to be processed. If the product name is known, the preset key screen may be displayed. The store clerk can input the product information of the product to be processed into the product information area AR41 by operating the preset key of the corresponding product among the preset keys arranged on the displayed preset key screen. .

A product code input declaration button BT422 is arranged in the input operation area AR42. The commodity code input declaration button BT422 is a button operated when declaring that a commodity code input operation will be performed.
After operating the product code input declaration button BT422, for example, the store clerk inputs the numerical value of the product code indicated by printing or the like on the product to be processed to the keyboard arranged in the input operation area AR42. I do. As a result, the product code is entered in the product information area AR41.

When the product information input screen P40 is displayed in response to the store clerk causing the checkout device 40 to read the product code, the read product code has already been entered in the product information area AR41, and NON- If the product is an unspecified product other than the FILE (classification number 1), the product name, price, etc. are also entered because the checkout device 40 identifies the product from the product master based on the product code, for example. It is in.

If the product to be processed is classified as NON-FILE (classification number 1), the product code is entered in the product information area AR41 when the product information input screen P40 is displayed. in a state. In this case, the store clerk inputs the product name, price, etc. in the product information area AR41 by operating the keyboard arranged in the input operation area AR42.

The registration button BT41 is a button that is operated to confirm the information entered in the product information area AR41 as described above, cancel the suspension of the corresponding unspecified product, and make the product normally registered. .
The cancel button BT42 is a button for instructing cancellation of registration of the corresponding unspecified product.

After confirming the contents entered in the product information area AR41, the store clerk operates the registration button BT41. As a result, the settlement device 40 cancels the pending state of the unspecified product so far and processes to include it in the registered product.
After the registration button BT41 is operated, the product information input screen P40 is erased and the reserved product processing screen (FIG. 14) is displayed again. At the stage of returning to the pending product processing screen, the pending release declaration button BT31 of the list item of the product to be processed in the pending product list area AR31 indicates that the pending state has been canceled by displaying, for example, "confirmed". indicates

Alternatively, when the store clerk determines that the product to be processed should not be registered, the clerk operates the cancel button BT42 to cancel the registration and collect the product from the shopping cart.
Even after the cancel button BT42 is operated, the product information input screen P40 is erased and the reserved product processing screen (FIG. 14) is displayed again. At the stage of returning to the reserved product processing screen, the list item of the product to be processed in the reserved product list area AR31 has changed to a predetermined mode indicating that the registration has been cancelled.

The status confirmation screen P10 and the product information input screen P40 may display the classification number, classification name, etc. of the corresponding unspecified product.

In the captured image area AR43, the target captured image area AR43-1 is an area in which the target captured image is displayed. The target captured image is a captured image obtained when the unspecified product to be processed this time is a code-unacquired product and is within the imaging range during the product registration operation. The captured image displayed in the target captured image area AR43-1 may be the same as the captured image G12 displayed in the situation confirmation screen P10, for example.
In the captured image area AR43, the next captured image area AR43-2 is an area in which the next captured image is displayed. The next picked-up image is a picked-up image obtained by picking up at the time of the product registration operation performed subsequent to the product registration operation corresponding to the code-unacquired product to be processed this time. In other words, the next captured image is the captured image corresponding to the product registration operation in which the product code was first successfully read and the product was identified after the product registration operation corresponding to the code-unacquired product to be processed this time. It is an image.
If there is a captured image in which an article as a product is detected among the captured images obtained in response to the next product registration operation, the captured image including the detected product is selected as the next captured image. be.

As a result of the customer performing a product registration operation for a certain product, if the customer terminal device 50 cannot read the product code normally and the product is registered as a code-unacquired product, the customer may re-register the same product. Product registration operations are often attempted. In such a case, the customer will perform the product registration operation twice in succession for the same product. In such a case, if the product code is successfully read by the second product registration operation, the same product will be registered as a pending product for which the code has not been acquired, and based on the read product code Double registration will be performed with normal registration in which the product is specified by
In such a case where double registration is performed, as a procedure for canceling the reservation by the store clerk, it is necessary to delete the registration of the pending product as the product for which the code has not been obtained and to leave the normal registration of the same product. Just do it. In order to perform such processing smoothly, it is required that the store clerk can easily grasp whether or not the code-unacquired product for which the hold is to be released has been double-registered.

Therefore, in the present embodiment, the captured image area AR43 (the target captured image area AR43-1, the next captured image area AR43-2) is arranged on the product information input screen P40, and the target captured image and the next captured image are displayed. I'm trying
If the target captured image and the next captured image show that the same product is captured, the store clerk can confirm that double registration has been performed. Therefore, the store clerk in this case, for example, operates the cancel button BT42 arranged on the product information input screen P40. As a result, the code-unacquired product to be processed is deleted from the list of registered products.

Also, in the next captured image area AR43-2 in the figure, a quantity display portion NM is arranged. The quantity display portion NM is an image portion that indicates the quantity (registered quantity) registered by the customer's operation, for example, for the product normally registered by the product registration operation when the next captured image is captured.
By arranging the quantity display part NM, the store clerk grasps the registered quantity of the product that has been registered normally in duplication with the unspecified product to be released from the hold at the stage of performing the hold release operation, Work and operations related to hold release can be performed accurately.

If the product to be processed is an unspecified product as NON-FILE (classification number 1), the customer terminal device 50 succeeds in reading the product code, but does not specify the product. is notified. In this case, the customer can know that the product code has been successfully read, so there is little possibility that the same product will be registered again and double registration will occur. Therefore, when the registration result of the product to be processed corresponds to NON-FILE, the captured image area AR43 (image to be processed, next captured image) may not be displayed.
However, there is a possibility that some customers may misunderstand that the product code has failed to be read even if the notification is made according to the result of non-registration as NON-FILE, and may perform the product registration operation again. . For this reason, even when the registration result of the product to be processed corresponds to NON-FILE, the captured image area AR43 (image to be processed, next captured image) may be displayed. If the captured image area AR43 is displayed, the store clerk can easily understand that the non-registration result of NON-FILE for the same product has been registered twice.

[Example of processing procedure]
An example of a processing procedure executed by the customer terminal device 50 and the transaction management device 60 of the present embodiment in relation to product registration will be described with reference to the flowchart of FIG. 17 . The process of FIG. 9 corresponds to FIG. 9, and shows more specifically the process of steps S5 to S11 including the process corresponding to the registration result of the unspecified product.

First, an example of a processing procedure executed by the customer terminal device 50 will be described.
Step S101: With the product registration screen displayed, the customer terminal device 50 determines whether or not the product code has been successfully read.

Step S102: If the customer terminal device 50 successfully reads the product code, the product registration result corresponding to the previous product registration operation will be the result of code not acquired (reading NG (classification number 2), pseudo scan input (classification No. 3) or non-scan input (any of classification No. 4)).
The code not acquired result corresponds to a case where a pending product as a code not acquired product is registered as a product registration result.

Step S103: If it is determined in step S102 that the product registration result in response to the previous product registration operation was the result of the code not being acquired, the customer terminal device 50 selects the , acquires (extracts) captured images in which the product is stored during the period corresponding to the current product registration operation. The captured image acquired by the customer terminal device 50 in step S103 is the next captured image area AR43-2 of the product information input screen P40 for which the code-unacquired product registered by the previous product registration operation is subject to the process of releasing the hold. It is used as the next captured image.

Note that the format (moving image, still image) of the captured image acquired by the customer terminal device 50 in step S103, the number of captured images, the time of the captured image to be acquired, the period, etc. may be different depending on the classification of

Step S104: If it is determined in step S102 that the code has not been obtained yet, or after the process of step S103, the customer terminal device 50 transmits the product registration information.
The product registration information includes the product code read in step S101 and cart identification information. After that, when step S104 is reached through step S103, the customer terminal device 50 transmits product registration information further including the captured image acquired in step S103. If it is determined in step S102 that the code has not been acquired yet, and if the product registration result corresponds to an unspecified product of NON-FILE (classification number 1), the customer terminal device 50 Product registration information indicating that the product is registered as FILE (classification number 1) is transmitted.

Step S105: Upon receipt of the registration completion notification transmitted from the transaction management device 60 in response to the transmission of the product registration information in step S102, the customer terminal device 50, for example, as shown in FIG. Update the registration screen.

Step S106: If it is determined in step S101 that the code was not read normally, or after the process of step S105, the customer terminal device 50 confirms that the product registration result corresponding to the current product registration operation is the code not obtained result. It is determined whether or not The code non-acquisition result is a product registration result that corresponds to any one of pending products of reading NG (classification number 2), pseudo-scanning input (classification number 3), and non-scanning input (classification number 4).

First, the customer terminal device 50 is in a state where it is recognized that the entire bar code of the product is captured in the captured image, but a certain period of time has passed without completing (successfully) reading the bar code. If so, it is determined that a code not acquired result as reading NG (classification number 2) has occurred.

In addition, the customer terminal device 50 recognizes the product in the captured image, but when the barcode reading is not completed normally because the barcode cannot be recognized at all, the customer terminal device 50 performs pseudo scanning (classification number 3). It is determined that a code not obtained result has occurred.
Alternatively, if the customer terminal device 50 could not recognize only a part of the barcode of the product in the captured image and the barcode reading was not completed normally, the result of code not acquired as a pseudo scan occurred. I judge.
Alternatively, the customer terminal device 50 can recognize the bar code of the product in the captured image, but the product is moving too fast, and the barcode reading is not completed normally. It is determined that a code not obtained result has occurred.
Code not obtained results classified as pseudo scans are fraudulent acts such as placing products in a shopping cart just by pretending that the customer is performing an operation to read the barcode of the product. there may be.

Moreover, the customer terminal device 50 set in the shopping cart can image the contents of the shopping cart placed on the shopping cart. When the customer terminal device 50 detects that a new product has been added to the shopping cart even though the bar code of the product is not recognized in the captured image. Then, it is determined that a code non-acquisition result has occurred as non-scan input (classification number 4).
It should be noted that, for example, the customer may move already registered products within the shopping cart in order to organize the contents of the shopping cart. The customer terminal device 50 may be configured to be able to distinguish between such movement of products and additional introduction of new products corresponding to code non-acquisition results as non-scanning introduction, based on the captured image.
Occurrence of the code not obtained result classified as non-scan input is caused by fraud such as the customer placing the product in the shopping cart as it is without allowing the customer terminal device 50 to read the bar code of the product. there may be.

Further, when it is determined in step S106 that the product registration result is not the result of not obtaining the code, the customer terminal device 50 analyzes the image captured by the imaging unit 506, and the product registration operation is performed. is not performed.

Step S107: If it is determined that the code has not been obtained in step S106, the customer terminal device 50 selects the images captured by the imaging unit 506 during the period corresponding to the current product registration operation. Acquire (extract) an image.
The captured image acquired by the customer terminal device 50 in step S107 is the captured image G11 displayed on the situation confirmation screen P10 when the code-unacquired product registered by the current product registration operation is subject to the process of canceling the hold. , G12 and G13. In addition, the captured image acquired by the customer terminal device 50 in step S107 is the target captured image on the product information input screen P40 when the code-unacquired product registered by the current product registration operation is subject to the process of releasing the hold. The area AR43-1 may also be used as the target captured image.

Step S108: The customer terminal device 50 transmits to the transaction management device 60 product registration information indicating the result of product registration as a result of not obtaining the code this time. Also, the product registration information transmitted in step S108 includes the captured image acquired in step S107.

Step S109: The customer terminal device 50 updates the product registration screen in response to receiving the registration completion notice transmitted from the transaction management device 60 in response to the transmission of the product registration information in step S108.

Step S110: If it is determined in step S106 that the code has not yet been obtained, or after the processing in step S109, the customer terminal device 50 determines whether or not it has received an instruction to shift to settlement.
If the settlement transfer instruction operation has not been received, the process returns to step S101.

Step S111: Upon receiving the payment shift instruction operation, the customer terminal device 50, for example, converts the cart identification information into a two-dimensional code, and displays the generated two-dimensional code on the code display screen illustrated in FIG. 11(D), for example. 504 to display.

Next, an example of a processing procedure executed by the transaction management device 60 will be described.
Step S201: The transaction management device 60 determines whether or not the product registration information transmitted from the customer terminal device 50 in step S104 or step S108 has been received.

Step S202: When the product registration information is received, the transaction management device 60 identifies the cart information indicated by the cart identification information included in the received product registration information.

Step S203: Transaction management device 60 updates the cart information specified in step S202. That is, transaction management device 60 generates registered product information or pending product information based on the product code included in the product registration information received in response to step S201. Transaction management device 60 adds the generated registered product information or reserved product information to the cart information specified in step S202. As a result, one product is registered in the cart information.
Further, if the product registration information received in step S201 includes a captured image, the transaction management device 60 associates the captured image with the registered product information or the pending product information added to the cart information. memorize.

Step S204: The transaction management device 60 transmits a registration completion notice to the customer terminal device 50 after the process of step S203.

In the process of FIG. 1, the customer terminal device 50 selects a captured image that is not to be transmitted to the transaction management device 60 (i.e., a captured image that is not used as the target captured image or the next captured image), among the captured images obtained by regular capturing. image) may be deleted at a predetermined timing. For example, when a product is identified and registered twice consecutively, it is determined that the captured image corresponding to the first registration will not be used as the next captured image. Therefore, the customer terminal device 50 may delete the captured image corresponding to the first registration at the timing when the product is identified and registered twice consecutively. Alternatively, the customer terminal device 50 may delete captured images that have not been transmitted to the transaction management device 60 at the timing when the settlement transfer instruction operation is performed and the product registration for all products is completed.

In addition, in the shopping system of the present embodiment, the customer terminal device 50 does not transmit product registration information each time a product is registered, for example. You may collectively transmit the product registration information for all the products that have been registered. At this time, the customer terminal device 50 transmits the product registration information including the target captured image and the captured image used as the next captured image.
When the product registration information is collectively transmitted in this manner, the customer terminal device 50, for example, at the timing when product registration for all products is completed, captures images (target captured images, target captured images, A captured image that is not used as the next captured image) may be deleted.

With reference to the flowchart of FIG. 18, an example of the processing procedure executed by the settlement device 40 in relation to the cancellation of the reservation of the reserved product will be described.
Step S301: The settlement device 40 waits for the log-in by the store clerk who cancels the suspension while the customer-side display unit 405 displays the settlement screen including the list items of the suspended products as shown in FIG. stand by.

Step S302: In response to the log-in by the store clerk, the settlement device 40 changes the display on the customer-side display section 405 from the settlement screen to the pending goods processing screen (FIG. 14).

Step S303: While the pending product processing screen is being displayed, the settlement device 40 determines whether or not an unidentified record specifying operation has been performed. The unspecified record specifying operation is an operation on the hold release declaration button BT31 arranged in the list item corresponding to the unspecified product among the list items of the pending products (unspecified record) in the pending product list area AR31.

Step S304: When the unspecified record specifying operation is performed, the settlement device 40 displays the status confirmation screen P10 for the unspecified product corresponding to the list item specified by the unspecified record specifying operation to be subject to hold release processing. Displayed on the display unit 405 .

Step S305: With the status confirmation screen P10 displayed, the settlement device 40 waits for a screen transition trigger to the product information input screen P40. The screen transition trigger is reception of an operation to the screen transition button BT35 on the situation confirmation screen P10 or completion (success) of reading the merchandise code by the settlement device 40 .

Step S306: When the screen transition trigger occurs, the settlement device 40 displays the product information input screen P40 for the unspecified product to be processed.
Step S307: The settlement device 40 confirms that the product registration information (product code, product name, price, quantity, etc.) has been input by the store clerk while the product information input screen P40 is being displayed. Enter the product registration information accordingly.
Step S308: The settlement device 40 transmits registration product information or a cancellation request to the transaction management device 60 in response to the operation of the registration button BT41 or the cancellation button BT42.
The registered product information is transmitted in response to the operation of the registration button BT41, and has contents reflecting the information input to the product information area AR41. The cancel request is a command that is transmitted in response to the operation of the cancel button BT42 and requests that the pending product information to be processed stored in the cart information be in a canceled state.

Step S309: If it is determined in step S303 that the unidentified record designation operation has not been performed, the settlement device 40 determines whether or not the reserved product confirmation operation has been performed. The reserved product confirmation operation is an operation on the reserve cancellation declaration button BT31 in the list item corresponding to the reserved product that is not the unspecified product. In other words, pending products that are not unspecified products are age-confirmed products (category number 5), medicines (category number 6), and crime prevention tag products (category number 7) that can be specified. With respect to these reserved products that are not unspecified products, the hold is released by the store clerk performing predetermined handling work and then operating the hold release declaration button BT31 of the corresponding list item.

Step S310: When the pending product confirmation operation has been performed, the settlement device 40 transmits to the transaction management device 60 a hold release request corresponding to the pending product for which the pending product confirmation operation has been performed this time.

Step S311: The transaction management device 60 updates the corresponding cart information in response to the registration product information or the cancellation request transmitted from the settlement device 40 in step S308. That is, when the transaction management device 60 receives the registered product information, the transaction management device 60 changes the pending product information of the target product to the product registration information based on the received registered product information. At this time, the transaction management device 60 may change, for example, the hold release flag included in the product information to indicate that the hold has been released.
Further, when the transaction management device 60 receives a cancellation request, the transaction management device 60 changes the pending product information of the target product to indicate that it has been cancelled. Further, in response to receiving the hold release notification transmitted from the settlement device 40 in step S310, the transaction management device 60 changes the product information type so that the held product information of the target product in the cart information is managed as registered product information. change. In this case, the transaction management device 60 may change, for example, the hold release flag included in the product information to indicate that the hold has been released.
After updating the cart information as described above, the transaction management device 60 transmits settlement information corresponding to the updated cart information to the settlement device 40 . The settlement device 40 receives the transmitted settlement information.

Step S312: The settlement device 40 determines whether or not the suspension of all the suspended products has been released. If there are still products on hold that have not been released from the hold, the process returns to step S302.
When the process returns from step S312 to step S302, the settlement device 40 displays the pending product processing screen updated according to the content of the settlement information received in step S311.

Step S313: If it is determined in step S312 that all the pending products have been released, the settlement device 40 displays a settlement screen reflecting the details of the settlement information received in step S311. do. In the registered product list area AR3 of the checkout screen displayed in step S312, the list item of the reserved product is not displayed, so that the checkout device 40 can execute checkout processing in accordance with subsequent operations by the customer. state.

<Modification>
Modifications of this embodiment will be described below. Modifications described below may be appropriately combined with the above embodiment and other modifications.

[First modification]
In the above embodiment, the transaction management device 60 identifies the product based on the product code read by the customer terminal device 50 . Product identification is not limited to such processing. For example, the customer terminal device 50 transmits a captured image of a product to the transaction management device 60, and the transaction management device 60 compares the received captured image with a product image database to specify the product. may be

[Second modification]
The next captured image may also be displayed on the situation confirmation screen P10, for example. FIG. 19 shows an example of the situation confirmation screen P10 corresponding to this modified example. In the situation confirmation screen P10 in the figure, in addition to the captured images G11, G12, and G13 when the product registration operation was performed for the unspecified product, the next captured image G21 is arranged.
In this case, the store clerk can determine whether or not double registration has occurred when the status confirmation screen P10 is displayed before the product information input screen P40 is displayed.
Note that the layout of the captured images G11, G12, G13 and the next captured image G21 on the situation confirmation screen P10 is not limited to the example shown in FIG. For example, the next captured image G21 may be arranged in an area above or below the areas in which the captured images G11, G12, and G13 are arranged. Alternatively, they may be arranged so as to fall within any one of the captured images G11, G12, and G13. Alternatively, for example, when the captured images G11, G12, and G13 are displayed, but the next captured image G21 is not displayed on the situation confirmation screen P10, the button for displaying the next captured image, for example, is operated. Accordingly, the next captured image may be displayed.
Note that a quantity display portion NM similar to that illustrated in FIG. 16 may be arranged so as to correspond to the next captured image G21 shown in FIG.

[Third Modification]
On the checkout screen (Fig. 13) and pending product processing screen (Fig. 14), for example, the list items (unspecified records) of pending products as unspecified products are registered normally first by subsequent product registration operations, regardless of the sorting order. The items may be arranged in such a manner that the list items (normally registered records) of the registered products and the order of arrangement are arranged in reverse order.
FIG. 20 shows an example of a settlement screen corresponding to this modified example. In the same figure, among unspecified products, code unacquired products (reserved products corresponding to any of reading NG (classification number 2), pseudo scan input (classification number 3), non-scan input (classification number 4)) are arranged in the same order as the list item of the first successfully registered product after the registration of the code-unacquired product.
The figure shows an example in which the list item of the code-unacquired product is first, and the list item of the first successfully registered product after the registration of the code-unacquired product is arranged in the following order. In addition, in the figure, list items of code-unacquired products and list items of normally registered products are surrounded by one frame FL. This makes it easier to visually grasp a set of list items of code-unacquired products that may be double-registered and list items of normally registered products. Further, the settlement device 40 displays the partial area where the area FL1 is displayed and the area different from the partial area so that the visibility is different. 13 and 14, there is only one partial area (only AR31), but in FIG. 20, AR31 and FL1 correspond to the partial area. That is, the partial area may be plural.

[Fourth Modification]
In the above embodiment, in response to the release of the reserved product, the corresponding list items displayed in the reserved product list area AR31 of the reserved product processing screen are changed, for example, by the display of the release declaration button BT31. It was designed to indicate that the hold was released by In this case, the list item of the reserved product subject to the release of the hold is arranged at the same position in the reserved product list area AR31 even after the release of the hold.
However, the items on the list of pending products are moved to the registered product list area AR3 outside the reserved product list area AR31 in response to the release of the hold, and are treated as normal registration records in the currently set arrangement order (sort order). ).

[Fifth Modification]
In the above embodiment, the captured image corresponding to the product registration operation in which the product was first identified after the registration of the unspecified product was displayed as the next captured image.
On the other hand, in this modification, for example, even if a registration result indicating that the product is an unspecified product is obtained by the next product registration operation after the unspecified product has been registered, the following product registration operation is performed. The corresponding captured image can be displayed as the next captured image. Alternatively, if a product registration operation performed within a certain period of time after the registration of an unspecified product yields a registration result indicating that the product is an unspecified product, it will be dealt with at the time of the next product registration operation. The captured image may be displayed as the next captured image.
For example, when a customer performs product registration operation for a certain product and it is registered as an unspecified product, when the same product is registered again, it is also registered as an unspecified product. There are cases like this. In other words, when registering the product, there are cases where the same product is registered twice as unspecified products. With the configuration of this modified example, it is easy for the store clerk to grasp such double registration, and it is possible to quickly take countermeasures.
In addition, if the registration result of the unspecified product is obtained by the next product registration operation after the unspecified product has been registered as described above, or within a certain period of time after the unspecified product has been registered If a registration result indicating that the product is an unspecified product is obtained as a result of the product registration operation that has been performed, the same product is assumed to be registered as an unspecified product, and the transaction management device 60, for example, creates one unspecified record. may be processed to

[Sixth Modification]
It should be noted that after the customer terminal device 50 regularly transmits the captured image obtained by the imaging unit 506 to the transaction management device 60, the transaction management device 60 receives the time and classification of the code not obtained result. A picked-up image corresponding to the code non-acquisition result may be acquired according to the result, the image analysis result, or the like.

[Seventh Modification]
Further, the transaction management device 60 is configured to store captured images that are regularly transmitted from the customer terminal device 50, and then the customer terminal device 50 or the transaction management device 60 determines whether the code has not been obtained based on the captured images. In response to the determination that the code has not been acquired, the captured image may be managed as corresponding to the code not acquired result, for example, by adding a flag or identification information.

[Eighth modification]
Further, the next picked-up image displayed on the settlement device 40 may be displayed by a store clerk's search. For example, when one unspecified product is to be released from the hold, the store clerk instructs to search for a captured image corresponding to the first normally registered product after the registration of the unspecified product. 40. The settlement device 40 requests the transaction management device 60 to retrieve the instructed captured image. The transaction management device 60 executes a search in response to a request from the client, and transmits the retrieved captured image to the settlement device 40 . The settlement device 40 displays the received captured image as the next captured image.

[Ninth Modification]
Based on the result of analysis of the change in the captured image obtained by imaging the inside of the shopping basket by the customer terminal device 50, the situation where the registered product is not put into the shopping basket, or due to, for example, the customer's companion. The customer terminal device 50, the transaction management device 60, or the like may detect the occurrence of a situation where a product is put into the shopping cart without being registered.
In addition, when it is detected that the above situation has occurred, the customer terminal device 50 asks the customer to put the registered merchandise in the shopping cart, or asks the customer to put the registered merchandise in the shopping cart. For example, a display or the like may be used to guide the user to perform product registration for the product contained in the product.

[Tenth Modification]
In the commodity information input screen P40 of FIG. 16, it may be possible to search for the commodity registered in the corresponding transaction. Also, the search that can be performed in this modified example may be a fuzzy search that searches for products that "include" the entered keyword.
For example, a button for instructing a fuzzy search is arranged on the product information input screen P40 of this modified example. When the button is operated, a keyboard for character input on which, for example, the Japanese syllabary (or the alphabet) is arranged is displayed in the input operation area AR42. The store clerk performs an operation of inputting a keyword, which may be part of the name of the product to be searched for, into the keyboard for character input. At this time, it may be possible to convert hiragana characters input as keywords into words. After that, the store clerk operates a search execution button arranged on the product information input screen P40.
In response to the search execution button being operated, the transaction status management device 80 executes a fuzzy search and displays the search results. Search results may be displayed as, for example, a pop-up screen. Further, in the search results, the product name, price, registration number, etc. of each searched product may be displayed.
The store clerk identifies an unspecified product to be processed this time from among the products presented as search results, and performs an operation of selecting the identified product. For example, the product information input screen P40 may be displayed according to the operation. In the displayed input operation area AR42, the product name, price, registered quantity, product code, etc. of the selected product are entered. After confirming the contents displayed in the input operation area AR42, the store clerk operates the registration button BT41. As a result, the store clerk can efficiently cancel the holding of unspecified products without having to enter, for example, a number with a large number of digits as a product code or narrow down the product classification. Become.

[11th Modification]
For example, by operating a screen such as the status confirmation screen P10 of FIG. 15 (and FIG. 19) or the product information input screen P40 of FIG. A moving image (or time-lapse image) may be displayed. The operation to display the moving image may be, for example, an operation on a moving image display button arranged on the situation confirmation screen P10 or the product information input screen P40, or for example, the captured image G12 on the situation confirmation screen P10 or the product information input screen. It may be an operation for the target captured image area AR43-1 or the next captured image area AR43-2 in P40.
For example, when the next captured image is displayed, a moving image is displayed from the start of the product registration operation when the target unspecified product is registered until the product corresponding to the next captured image is captured. You may allow Note that the moving image may be deleted, for example, in response to the completion of payment. However, if for some reason the transaction is terminated without the payment being completed, the video will be saved for a certain period of time after the transaction is completed so that the store clerk can check it even after the transaction is completed. You may be asked to do so. Further, the moving image may be stored in the transaction management device 60 or the transaction status management device 80 in association with the date, member identification information, and the like. The saved moving image can be played back on a terminal such as the transaction status management device 80 or the like.

[Twelfth Modification]
It should be noted that, in the above-described embodiment and modifications, etc., a part of the processing executed by the customer terminal device 50, the transaction status management device 80, etc. is performed by a host device such as the transaction management device 60, which is connected to the customer terminal device 50 via communication. may be made to run. In addition, in the above-described embodiment and modified examples, part of the processing executed by the settlement device 40 may be executed by a host device such as the transaction management device 60 connected to the settlement device 40 via communication.
As one of the aspects as described above, the shopping system of the present embodiment may be provided with a configuration of a thin client system.
As an example, the transaction management device 60 may be configured as a thin client-compatible server (for example, a cloud server), and the customer terminal device 50, the transaction status management device 80, and the like may function as thin clients. In this case, the thin client terminals such as the customer terminal device 50 and the transaction status management device 80 transmit information such as captured images and commands corresponding to operations performed on themselves to the transaction status management device 80 . The transaction status management device 80 may execute processing in response to information received from the thin client terminal, and transmit image data or web page data as a screen or the like reflecting the processing result to the thin client terminal. The customer terminal device 50 and the transaction status management device 80 as thin client terminals display the transmitted image data and web page data using an image viewer or web browser.

[Thirteenth Modification]
Next, a description will be given of control for displaying a part of the display area (hereinafter, sometimes referred to as an "attention area") and an area different from the part so that the visibility is different. do. As a background for such control, there is an increase in the size of displays in recent years. For example, although warning screens, operation screens, and the like are displayed on the display by means of pop-ups and the like, customers and store clerks are puzzled as to where to look because the display has become larger. Erroneous operation is likely to occur.

In particular, in the case of a customer, when purchasing a product, the customer can only see the display locally in terms of the viewing angle because the customer comes very close to the POS main body. Furthermore, in recent years, customers sometimes perform operations to determine the payment method, etc., but customers do not know exactly where to look on the display, and as a result, they become impatient and perform incorrect operations. be. In addition, even when the correct operation is performed, the time required to look at and think about what to do increases, so there is also the problem that the time required to handle customers increases.

As described above, the increase in size of the display causes a problem that the operator's visibility is lowered.

A control example for solving such problems will be described. In the above-described embodiment, an example of a partial area is an area where a display related to a reserved product is displayed, but the area is not limited to this. As shown below, the attention area contains caution information to call the operator's attention (for example, information indicating that a store clerk is being called), or reception information for accepting the operator's operation (for example, information for accepting a selection operation, etc.) are displayed. Note that the settlement device 40 of the present embodiment is an example of a sales processing device. Further, an operator indicates a person who operates the settlement device 40, such as a store clerk or a customer.

FIG. 21 is a diagram showing a screen display example. As shown in FIG. 21, the screen is assumed to be vertically long. FIG. 21A is a diagram showing a screen in an idle state waiting for settlement processing. FIG. 21B is a diagram showing a pop-up screen in the area AR502 indicating that a store clerk is being called out when performing settlement processing.

As shown in FIG. 21B, an attention area AR502 and an area AR501 different from the attention area AR502 are displayed with different visibility. In this way, by displaying with different visibility, in the case of FIG. 21B, the operator can narrow down to two areas AR501 and AR502. can be selected, the visibility of the operator can be improved compared to the case where the visibility is not displayed differently. Although the area AR502 is superimposed on the area AR501, the area AR501 is not included in the area AR501. there is That is, the area AR501 and the area AR502 are different areas. Thus, the area AR501 and the area AR502 may be different areas, or the area AR502 may be an area overlapping the area AR501. In the following description as well, the two areas that overlap each other may be different areas, or one area may overlap the other area.

FIG. 21C is a diagram showing a pop-up screen in the area AR503 for inputting information necessary for the maintenance of the apparatus. As shown in FIG. 21C, an attention area AR503 and an area AR501 different from the attention area AR503 are displayed with different visibility. In this way, by displaying with different visibility, the operator can narrow down to two areas AR501 and AR503 also in the case of FIG. Therefore, the operator's visibility can be improved compared to the case where the visibility is not displayed differently.

In the following description, the grayed-out aspect may be referred to as dark display as in AR501. Also, a darkened area may be referred to as a darkened area.

Next, control for displaying the auxiliary area displaying information that assists the information displayed in the attention area with the same visibility as the attention area will be described. FIG. 22 is a diagram showing a settlement screen. FIG. 22A is a diagram showing a settlement screen displaying a subtotal amount of transactions and a list of registered commodities displayed on the settlement device after steps 12 to 17, similar to FIG. All the products registered by the customer are displayed, and if the number of products does not fit on one page, the product information is also displayed on the next page. By pressing the "reserved goods" button on the screen, only the reserved goods existing in the transaction are extracted and collectively displayed on one screen. FIG. 22B shows a screen (pop-up) that collectively displays only reserved products.

Compared with the settlement screen of FIG. 22A, in the settlement screen shown in FIG. is not dimmed. In addition, the information shown in the area AR510 where the approximate total (or total), the total number of purchases, the number of products by price range are displayed, and the area AT513 which shows the number of pending products is displayed in the area AR512 where the list of pending products is displayed. This is information that assists the displayed information. In this manner, in FIG. 22B, the auxiliary areas AR510 and 513 displaying information that assists the information displayed in the attention area AR512 are displayed with the same visibility as the attention area. By doing so, the operator can more accurately grasp the display contents from the auxiliary information, compared to the case where the areas other than the attention area are uniformly displayed in black. Further, when the column "Scan failed" displayed in the pending product list in Fig. 22(B) is pressed, the screen transitions to the next screen in Fig. 23 in order to move on to the task of identifying the products that could not be scanned. .

FIG. 23A is a diagram showing the situation confirmation screen of FIG. 15 and the product information input screen of FIG. 16 side by side on one screen. In other words, the screen for confirming the status and the product information input screen to be input based on the confirmation are integrated into one screen, and the process is collectively received without screen transition. The product information input screen in FIG. 23A shows an area AR520 for performing an input operation, an area AR521 for displaying an approximate total (or total) and a situation confirmation screen, and an area AR522. Of these areas, the area AR522 is displayed in the dark. In FIG. 23A, the area AR520 corresponds to the attention area, and the information shown in the area AR521 is information that assists the information displayed in the area AR520. In this manner, in FIG. 23A, the visibility of the auxiliary area AR521 that displays information that assists the information displayed in the attention area AR520 is displayed with the same visibility as that of the attention area. By doing so, the operator can more accurately grasp the display contents from the auxiliary information, compared to the case where the areas other than the attention area are uniformly displayed in black. Furthermore, unlike the checkout screen shown in FIG. 22, the product information input screen in FIG. 23A is a screen that requires an input operation. can do.

FIG. 23B is a diagram showing a payment method selection screen. The settlement method selection screen of FIG. 23B shows an area AR526, an area AR527, an area 528 for performing an input operation, and an area AR529 for indicating an approximate total (or total). Among them, the area AR527 and the area 528 are displayed in the dark. The payment method selection screen in FIG. 23B is a screen that requires an input operation, and even when such an input operation is required, it can be operated more accurately. In particular, when there is a queue at the POS, there is a high possibility that the customer will become impatient and perform an erroneous operation. Since selecting a payment method is an important operation, it is very effective to improve the operator's visibility in order to avoid erroneous operations as much as possible.

FIG. 24 is a diagram showing an example of a screen that is displayed in a stepwise darkening manner. In FIG. 24(A), an area AR530 corresponds to the area of interest, an area AR531 for displaying the total amount of the transaction, the total number of purchases, and the number of items for each price range, and an area AR531 for declaring the end of the transaction and selecting a settlement type (for example, FIG. 23 The area AR532 of the checkout button, which is the operation button for transitioning to (B)), corresponds to the auxiliary area, and the area AR533 corresponds to the darkening area. Of these areas, the area AR530 is an area where an input operation is performed for the customer to select a product to eat and drink in the store.

Among the products displayed in the area AR530, if the customer can switch between take-out and eat-in, a check box is displayed at the beginning of the product name. A check mark is added to the check box. When the payment button displayed in the area AR532 is pressed in the checked state, the tax rate of the checked product is changed and the amount after recalculation is displayed, and the screen shown in FIG. 24(B) is displayed. Is displayed. An area AR534, which is a screen requesting approval to eat and drink the checked product in the store, corresponds to the attention area, and an area AR535 corresponds to the darkened area. By pressing "Yes" in the area AR534, the screen changes to the payment type selection screen (FIG. 23B), and by pressing "No", the area 530, which is the product selection screen, is displayed again. In this way, the operator's visibility can be improved by performing a stepwise darkening display. Control is performed so that the latest area to be displayed later is set as an attention area and the previous attention area is set as a non-attention area (darkening display), and at the same time, the area AR531 is constantly maintained as an auxiliary area. .

Next, a setting example for setting the display position of the attention area will be described. When the screen is vertically long and there are many operators who are relatively short in stature, the display position of the attention area is set to the lower part of the display area. Here, the lower side will be described with reference to FIG. 25 . Area AR540 in FIG. 25 is the entire display area of the display. AR541 is the region of interest. A dashed line 542 indicates a line segment that equally divides the area AR540 in the vertical direction. A dashed line 543 indicates a line segment dividing the area AR541 into equal parts in the vertical direction.

Based on this, the lower side means that the line segment 543 exists below the line segment 542 . In other words, the area where the area AR541 and the lower half of the area AR540 intersect is larger than the area where the area AR541 and the upper half of the area AR540 intersect. By doing so, when there are many operators who are relatively short in stature, the visibility of many operators can be improved.

When the screen is vertically long and there are many operators who are relatively tall, the display position of the attention area is set to the upper part of the display area. Upward means that the line segment 543 exists above the line segment 542 . In other words, the area where the area AR541 and the lower half of the area AR540 intersect is smaller than the area where the area AR541 and the upper half of the area AR540 intersect. By doing so, when there are many operators who are relatively tall, the visibility of many operators can be improved.

The fact that the display position of the attention area can be set is also possible for applications other than the above. Specifically, the display position can be set according to the height at which the POS housing such as the settlement device is installed. To set the display position of an attention area lower when a housing or a display is installed higher. On the other hand, when the housing or the display is installed at a lower position, the display position of the attention area is set higher. By doing so, it is possible to flexibly set the display position, so that the operator's visibility can be improved according to the mode of use of the store.
Specifically, by measuring the distance from the position where the customer stands to the lower end (or upper end) of the screen display and entering the measured value on the setting screen of the POS, the display position of the attention area on the POS is determined. can be done.

In the twelfth modified example, the case where the screen is vertically long has been described, but the display position may be settable even when the screen is horizontally long. For example, if the POS housing is on the customer's left hand side, the display position of the attention area is set to the right side of the display area. Here, the right side will be described with reference to FIG. 26 . Area AR550 in FIG. 25 is the entire display area of the display. AR551 is the region of interest. A dashed line 552 indicates a line segment that equally divides the area AR550 in the horizontal direction. A dashed line 543 indicates a line segment that equally divides the region AR551 in the horizontal direction.

Based on this, the right side means that the line segment 553 exists in the right direction from the line segment 552 . In other words, the area where the area AR551 and the right half of the area AR550 intersect is larger than the area where the area AR551 and the left half of the area AR550 intersect. By doing so, the operator's visibility can be improved.

When the screen is horizontally long and the housing of the POS is on the customer's right hand side, the display position of the attention area is set to the left side of the display area. Left side means that the line segment 553 exists in the left direction from the line segment 552 . In other words, the area where the area AR551 and the right half of the area AR550 intersect is smaller than the area where the area AR551 and the left half of the area AR550 intersect. By doing so, the operator's visibility can be improved.
Specifically, by using a camera, which will be described later, the customer's standing position with respect to the screen is specified, and if the customer is standing on the right side of the screen, the attention area is displayed on the right hand side, and the customer's position on the screen is displayed. If it is double standing on the left side, the attention area is displayed on the left hand side.
Furthermore, it is also possible to follow the movement of the customer and always display the attention area in front of the customer.

The upper side, the lower side, the left side, and the right side may be combined. For example, if the POS housing is on the customer's right hand side and the display is located at a relatively high position, the attention area may be displayed lower and left. If the POS housing is on the customer's left hand side and the display is provided at a relatively low position, the attention area may be displayed on the upper side and on the right side.

Next, control for setting the display position of a partial area according to the height of the operator will be described. A recent POS may be equipped with a camera for recording customer operations and change. The customer's approximate height is measured from the customer's image taken by this camera. Then, in proportion to the measured height, if the height is large, the display position of the attention area is set at a high position, and if the height is small, the display position of the attention area is set at a low position. By doing so, the display position is set according to the height of the operator, regardless of the height of the operator, so that the visibility of the operator can be improved.

Note that the display itself may be moved. That is, the display is moved to a higher position if the customer is taller, and the display is moved to a lower position if the customer is shorter, in proportion to the height measured from the image of the customer photographed by the camera. By doing so, the display position is set according to the height of the operator, regardless of the height of the operator, so that the visibility of the operator can be improved.

In the above-described embodiment, a part of the area and an area different from the part of the area are displayed with different visibility. may be displayed with different visibility.

FIG. 27 is a diagram showing a display example in which a partial area and a peripheral area of the partial area have different visibility.

An area AR560 in FIG. 27A is the entire display area of the display. Area AR562 is the attention area. Area AR561 is the periphery of a part of the area. In this way, the visibility may differ between the area AR562 and the surrounding area AR561. This also makes it possible to improve the visibility of the attention area compared to the case where the visibility is not made different.

An area AR560 in FIG. 27B is the entire display area of the display. Area AR563 is the frame of the attention area. That is, the area AR563 is the periphery of the partial area. In this way, the attention area and its frame may have different visibility. This also makes it possible to improve the visibility of the attention area compared to the case where the visibility is not made different.

You may make it change the display mode of area|region AR561 and area|region AR563 of FIG. For example, by changing the color or pattern, it is possible to naturally draw attention to the attention area surrounded by the area AR561 and the area AR563.

FIG. 28 is a diagram showing a display example of a dark area. In FIG. 28, an area AR700 indicates an attention area. Area AR701 indicates a darkened area. FIG. 28A shows an example of darkening using oblique lines. FIG. 28B shows an example of darkening using points. FIG. 28C shows an example of darkening by painting. In either case, the information that was displayed before darkening may be slightly transparent, or it may not be transparent. Visibility of the area can be improved.

Note that areas other than the attention area may be displayed in monochrome. Since a color display is standard on a display, by displaying an area other than the attention area in monochrome, the color display of the attention area stands out, so that the visibility of the attention area can be improved. It is not always necessary to perform dark display in this way.

Further, instead of darkening display, blurring processing or mosaic processing may be performed on regions other than the attention region. Blur processing and mosaic processing make images and characters drawn in areas other than the attention area unrecognizable, so that the visibility of the attention area can be improved.

Also, the luminance of regions other than the region of interest may be reduced. Since images and characters drawn in areas other than the attention area become unrecognizable due to the decrease in luminance, the visibility of the attention area can be improved.

In general, human eyes tend to pay attention to moving objects. This property may be used to dynamically change the attention area. FIG. 29 is a diagram showing an example of dynamically changing the attention area. An area AR711 in FIG. 29 is the entire display area of the display. Area AR710 is the frame of the attention area.

As shown in FIG. 29, the size of area AR710 is gradually increased. As a result, since the area AR710 is naturally noticed, the visibility of the attention area can be improved.

As another example, the visibility of the attention area is improved by dynamically changing the attention area, such as sliding the attention area from the top and bottom or left and right, and rotating the attention area. can be made

Also, a moving image may be displayed to make the attention area noticeable. For example, the visibility of the attention area can be improved by displaying a moving image in which the characters "attention" and an arrow flow in the attention area.

The operator may be prompted to touch the screen, and an attention area may be displayed at the touched location. In this case, the visibility of the attention area can be improved because the operator sees the area where the attention area is displayed from the beginning.

You may fix the area|region where an attention area is displayed. In this case, the operator is notified of the position of the attention area in advance, or the operator recognizes that the position of the attention area is fixed while using the device several times. By doing so, the operator sees the attention area first, so that the visibility of the attention area can be improved as a result. The operator here may be a store clerk or a customer as described above, but it is particularly effective in operations aimed at customers who are unfamiliar with the operation. For example, it is effective in full self-service devices, ticket vending machines, and self-checkout devices that leave registration and payment to customers themselves.

As described above, according to this embodiment, the visibility of the attention area can be improved. As a result, the operator can immediately understand where to look on the display, thereby suppressing the occurrence of erroneous operations. In addition, compared to the case where the visibility of the attention area is not improved, the time required to think about where to look and what to do is shortened, so the time required for handling customers and the operation time of the store clerk can be reduced. Therefore, suitable store management can be performed.

Further, in the above-described embodiment, the embodiment using the settlement device 40 has been described, but the settlement device is not limited to the settlement device. This embodiment can be applied to any device provided with a display unit. Devices having a display unit include, for example, label printers, labeling devices, packaging devices, various inspection devices, weighing devices, and the like, to which the present embodiment can be applied. By applying this embodiment to a device having a display portion, the device can also obtain the effects obtained from this embodiment.

<Summary of embodiment>
[Technical field]
The present invention relates to a sales processing device, program, and control method.
[Background technology]
There is a POS (Point Of Sales) provided with a display (see Patent Document 1, for example).
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent No. 5559252 [Summary of the Invention]
[Problems to be solved by the invention]

In recent years, displays have become larger. A large display increases the amount of information that can be displayed, and thus presents a new problem that it is difficult for customers and staff to understand where to look on the display.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and an object of the present invention is to improve the visibility of an operator.

[Means to solve the problem]
(1) As described above, one aspect of the present embodiment includes display means for displaying information about transactions, a partial area (for example, AR502 in FIG. 21) of the display area of the display means, and display control means for displaying an area different from the partial area (for example, AR501 in FIG. 21) so as to have different visibility.

According to the above configuration, by displaying images with different visibility, it is possible to narrow down the area that the operator should pay attention to, so that the visibility of the operator can be improved.

(2) One aspect of the present embodiment is the sales processing apparatus according to (1), wherein the display control means displays a The visibility of auxiliary areas (for example, area AR510 and area AR512 in FIG. 22B) that displays information that assists the information to be displayed is displayed with the same visibility as the partial area.

According to the above configuration, the operator can more accurately grasp the display contents from the auxiliary information, compared to the case where the areas other than the attention area are uniformly displayed in black.

(3) An aspect of the present embodiment is the sales processing device according to (1) or (2), further comprising position setting means for setting a display position of the partial area in the display area, 3. The sales processing apparatus according to claim 1, wherein the position setting means sets the display position of the partial area to the lower part of the display area, the upper part of the display area, or a position according to the height of the operator.

According to the above configuration, it is possible to improve the visibility of the operator according to the tendency of the operator's height and the mode of use of the store. By lowering the display position, it is possible to improve the visibility of the operator when there are many operators who are relatively short in stature. By moving the display position upward, it is possible to improve the visibility of the operator when there are many operators who are relatively tall. Further, by setting the display position to a position corresponding to the height of the operator, the display position is set according to the height of the operator regardless of the height of the operator, thereby improving the visibility of the operator. can be done.

(4) An aspect of the present embodiment is the sales processing device according to any one of (1) to (3), wherein the partial area contains caution information calling attention to the operator, or Acceptance information for accepting an operator's operation is displayed.

According to the above configuration, it is possible to improve the operator's visibility of important information for the operator.

(5) An aspect of the present embodiment is the sales processing device according to any one of (1) to (4), wherein the display control means grays out an area different from the partial area. display with different visibility.

According to the above configuration, by graying out, the information of the area different from the partial area is shielded, so that the visibility of the attention area can be improved.

(6) One aspect of the present embodiment is a program for functioning as a sales processing device provided with display means for displaying information on transactions, wherein the computer displays part of the display area of the display means. and a region different from the partial region to function as display control means for displaying the region with different visibility.

According to the above configuration, by displaying images with different visibility, it is possible to narrow down the area that the operator should pay attention to, so that the visibility of the operator can be improved.

(7) One aspect of the present embodiment is a control method for a sales processing device provided with display means for displaying information on transactions, comprising: a part of the display area of the display means; and a display control step of displaying an area different from the area with different visibility.

According to the above configuration, by displaying images with different visibility, it is possible to narrow down the area that the operator should pay attention to, so that the visibility of the operator can be improved.

It should be noted that a program for realizing the functions of the settlement device 40 described above in each of the above embodiments may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be read and executed by a computer system. , the processing as the settlement device 40 may be performed. Here, "loading and executing the program recorded on the recording medium into the computer system" includes installing the program in the computer system. The "computer system" here includes hardware such as an OS and peripheral devices. Also, the "computer system" may include a plurality of computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. The term "computer-readable recording medium" refers to portable media such as flexible discs, magneto-optical discs, ROMs and CD-ROMs, and storage devices such as hard discs incorporated in computer systems. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. Recording media also include internal or external recording media accessible from the distribution server for distributing the program. The program code stored in the recording medium of the distribution server may be different from the program code in a format executable by the terminal device. That is, as long as it can be downloaded from the distribution server and installed in a form that can be executed on the terminal device, the form stored in the distribution server does not matter. It should be noted that the program may be divided into a plurality of parts, and the divided programs may be downloaded at different timings and then merged in the terminal device, or the distribution servers that distribute the divided programs may be different. In addition, "computer-readable recording medium" is a volatile memory (RAM) inside a computer system that acts as a server or client when the program is transmitted via a network, and retains the program for a certain period of time. It shall also include things. Further, the program may be for realizing part of the functions described above. Further, it may be a so-called difference file (difference program) that can realize the above functions by combining with a program already recorded in the computer system.

[Summary of other embodiments]
(1) As described above, one aspect of the present embodiment is a merchandise sales data processing system in which a customer registers merchandise using a terminal device (for example, the customer terminal device 50). , imaging means (e.g., imaging unit 506) for imaging a product to be registered; product identification means for identifying the product to be registered based on the captured image obtained by imaging by the imaging means; and the product identification means. When an unspecified product cannot be specified by the method, the photographed image corresponding to the product first specified by the product specifying means after the timing of the unspecified result is used as the unspecified result. and storage means (step S203) for storing as an auxiliary image (for example, a next captured image).

According to the above configuration, in response to registration of a pending product as an unspecified product, an image corresponding to the registration result in which the product is first specified after the unspecified product is registered is used as the next captured image. can be obtained. By displaying the next captured image at a predetermined opportunity, it is possible to efficiently eliminate the unspecified state of the product (for example, cancel the hold of the unspecified reserved product).

(2) One aspect of the present embodiment is the product sales data processing system described in (1), wherein the product is registered as registration result information indicating a result of product registration performed by a customer using a terminal device. A registration result information list (for example, a pending product Displaying the registered product list area AR3) on the processing screen, and in response to designation of unspecified information from among the registration result information shown in the registration result information list, unspecified information corresponding to the specified unspecified information. A captured image when a result occurs (for example, the target captured image in the target captured image area AR43-1) and an auxiliary image corresponding to the unspecified result indicated by the specified unspecified information (for example, the next captured image area AR43 -2 next picked-up image).

According to the above configuration, it is possible to display the target captured image obtained by capturing the status of the product registration operation corresponding to the unspecified product to be released from the hold and the next captured image corresponding to the unspecified product. can be done. As a result, for example, the store clerk can easily determine whether or not the same product has been registered twice by the customer by viewing the target captured image and the next captured image.

(3) One aspect of the present embodiment is the product sales data processing system according to (2), wherein the display control means continuously arranges the unspecified information in the registration result information list. to display.

According to the above configuration, in the registered product list area AR3 of the reserved product processing screen, it is possible to form the reserved product list area AR31 in which list items of unspecified products are arranged in order from the top, for example. This makes it easier for the store clerk to cancel the reservation of the unspecified product.

(4) One aspect of the present embodiment is the product sales data processing system according to (2), wherein the unspecified information and the unspecified result corresponding to the unspecified information are included in the registration result information list. After the timing of occurrence, the specific registration information of the product specified first by the product specifying means is displayed so as to be arranged before and after.

According to the above configuration, in the registered product list area AR3 of the pending product processing screen, the list item of the unspecified product is a list of the first specified product after the product registration corresponding to the unspecified product is performed. Items can be arranged so that the arrangement order is continuous. As a result, for example, in the registered product list area AR3, the list items of the unspecified product and the list items of products that may have been registered in duplicate corresponding to the unspecified product are arranged side by side. It is possible to improve the efficiency of the store clerk's work of canceling the reservation of unspecified commodities.

(5) One aspect of the present embodiment is the product sales data processing system according to any one of (2) to (4), wherein the display control means controls the auxiliary image as well as the auxiliary image. Display the quantity registered for the corresponding product (for example, display the quantity display section NM).

According to the above configuration, the quantity display portion NM can be displayed in association with the next picked-up image. As a result, the store clerk can grasp the quantity of the products that have been successfully registered in duplicate with the unspecified products to be released from the hold at the stage of performing the operation to release the hold, and can perform the work and operations related to the release of the hold. can be done accurately.

(6) One aspect of the present embodiment is the product sales data processing system according to any one of (2) to (5), wherein editing means for editing the unspecified information (for example, product information input screen P40), and the display control means changes the unspecified information from the unspecified information in the registration result information list in response to the edit by the editing means so as to change the unspecified information to the specific registration information. The specific registration information obtained is arranged in an arrangement order according to a predetermined arrangement rule for the registration result information.

According to the above configuration, in the registered product list area AR3 where the list items of the reserved products are arranged in order, the list items corresponding to the products whose reservation has been released are set as the list items of the normally registered products. They can be rearranged according to the placement order.

(7) One aspect of the present embodiment is a settlement device (40) in a product sales data processing system in which a customer uses a terminal device (eg, customer terminal device 50) to register products. , information acquisition means for acquiring registration result information relating to product registration results performed using the terminal device; and a customer using the terminal device based on the registration result information acquired by the information acquisition means. A registration result information list that shows specific registration information about the specified product and unspecified information indicating unspecified results that the product was not specified in the registration of the product (for example, registered product on the pending product processing screen list area AR3), and when the unspecified information is specified from among the registration result information shown in the registration result information list, the specified unspecified information (for example, the target captured image area AR43- 1 target captured image) and information about the first specified product after the unspecified result corresponding to the specified unspecified information (for example, the next captured image in the next captured image area AR43-2). It is a settlement device provided with display control means for displaying.

(8) One aspect of the present embodiment is that a computer as a settlement device in a product sales data processing system in which a customer uses a terminal device to register products is performed using the terminal device. information acquisition means for acquiring registration result information related to the registration result of the product, and the product specified in the product registration performed by the customer using the terminal device based on the registration result information acquired by the information acquisition means and unspecified information indicating unspecified results in which the product was not specified, and displaying the unspecified registration result information from among the registration result information shown in the registration result information list display control means for displaying specified unspecified information and information on the product specified first after the unspecified result corresponding to the specified unspecified information occurs in response to the information specified; It is a program for functioning as

10 Management Device 40 Settlement Device 50 Customer Terminal Device 60 Transaction Management Device 70 Credit Card Settlement Server 80 Transaction Status Management Device AR502 Attention Area AR501 Darkening Area AR501 Auxiliary Area

Claims (6)

display means for displaying information about transactions;
display control means for displaying a partial area of the display area of the display means and an area different from the partial area so as to have different visibility;
sales processing equipment. 2. The sales process according to claim 1, wherein the display control means displays the auxiliary area displaying information that assists the information displayed in the partial area with the same visibility as the partial area. Device. Position setting means for setting a display position of the partial area in the display area,
3. The sales processing apparatus according to claim 1, wherein the position setting means sets the display position of the partial area to a lower portion, an upper portion of the display area, or a position according to the height of the operator. . 4. The sales processing apparatus according to any one of claims 1 to 3, wherein caution information for calling attention to the operator or acceptance information for accepting operator's operation is displayed in the partial area. A program for causing a computer to function as a sales processing device equipped with display means for displaying information on transactions,
said computer,
display control means for displaying a partial area of the display area of the display means and an area different from the partial area so as to have different visibility;
A program that acts as a A control method for a sales processing device equipped with display means for displaying information on transactions, comprising:
a display control step of displaying a partial area of the display area of the display means and an area different from the partial area so as to have different visibility;
control method with

Images