JP7371748B2 - Image identification cash register device, image identification cash register system, information presentation method, and program - Google Patents

Description

The present invention relates to technology for supporting store operations.

Patent Document 1 listed below discloses a technology in which a display for clerks and a display for customers are provided on a checkout counter, and information about registered products and other advertising information is output to the display for customers. has been done.

JP2008-217488A

In order to acquire more customers, stores need to provide high-quality customer service and strive to improve customer satisfaction. Here, it can be said that the quality of customer service at the checkout counter has a particularly high degree of influence on customer satisfaction.

The present invention has been made in view of the above problems. One of the objects of the present invention is to provide a technology that improves the quality of customer service at checkout counters.

The image identification cash register device of the present invention includes:
Product identification means for identifying the product using an image of the product placed on a display;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
Equipped with
The store clerk display information includes at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to urge the customer to confirm whether or not an ice pack is required.

The image identification cash register system of the present invention includes:
A display whose display surface is used as a product placement surface;
an imaging device that photographs a product placed on the display and generates an image of the product;
Product identification means for identifying the product using an image of the product;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
Equipped with
The store clerk display information includes at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to urge the customer to confirm whether or not an ice pack is required.

The information presentation method of the present invention includes:
The computer is
identifying the product using an image of the product placed on the display;
Outputting display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
including that
The store clerk display information includes at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to urge the customer to confirm whether or not an ice pack is required.

The program of the present invention causes a computer to execute the above-described information presentation method.

According to the present invention, the quality of customer service at the checkout counter can be improved.

The above-mentioned objects, and other objects, features, and advantages will become more apparent from the preferred embodiments described below and the accompanying drawings.

1 is a diagram showing a configuration example of an image identification register system in a first embodiment; FIG. 1 is a block diagram illustrating the hardware configuration of an image identification register system 1. FIG. FIG. 2 is a sequence diagram illustrating the flow of processing executed by the image identification register system of the first embodiment. It is a figure which shows an example of the information which a product information storage part memorize|stores. FIG. 3 is a diagram showing an example of a purchased product list stored in the memory of the image identification cash register device. It is a figure which shows an example of the information which the display information storage part for store clerks memorize|stores. FIG. 7 is a sequence diagram illustrating the flow of processing executed by the image identification register system of the second embodiment. It is a figure showing an example of composition of an image identification register system in a 3rd embodiment. It is a figure showing an example of the direction in which display information for store clerks and display information for customers are output. It is a flowchart which illustrates the flow of processing performed by the image identification register system of a 3rd embodiment. It is a figure which shows the output example of the display information for store clerks, and the display information for customers.

Embodiments of the present invention will be described below with reference to the drawings. Note that in all the drawings, similar components are denoted by the same reference numerals, and descriptions thereof will be omitted as appropriate. Furthermore, unless otherwise specified, each block in each block diagram represents a configuration of a functional unit rather than a configuration of a hardware unit.

[First embodiment]
〔System configuration〕
FIG. 1 is a diagram showing a configuration example of an image identification register system 1 in the first embodiment. Note that FIG. 1 is merely an example, and the image identification register system 1 according to the present invention is not limited to the configuration depicted in FIG. 1. As shown in FIG. 1, the image identification cash register system 1 includes an image identification cash register device 10, an imaging device 30, and a display 40. The image identification register device 10 is connected to an imaging device 30 and a display 40 via wiring (not shown) or the like. Furthermore, an accounting processing device (not shown) for performing accounting processing is connected to the image identification cash register device 10. Accounting processing devices include, for example, barcode scanners, cashiers, drawers, automatic change machines, receipt printers, input devices such as keyboards and mice, and output devices such as speakers.

The display 40 displays various images used in store operations (for example, product checkout operations) on its display surface. Note that the display 40 may be a touch panel display having a function of receiving input by touch operation using a finger, a touch pen, or the like. The display surface of the display 40 is also used as a placement surface on which the product P is placed, as shown in the figure. Here, the product P is a product to be purchased.

As shown in FIG. 1, the imaging device 30 is arranged so that the display 40 is included in the imaging range. The imaging device 30 photographs the product P placed on the display surface of the display 40 and generates an image showing the product P. The image generated by the imaging device 30 is transmitted to the image identification register device 10.

As illustrated in FIG. 1, the image identification cash register device 10 of this embodiment includes a product identification section 110 and a display control section 120.

The product identification unit 110 acquires an image of the product P placed on the display 40 from the imaging device 30. Further, the product identification unit 110 identifies the product P using the image of the product P placed on the display. Specifically, the display control unit 120 can obtain the identification result of the product P, the identification result of the position of the product P, etc. by analyzing the image of the product P placed on the display. Here, the product identification unit 110 uses known object recognition technology (for example, a classifier constructed by pattern matching or machine learning) to identify the products shown in the image generated by the imaging device 30 and the products. can identify the location of Further, even if multiple products are included in the image generated by the imaging device 30, the product identification unit 110 can individually identify each of the products using a known object recognition algorithm. can. The product identification unit 110 then acquires information regarding the identified product (product information) from the product information storage unit 112 that stores product information for each product. The product identification unit 110 then generates a list of products to be purchased using the product information acquired based on the product identification results. The list of products to be purchased generated by the product identification unit 110 is stored in the memory of the image identification register device 10 or the like.

The display control unit 120 outputs display information for store staff (hereinafter referred to as “display information for store staff”) on the display 40 based on the product identification result by the product identification unit 110. The display information for the store clerk includes information indicating the work that the store clerk should perform according to the single product or the combination of multiple products identified by the product identification unit 110.

As an example, the display information for store staff includes an instruction prompting the customer to confirm whether or not to heat the product using a microwave oven or the like. When the product identification unit 110 identifies a product that requires heating, such as a lunch box, the display control unit 120 acquires such salesperson display information from the salesclerk display information storage unit 122 and displays it on the display 40. Output. As another example, the display information for store staff includes an instruction prompting the customer to confirm whether or not an ice pack is necessary. For example, when a product such as ice cream that is sensitive to heat is identified by the product identification unit 110, the display control unit 120 acquires such salesperson display information from the salesclerk display information storage unit 122 and displays it on the display 40. Output. Further, as another example, the display information for the store clerk includes an instruction prompting the customer to confirm whether or not to put the products purchased by the customer into multiple bags. For example, when food and non-food products are identified by product identification section 110, display control section 120 acquires such store clerk display information from store clerk display information storage section 122 and outputs it on display 40. In addition, for example, when the product identification unit 110 identifies a heat-sensitive product such as ice cream as well as a heat-sensitive product such as a hot drink, the display control unit 120 displays such display information for the store staff. It may also be acquired from the information storage unit 122 and output on the display 40. Note that these are just examples, and the display information for clerks is not limited to the examples given here.

[Hardware configuration example]
The image identification cash register system 1 may be realized by hardware (e.g., hard-wired electronic circuits) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., an electronic circuit and its It may also be realized by a combination of programs that control the A case in which the image identification register system 1 is realized by a combination of hardware and software will be further described below.

FIG. 2 is a block diagram illustrating the hardware configuration of the image identification register system 1. As shown in FIG.

The image identification cash register device 10 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input/output interface 1050, and a network interface 1060.

The bus 1010 is a data transmission path through which the processor 1020, memory 1030, storage device 1040, input/output interface 1050, and network interface 1060 exchange data with each other. However, the method of connecting the processors 1020 and the like to each other is not limited to bus connection.

The processor 1020 is a processor implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

The memory 1030 is a main storage device implemented by RAM (Random Access Memory) or the like.

The storage device 1040 is an auxiliary storage device realized by a HDD (Hard Disk Drive), an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory), or the like. The storage device 1040 stores program modules that implement each function of the image identification register device 10 (product identification section 110, display control section 120, etc.). When the processor 1020 reads each of these program modules onto the memory 1030 and executes them, each function corresponding to the program module is realized.

The input/output interface 1050 is an interface for connecting the image identification register device 10 and various input/output devices. In FIG. 2, the image identification register device 10 is connected to the imaging device 30 and the display 40 via an input/output interface 1050. The imaging device 30 is, for example, a camera equipped with a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. As illustrated, the imaging device 30 is installed so that the imaging range includes the display 40 (and the product P placed on the display 40). The imaging device 30 photographs the product P placed on the display 40 and generates an image showing the product P. Display 40 is a general display device. The display 40 may be a display with a touch function (touch panel display). Note that the display 40 is also used as a surface on which the product P is placed. Therefore, as the display surface of the display 40, a flat display such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an organic EL (Electro Luminescence) is preferably used. Furthermore, an accounting processing device (not shown) is connected to the input/output interface 1050. Accounting processing devices include, for example, barcode scanners, cashiers, drawers, automatic change machines, receipt printers, input devices such as keyboards and mice, and output devices such as speakers. Further, as a checkout processing device, a display exclusively for store staff or for customers (a display different from display 40) may be connected to image identification register device 10 via input/output interface 1050.

Network interface 1060 is an interface for connecting image identification cash register device 10 to a network. This network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method by which the network interface 1060 connects to the network may be a wireless connection or a wired connection.

FIG. 2 is just an example, and the hardware configuration of the image identification register system 1 is not limited to the example of FIG. 2. For example, the image identification register device 10 may be connected to the imaging device 30 and the display 40 via the network interface 1060.

[Processing flow]
The flow of processing executed by the image identification register system 1 of this embodiment will be explained using FIG. 3. FIG. 3 is a sequence diagram illustrating the flow of processing executed by the image identification register system 1 of the first embodiment.

First, the product identification unit 110 acquires a captured image generated by the imaging device 30 (S102). For example, the imaging device 30 constantly outputs the sensing results (photographed images) of the image sensor to the product identification section 110. Furthermore, the imaging device 30 may be configured to generate images in response to instructions from the product identification unit 110. Then, the product identification unit 110 determines whether a product exists in the captured image acquired from the imaging device 30 (S104). For example, the product identification unit 110 inputs the acquired photographed image (or the feature amount extracted from the photographed image) into a product identification engine (not shown), and based on the output result obtained, the It is possible to determine whether a product exists. Alternatively, the product identification unit 110 may detect an object area from a photographed image using an edge feature amount or the like, and then perform template matching or the like to determine whether the object is a product.

If the product does not exist in the captured image (S104: NO), the product identification unit 110 acquires a new captured image generated by the imaging device 30, and determines whether or not the product exists in the new captured image. Determine whether

On the other hand, if the product exists in the captured image (S104: YES), the product identification unit 110 receives the product identification result (for example, product ID (Identifier), product name, etc.) in the captured image from the product identification engine. Then, the identification result of the position of the product can be obtained. Furthermore, the product identification unit 110 can acquire product information of the product based on the product identification result (S106). The product identification unit 110 can acquire product information of the identified product from a product information storage unit 112 as shown in FIG. 4, for example.

FIG. 4 is a diagram showing an example of information stored in the product information storage section 112. In the example of FIG. 4, the product information storage unit 112 stores product information including a product ID, a product name, a product price, and a product category (classification). Note that the product information illustrated in FIG. 4 is just an example. The product information may further include, for example, information regarding benefits applied to the product (amount of discount, number of loyalty program points, etc.). As a specific example, assume that in the process of S106, product ID "000101" and product ID "100001" are obtained as product identification results using the product identification engine. In this case, the product identification unit 110 identifies product information such as product name "Yakiniku Bento", price "500 yen", category "Food/Lunch", product name "Dishwashing detergent", and product information based on these product IDs. It is possible to obtain product information including a price of "250 yen" and a category of "daily necessities."

The product identification unit 110 then adds the product information acquired in S106 to the purchased product list held in the memory 1030 or the like (S108). The memory 1030 stores a purchased product list as illustrated in FIG. 5, for example. FIG. 5 is a diagram showing an example of a purchased product list stored in memory 1030. As illustrated in FIG. 5, the purchased product list includes product information acquired based on product identification results.

The display control unit 120 selects the display information for the store clerk to be output on the display 40 based on the product information included in the purchased product list stored in the memory 1030 or the like (S110). The display control unit 120 can acquire the salesperson display information from the salesperson display information storage unit 122 as illustrated in FIG. 6, for example.

FIG. 6 is a diagram showing an example of information stored in the store clerk display information storage section 122. In the example of FIG. 6, the store clerk display information storage section 122 stores information regarding selection conditions for store clerk display information in association with various store clerk display information. In FIG. 6, the selection conditions are set based on attributes of the product, such as "needs heating," "susceptible to heat," and "food and non-food." That is, in the example of FIG. 6, it can be said that each store clerk display information is stored in association with the attribute of the product.

The display information A for store clerks illustrated in FIG. 6 is information regarding an instruction to prompt the customer to confirm whether or not warming the product is necessary. The selection condition for this display information A for clerks is that "products that require heating are included in the purchased product list." Note that the display control unit 120 determines whether or not a product that requires warming is included in the purchased product list based on, for example, information regarding the product category included in the product information acquired in the process of S106. You can judge by For example, when the purchased product list shown in FIG. It can be determined that the product is of good quality. In this case, the display control unit 120 acquires the salesperson display information A from the salesperson display information storage unit 122.

Further, the display information B for the store clerk illustrated in FIG. 6 is information regarding an instruction to prompt the customer to confirm whether or not an ice pack is necessary. The selection condition for this display information B for clerks is that "a product that is sensitive to heat is included in the list of purchased products." As in the case of the display information A for salesclerks, the display control unit 120 can determine whether selection of the display information B for salesclerks is necessary based on information regarding the product category. For example, if the purchased product list shown in FIG. 5 is stored in the memory 1030, the display control unit 120 can determine that the salesperson display information B is unnecessary because the selection conditions are not satisfied.

Further, the display information C for store clerks illustrated in FIG. 6 is information regarding an instruction to prompt the customer to confirm whether to separate bags into food and non-food items. The selection condition for this display information C for clerks is that "food and non-food items are included in the list of purchased products." Note that the display control unit 120 determines whether "foods and non-foods are included in the purchased product list" based on, for example, information regarding product categories included in the product information acquired in the process of S106. I can judge. For example, if the purchased product list shown in FIG. Based on the category "Daily Necessities", it can be determined that food and non-food items are included in the purchase list. In this case, the display control unit 120 acquires the salesperson display information C from the salesperson display information storage unit 122.

The flow of selecting the store clerk display information to be output on the display 40 is not limited to the above example. For example, the store clerk display information storage section 122 may store each store clerk display information and product ID in association with each other. In this case, the display control unit 120 can specify the store clerk display information to be output on the display 40 based on the individual product IDs included in the purchased product list and the combination of the individual product IDs.

Returning to FIG. 3, the display control unit 120 transmits an instruction to output the selected store clerk display information to the display 40 (S112). The display 40 outputs display information for the store clerk in response to the output instruction in S112 (S114).

By checking the display information for the store clerk output on the display 40 in this way, the store clerk can easily understand the work to be performed by the store clerk. By having the store clerk perform work appropriately in accordance with the information on the display 40, it is possible to prevent the store clerk from omitting work and provide high-quality customer service to the customer.

[Second embodiment]
In the image identification cash register system 1 as shown in FIG. 1, a customer also stands in a position where the display 40 can be viewed. The image identification cash register system 1 of this embodiment further includes a configuration for displaying display information useful for customers (hereinafter referred to as "display information for customers") on the display 40.

〔System configuration〕
The image identification register system 1 of this embodiment has a configuration similar to that of the first embodiment (eg, FIG. 1). In this embodiment, the display control unit 120 further outputs customer display information on the display 40 based on the product identification result by the product identification unit 110.

Here, the customer display information includes information indicating the status of cashier operations. Specifically, the customer display information includes product identification results by the product identification unit 110 (for example, product name, number of products, price of the product, number of products, information regarding benefits applied to the product, etc.) . Moreover, the display information for customers includes information that promotes the customer's desire to purchase. Specifically, the customer display information includes advertisements for products related to the product identified by the product identification unit 110.

[Processing flow]
The flow of processing executed by the image identification register system 1 of this embodiment will be explained using FIG. 7. FIG. 7 is a sequence diagram illustrating the flow of processing executed by the image identification register system 1 of the second embodiment.

The processing from S202 to S210 is similar to the processing from S102 to S110 in FIG. The display control unit 120 of this embodiment executes the following process in addition to the same process as the process from S102 to S110 in FIG. 3. That is, the display control unit 120 generates customer display information based on the product identification result by the product identification unit 110 (S212). As an example, the display control unit 120 uses the product identification result by the product identification unit 110 to generate customer display information including a list of products identified as products to be purchased and the total price of those products. As another example, the display control unit 120 uses the product identification result by the product identification unit 110 to generate customer display information including advertisement information for products related to the product. Note that the product advertisement information is stored in, for example, the storage device 1040 in association with the identification information of each product.

Then, the display control unit 120 transmits an instruction to output the store clerk display information selected in the process of S210 and the customer display information generated in S212 to the display 40 (S214). The display 40 outputs the display information for the store clerk and the display information for the customer in response to the output instruction in S214 (S216).

In this embodiment, customer display information based on the identification result of the product identification section 110 is further output on the display 40. As an example, customer display information indicating the status of the cash register operation (for example, products identified as items to be purchased) is displayed on the display 40. Such customer display information allows the customer to grasp the status of the cash register operation. Therefore, even if there is an error in the cashier's cash register operations, it can be noticed immediately, giving customers peace of mind. As another example, customer display information including information that promotes the customer's desire to purchase (for example, advertising information for related products) is displayed on the display 40. By appealing to customers about recommended products and the like through such display information for customers, it is possible to expect the effect of increasing store sales.

[Third embodiment]
In the image identification cash register system 1 as shown in FIG. 1, it is assumed that the cash register work is performed with the clerk and the customer standing in different positions. For example, it is assumed that a cash register operation is performed with a store clerk and a customer facing each other through a counter provided with the display 40. In this case, from the viewpoint of visibility, the display information for clerks and the display information for customers should be output on the display 40 in appropriate orientations.

[System configuration example]
FIG. 8 is a diagram showing a configuration example of the image identification register system 1 in the third embodiment. In this embodiment, the image identification cash register device 10 further includes a clerk position acquisition section 130 and a customer position acquisition section 140.

The clerk position acquisition unit 130 acquires information indicating the position of the clerk (hereinafter referred to as "clerk position information"). As an example, the store clerk position acquisition unit 130 can analyze an image generated by the imaging device 30 or another imaging device (not shown) and acquire store clerk position information. Specifically, the store clerk position acquisition unit 130 first detects an area recognized as a person (person area) from the image using a known object recognition algorithm. Then, the store clerk position acquisition unit 130 identifies an area that matches the store clerk's pre-registered characteristics (such as the facial features of the store clerk or the characteristics of the store's uniform) from among the detected human regions. The clerk position acquisition unit 130 can then acquire information on the position corresponding to the specified area as clerk position information. Note that in this case, the store clerk's characteristics are registered in advance in the storage device 1040 or the like. Alternatively, in the image identification cash register system 1, when a clerk's work place is predetermined, the clerk position acquisition unit 130 acquires information on a position corresponding to a person area existing inside or near the work place as the clerk's position. It may be obtained as information. As another example, the store clerk position acquisition unit 130 can acquire store clerk position information using a sensor (for example, an infrared sensor), which is not shown. In this case, the sensor for acquiring store clerk position information is provided so that the sensing range includes the position where the store clerk is assumed to be. For example, a sensor for acquiring store clerk position information is installed on the edge of the counter where the display 40 is provided, on the side of the store clerk's work place.

The customer location acquisition unit 140 acquires information indicating the customer's location (hereinafter referred to as "customer location information"). As an example, the customer location acquisition unit 140 can analyze an image generated by the imaging device 30 or another imaging device (not shown) and acquire customer location information. Specifically, like the clerk position acquisition unit 130, the customer position acquisition unit 140 first detects an area recognized as a person (person area) from the image using a known object recognition algorithm. Then, the customer position acquisition unit 140 identifies, from among the detected human regions, regions that do not match the store clerk's pre-registered characteristics (such as the store clerk's facial features or store uniform characteristics). The customer location acquisition unit 140 can then acquire location information corresponding to the specified area as customer location information. Alternatively, in the image identification cash register system 1, when a customer's waiting place is predetermined, the customer position acquisition unit 140 acquires position information corresponding to a person area existing inside or near the waiting place as the customer's position. It may be obtained as information. As another example, the customer location acquisition unit 140 can acquire customer location information using a sensor (for example, an infrared sensor), which is not shown. In this case, the sensor for acquiring customer location information is provided so that the sensing range includes the location where the customer is assumed to be. For example, a sensor for acquiring customer position information is installed at the edge of the counter where the display 40 is provided, on the side of the customer's waiting area.

The display control unit 120 of this embodiment determines the direction in which the store clerk display information is output based on the store clerk's position indicated by the store clerk position information. Furthermore, the display control unit 120 of this embodiment determines the direction in which the customer display information is output based on the customer's position indicated by the customer position information. For example, the direction in which the store clerk display information and the customer display information are output is determined for each area around the counter where the display 40 is provided (eg, FIG. 9). FIG. 9 is a diagram illustrating an example of the direction in which display information for clerks and display information for customers are output. In the example of FIG. 9, four areas (areas A to D) are set around the counter where the display 40 is provided. The direction corresponding to area A is the upward direction _dA in the drawing. Further, the direction corresponding to region B is a direction _dB toward the right in the drawing. Further, the direction corresponding to the region C is the downward direction _dC in the drawing. Further, the direction corresponding to the region D is a direction _dD toward the left in the drawing. Information specifying the output direction of such information is stored in the storage device 1040, for example. The display control unit 120 can identify the area where the store clerk exists based on the position indicated by the store clerk location information. Then, the display control unit 120 can determine the direction corresponding to the area identified as the area where the store clerk is present as the direction in which the store clerk display information is output. Similarly, the display control unit 120 can identify the area where the customer exists based on the location indicated by the customer location information. Then, the display control unit 120 can determine the direction corresponding to the area identified as the area where the customer is present as the direction in which the customer display information is output.

[Hardware configuration example]
The image identification register system 1 of this embodiment has the same hardware configuration as that of the first embodiment (eg, FIG. 2). The storage device 1040 of this embodiment further stores a program module that implements the functions of the above-described store clerk location acquisition section 130 and customer location acquisition section 140. When the processor 1020 reads these program modules onto the memory 1030 and executes them, the functions of the clerk position acquisition unit 130 and the customer position acquisition unit 140 of this embodiment are realized.

[Processing flow]
The flow of processing executed by the image identification register system 1 of this embodiment will be explained using FIG. 10. FIG. 10 is a flowchart illustrating the flow of processing executed by the image identification register system 1 of the third embodiment.

The clerk position acquisition unit 130 and the customer position acquisition unit 140 acquire clerk position information and customer position information, respectively (S302). The display control unit 120 determines the output position and orientation of the store clerk display information based on the position indicated by the store clerk position information (S304). Furthermore, the display control unit 120 determines the output position and direction of the customer display information based on the position indicated by the customer position information (S306). Then, the display control unit 120 generates an output instruction for store clerk display information and customer display information based on the results of these processes, and transmits the output instruction to the display 40. Then, the display information for clerks and the display information for customers are output on the display 40 in the determined orientations (eg, FIG. 11). FIG. 11 is a diagram showing an example of output of display information for clerks and display information for customers. In the example of FIG. 11, the display information for store clerks is outputted in the direction indicated by _dA in the figure, and the display information for customers is outputted in the direction indicated by _dC in the figure.

As described above, according to the present embodiment, the display information for the clerk and the display information for the customer can be output on the display 40 in appropriate orientations depending on the positions of the clerk and the customer with respect to the counter where the display 40 is provided. . Thereby, it is possible to prevent the visibility of the display information for clerks and the display information for customers from decreasing.

Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above may also be adopted.

For example, the present invention can also be applied to conventional cash register terminals each equipped with a display for clerks and a display for customers. In this case, the display control unit 120 may output the store clerk display information and the customer display information to the store clerk display and the customer display, respectively. Note that when the present invention is applied to a conventional cash register that is equipped with a display for clerks and a display for customers, the display control unit 120 differs from the case where the single display 40 described above is used. , there is no need to specify the output direction of each piece of information.

Further, in the sequence diagrams and flowcharts used in the above description, a plurality of steps (processes) are described in order, but the execution order of the plurality of steps (processes) is not limited to the order of the description. In each embodiment, the order of the illustrated steps can be changed within a range that does not affect the content. Furthermore, the above-described embodiments can be combined as long as the contents do not conflict with each other.

Part or all of the above embodiments may be described as in the following additional notes, but are not limited to the following.
1.
Product identification means for identifying the product using an image of the product placed on a display;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
An image identification cash register device comprising:
2.
Further comprising a clerk position acquisition means for acquiring clerk position information indicating the position of the store clerk,
The display control means includes:
determining the direction in which the store clerk display information is output based on the position indicated by the store clerk position information;
1. The image identification cash register device described in .
3.
The display control means further outputs customer display information on the display based on the identification result of the product.
1. or 2. The image identification cash register device described in .
4.
further comprising a customer location acquisition means for acquiring customer location information indicating the customer's location,
The display control means includes:
determining the direction in which the customer display information is output based on the position indicated by the customer position information;
3. The image identification cash register device described in .
5.
A display whose display surface is used as a product placement surface;
an imaging device that photographs a product placed on the display and generates an image of the product;
Product identification means for identifying the product using an image of the product;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
Image identification cash register system.
6.
Further comprising a clerk position acquisition means for acquiring clerk position information indicating the position of the store clerk,
The display control means includes:
determining the direction in which the store clerk display information is output based on the position indicated by the store clerk position information;
5. Image identification cash register system described in .
7.
The display control means further outputs customer display information on the display based on the identification result of the product.
5. or 6. Image identification cash register system described in .
8.
further comprising a customer location acquisition means for acquiring customer location information indicating the customer's location,
The display control means includes:
determining the direction in which the customer display information is output based on the position indicated by the customer position information;
7. Image identification cash register system described in .
9.
The computer is
identifying the product using an image of the product placed on the display;
Outputting display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
information presentation methods, including
10.
The computer,
Obtaining store clerk location information indicating the location of the store clerk,
determining the direction in which the store clerk display information is output based on the position indicated by the store clerk position information;
9. Information presentation method described in .
11.
The computer,
further outputting customer display information on the display based on the identification result of the product;
9. or 10. Information presentation method described in .
12.
The computer,
Obtain customer location information indicating the customer's location,
determining the direction in which the customer display information is output based on the position indicated by the customer position information;
11. Information presentation method described in .
13.
To the computer, 9. A program for executing the information presentation method according to any one of 12 to 12.

Claims (7)

Product identification means for identifying the product using an image of the product placed on a display;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
Equipped with
The store clerk display information includes an image identification register including at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to prompt the customer to confirm whether or not an ice pack is required. Device. Further comprising a clerk position acquisition means for acquiring clerk position information indicating the position of the store clerk,
The display control means includes:
determining the direction in which the store clerk display information is output based on the position indicated by the store clerk position information;
The image identification register device according to claim 1. The display control means further outputs customer display information on the display based on the identification result of the product.
The image identification register device according to claim 1 or 2. further comprising a customer location acquisition means for acquiring customer location information indicating the customer's location,
The display control means includes:
determining the direction in which the customer display information is output based on the position indicated by the customer position information;
The image identification register device according to claim 3. A display whose display surface is used as a product placement surface;
an imaging device that photographs a product placed on the display and generates an image of the product;
Product identification means for identifying the product using an image of the product;
display control means that outputs display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
Equipped with
The store clerk display information includes an image identification register including at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to prompt the customer to confirm whether or not an ice pack is required. system. The computer is
identifying the product using an image of the product placed on the display;
Outputting display information for a store clerk on the display indicating the work that the store clerk should do with respect to the identified product;
including that
The display information for store staff includes an information presentation method including at least one of an instruction to prompt the customer to confirm whether or not to heat the product, and an instruction to urge the customer to confirm whether or not an ice pack is required. . A program that causes a computer to execute the information presentation method according to claim 6.

Images