JP7275563B2 - Product data registration device and program - Google Patents

Description

The present invention relates to a product data registration device and a program.

In order to use an electronic cash register (sales data processing device) in shops including restaurants, it is necessary to register the products being sold (also referred to as product registration or product data registration). The registration contents include product name, price and category. When registering a product in a restaurant, a user (clerk) inputs the product name, price, and department while looking at the menu.

In order to reduce input work, it is desirable that the electronic register obtains the product name, price and category from the menu (image of the menu) and registers the product. There is an invention described in Patent Document 1 as a technique for acquiring products and prices from images.

JP 2015-197685 A

In the invention described in Patent Document 1, a user designates a partial image including one product and its price in a leaflet image using a terminal device. The electronic handbill server performs processing such as character recognition, morphological analysis, and dictionary reference from the partial image obtained from the terminal device, and obtains the product name and price (see paragraph 0034 of the specification).

If the above technology is applied to product data registration from menu images, the user needs to specify a partial image on the menu image representing the product name and price for each product. Designation of a partial image needs to be repeated for each product, which is time-consuming. Also, the department to which the product belongs must be registered separately.

Such problems are not limited to restaurant menus, but also apply to menus for various services such as relaxation and beauty care. A similar problem occurs when product data is registered from leaflets of products such as food, clothing, and home appliances.

The present invention has been made in view of such a background, and provides a product data registration device and a program that can improve the efficiency of the work of registering product data based on images representing products, prices, etc. The task is to

In order to solve the above-described problems, the product data registration device according to claim 1 includes display control means for displaying an image including a predetermined menu table on a display unit, and character recognition for executing character recognition processing on the image. means, classification means for classifying each of the plurality of text data acquired by the character recognition process into one of product name, price, and product category, and a first The first text data classified as product names and the second text data classified as prices by the classifying means are associated with each other and registered as product data indicating one product based on the association operation. a first registration means; and on the image in which the product data is registered by the first registration means, the first text is generated by a second association operation different from the first association operation. When an operation is performed to associate both the data and the second text data with the third text data classified as a product category by the classification means, the product category is assumed to include the product data. and a second registration means for registering, the display control means registering a line segment connecting the first text data and the second text data when the first association operation is performed. When the second association operation is performed while the line segment is displayed, the frame line surrounding the first text data and the second text data is displayed as the third text data. It is characterized in that it is displayed so that at least a part of it overlaps with the data .

Advantageous Effects of Invention According to the present invention, it is possible to provide a product data registration device and a program that enable improvement in efficiency of work for registering product data based on images representing products, prices, and the like.

1 is an overall configuration diagram of an electronic register according to a first embodiment; FIG. 4 is a data configuration diagram of a product registration database according to the first embodiment; FIG. 4 is a flow chart showing a procedure for product data registration executed by a user of the electronic cash register according to the first embodiment; 7 is a flowchart showing product data registration processing executed by the electronic cash register according to the first embodiment; 9 is a flowchart of correction processing in product data registration processing according to the first embodiment; FIG. 3 is a diagram showing menus to be registered as product data according to the first embodiment; It is a figure which shows the initial screen of the product data registration process which concerns on 1st Embodiment. It is a figure which shows the correction screen of the product data registration process which concerns on 1st Embodiment. FIG. 10 is a diagram showing a correction screen before changing the correspondence between product names and prices according to the first embodiment; FIG. 10 is a diagram showing a correction screen during changing the correspondence between the product name and the price according to the first embodiment; FIG. FIG. 10 is a diagram showing a correction screen after changing the correspondence between the product name and the price according to the first embodiment; It is a figure which shows the record after matching change in the goods registration database which concerns on 1st Embodiment. It is a figure which shows the correction screen before adding the correspondence of a goods name and price which concerns on 1st Embodiment. FIG. 10 is a diagram showing a correction screen during adding of association between product names and prices according to the first embodiment; FIG. 10 is a diagram showing a correction screen after adding a correspondence between a product name and a price according to the first embodiment; It is a figure which shows the record after matching addition in the goods registration database which concerns on 1st Embodiment. FIG. 10 is a diagram showing a correction screen before merging a product name area and a product name area according to the first embodiment; FIG. 10 is a diagram showing a correction screen during merging of a product name area and a product name area according to the first embodiment; FIG. 10 is a diagram showing a correction screen after merging a product name area and a product name area according to the first embodiment; FIG. 7 is a diagram showing records after area merging of product names in the product registration database according to the first embodiment; FIG. 9 is a diagram showing a correction screen after correlating product names and prices and correcting product name areas according to the first embodiment; FIG. 10 is a diagram showing a correction screen after a product name, which is a department name to be associated, is selected according to the first embodiment; FIG. 10 is a diagram showing a correction screen in the middle of enclosing products associated with department names according to the first embodiment; FIG. 10 is a diagram showing a correction screen after enclosing products associated with department names according to the first embodiment; FIG. 7 is a diagram showing records after a department change in the product registration database according to the first embodiment; FIG. 10 is a diagram showing a correction screen after all department names have been associated with each other according to the first embodiment; It is a figure which shows the sales data registration screen which concerns on 1st Embodiment. FIG. 12 is a diagram showing a correction screen before changing products belonging to a department according to the modification of the first embodiment; FIG. FIG. 10 is a diagram showing a correction screen while changing products belonging to a department according to the modification of the first embodiment; FIG. 12 is a diagram showing a correction screen before changing products belonging to a department according to the modification of the first embodiment; FIG. FIG. 10 is a diagram showing a correction screen while changing products belonging to a department according to the modification of the first embodiment; It is a figure which shows the whole structure of the product data registration system which concerns on 2nd Embodiment.

≪Overall composition≫
An electronic register as a product data registration device according to a mode (embodiment) for carrying out the present invention will be described below. The electronic register acquires a food menu as an image, recognizes characters representing the product name (food name), price, and category (product category, department) from the image, and registers the product (product data). In the first embodiment and the second embodiment described later, product data registration processing for menu images of dishes will be described, but this is an example. The target is not particularly limited as long as the image includes characters representing the product name, price, and category.

FIG. 1 is an overall configuration diagram of an electronic register 100 according to the first embodiment. In the following description, the electronic cash register 100 is assumed to be of the tablet terminal type. The electronic cash register 100 is connected to a printer and a drawer device via a communication unit 140, which will be described later, so that receipts can be printed and money can be stored.

The electronic register 100 includes a CPU (Central Processing Unit) 110 , a storage section 120 , a touch panel display 130 , a communication section 140 and a camera 150 .
By executing a program (not shown) stored in the storage unit 120, the CPU 110 executes product data registration processing shown in FIG. 4, which will be described later.

The storage unit 120 includes a RAM (Random Access Memory) 121, a ROM (Read Only Memory) 122, and a flash memory 123, and stores a program for executing product data registration processing and data necessary for executing the product data registration processing. Remember. Storage unit 120 further includes a product registration database (described as product registration DB (Database) in FIG. 1) 200 and a product database (described as product DB in FIG. 1) 300, which will be described later.

Touch panel display 130 displays a product data registration screen (see FIG. 7, which will be described later), and accepts a user's operation.
The communication unit 140 transmits and receives communication data to and from a computer, printer, or the like that is different from the electronic register 100 .
The camera 150 is a camera used for photographing menus.

The product database 300 is a database in which registered product names, prices and departments (product categories) are associated and stored. The product registration database 200 (see FIG. 2 below) stores temporary data during the product data registration process (see FIG. 4 below), while the product database 300 stores data during the product data registration process. Store the result. After registering the product data, the electronic register 100 refers to the product database 300 during the sales data registration process for registering the products purchased by the customer and calculating the total purchase price.

≪Overall structure: product registration database≫
FIG. 2 is a data configuration diagram of the product registration database 200 according to the first embodiment. The product registration database 200 is data accessed by the CPU 110 during product data registration processing (see FIG. 4 described later). The product registration database 200 is, for example, tabular data, and one row (record) represents one product name and price included in a menu image (menu image taken in step S101 in FIG. 3, which will be described later). Or indicate the department name. One record includes identification information (denoted as ID (Identifier) in FIG. 2) 201 , area 202 , text 203 , type 204 , connection destination 205 and department 206 attributes (columns).

The identification information 201 is identification information of the product name, price, or department name indicated by the record.
An area 202 is an area in the menu image of the character string representing the product name, price, or department name indicated by the record, and is represented, for example, by the coordinates of the corners of a rectangle indicating the area.
Text 203 is a character string contained in area 202 . A character string is obtained as a result of processing such as character recognition, morphological analysis, and collation with a dictionary in the area 202 .

The type 204 is one of "merchandise", "price" and "department", and the text 203 indicates the merchandise name, price and department name, respectively. If the product name or department name cannot be distinguished, the type 204 is "product".
The connection destination 205 indicates correspondence between product names and prices. The connection destination 205 of the record whose type 204 is "merchandise" is the identification information 201 of the record whose type 204 is "price". The connection destination 205 of the record whose type 204 is "price" is the identification information 201 of the record whose type 204 is "merchandise".

Department 206 indicates the department to which the product belongs. Specifically, when the type 204 is "product" or "price", the department 206 is the identification information 201 of the record whose type 204 is "department". If the department to which the record belongs is unknown or if the record indicates the department (when the type 204 is "department"), the department 206 is "N/A".

The product registration database 200 shown in FIG. 2 is in a state in which data obtained as a result of analyzing a menu image shown in FIG. 6, which will be described later, is registered. Each record will be described below.
A record 221 is a record in which the text 203 is "meat dish" and the type 204 is "merchandise". "Meat dish" is a department, and the type 204 should be "department", but when the record 221 is registered in the product registration database 200, it is unknown whether it is the product name or the department name, so "product" is entered. there is The connection destination 205 is unknown and indicated as "-", and the department 206 is also unknown and indicated as "N/A".

A record 222 is a record in which the text 203 is "sautéed beef and green pepper" and the type 204 is "merchandise". The connection destination 205 is “0003” and is associated with the price indicated by the record 223 . The department 206 is unknown and is "N/A".
A record 223 is a record in which the text 203 is "¥1,080" and the type 204 is "price". The connection destination 205 is “0002” and is associated with the product indicated by the record 222 . The department 206 is unknown and is "N/A".

A record 231 is a record in which the text 203 is "pork fillet with black vinegar and sour pork" and the type 204 is "merchandise". A record 232 is a record in which the text 203 is "¥980" and the type 204 is "price". A record 233 is a record whose text 203 is "fried water spinach and garlic" and whose type 204 is "merchandise". A record 234 is a record in which the text 203 is "¥970" and the type 204 is "price". As shown in connection destination 205, records 232 and 233 are associated, but this is an error (see FIG. 6 described later). This error is corrected by an operation input by the user (see FIGS. 9 to 11 described later).

A record 241 is a record whose text 203 is "crispy fried chicken" and whose type 204 is "merchandise". A record 242 is a record in which the text 203 is "with ethnic sauce" and the type 204 is "merchandise". A record 243 is a record in which the text 203 is "¥1,070" and the type 204 is "price". One product name, “crispy fried chicken with ethnic sauce,” is erroneously registered as two product names. This error is corrected by an operation input by the user (see FIGS. 17 to 19 described later).

≪Product data registration procedure≫
FIG. 3 is a flow chart showing the procedure for product data registration executed by the user of the electronic cash register 100 according to the first embodiment.
In step S101, the user uses the camera 150 of the electronic cash register 100 to photograph the menu (see FIG. 6). The user may import an existing menu image into the electronic cash register 100 without photographing the menu. The electronic register 100 acquires the product name, price, and department name from the menu image, associates the product name with the price, and displays them on the touch panel display 130 (see steps S202 to S204 in FIG. 4 and FIG. 8, which will be described later).

In step S102, the user corrects the correspondence between the product name and price. For example, in FIG. 8, which will be described later, the association 427 between the product name 424 of "fried spinach and garlic" and the price 425 of "980 yen" is incorrect, and the user corrects the association 427. FIG. In addition, as shown in FIG. 17, which will be described later, one product name is erroneously divided into product name 437 "crispy fried chicken" and product name 438 "with ethnic sauce." Correct so that the product names 437 and 438 are merged.

In step S103, the user instructs the correspondence between departments and products. Specifically, the user instructs the correspondence between the department and the product by enclosing the product name and price after designating the department name (see FIGS. 22 to 24 described later).
In step S104, the user instructs registration of product data. For details, the user taps a product data registration button 416 (see FIG. 7, which will be described later).

≪Product data registration processing≫
FIG. 4 is a flow chart showing product data registration processing executed by the electronic register 100 according to the first embodiment.
In step S201, CPU 110 shoots a menu using camera 150 according to a user's instruction. Instead of photographing the menu, a menu image may be acquired from another computer via the communication unit 140, or a menu image in an external storage medium may be acquired.

FIG. 6 is a diagram showing a menu 401 to be registered as product data according to the first embodiment. FIG. 7 is a diagram showing an initial screen 410 for product data registration processing according to the first embodiment. A menu icon 411 and a screen title 412 are arranged in the upper part of the initial screen 410 . At the bottom of the initial screen 410, a menu shooting button 414, a data correction button 415, and a product data registration button 416 are arranged. The user taps the menu shooting button 414 to start menu shooting. The photographed image of the menu is displayed in the menu display area 413 .

Returning to FIG. 4, in step S202, CPU 110 acquires the product name, price, and department name from the menu image, and registers them in product registration database 200. FIG. Specifically, CPU 110 scans the entire menu image to obtain a character string (character recognition processing). Next, the CPU 110 adds a record to the product registration database 200 , newly assigns the identification information 201 , registers the area of the menu image containing the character string in the area 202 , and stores the character string in the text 203 . If the character string is a character string representing a price such as "¥1,080" or "980 yen", the CPU 110 sets the type 204 to "price" and the others to "product". The CPU 110 sets the connection destination 205 to "-" and sets the department 206 to "N/A".

In step S203, the CPU 110 associates the product name with the price. Specifically, the CPU 110 associates two records whose areas 202 are close to each other, one of which has the type 204 of "merchandise" and the other of which has the type 204 of "price". For association, the CPU 110 sets the connection destination 205 to the identification information 201 of the other party's record (see records 222 and 223 in FIG. 2).

In step S<b>204 , CPU 110 displays on touch panel display 130 a menu image in which product names and price areas and associations are visualized.
FIG. 8 is a diagram showing a correction screen 420 for product data registration processing according to the first embodiment. Character strings representing product names, prices, and department names are displayed surrounded by a rectangle representing area 202 . The correspondence between the product name and price is displayed as a line (segment) connecting the product name area and the price area.

A product name 421 “stir-fried beef and bell pepper” and a price 423 “¥1,080” are associated with each other and displayed in an association 422 . Note that the product name 421 “sautéed beef and green pepper” corresponds to the record 222 (see FIG. 2), and the price 423 “¥1,080” corresponds to the record 223 . Correspondence 422 corresponds to connection destination 205 of records 222 and 223 .

A product name 424 “fried water spinach and garlic” is associated with a price 425 “¥980” by an association 427 . Note that the product name 424 “fried spinach and garlic” corresponds to the record 233, and the price 425 “¥980” corresponds to the record 232. Correspondence 427 corresponds to connection destination 205 of records 232 and 233 .

The price 425 “¥980” should be associated with the product name 426 “Pork fillet black sweet and sour pork”, but is erroneously associated with the product name 424 “Stir-fried water spinach and garlic” which is closer.
When the menu image is displayed, the data correction button 415 is highlighted and displayed. ”) is modifiable.

Returning to FIG. 4, in step S205, CPU 110 receives an instruction from the user and repeats the correction process. Details of the correction processing will be described with reference to FIG. 5 described later.
In step S206, CPU 110 registers the product data in product database 300 in response to the user's instruction. Specifically, the user taps the product data registration button 416 (see FIG. 7) to instruct registration of product data. Upon receiving the instruction, the CPU 110 acquires the product name, price, and department name from the product registration database 200 and registers them in the product database 300 .

≪Product data registration processing: Correction processing≫
FIG. 5 is a flowchart of correction processing in product data registration processing according to the first embodiment. The correction process repeatedly executed in step S205 of FIG. 4 will be described with reference to FIG.

In step S221, CPU 110 accepts a user's operation to instruct correction processing, and branches to steps S222, S223, S224, and S226 according to the accepted operation. Specifically, if the received operation is to change the association (step S221→change association), the CPU 110 proceeds to step S222.

If the received operation is addition of correspondence (step S221→addition of correspondence), the CPU 110 proceeds to step S223.
If the received operation is to change the product name area (step S221→change product name area), the CPU 110 proceeds to step S224.
If the received operation is a long press (long tap) on the product name (step S221→long press on the product name), the CPU 110 proceeds to step S226.

≪Product data registration process: Correction process: Correspondence change≫
FIG. 9 is a diagram showing the correction screen 420 before changing the correspondence 427 between the product name 424 and the price 425 according to the first embodiment. An operation for changing the association (first association operation) by the user will be described in conjunction with FIGS. 10 and 11. FIG.

In FIG. 9, the user attempts to change the partner of the association 427 of the price 425 "¥980" from the product name 424 "Stir-fried water spinach and garlic" to the product name 426 "Pork fillet black vinegar sweet and sour pork". Specifically, the end point 432 of the association 427 on the side of the product name 424 is touched, and while being touched, the user moves to the point that should be the endpoint 431 of the association on the side of the product name 426 .

FIG. 10 is a diagram showing a correction screen 420A in the process of changing the correspondence between the product name 424 and the price 425 according to the first embodiment. As indicated by the fingertip of the icon 491, the end point of the association 427A has moved from the product name 424 area to the product name 426 area.
FIG. 11 is a diagram showing a correction screen 420B after changing the correspondence between the product name 424 and the price 425 according to the first embodiment. The correspondence relating to the price 425 is changed from the correspondence 427 (see FIG. 9) with the product name 424 to the correspondence 427B with the product name 426 .

Returning to FIG. 5, in step S222, CPU 110 changes connection destination 205 of the record corresponding to the changed association.
FIG. 12 is a diagram showing records after the association change in the product registration database 200 according to the first embodiment. The CPU 110 changes the connection destinations 205 of the records 231, 232, and 233 (see FIG. 2). Specifically, the CPU 110 changes the association of the records 232 and 233 to the association of the records 231A and 232A.
Note that in the description of FIGS. 9 to 11, the end point of the correspondence on the product name side has been moved. The association may be changed by moving the end point on the price side.

≪Product data registration process: Correction process: Correspondence addition≫
FIG. 13 is a diagram showing the correction screen 420B before adding the correspondence between the product name 424 and the price 434 according to the first embodiment. An operation for adding association (first association operation) by the user will be described in conjunction with FIGS. 14 and 15 .

In FIG. 13, the user tries to add the association between the product name 424 "fried spinach and garlic" and the price 434 "¥970". Specifically, in order to establish a new correspondence between the product name 424 and the price 434, the endpoint 433, which is the endpoint of the association, is touched and moved to the endpoint 435, which is the other endpoint, while being touched.

FIG. 14 is a diagram showing the correction screen 420C during the process of adding the correspondence between the product name 424 and the price 434 according to the first embodiment. As indicated by the fingertip of the icon 492, the line 436 of the correspondence 436 between the product name 424 and the price 434 is drawn from the end point 433 on the product name 424 side to the end point 435 on the price 434 side.
FIG. 15 is a diagram showing a correction screen 420D after adding a correspondence 436A between the product name 424 and the price 434 according to the first embodiment. Product name 424 and price 434 are associated by association 436A.

Returning to FIG. 5, in step S223, CPU 110 changes connection destination 205 of the record corresponding to the added association.
FIG. 16 is a diagram showing records after addition of correspondence in the product registration database 200 according to the first embodiment. CPU 110 changes connection destination 205 of records 233A and 234 (see FIG. 12). Specifically, the CPU 110 changes the state in which the records 233A and 234 are not associated to the state in which the records 233B and 234B are associated.
In the description of FIGS. 13 to 15, a corresponding line is drawn from the end point on the product name side to the end point on the price side. Conversely, a corresponding line may be drawn from the end point on the price side to the end point on the product side.

≪Product data registration process: Correction process: Change product name area≫
FIG. 17 is a diagram showing a correction screen 420D before merging the area for the product name 437 and the area for the product name 438 according to the first embodiment. In conjunction with FIGS. 18 and 19, the operation of changing the product name area by merging the product name areas by the user will be described.
In FIG. 17, the user enlarges the area of the product name 437 and overlaps the area of the product name 438 in order to merge the product name 437 “crispy fried chicken” and the product name 438 “with ethnic sauce”. do.

FIG. 18 is a diagram showing a correction screen 420E in the process of merging the area for the product name 437 and the area for the product name 438 according to the first embodiment. As indicated by the fingertip of the icon 493, the lower right corner of the product name 437 (see FIG. 17) is touched, and by moving while touching, the area of the product name 437A is enlarged so that it overlaps with the area of the product name 438. do.

FIG. 19 is a diagram showing a correction screen 420F after merging the area of the product name 437 and the area of the product name 438 according to the first embodiment. The area for the product name 437 and the area for the product name 438 are combined to form one product name 439 "crispy fried chicken with ethnic sauce".

Returning to FIG. 5, in step S224, CPU 110 deletes and adds records in product registration database 200. FIG. Specifically, CPU 110 deletes records corresponding to product name 437 and product name 438 and adds a record corresponding to merged product name 439 .
FIG. 20 is a diagram showing records after area merging of product names in the product registration database 200 according to the first embodiment. CPU 110 deletes records 241 and 242 (see FIG. 2) and adds record 245 .

Returning to FIG. 5, CPU 110 changes connection destination 205 of added record 245 in step S225. The CPU 110 changes the connection destinations 205 of the records 245 and 243A and associates them (see FIG. 20).

FIG. 21 is a diagram showing a correction screen 420G in which the association between the product name and the price and the correction of the product name area according to the first embodiment have been completed. Compared with the correction screen 420F of FIG. 19, the associations of the product name “stewed beef rib”, the product name “spicy stir-fried beef and garlic stalk”, and the product name “pork and cabbage stir-fried with mustard miso” are corrected. It is

≪Product data registration process: Correction process: Department setting (long press the product name)≫
After completing the correction of the product name and the correction of the correspondence between the product name and the price, the user instructs the correspondence between the department and the product (see step S103 in FIG. 3). After the user presses and holds the product name, which is the department name, to select the department name to be associated (classification operation), the user performs an operation to enclose the product names and prices belonging to the department (second association operation). (see FIGS. 22 to 24 to be described later).

Returning to FIG. 5, in step S226, CPU 110 emphasizes and displays the product name selected by long pressing.
FIG. 22 is a diagram showing the correction screen 420H after the product name, which is the department name to be associated, is selected according to the first embodiment. When the product name 441 “meat dishes” is long-pressed, the CPU 110 recognizes that the product name 441 is a department name, and emphasizes the frame of the product name 441 for display.
Returning to FIG. 5, in step S227, CPU 110 changes type 204 of record 221A corresponding to product name 441 to "department" (see record 221A in FIG. 25 described later).

FIG. 23 is a diagram showing a correction screen 420I in the middle of enclosing products associated with department names according to the first embodiment. As indicated by the fingertip of the icon 494, the user touches the product name 441, which is the department, and while touching, moves to enclose the associated product name and price, and moves the boundary line 442 of the enclosing area (range). draw. The user goes back to the product name 441 while touching, encloses the product name and price, and stops touching to select the product.

Returning to FIG. 5, in step S228, CPU 110 detects movement while touching, and detects the end of touch, thereby detecting an enclosed area and displaying the area.
FIG. 24 is a diagram showing a correction screen 420J after enclosing products associated with department names according to the first embodiment. A region 443 detected by the CPU 110 is displayed with a thick dotted line (frame line).

Returning to FIG. 5, in step S229, CPU 110 identifies the product inside the enclosed area. Specifically, the CPU 110 identifies the product name and price within the enclosed area to identify the product within the area.
In step S230, CPU 110 changes department 206 of the record corresponding to the specified product. Specifically, CPU 110 changes the department 206 of the record corresponding to the product name and price of the specified product to the identification information 201 of the record of the product name selected in step S226.

FIG. 25 is a diagram showing records after the department 206 is changed in the product registration database 200 according to the first embodiment. The CPU 110 changes the department 206 of the records 222 and 223 (see FIG. 2) to the identification information 201 of the record 221, records them as records 222A and 223A, and associates them with the record 221A.

FIG. 26 is a diagram showing a correction screen 420K after all department names have been associated with each other according to the first embodiment. An area 444 indicating the association is indicated by a thick dotted line (frame line), with the department name "vegetable dishes" being specified to be associated.

≪Product data registration process: Product data registration instruction≫
When the user taps product data registration button 416, CPU 110 refers to product registration database 200 and registers product data in product database 300 (see step S206 in FIG. 4). When the product data is registered in the product database 300, the user of the electronic register 100 can register the sales data by designating the registered department and product name.

FIG. 27 is a diagram showing a sales data registration screen 500 according to the first embodiment. The screen configuration of the sales data registration screen 500 will be described with reference to FIG. When the CPU 110 displays the product (product name and price) in the product display area 550 (described later) or displays the department in the department display area 560 (described later), the CPU 110 is instructed to register the product and displays the slip display area (described later). When displayed at 530 , it refers to the product database 300 .

A menu icon 411 and a screen title 412A are arranged in the upper part of the sales data registration screen 500 . The screen title 412A indicates that the screen being displayed is the sales data registration screen 500. FIG.
The total price display area 520 displays the total price of the registered products.
The slip display area 530 displays a list of registered product names, quantities, and prices.
A numeric keypad 540 is a button for inputting a numerical value.

The selected department display area 511 displays the name of the department selected from the department display area 560 described later. Products belonging to the department displayed in the selected department display area 511 are displayed in a product display area 550 described later.
When the upward scroll button 512 is tapped, the product display area 550 is scrolled upward. Further, when the downward scroll button 513 is tapped, the product display area 550 is scrolled downward.

The product display area 550 is an area in which a list of products is displayed, and buttons for registering products are arranged. In FIG. 27, "meat dishes" is selected in a section display area 560, which will be described later, and a list of products belonging to "meat dishes" is displayed in the product display area 550. FIG. When the product button in the product display area 550 is tapped, the tapped product is registered and displayed in the slip display area 530 .

A department display area 560 is a list of departments, in which department buttons are arranged. When the user taps the button of the department to which the product belongs, the product of the tapped department is displayed in the product display area 550 . When the "<<" button at the left end of the department display area 560 is tapped, the department display area 560 scrolls to the left. When the ">>" button on the right end of the department display area 560 is tapped, the department display area 560 scrolls to the right.

≪Characteristics of product data registration processing≫
The CPU 110 acquires the product name, price, and department name from the menu image, and displays the product name and the price in association with each other (see FIG. 8). The CPU 110 accepts and corrects a user's instruction to correct the association between the product name and the price, or to correct the product name. The user's operations for instructing correction are an operation to move the end point of the line representing the correspondence, an operation to draw a line connecting the product name and the price to be associated, and an operation to change the area of the product name. Since it is an operation, operability is high. For this reason, the user can easily modify it.

The correspondence between departments (categories) and products is specified by the user by specifying the department name followed by enclosing the product name and price. This instruction operation is also an intuitive operation, so that the operability is high. Therefore, the user can easily associate departments with products.
As described above, the user can easily modify the correspondence between the product name and price, and the correspondence between products and departments, and can easily register product data.

≪Modified Example: Department Recognition≫
In the above-described embodiment, the CPU 110 recognizes the character string other than the price as the product name. A representative department name is registered in the dictionary, and in step S202 (see FIG. 4), when registering in the product registration database, the CPU 110 registers the type 204 as "department" instead of "product". may By doing so, it is possible to prevent an error in associating the product name representing the department name with the price.

≪Modified Example: Association of departments≫
In the department correspondence of the above embodiment, the user selects the product name representing the department name and encloses the product name and price to be associated (see FIG. 23). The product may be associated by enclosing either the product name or the price of the product to be associated. Moreover, even if the entire area (range) of the product name and price is not enclosed, the product may be associated with the product by enclosing a part (range) of the area. In the above-described embodiment, the area is set by moving while touching and specifying the boundary of the area. good.

≪Modification: Correspondence between product name and price≫
In step S203 (see FIG. 4), the product name and the price at a short distance are associated with each other. Assuming that the price is on the right side of the same list of product names, the product name may be associated with the price to the right of the product name. When the menu is written vertically, the product name is associated with the price below it.

≪Modification: Product change in section setting≫
In the department setting of the first embodiment described above, the products belonging to the department are specified by enclosing the product names and prices belonging to the department by moving while touching. By changing the enclosed area, the product belonging to the department may be changed.

FIG. 28 is a diagram showing a correction screen 420L before changing products belonging to a department according to the modification of the first embodiment. As indicated by an area 451, all products shown in the menu image are designated as products belonging to the category of "meat dishes". The user touches a point 452 on the boundary of the area 451, moves while touching a point 453 on the boundary of the area 451, and stops touching at a point 453 on the boundary of the area 451. The area 451 is changed by specifying the boundary of the area 451 after change.

FIG. 29 is a diagram showing a modification screen 420M during modification of products belonging to a department according to the modification of the first embodiment. As indicated by the fingertip of icon 495, a line is drawn from point 452 to point 453 to designate the boundary of area 451 after change. The area after change becomes area 443 (see FIG. 24).
When a line is drawn from point 452 to point 453, area 451 is divided into a large upper left area and a smaller lower right area. The CPU 110 determines that the upper left large area overlapping the product name 441 "meat dish" indicating the category is the post-change area. The CPU 110 determines that the product included in the lower right small area has been excluded from the category, and sets the category 206 (see FIG. 2) of the record corresponding to the product name and price of the product to "N/A". change.

The operations described with reference to FIGS. 28 and 29 are operations for reducing the area for designating products belonging to a department and removing some of the products from the designation. In the following, an operation of enlarging the area for designating products belonging to a department and adding the products will be described.

FIG. 30 is a diagram showing a correction screen 420N before changing products belonging to a department according to the modification of the first embodiment. As indicated by an area 461, the products on the left half of the menu image are designated as products belonging to the "meat dishes" category. The user touches a point 462 on the boundary of the area 461, moves while touching a point 463 on the boundary of the area 461, and stops touching at a point 463 on the boundary of the area 461. The area 461 is changed by specifying the boundary of the area 461 after change.

FIG. 31 is a diagram showing a modification screen 420O during modification of products belonging to a department according to the modification of the first embodiment. As indicated by the fingertip of icon 496, a line is drawn from point 462 to point 463 to designate the boundary of area 461 after change. The area after change becomes area 443 (see FIG. 24).
The CPU 110 determines that the newly added product included in the upper right area has been added to the category, and changes the category 206 (see FIG. 2) of the record corresponding to the product name and price of the product to the product name 441 ". The identification information 201 of the record corresponding to "meat dish" is changed.

<<Second Embodiment>>
In the first embodiment, the electronic register 100 alone executes product data registration processing. The product data registration process may be executed in cooperation with the server.
FIG. 32 is a diagram showing the overall configuration of a product data registration system 680 according to the second embodiment. Product data registration system 680 includes electronic register 100A and server 600 connected via network 690 .

Server 600 includes CPU 610 , storage unit 620 and communication unit 640 .
CPU 610 executes a product data registration processing program for the server, and executes product data registration processing in cooperation with electronic register 100A.
The communication unit 640 transmits and receives communication data with the electronic register 100A.

Storage unit 620 includes RAM 621 , ROM 622 and SSD (Solid State Drive) 623 . Storage unit 620 further includes product registration database 200B and product database 300B. The product registration database 200B has the same configuration as the product registration database 200 (see FIG. 2). The product database 300B has the same configuration as the product database 300. FIG.

Compared to the first embodiment, the product registration database 200 and the product database 300 are provided in both the electronic register 100A and the server 600, and the server side is the master. Specifically, the product registration database 200B provided in the server 600 is the master, and the product registration database 200A provided in the electronic register 100A is the slave. Product database 300B provided in server 600 is the master, and product database 300A provided in electronic register 100A is the slave.

The product data registration process executed cooperatively by the electronic register 100A and the server 600 will be described below with reference to FIG.
In step S201, electronic register 100A captures a menu image using camera 150 in accordance with a user's instruction, and transmits a menu image, which is the imaged result, to server 600. FIG.

In step S202, server 600 acquires the product name, price, and department name from the menu image received from electronic register 100A, and registers them in product registration database 200B. This process is similar to step S202 executed by the electronic register 100 in the first embodiment.
In step S203, the server 600 associates the product name with the price, and registers the association result in the product registration database 200B. This process is similar to step S203 executed by the electronic register 100 in the first embodiment. Subsequently, server 600 transmits the contents of product registration database 200B to electronic register 100A.

In step S204, the electronic register 100A receives the contents of the product registration database 200B and stores them in the product registration database 200A. Subsequently, the electronic register 100A displays the menu image on the touch panel display 130. FIG. This menu image displays, in addition to the photographed menu image, areas for product names, prices, and department names, and associations between product names and prices (see FIG. 8).

In step S205, the electronic register 100A receives an instruction from the user and repeats the correction process. This correction processing is the same as in the first embodiment, and the corrected result is stored in the product registration database 200A and transmitted to the server 600. FIG. Server 600 stores the received correction result in product registration database 200B.

In step S206, the electronic register 100A receives an instruction to register product data from the user and transfers this instruction to the server 600. FIG. Server 600 registers product data in product database 300B. This process is similar to step S206 executed by the electronic register 100 in the first embodiment. Subsequently, the server 600 transmits the product data and the contents of the product database 300B to the electronic register 100A. The electronic register 100A stores the received contents of the product database 300B in the product database 300A.

<<Features of the second embodiment>>
In the second embodiment, the server 600 acquires the product name, price, and department name from the menu image and associates the product name with the price. Register 100A does. The electronic register 100A and the server 600 are provided with product registration databases 200A and 200B, respectively, and are synchronized each time there is a change during correction processing.

In the first embodiment, the electronic register 100 has the product database 300, whereas in the second embodiment, the server 600 has the product database 300B, and a plurality of electronic registers share the product database. be able to. More specifically, if one electronic register shoots a menu and corrects it, and the product data is registered in the product database 300B of the server 600, the other electronic registers acquire the product database 300B of the server 600. This means that the product data has been registered without photographing the menu or performing correction processing.

≪Modification: Synchronization of product registration database≫
In the correction process of the second embodiment (step S205 in FIG. 4, see FIG. 5), the product registration databases 200A and 200B are synchronized each time the correction process is performed (each time the user makes a correction operation). The electronic register 100A may transmit and synchronize the data in the product registration database 200A at the stage where the correction operation is completed and the product data registration instruction is received. Server 600 registers product data in product database 300B based on the latest data in product registration database 200B.

≪Modification: Correction processing on the server≫
In the second embodiment, the electronic register 100A executes the correction processing shown in FIG. The server 600 may perform the correction process.

Specifically, the data related to the user's operation on the touch panel display 130, such as the coordinate data of the tapped position on the touch panel display 130 and the coordinate data of the touched position when the user moves while being touched, are used as timing information. The electronic register 100A transmits to the server 600 together with (time information). Based on the data related to the received operation and the product registration database 200B, the server 600 performs correction processing (see Fig. 5) is executed.

The present invention is not limited to the above-described embodiments, and can be modified without departing from the scope of the invention. For example, the form of distribution of functions on the server side and the electronic register side in the product data registration system exemplified in the second embodiment is not limited to the form described above. can be physically or physically distributed and integrated.

In this specification, the steps of writing a program recorded on a recording medium are not necessarily processed chronologically according to the order, but may be executed in parallel or individually. It also includes the processing to be executed.

Although several embodiments of the present invention have been described above, these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the scope of the invention described in the claims and equivalents thereof.

The invention described in the scope of claims originally attached to the application form of this application is additionally described below. The claim numbers of the claims described in the supplementary notes are as in the claims originally attached to the request of this application.

≪Note≫
<<Claim 1>>
display control means for displaying an image including a predetermined menu table on a display unit;
character recognition means for performing character recognition processing on the image;
classification means for classifying each of the plurality of text data acquired by the character recognition process into one of product name, price, and product category;
Based on a first association operation on the image displayed on the display unit, the text data classified as the product name and the text data classified as the price by the classification means are associated with each other to form one product. and the product data and the text data classified as product categories by the classification means based on a second matching operation different from the first matching operation on the image. and registration means for registering in association with
A product data registration device comprising:
<<Claim 2>>
display control means for displaying an image including a plurality of text data on a display unit;
classification means for classifying each of the plurality of text data into one of product name, price, and product category;
Based on a first association operation on the image displayed on the display unit, the text data classified as the product name and the text data classified as the price by the classification means are associated with each other to form one product. and the product data and the text data classified as product categories by the classification means based on a second matching operation different from the first matching operation on the image. and registration means for registering in association with
A product data registration device comprising:
<<Claim 3>>
the first associating operation is an operation of associating text data classified as a product name and text data classified as a price on the image;
The second association operation is an operation of designating a predetermined range on the image based on text data classified as a product category.
2. The product data registration device according to claim 1, wherein:
<<Claim 4>>
The display control means displays a line segment indicating the association by the first association operation, and displays a frame line indicating the association by the second association operation.
3. The product data registration device according to claim 2, wherein:
<<Claim 5>>
The classification means classifies each of the plurality of text data as a price if the text data is composed of numerical values, and if the text data is composed of non-numeric values, a predetermined price on the image. Classify into either product name or product category based on the classification operation,
4. The product data registration device according to any one of claims 1 to 3, characterized in that:
<<Claim 6>>
the computer,
display control means for displaying an image including a predetermined menu table on the display unit;
character recognition means for performing character recognition processing on the image;
classification means for classifying each of the plurality of text data acquired by the character recognition process into one of product name, price, and product category;
Based on a first association operation on the image displayed on the display unit, the text data classified as the product name and the text data classified as the price by the classification means are associated with each other to form one product. and the product data and the text data classified as product categories by the classification means based on a second matching operation different from the first matching operation on the image. and registration means for registering in association with
A program characterized by functioning as
<<Claim 7>>
the computer,
display control means for displaying an image containing a plurality of text data on a display unit;
Classifying means for classifying each of the plurality of text data into one of product name, price, and product category;
Based on a first association operation on the image displayed on the display unit, the text data classified as the product name and the text data classified as the price by the classification means are associated with each other to form one product. and the product data and the text data classified as product categories by the classification means based on a second matching operation different from the first matching operation on the image. and registration means for registering in association with
A program characterized by functioning as

100, 100A electronic register (product data registration device)
110 CPU (display control means, character recognition means, classification means, registration means)
130 touch panel display 150 camera 200, 200A, 200B product registration database 300, 300A, 300B product database

Claims (7)

display control means for displaying an image including a predetermined menu table on a display unit;
character recognition means for performing character recognition processing on the image;
classification means for classifying each of the plurality of text data acquired by the character recognition process into one of product name, price, and product category;
the first text data classified as product names and the second text data classified as prices by the classification means based on a first association operation on the image displayed on the display unit; a first registration means for registering as product data indicating one product in association;
The first text data and the second text are obtained by a second association operation different from the first association operation on the image in which the product data is registered by the first registration means. second registration means for registering the product category as including the product data when an operation is performed to associate both of the data with the third text data classified as the product category by the classification means; and,
with
The display control means displays a line segment connecting the first text data and the second text data when the first association operation is performed, and, with the line segment displayed, displaying a frame surrounding the first text data and the second text data so as to at least partially overlap the third text data when the second association operation is performed;
A product data registration device characterized by: display control means for displaying an image including a plurality of text data on a display unit;
classification means for classifying each of the plurality of text data into one of product name, price, and product category;
the first text data classified as product names and the second text data classified as prices by the classification means based on a first association operation on the image displayed on the display unit; a first registration means for registering as product data indicating one product in association;
The first text data and the second text are obtained by a second association operation different from the first association operation on the image in which the product data is registered by the first registration means. second registration means for registering the product category as including the product data when an operation is performed to associate both of the data with the third text data classified as the product category by the classification means; and,
with
The display control means displays a line segment connecting the first text data and the second text data when the first association operation is performed, and, with the line segment displayed, displaying a frame surrounding the first text data and the second text data so as to at least partially overlap the third text data when the second association operation is performed;
A product data registration device characterized by: the first associating operation is an operation of associating the first text data classified as product names and the second text data classified as prices on the image;
The second association operation is an operation of designating a predetermined range on the image based on third text data classified as a product category.
2. The product data registration device according to claim 1, wherein: The classification means classifies each of the plurality of text data as a price if the text data is composed of numerical values, and if the text data is composed of non-numeric values, a predetermined price on the image. Classify into either product name or product category based on the classification operation,
4. The product data registration device according to any one of claims 1 to 3, characterized in that: the first association operation and the second association operation are performed on the same image;
5. The product data registration device according to any one of claims 1 to 4, characterized in that: the computer,
display control means for displaying an image including a predetermined menu table on the display unit;
character recognition means for performing character recognition processing on the image;
classification means for classifying each of the plurality of text data acquired by the character recognition process into one of product name, price, and product category;
the first text data classified as product names and the second text data classified as prices by the classification means based on a first association operation on the image displayed on the display unit; a first registration means for registering as product data indicating one product in association;
The first text data and the second text are obtained by a second association operation different from the first association operation on the image in which the product data is registered by the first registration means. second registration means for registering the product category as including the product data when an operation is performed to associate both of the data with the third text data classified as the product category by the classification means; ,
function as
The display control means displays a line segment connecting the first text data and the second text data when the first association operation is performed, and, with the line segment displayed, displaying a frame surrounding the first text data and the second text data so as to at least partially overlap the third text data when the second association operation is performed;
A program characterized by the computer,
display control means for displaying an image containing a plurality of text data on a display unit;
Classification means for classifying each of the plurality of text data into one of product name, price, and product category;
the first text data classified as product names and the second text data classified as prices by the classification means based on a first association operation on the image displayed on the display unit; a first registration means for registering as product data indicating one product in association;
The first text data and the second text are obtained by a second association operation different from the first association operation on the image in which the product data is registered by the first registration means. second registration means for registering the product category as including the product data when an operation is performed to associate both data with the third text data classified as the product category by the classification means; ,
function as
The display control means displays a line segment connecting the first text data and the second text data when the first association operation is performed, and, with the line segment displayed, displaying a frame surrounding the first text data and the second text data so as to at least partially overlap the third text data when the second association operation is performed;
A program characterized by

Images