JP2016090238A - Merchandise sales data processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a merchandise sales data processing device for notifying a placement guide for placing merchandise at a substantially center of a placement part, improving a recognition rate of the merchandise, and correctly registering the merchandise.SOLUTION: The merchandise sales data processing device includes: a placement part on which merchandise is placed; photographing means for photographing the merchandise to be placed on the placement part; position determination means for determining whether or not the merchandise is located at a photographable position in the placement part; and notification means that, when the position determination means determines that the merchandise is not located at the photographable position in the placement part, notifies of the placement guide of the merchandise. Further the notification means displays, on the display part, photographic data photographed by the photographing means, and a guide for placing the photographed merchandise at the photographable position in the placement part.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a merchandise sales data processing apparatus.

  There is known a weighing scale with a camera for weighing an article (product) placed by a customer (user) (for example, see Patent Document 1). In a conventional weighing scale with a camera, in order to increase the recognition rate of an article imaged by the camera, it is necessary for the customer to place the article as centrally as possible on the placement portion of the weighing scale.

JP 2014-92492 A

  However, in the conventional weighing scales with a camera, etc., the customer only needs to be notified by advertisements or stickers so that the article can be placed in the center of the weighing scale as much as possible. There was a case where the product was not placed in the center of the placement portion of the weighing scale without noticing the presentation or sticker. At this time, the article imaged by the camera cannot be recognized correctly, and the product may not be registered correctly.

  The present invention has been made in view of the above-described problems. In the merchandise sales data processing apparatus, the product placement guidance is notified so that the product is placed at substantially the center of the placement unit, and the product recognition rate is increased. An object of the present invention is to provide a product sales data processing apparatus that can improve and register products correctly.

In order to achieve such an object, the merchandise sales data processing apparatus of the present invention comprises at least the following configuration.
The merchandise sales data processing device includes a placement unit for placing a product,
Imaging means for imaging the product placed on the placement section,
Position determination means for determining whether or not the product is positioned at a position where imaging can be performed in the placement unit;
When the position determination means determines that the product is not located at a position where the image can be captured in the placement section, the position determination means includes notification means for notifying placement guidance of the product.

  According to the present invention, in the merchandise sales data processing apparatus, it is possible to notify the product placement guidance so that the product is placed at substantially the center of the placement unit, and to improve the product recognition rate. The merchandise sales data processing apparatus of the present invention can correctly register merchandise.

The front view which shows an example of the merchandise sales data processing apparatus which concerns on embodiment of this invention. The perspective view which shows an example of the merchandise sales data processing apparatus shown in FIG. The figure which shows an example of a structure of a merchandise sales data processing apparatus, (a) is an electrical functional block diagram, (b) is a functional block diagram of a control part. The figure which shows an example of the information memorize | stored in the merchandise sales data processing apparatus, (a) is a figure which shows an example of merchandise information, (b) is a figure which shows an example of container information. The figure which shows an example of the label printed by the printing part of a merchandise sales data processing apparatus. The figure which shows an example of the setting screen by a merchandise sales data processing apparatus. The figure which shows an example of the setting screen of a mounting position. The figure which shows an example of the setting screen of the approximate center position of the area | region which can be imaged in a mounting part. The figure which shows an example of the display screen at the time of mounting goods etc. in a mounting part. The figure which shows an example of the container (tray) selection screen displayed on the display part of a merchandise sales data processing apparatus.

  A merchandise sales data processing apparatus according to an embodiment of the present invention includes a placement unit such as a weighing pan of a weighing unit on which a product is placed, and an imaging unit that captures an image of the product placed on the placement unit. When it is determined that the product is not located at a position where the image can be captured in the unit, the product placement guidance is notified. Specifically, the merchandise sales data processing apparatus notifies the user to place the weighing pan on a predetermined position of the weighing pan of the loading portion, for example, the central position of the weighing pan.

  A merchandise sales data processing apparatus according to an embodiment of the present invention will be described with reference to the drawings. The embodiment of the present invention includes the contents shown in the drawings, but is not limited to this. In the following description of each drawing, parts that are common to the parts that have already been described are assigned the same reference numerals, and duplicate descriptions are partially omitted.

  FIG. 1 is a front view showing an example of a merchandise sales data processing apparatus 100 according to an embodiment of the present invention. FIG. 2 is a perspective view showing an example of the merchandise sales data processing apparatus 100. FIG. 3 is a diagram illustrating an example of the configuration of the merchandise sales data processing apparatus 100. Specifically, FIG. 3A is an electrical functional block diagram, and FIG. 3B is a functional block diagram of the control unit.

  In the present embodiment, a case where the merchandise sales data processing apparatus 100 is applied to a self-type weighing apparatus will be described. This merchandise sales data processing apparatus 100 is installed in a store such as a supermarket, generates sales data such as the type and amount of merchandise in which an article is stored in a container, and sends the sales data to a cash register, a host computer, or the like. You can register. The merchandise sales data processing apparatus 100 includes a printing unit 9 such as a printer, and the printing unit 9 can issue a label corresponding to the sales data. This store sells products such as salads and items sold in pieces such as croquettes.

The merchandise sales data processing apparatus 100 (self-type weighing apparatus) according to the embodiment of the present invention does not perform an operation input for designating whether it is a sales form of quantity sale or quantity sale by an operator (customer), and performs self-type measurement. When a product is placed on a weighing pan or the like of the weighing unit 7 of the apparatus, it is automatically discriminated whether it is a sales form of a scale sale product or a number sale product, and sales data of the product is generated. . Further, the merchandise sales data processing apparatus 100 issues a label on which information corresponding to the merchandise sales form is printed. The customer attaches the label to the container and pays a predetermined amount at the place where the cash register is installed.
Hereinafter, each component of the merchandise sales data processing apparatus 100 (self-measuring device) will be described in detail.

  A merchandise sales data processing apparatus 100 according to an embodiment of the present invention includes a control unit 1 (CPU), a ROM 2 and a RAM 3 as storage units (storage means), an auxiliary storage unit 4, an operation unit 5, and a display unit 6. A measuring unit 7, an imaging unit 8, a printing unit 9, a communication unit 10, an audio output unit 11 (speaker), and the like. Each of the above components is electrically connected by a communication line 12 such as a bus (see FIG. 3A and the like).

As shown in FIG. 1 and FIG. 2, the weighing unit 7 having a weighing pan (not shown) and the like is provided in the apparatus main body 100 a of the merchandise sales data processing apparatus 100. The apparatus main body 100a is provided with a printing unit 9 such as a printer, and a label issued by the printing unit 9 is discharged from a paper discharge port 9a.
On the upper part of the apparatus main body 100a, an operation unit 5, a display unit 6 and the like supported by a support column 100b are provided. In the present embodiment, a touch panel device is employed as the operation unit 5 or the display unit 6. The operation unit 5, the display unit 6, or the column unit 100 b is provided with an imaging unit 8 that captures an image of a product (container) placed on a weighing pan (mounting unit (mounting unit)) of the weighing unit 7. It has been. An imaging range 80 (recognition range) of the imaging unit 8 is set on the weighing unit 7 (see FIG. 2).

When the product (container) placed on the weighing pan (mounting unit) or the like of the weighing unit 7 is imaged by the imaging unit 8, the reflection reflected by the light hitting the weighing pan (mounting unit) of the weighing unit 7 is reflected. From the captured image of the product (container) including the background consisting of the weighing pan (mounting unit) of the measuring unit 7 captured by light, the shape and color of the product (container), or a sticker attached to the container May not be recognized correctly.
In order to avoid such a state, for example, there is a method in which the weighing pan (mounting unit) of the weighing unit 7 is baked and painted in black, but it is not possible to completely prevent reflection of light. .
Therefore, as a method for completely preventing the reflection of light (or a method for reducing the reflection of light), a method of raising black at a predetermined density on the weighing pan (mounting unit) of the weighing unit 7 was adopted. In detail, electrostatic flocking and flocking coating are performed as a method of raising black at a predetermined density on the weighing pan (mounting unit) of the weighing unit 7.
Thereby, since it is possible to completely prevent reflection of light with respect to the weighing pan (mounting unit) of the weighing unit 7, it is possible to correctly recognize the shape and color of the product (container) from the captured image. . In addition, when a sticker having identification information for identifying the container is attached to the container (for example, the sticker is a graphic seal or a label printed with code information), the sticker is also attached. It is possible to correctly recognize the attached sticker. Moreover, it is effective also for a transparent container, and the shape and color of goods (transparent container) can be correctly recognized from a captured image.
In addition to electrostatic flocking and flocking coating, for example, the weighing pan (mounting unit) of the weighing unit 7 is wrapped or covered with a sponge or cloth that is difficult to reflect, such as black, to prevent light reflection. It is possible.

  In addition, at least the imaging unit 8 is mounted on the weighing pan (mounting unit) of the measuring unit 7 in the region where the measuring plate (mounting unit) of the measuring unit 7 is raised black at a predetermined density by electrostatic flocking or flocking. It is set as the area | region which images the placed goods (container). Moreover, it may be of a different material (for example, a normal plated state, or a baked paint or a matte paint, etc.) other than a region where black is raised. Thereby, since the texture is different between the black brushed region imaged by the imaging unit 8 and the other region, when the customer places the container on the weighing pan (mounting unit), where to place it It is easy to understand whether it is good, and the container is not placed in a place where the imaging unit 8 cannot capture an image. Thus, the container can be correctly recognized and specified from the captured image data.

  The control unit 1 (CPU) comprehensively controls each component of the merchandise sales data processing apparatus 100.

The ROM 2 stores various programs and setting values according to the present invention. The RAM 3 has a work area for executing a program. In the present embodiment, the RAM 3 as a storage unit includes a product information storage unit, a container information storage unit, and the like.
The product information storage unit stores the unit price of the product. The container information storage unit is specific information indicating whether the sales form of the article accommodated in the container is a sales form of a quantity sale or a quantity sale, that is, specific information for specifying a container as container information (on the imaging unit 8 side) Container area and shape, etc.), container mass data, etc. are stored in association with each other.
The specific information includes the area of the container (number of dots corresponding to the area of the container, etc.), the shape and color of the seal written (attached) on the container, or identification information for identifying the container (for example, code information) ) Is printed on the label (sticker). The control unit 1 can determine whether the container is a product sold by quantity or a product sold by quantity based on the specific information.
The RAM 3 as a storage unit stores imaging data (image data) of a container (product) captured by the imaging unit 8.

The auxiliary storage unit 4 is, for example, a storage device such as a detachable flash memory, and can store setting information regarding the product sales data processing device 100.
The operation unit 5 is a switch, button, touch panel, or the like, and is operated by an operator (customer or the like), and outputs a signal corresponding to a predetermined operation input to the control unit 1.
The display unit 6 performs display according to the present invention under the control of the control unit 1. In the present embodiment, a touch panel type display unit 6 is employed.

  The weighing unit 7 includes a weighing pan (mounting unit) and the like, measures the mass of an article placed on the weighing pan or the like, and outputs information indicating mass data of the article to the control unit 1.

The imaging unit 8 images products, containers, and the like. In the present embodiment, a container containing an article as a product placed in the imaging range 80 (recognition range) on the weighing unit 7 is imaged and output to the control unit 1. Examples of the imaging unit 8 include a CCD imaging device and a CMOS imaging device.
A light emitting unit such as a light that illuminates the imaging range 80 (recognition range) of the measuring unit 7 may be provided in the vicinity of the imaging unit 8.

  Under the control of the control unit 1, the printing unit 9 prints the sales data (product type, price, etc.) of the product containing the product in the container on the label.

  The communication unit 10 can perform data communication with a computer such as a cash register or a host computer via a wired or wireless communication path under the control of the control unit 1.

  The sound output unit 11 (speaker) can generate sound such as operation guidance and error sound related to the merchandise sales data processing device 100 (self-measuring device) at a predetermined timing under the control of the control unit 1.

  As described above, the control unit 1 (CPU) causes the merchandise sales data processing apparatus 100 as a computer to realize the functions according to the present invention by executing the control program stored in the storage unit. As shown in FIG. 3B, the control unit 1 includes a position determination unit 121, a container determination unit 122, a product registration unit 123, a notification unit 124, and the like.

  The position determination unit 121 serving as a position determination unit determines whether or not the product is located at a position where the product can be imaged on the placement unit (the weighing pan of the weighing unit 7). In the placement portion, a placement possible area for the product placed on the placement portion is set.

  The container determination unit 122 as a container determination unit specifies the container imaged by the imaging unit 8 based on the imaging data of the container imaged by the imaging unit 8 and the identification information for specifying the container, and the identification is performed. It is determined whether or not the sales form by the container is sale by weight, in detail whether it is sale by weight or quantity sale.

The product registration unit 123 registers the product to be placed on the placement unit based on the imaging data captured by the imaging unit 8 and the product information.
When the position determination unit 121 determines that the product is located at a position where the product can be imaged in the placement unit, the product registration unit 123 registers the product placed on the placement unit.
Further, in the present embodiment, when the sales form of the container specified by the container determination unit 122 is a product sold by scale sales, the product registration unit 123 is based on mass data such as an article weighed by the weighing unit 7. , Generate and register product sales data. In addition, the product registration unit 123 is based on the sales form of the container specified by the container determination unit 122, the mass data of the product measured by the weighing unit 7, and the unit price of the article stored in the product information storage unit. Generate and register product sales data.
The merchandise registration unit 123 performs processing for generating and registering sales data based on the mass data obtained by subtracting the mass data of the container from the mass data of the container containing the article weighed by the weighing unit 7 and the unit price of the article. .

The notification unit 124 displays on the display unit 6 imaging data obtained by imaging by the imaging unit 8 and guidance for placing the imaged product at a position where imaging can be performed on the placement unit. Note that the notification may be displayed on the display unit 6 or pronounced from a speaker or the like.
In addition, when the position determination unit 121 determines that the product is not located at the approximate center of the placement unit or the product exceeds the mountable area, the notification unit 124 sends the product to the placement unit. Announcement of correct placement is performed.
In addition, when the product is located at a predetermined position in a central area of a predetermined width including the approximate center of the placement unit, does not exceed the placement possible region, and the product cannot be specified, the notification unit 124 A candidate for a product to be placed is notified as information to be displayed in a selectable manner.

  In addition, in the process of specifying the container that stores the article by the container determination unit 122, the control unit 1 adds the specific information that specifies the container stored in the container information storage unit to the container of the product imaged by the imaging unit 8. When the corresponding information is not included, processing for displaying a plurality of container type candidates stored in the storage unit such as the RAM 3 on the touch panel type display unit 6 is performed.

  FIG. 4 is a diagram illustrating an example of information stored in the RAM 3 as a storage unit of the product sales data processing apparatus 100. Specifically, FIG. 4A is a diagram illustrating an example of product information, and FIG. 4B is a diagram illustrating an example of container information.

Product information (article information) is stored in association with product classification, product code (article code), product name such as croquettes and salads, name of production area, unit weight (unit mass data), standard unit, container code, unit price, etc. doing.
In addition, when specifying an article (product) with imaging data (image data) obtained by imaging the article (product) with the imaging unit 8 (imaging means), product specifying information (product specifying information for specifying the product in the product information is: (Data obtained by quantifying product dimensions, colors, shapes, etc.).

  Container information includes container code, container name (container type) such as rectangular container and round container, container identification information (specific information), sales form information, product code (article code), container mass data (tare weight data) , Or tare mass data), etc. are stored in association with each other. The container specifying information is information indicating the area of the container (the area of the container when the imaging unit 8 images the container), the shape of the container, and the like. The information indicating the shape of the container is not limited to the shape, area, color, and the like when the container is imaged from above. For example, the imaging unit 8 (imaging unit) images the bottom of the article (product) and captures the imaging data. In the case of acquiring (image data), the shape of the bottom of the container, the area of the bottom, the color of the bottom, and the like become container specifying information (specific information), and the imaging direction of the imaging unit 8 (imaging means) is the side edge of the container. In the case of both (front and rear, left and right), the shape of the side end of the container, the area of the side end, the color of the side end, and the like become the container specifying information (specific information). As the sales form information, for example, 0 is indicated in the case of quantity sales, and 1 is indicated in the case of quantity sales. In other words, the sales form information indicates whether or not the sales form by the container is a weighing sale. The container specifying information is set on the setting screen, and an empty container placed on the placement unit of the weighing unit 7 is imaged by the imaging unit 8 and binarized to obtain the area of the container. The acquired area is stored in a storage unit such as the RAM 3 as container specifying information (specific information) of the container. Note that the container specifying information is not limited to the area, and may be, for example, the number of dots obtained by binarizing the container, or the external shape (silhouette), three-dimensional actual dimensions (vertical, horizontal, height). In addition, a combination of the color and pattern on the surface of the container may be used.

  In the present embodiment, the type of the container (tray) and the type of the article stored in the container (tray) are associated with each other and stored in the storage unit. In addition, the type of container (tray) and sales form information are associated with each other and stored in the storage unit.

FIG. 5 is a diagram showing an example of a label printed by the printing unit of the merchandise sales data processing apparatus.
The label includes a product name (such as a salad), date of manufacture, expiration date, product weight, unit price, product price, store name, store address, and the like.

  FIG. 6 is a diagram showing an example of a setting screen by the merchandise sales data processing apparatus. Specifically, an example of a screen for setting information about a container such as a tray (container) size is shown.

On the setting screen, binarization processing is performed on the image (capture image 61) of the product captured by the capture button 60, the imaging unit, and the image (capture image 61) based on the set threshold value. The obtained binarized image (converted image 62), a plurality of operation buttons 63 for setting a threshold value for binarization processing, a threshold value display unit 64 for displaying a threshold value, and a plurality of operations for setting a protrusion threshold value A button 65, a protrusion threshold value display unit 66 for displaying a protrusion threshold value, a tray size display part 67 for indicating the size of the tray (container), a setting button 68 for setting the size of the tray (container), and an end for ending the setting Buttons 69, and the like.
The tray size display portion 67 displays the number of pixels or the area of the tray (container) corresponding to the tray (container) in the binarized image (post-conversion image 62) (white portion in FIG. 6). .
The size of the tray (container) can be set by placing the tray (container) in each of the five locations of the center, upper right, lower right, upper left and lower left of the weighing pan (mounting unit). From the binarized image obtained by capturing an image of each placed tray (container) on the image capturing unit and performing binarization processing based on the image of each captured tray (container) and the set threshold value The area of the tray (container) at five locations is acquired and stored. Based on the areas of the trays (containers) at the five locations, each of the trays (containers) is placed at each of the five locations of the center, upper right, lower right, upper left, and lower left of the weighing pan (mounting portion). You may make it determine with the area of a tray (container), and add up and average the area of each tray (container) when it is placed in each of the five places as the area of the tray (container) It may be memorized.

  By operating the up button 63u or the down button 63d related to the binarization process, the threshold value of the binarization process can be finely adjusted manually. When the automatic setting button 63a for automatically setting the threshold value of the binarization process is operated, a predetermined threshold value is set based on the illuminance (luminance) of the surrounding environment.

  By operating the up button 65u or the down button 65d related to the protrusion threshold, the protrusion threshold can be finely adjusted manually. When the automatic setting button 65a for automatically setting the protruding threshold value is operated, a prescribed protruding threshold value is set based on the illuminance (luminance) of the surrounding environment.

When the capture button 60 is operated, a capture image 61 such as a container imaged by the imaging unit is displayed, and binarization obtained by performing binarization processing on the capture image 61 based on the set black and white threshold value. An image (post-conversion image 62) is displayed.
Then, the number of pixels in the portion corresponding to the tray (container) (white portion in FIG. 6) or the area of the tray (container) (container specifying information) is displayed on the tray size display section 67.
When the setting button 68 is operated, the area of the tray (container) displayed on the tray size display unit 67 and the set type of the tray (container) are associated with each other and stored in the storage unit such as the RAM 3. The

  As shown in FIG. 6, a product recognition range 61a is set in the image (capture image 61). The recognition range 61a is preferably set to correspond to, for example, the edge of the weighing pan of the weighing unit. The control unit determines that the product container cannot be accurately specified when the product protrudes from the recognition range 61a, or when the operator's hand or the like appears in the captured image 61, and performs error processing. . Examples of error processing by the control unit include processing for displaying an error on the display unit, processing for displaying a display (placement guidance information) for prompting the product to be placed in the recognition range 61a, and the like. be able to.

  Specifically, in the present embodiment, a plurality of protrusion detection units 61c are provided around the recognition range 61a. When the pixel value of the protrusion detection unit 61c is equal to or greater than the threshold value, the control unit 1 determines that the product is protruding from the recognition range 61a or that the operator's hand is reflected in the captured image 61. And error handling.

  In addition, when the pixel value of the protrusion detection unit 61c is equal to or greater than the threshold value, the control unit 1 determines that there is an error and performs error processing. As this error processing, the container selection screen is displayed on the display unit. Processing may be performed. On the container selection screen, an image showing the types of a plurality of containers stored in the storage unit is displayed. An operator (such as a user) looks at the container selection screen displayed on the display unit and selects the same type of container as the actual one. The control unit 1 performs a process of specifying the container based on the signal input from the operation unit. By doing so, even if there is an error in the image recognition processing, the control unit 1 can easily identify the container based on the signal from the operation unit.

  Further, when an error is detected by a plurality of protrusion detection units 61c, and when the increase / decrease number of the “excess detection units 61c” less than the threshold is less than a predetermined number, the control unit 1 may make an error. . By doing so, the error detection accuracy can be improved.

  In fact, since the hand is also determined as a part of the container, the area of the container (for example, the total number of dots) may happen to coincide with another container. Since there is a possibility that processing will be performed after determination, the protrusion detection unit 61c is provided.

  In addition, when the protrusion detection unit 61c cannot be detected, the control unit 1 performs error processing. For example, when a seal (specific information) that specifies the sales form of the container is detected in the imaging data, the control unit 1 From the sticker (specific information), it may be determined whether it is a product sold by quantity or a product sold in quantity, and a container selection screen may be displayed. In addition, it is not only the case where the protrusion detection part 61c cannot be detected, but the container (product) mounted on the mounting part is a product sold by weight only by a seal (specific information) specifying the sales form affixed to the container. It may be determined whether or not. In this case, the seal specifying the sales form affixed to the container may be, for example, a seal made of a graphic specifying the sales form, a label printed with code information specifying the sales form, or the like. Moreover, the seal | sticker which specifies the sales form affixed on a container may be affixed on any place of a container, if it is a place which can be imaged.

  FIG. 7 is a diagram illustrating an example of a setting screen for the placement position. On the setting position setting screen, an image 61 (capture image 61) captured by the imaging unit, a range 61d indicating the size of a region for more efficiently determining the mounting state of a container or a product, Operation buttons (up button 601U, down button 601D, left button 601L, right button 601R) for adjusting a plurality of protrusion detection units 61c provided around the recognition range 61a, the position of the range 61d, the position of the protrusion detection unit 61c, and the like. ), A setting button 68 and the like.

An example of a method for adjusting the position of the protrusion detection unit 61c will be described.
The desired protrusion detection unit 61c is selected, and the operation buttons such as the upper button 601U, the lower button 601D, the left button 601L, and the right button 601R are operated to adjust the position of the protrusion detection unit 61c. Yes. Note that the position adjustment may be performed by selecting a plurality of protrusion detection units 61c.
It should be noted that a setting button for increasing or decreasing the number of a plurality of points constituting each side indicating the “extrusion detection unit 61c” (placeable area) constituting three or four sides in the weighing pan (placement unit). The number of points on each side may be increased or decreased by operating the setting button.

An example of a method for adjusting the position of the range 61d indicating the size of the region for more efficiently determining the placement state of the container or the product will be described.
Select an upper side, a lower side, a left side, or a right side of a range 61d indicating the size of an area for more efficiently determining the placement state of a container or a product, and select an upper button 601U, a lower button 601D, a left button 601L, By operating an operation button such as the right button 601R, the position is adjusted. The position adjustment may be performed by selecting a plurality of the upper side, the lower side, the left side, and the right side.

  When the setting button 68 is operated after the position adjustment, the position adjustment is stored in the storage unit and the setting is reflected.

FIG. 8 is a diagram illustrating an example of a setting screen for a substantially central position of an imageable area in the placement unit.
The substantially center position of the imageable area in the placement unit is configured to be settable. One or a plurality of points 621 define the approximate center position of the imageable area on the placement unit. In the present embodiment, as shown in FIG. 8, four points 621 define a substantially center position of an imageable area in the placement unit. Based on the change in the pixel value at this point 621, it can be determined whether or not a product, a container, a tray, or the like is positioned at a substantially central position of an imageable area in the placement section (position determination means). Note that the plurality of points 621 indicating the imageable central region are not limited to the four points, and when the size of one point 621 indicating the imageable central region is increased, the set points are It may be one point. Therefore, depending on the size of the points to be set and the like, it is possible to determine whether or not the product is placed in the center of the weighing pan (placement unit) without being limited to the number of points to be set. May be composed of one or more points, and is not limited to four as described above.

  The position of the point 621 can be adjusted by operating operation buttons such as the up button 601U, the down button 601D, the left button 601L, and the right button 601R. Note that the position adjustment may be performed by selecting a plurality of points 621. When the setting button 68 is operated after the position adjustment, the position adjustment is stored in the storage unit and the setting is reflected.

  In the above-described embodiment, since the plurality of points 621 are provided at approximately the center position of the imageable region in the placement unit, based on the change in the pixel value at each point 621, the product, container, The movement of the tray can be detected.

The determination that a product or the like enters or exits an imageable area in the placement unit of the product sales data processing apparatus can be made in the placement possible area (position determination unit).
Further, the timing for specifying the product by the imaging unit 8 may be before the product is placed on the placement unit. For example, the product may be specified when the product is guided to a position where imaging can be performed on the placement unit.
In addition, the display of the guidance for placing the product at a position where the product can be imaged in the placement unit is the “extruding detection unit 61c” (placement possible area) that constitutes three or four sides in the weighing pan (placement unit). ) May be displayed on the display unit 6 or may be erased from the display unit 6 according to the number of the number of points constituting each side increases or decreases depending on the product or the hand. For example, on one side of three sides or four sides, or two sides where sides meet each other, depending on the product in the weighing pan (placement unit) in the captured image and the “projection detection unit 61c” (placement possible area) When the number of points constituting the “protrusion detection unit 61c” (placeable area) increases (increases), the operator (customer) takes the weighing pan. It is determined that the operation of placing the product on the (placement unit) is performed, and the number of points constituting the “extrusion detection unit 61c” (placement possible area) is blocked by the product or the hand. When the number of items decreases (decreases), it can be determined that the operator (customer) is performing an operation of taking out the product from the weighing pan (mounting unit). In addition, as described above, the number of points constituting the “protrusion detection unit 61c” (mountable area) may be determined by the number of points that are blocked by goods or hands. 61c "(placeable area) may be determined based on the number of points that are not blocked by goods or hands (position determination means).
As described above, when the number of points constituting the “extrusion detection unit 61c” (placeable area) is blocked by a product or a hand is increased from a predetermined number (a predetermined number or more), the display unit 6 displays “ “Guide to place product at imageable position on placement unit” is displayed for notification, and conversely, the point that constitutes “extrusion detection unit 61c” (placeable area) is blocked by the product or hand. When the number to be displayed is less than the predetermined number (below the predetermined number), the display of “Guide to place the product at the imageable position on the placement unit” displayed on the display unit 6 is deleted (stopped). ) Control from notification to a normal screen (standby screen) may be performed (position determination means).
It should be noted that the display (notification) of “guidance for placing the product at a position where the product can be imaged in the placement unit” displayed on the display unit 6 may be displayed when the placed product cannot be recognized ( Position determination means).
In addition, when the captured image is determined within the recognition range 61a, it may take time to identify the container. Therefore, the size of the region for determining the placement state of the container or the product more efficiently is shown. By using the range 61d, the time required to identify the container from the captured image can be reduced. To shorten the time required to identify the container means that the product placed on the weighing pan (mounting unit) has a size of an area for more efficiently determining the placement state of the container or the product. It is determined whether or not the product or container is located within a predetermined area that can be identified by the ratio of the area where the product or container is located within the range 61d shown. The unit 6 is caused to display (notify) “guidance for placing the product at a position where the product can be imaged on the placement unit” (position determination unit). As a result, it is possible to promptly notify the operator (customer), so that sales data such as the type and price of the product in which the article is contained in the container can be quickly and quickly generated and completed. (Customer) shopping can be processed quickly.
In addition to recognizing the captured image data, the detection of the “extrusion detection unit 61c” (mountable area) is performed using a sensor including a light emitting unit and a light receiving unit. The method may be a method of determining by the number of obstructed points, or a method of determining by the number of obstructing each point of the “protrusion detection unit 61c” (mountable area) using a reflective sensor.

FIG. 9 is a diagram illustrating an example of a display screen when a product or the like is placed on the placement unit.
As shown in FIG. 9, the display unit of the merchandise sales data processing apparatus has a frame indicating the imaging data captured by the imaging unit and the mounting position on the weighing pan (mounting unit) of the weighing unit 7 of the product 76. 77, a guide unit 78 for placing the imaged product 76 or the like at a position where the image can be imaged in the placement unit, a status display unit 79 such as a progress bar indicating the degree of approach of the product to the center position of the placement unit, and the like. It is displayed.
As described above, “notification (notification means)” for “guidance for placing a product on a position where an image can be taken in the placement unit” is performed by imaging data (moving image data or a still image taken at a predetermined interval). An area for displaying data (still image data that is displayed continuously), an area for displaying information instructing the operator (customer) what operations, actions, or operations should be performed using characters, etc. And a display area that displays a state such as a progress bar indicating the degree of approach to the center position of the placement unit.

The position determination unit of the control unit determines whether or not the product 76 is arranged in the frame 77. Further, in the center portion 77c of the frame 77, a point (point 621 in FIG. 8) indicating the substantially center position of the imageable area in the placement portion is defined invisible, and the change in the pixel value at that point is defined. Based on the above, it is possible to determine whether or not a product, a container, a tray, or the like is positioned at a substantially central position of the placement unit.
In addition, when it is determined that the product is not located at a position where the image can be captured in the placement unit, the placement guide for the product is displayed on the guide unit 78.

  In addition, in the guide unit 78, when it is determined that the product is not located at the approximate center of the placement unit or the product exceeds the mountable area, the product is correctly placed on the placement unit. Is notified.

As the placement guide, the placement guide information is displayed on the moving image being picked up, or the region for displaying the moving image or the still image, and the region for displaying the operation, operation or work instruction character, It is preferable to accurately notify an instruction to guide the operator (customer), for example, an area in which the current state (situation) is displayed to the operator (customer) and an integrated display in one screen area.
In addition, the placement guidance guides the area that is desired to be placed so that it can be identified visually. In addition, the area where the current state (situation) is displayed to the operator (customer) is displayed dynamically, such as with a progress bar until it reaches the correct placement position, or “a little more right” or “a little below” with characters etc. Auxiliary displays such as “a little more” and “a little more left” may be performed.

When the product is positioned at the correct placement position, a display indicating completion such as “placed at the correct position” or “OK” may be performed.
In addition, a moving image or a still image display area, or a colored figure or the like on the moving image or the still image itself may be superimposed on the product and dynamically guided. In this case, guidance may be provided such that the colored figure moves in advance in the direction in which the product is desired to be guided to the correct position and blinks at the final point.

  The placement guide is not limited to a product such as a tray, but may be a product in which sushi or the like is individually packaged. In this case, “OK” or the like is displayed on the information that can recognize the label affixed to the individually wrapped sushi on the guidance screen, and the product that is the object of the video or still image in the display area, or An area in which the label cannot be recognized for the target product in the moving image may be enclosed with a red frame or the like to identify the area and notify that the product is to be repositioned.

  When it is determined that the product is located at a position where the product can be imaged in the placement unit, the product registration unit registers the product placed on the placement unit.

FIG. 10 is a diagram showing an example of a container (tray) selection screen displayed on the display unit of the merchandise sales data processing apparatus.
As shown in FIG. 10, when a product or a tray is located at a predetermined position in a central area of a predetermined width including the approximate center of the mounting portion, does not exceed the mountable area, and the product cannot be specified, Then, the candidate of the product placed on the placement unit is notified as information to be displayed in a selectable manner.

  The information stored as the placement position information includes a central area, an area where at least three sides can be placed, a recognition area of the attached label, and the like.

  In the above embodiment, the type of the container is specified based on the imaging data (image data) imaged by the imaging unit 8, and the content associated with the type of the container in advance based on the type of the container. Although the kind and sales form of a certain article (product) are specified, it is not limited to this form. For example, the type of article such as croquette or azimuth fly may be specified based on the imaging data (image data) captured by the imaging unit 8. In the embodiment, the container placed on the placement unit is imaged from above. However, the present invention is not limited to this. For example, the imaging unit 8 (imaging unit) images the bottom of an article (product) and captures the image data. (Image data) may be acquired, or the imaging direction of the imaging unit 8 (imaging means) may be the side end (both front and rear and left and right) of the container. In this case, when the imaging direction of the imaging unit 8 (imaging means) is from the bottom of the container, the container specifying information (specific information) for specifying the container includes the shape of the bottom of the container, the area of the bottom, the color of the bottom, and the like. When it becomes container specific information (specific information) and the imaging direction of the imaging unit 8 (imaging means) is the side end (both front and rear, left and right) of the container, the container specific information (specific information) for specifying the container is the container The shape of the side end, the area of the side end, the color of the side end, and the like are container specifying information (specific information).

As described above, the merchandise sales data processing apparatus according to the embodiment of the present invention images the placing unit such as the weighing pan of the weighing unit 7 on which the product is placed and the product placed on the placing unit. The imaging unit (imaging unit 8), the position determination unit (position determination unit 121) that determines whether or not the product is located at a position where the product can be imaged in the placement unit, and the position determination unit, In the case where it is determined that the product is not located at a possible position, a notification unit (notification unit 124) that notifies the placement guidance of the product is provided.
In this way, it is determined whether or not the product imaged by the position determination means is placed at the approximate center of the placement unit, and when the product is not placed at the approximate center, the placement guidance of the product is notified. Therefore, the recognition rate of goods can be raised and correct goods registration can be performed.

Further, the notifying unit (notifying unit 124) of the commodity sales data processing apparatus according to the embodiment of the present invention can capture the image data captured by the image capturing unit (imaging unit 8) and the captured product on the placement unit. A process of displaying the guidance to be placed at the position on the display unit 6 is performed.
As described above, since the imaged image and the placement guidance of the product are displayed on the display unit 6 and the notification is made, the customer can easily recognize whether or not the product has been placed at the correct position, and the product can be placed on the placement unit. Can be placed at the approximate center.

In addition, the notifying unit (notifying unit 124) of the product sales data processing apparatus according to the embodiment of the present invention is set with a placeable area for the product placed on the placing unit. When the product sales data processing device determines that the product is not located at the approximate center of the placement unit or the product exceeds the mountable area by the position determination unit, the notification unit displays the placement unit. Informs the customer that the product is properly placed.
For this reason, since the determination means determines whether or not the product is placed at the correct position of the placement portion based on the approximate center of the placement portion and the mountable area, the placement portion is placed on the placement portion. The placement position of the product can be accurately determined, and the placement guidance of the product can be correctly notified to the customer.

Further, the product sales data processing apparatus according to the embodiment of the present invention is such that the product is located at a predetermined position in the central area of the predetermined width including the approximate center of the placement unit, does not exceed the placement possible area, and When the information cannot be specified, the notification means (notification unit 124) notifies the candidate of the product placed on the placement unit as information to be displayed in a selectable manner.
As described above, since the customer selects the product placed on the placement unit from among the product candidates, the product sales data processing apparatus that can easily identify the product placed on the placement unit is provided. can do.

In addition, the product sales data processing apparatus according to the embodiment of the present invention includes a product information storage unit (such as RAM 3 and ROM 2) that stores product information, imaging data captured by an imaging unit (imaging unit), and the product Product registration means for registering the product placed on the placement unit based on the information of the above, and the position determination means (position judgment unit 121) positions the product at a position where the product can be imaged on the placement unit. When it is determined that the product has been placed, the product registration means performs a process of registering the product placed on the placement unit.
In this way, when the product is located at a position where the product can be imaged in the placement unit, the product registration unit performs the process of registering the product placed on the placement unit, so that the recognition rate of the product is improved. , Correct product registration can be performed.

  Moreover, in this embodiment, each pixel of the imaging data (image data) imaged by the imaging unit 8 is binarized, and the container and the background portion other than the container are clearly separated, so that the area and shape of the container Etc. can be easily identified. The area of the container and the type of container are stored in advance in a storage unit such as the RAM 3. The control unit 1 can obtain the area of the container placed on the measuring unit 7 by binarizing the imaged data (image data) of the product imaged by the imaging unit 8. The type of the container stored in the storage unit can be easily specified based on the above.

In addition, depending on the installation location of the device (environment in which room illuminance changes due to external light), it is assumed that the room illuminance changes due to weather, time zones such as morning, noon, and night, indoor lighting, etc. The values of the brightness, gamma, color, etc. of each pixel of the image data (image data) imaged by the imaging unit 8 change greatly. In this embodiment, as calibration, a mounting surface (the color of the mounting surface is a single color) is imaged without placing any container or the like, and the brightness, gamma, and color of the captured image (imaging) data Are adjusted (corrected), and the corrected (adjusted) values of brightness, gamma, color, etc. are set as threshold values for the binarization process. Further, as calibration, focus, distortion, brightness, contrast, vividness, sharpness, backlight correction, white balance, and the like are adjusted. Thereby, it is possible to reliably identify the container from the image data captured by the imaging unit 8 in a state where the container is mounted on the mounting surface. Note that correction values such as lens distortion may be stored in addition to calibration.
Specifically, for example, the mounting surface is imaged by the imaging unit 8 for each time period, a threshold value for binarization processing is defined based on the image data, and stored in the storage unit. The control unit 1 performs binarization processing on the image data captured by the imaging unit 8 using the threshold value of the binarization processing for each time period stored in the storage unit, specifies the area of the container, The type of the container can be reliably identified from the area of the container. In addition, when storing in the storage unit, the value (calibration threshold value) calibrated for each time zone in the morning, noon, and night (the threshold value of the binarization process) and the switching time of the use time zone in the morning, noon, and night And automatically calibrated values (binarization processing threshold) for each time zone based on the time measured based on the time measuring means and the switching time. You may make it switch. Further, an illuminometer or the like may be provided in the apparatus, and a calibrated value (a threshold value for binarization processing) may be automatically switched based on a value indicated by the illuminometer.

The product sales data processing apparatus may have a “function for setting a daily sales target amount and an achievement level for each time” as a budget achievement support tool function.
More specifically, the merchandise sales data processing apparatus has a function of inputting a daily sales target amount on a setting screen, a function of setting and inputting a sales consumption ratio at an arbitrary time, and the like.

Further, the product sales data processing apparatus may have “a function of alerting the store (store management computer) if the budget is not achieved at the corresponding time” as a budget achievement support tool function.
Specifically, the merchandise sales data processing apparatus alerts by changing the color of the screen at the time of alerting. The merchandise sales data processing apparatus alerts at a predetermined interval before a series of moving images / BGM. The merchandise sales data processing apparatus has a function of automatically changing to a time sale price.
Note that the merchandise sales data processing apparatus may have a function of automatically changing the selling price POP in conjunction with an electronic shelf label (ESL).

Further, the merchandise sales data processing apparatus may have a “function to promote sales by calling or time sale” as a budget achievement support tool function.
Specifically, the merchandise sales data processing apparatus displays a “recommended” mark on the time sale to be applied. In addition, when the “recommended” time sale is selected, the merchandise sales data processing apparatus changes the price background from the specified color to white. In addition, the merchandise sales data processing apparatus performs processing for monitoring a checkpoint at the next specified time.

  Further, the merchandise sales data processing apparatus may have a process of reporting (reporting) the time sale performance. Specifically, the product sales data processing device can select the day to be confirmed on the display screen as a process for confirming the daily sales results (sales and points) for each day. The process of displaying the results of.

  Further, the merchandise sales data processing apparatus may have a function of calling attention to the customer through a video call. Specifically, the merchandise sales data processing apparatus has a function of clearly indicating the label location by blinking the red LED and sound.

As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to these embodiments, and there are design changes and the like without departing from the gist of the present invention. Is included in the present invention.
Further, the embodiments described in the above drawings can be combined with each other as long as there is no particular contradiction or problem in the purpose and configuration.
Moreover, the description content of each figure can become independent embodiment, respectively, and embodiment of this invention is not limited to one embodiment which combined each figure.

1 Control unit (CPU)
2 ROM (storage unit: storage means)
3 RAM (storage unit: storage means)
4 Auxiliary storage unit 5 Operation unit (operation means: touch panel)
6 Display section (display means: touch panel)
7 Measuring section (measuring means)
8. Imaging unit (acquiring unit, reading unit, imaging unit, scanner unit (scanner device))
9 Printing section 100 Product sales data processing device (self-type sales device)
121 position determination unit 122 container determination unit 123 product registration unit 124 notification unit

Claims (5)

A placement section for placing the product;
Imaging means for imaging the product placed on the placement section,
Position determination means for determining whether or not the product is positioned at a position where imaging can be performed in the placement unit;
And a notifying means for notifying the placement guidance of the product when the position determining means determines that the product is not located at a position where the product can be imaged in the placement unit. Data processing device.   2. The notification unit displays on the display unit imaging data captured by the imaging unit and guidance for placing the captured product on a position where imaging can be performed on the mounting unit. Product sales data processing device described in 1. The area where the product placed on the placement section is placed is set,
When it is determined by the position determination means that the product is not located at substantially the center of the placement section, or the product is beyond the mountable area, the notification means is directed to the placement section. The merchandise sales data processing apparatus according to claim 1 or 2, wherein notification that the merchandise is correctly placed is performed.   When the product is located at a predetermined position in a central area with a predetermined width including the approximate center of the placement unit, does not exceed the mountable area, and the product cannot be specified, the notification means The merchandise sales data processing apparatus according to any one of claims 1 to 3, wherein the merchandise candidate placed on the section is notified as information to be displayed in a selectable manner. Product information storage means for storing information on the product;
Image data captured by the imaging means, and product registration means for registering the product placed on the placement unit based on the product information,
When the position determination unit determines that the product is located at a position where the product can be imaged in the placement unit, the product registration unit registers the product placed on the placement unit. The merchandise sales data processing apparatus according to any one of claims 1 to 4.