JP6651816B2 - Product sales data processing device - Google Patents

Description

  The present invention relates to a merchandise sales data processing device.

2. Description of the Related Art In a grocery store such as a supermarket or a department store, merchandise sales are sometimes performed. As a weighing device used at that time, a weighing device with a camera having a function of weighing goods, and having a function of imaging a tare with a camera, specifying the tare, and subtracting the weight of the tare from the weight of the product. It is known (for example, see Patent Document 1).
In a conventional weighing device with a camera, a dent is provided at a predetermined position of a weighing pan, or a basket-shaped weighing pan is employed to prompt a user to place a tare at a predetermined position of the weighing pan, The recognition rate of the tare by the imaging was raised.

JP 2014-098722 A

  However, in a conventional weighing device with a camera, a weighing dish of a special shape having a basket or a depression has a structure movably fixed to a main body of the weighing apparatus, and the weighing dish becomes dirty with foodstuffs or the like. In such cases, the weighing pan is difficult to clean and may not be hygienic.

  Also, while capturing the moving image of the tare (container) with the camera, the position of the tare (container) is recognized by the real-time image processing, and the tare (container) is placed at the center of the mounting portion. If the weighing device is configured to display instructions on the screen of the display unit sequentially as it moves to the back or front, problems such as an increase in the processing load of the CPU and image processing engine and an increase in the processing time will occur. is there.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problem, and has a simple configuration to prompt a user to place an article or a container to be weighed at a predetermined position (such as a substantially central portion) on a placement section. To provide a product sales data processing device that can perform cleaning, to provide a clean and hygienic product sales data processing device, to provide a product sales data processing device that can perform product registration with high accuracy, etc. With the goal.

The product sales data processing device of the present invention has at least the following configuration.
The product sales data processing device
A product placement unit having a mark indicating a target area for placing the product,
Imaging means;
A registration unit configured to specify a product placed on the product placement unit and perform a product registration process based on an image obtained by imaging by the imaging unit;
In the product placement unit, a position determination unit that determines whether a product is placed in the area indicated by the mark,
When the position determining unit determines that the product is not located in the area indicated by the mark, a notifying unit that notifies a placement guide of the product,
With
The indicia, including the character string shown in the vicinity of the center portion of the product placement portion, a first frame surrounding the periphery of the character string, and the second frame surrounding the first frame, the See
The position determination unit is configured to include, in a case where a product protrudes from a recognition range set to include the second frame in an image obtained by imaging by the imaging unit, in a region indicated by the mark. It is characterized by determining that the product is not located .

ADVANTAGE OF THE INVENTION According to this invention, the goods sales data processing apparatus which can prompt to load goods, containers, etc. of an object to be weighed at a predetermined position (approximately the center, etc.) on the goods mounting section with a simple configuration. Can be provided.
Further, according to the present invention, it is possible to provide an easy-to-clean and hygienic product sales data processing device.
Further, according to the present invention, it is possible to provide a product sales data processing device capable of performing product registration with high accuracy.

FIG. 1 is a front view showing an example of a product sales data processing device according to an embodiment of the present invention. FIG. 2 is a perspective view of a product sales data processing device. The perspective view of the goods sales data processing apparatus at the time of non-mounting of the mounting member which has a mark. The figure which shows an example of a structure of a goods sales data processing apparatus, (a) is an electric functional block diagram, (b) is a functional block diagram of a control part. The figure which shows an example of the information memorize | stored in the goods sale data processing apparatus, (a) is a figure which shows an example of goods information, (b) is a figure which shows an example of container information. The figure which shows an example of the label printed by the printing part of a goods sales data processing apparatus. The figure which shows an example of the container (tray) selection screen displayed on the display part of a merchandise sales data processing apparatus. The figure which shows an example of the image obtained by the imaging means (camera) in the state where the goods (containers) are not mounted on the mounting member. The figure which shows an example of the image obtained by the imaging means (camera) in the state where the goods (containers) were mounted on the mounting member. The figure which shows an example of the image which deleted the mark which shows a target area by image processing. The figure which shows an example of the image which carried out the binarization process. 5 is a flowchart illustrating an example of the operation of the product sales data processing device. FIG. 4 is a perspective view showing an example of a commodity sales data processing device to which a mounting member having a locking portion can be freely attached.

  The commodity sales data processing apparatus according to the embodiment of the present invention includes a commodity placement section having a mark indicating a target area on which a commodity is placed, an imaging unit such as a camera, and an image obtained by imaging by the imaging unit. And a registration unit that specifies a product placed on the product placement unit and performs a product registration process based on the information. Hereinafter, a product or a container (tray) as an object to be weighed may be referred to as a product.

  A merchandise sales data processing device according to an embodiment of the present invention will be described with reference to the drawings. Embodiments of the invention include, but are not limited to, those shown. In the following description of each drawing, portions common to those already described are denoted by the same reference numerals, and a redundant description is partially omitted.

  FIG. 1 is a front view showing an example of a product sales data processing device 100 according to an embodiment of the present invention. FIG. 2 is a perspective view of the product sales data processing device 100. FIG. 3 is a perspective view of the merchandise sales data processing apparatus 100 when the mounting member 71 having the mark 72 is not mounted.

  In the present embodiment, a case will be described in which the product sales data processing device 100 is applied to a self-type weighing device with an imaging unit (camera). The merchandise sales data processing device 100 is installed in a store such as a supermarket, for example, and generates sales data such as the type, number, and amount of merchandise, and converts the sales data into a merchandise sales data processing device, a cash register, It can be registered in a host computer or the like (product registration processing). Further, the commodity sales data processing apparatus 100 includes a printing unit 9 (issuing unit) such as a printer, and can issue a label according to the sales data by the printing unit 9. In this store, for example, products sold by weight such as salads and products sold by quantity such as croquettes are sold.

In detail, the product sales data processing device 100 (self-type weighing device) according to the embodiment of the present invention does not require the operator (customer) to perform an operation input for specifying whether the sales mode is a weighing sale or a quantity sale. When a product is placed on the placing member 71 provided in the weighing unit 7 of the self-contained weighing device, it is automatically determined whether the sales form is a sales-by-measurement product or a sale-by-quantity product, Generate sales data for the product. Further, the merchandise sales data processing device 100 issues a label printed with information according to the sales form of the merchandise. The customer affixes the label to the container and pays a predetermined amount at the place where the cash register is installed.
Hereinafter, each component of the product sales data processing device 100 (self-type weighing device) will be described in detail.

  As shown in FIGS. 1 and 2, a weighing unit 7 having a mounting unit 7 a (a weighing dish) that is movably provided is provided in the apparatus main body 100 a of the product sales data processing apparatus 100. The placing section 7a (weighing dish) is provided detachably from the scale of the measuring section 7. A mounting member 71 having a mark 72 indicating a target area for mounting a product, a container, or the like as an object to be weighed is provided above the mounting portion 7a. The product placing section 700 has a placing section 7a and a placing member 71, and is provided detachably from the apparatus main body. Further, a printing unit 9 (issuing unit) such as a printer is provided in the apparatus main body 100a, and a label issued by the printing unit 9 is discharged from a paper discharge port 9a.

  An operation unit 5, a display unit 6, and the like, which are supported by a support unit 100b, are provided at an upper portion of the apparatus main body 100a. In the present embodiment, a touch panel device is employed as the operation unit 5 and the display unit 6. The operation unit 5, the display unit 6, or the support unit 100b captures an image of a product or a container (tray) as an object to be weighed placed on the placement unit 7a (placement means) of the weighing unit 7 or the like. An imaging unit 8 (camera) as imaging means is provided. An imaging range 80 (recognition range) of the imaging unit 8 is set on the weighing unit 7 (see FIG. 2).

  The mounting member 71 described above is formed in, for example, a plate shape or a sheet shape, and is formed of a predetermined material such as paper, resin, and metal. The product mounting surface of the mounting member 71 is formed flat. For this reason, the mounting member 71 has a structure that is easy to clean even when it is soiled with food or the like. In the present embodiment, the mounting member 71 is formed of cardboard in a plate shape. Note that the mounting member 71 may be formed of a bendable material.

Further, as shown in FIG. 3, the placing member 71 may be configured to be detachable from the placing section 7 a of the measuring section 7. When the mounting member 71 becomes dirty, the mounting member 71 is removed from the mounting portion 7a, and after the mounting member 71 is cleaned, the mounting member 71 can be easily mounted on the mounting portion 7a again, which is sanitary. .
Further, a plurality of mounting members 71 are prepared in advance, and when the mounting member 71 becomes dirty during use, it can be easily replaced with a new mounting member 71, which is sanitary. When the placing member 71 is formed of cardboard or the like, the used placing member 71 can be discarded as burning dust or the like.

  In order to improve the recognition rate of goods or containers (trays) as objects to be weighed imaged by the imaging unit 8, It is preferable to place a product, a container (tray), or the like near a substantially central portion of the placing member 71. In this embodiment, On the mounting surface of the mounting member 71, Within the imaging range of the imaging unit 8, As long as the items to be weighed such as products and containers (trays) can be placed, In a range where the recognition rate of products and containers is high, It has a mark 72 indicating a target area on which an object to be weighed such as a product or a container (tray) is placed. For details, A mark 72 is provided near a substantially central portion of the mounting member 71.

  The mark 72 may be a predetermined character, character string, symbol, graphic, mark imitating a product or a container (tray), a combination thereof, or the like. In the present embodiment, a predetermined character string 72a such as "Please place here" is displayed as a mark 72 near the center of the placing member 71, and a frame 72b surrounding the periphery is displayed. A large frame 72c surrounding the frame 72b is displayed outside the frame 72b (see FIG. 2). As the shape of the frames 72b and 72c, a predetermined shape such as a rectangular shape, a circular shape, an oval shape, and an elliptical shape can be adopted.

  The marking 72 of the placing member 71 may be directly printed on the placing member by ink or the like, or a sticker on which the marking 72 is printed may be attached to the placing member 71.

  The color of the mark 72 of the placing member 71 is preferably a color that can be distinguished from the color of a product or container (tray) as an object to be weighed, and a color that can be distinguished from the color of the placing surface of the placing member. As described later, the control unit of the product sales data processing apparatus according to the embodiment of the present invention performs image processing (erase processing) for removing the color of the mark 72 from the image obtained by the imaging unit. Thus, the recognition rate of products and the like is improved. In the present embodiment, the color of the mark 72 is set to a predetermined color such as red or pink. The color of the mounting surface of the mounting member 71 is set to a predetermined color such as black. Further, the mounting surface of the mounting member 71 may be subjected to an anti-reflection process in order to improve the recognition rate of a product or the like.

  FIG. 4 is a diagram showing an example of the configuration of the product sales data processing device 100. 4A is an electrical functional block diagram, and FIG. 4B is a functional block diagram of a control unit.

  The product sales data processing device 100 according to the embodiment of the present invention includes a control unit 1 (CPU), a ROM 2 and a RAM 3 as storage units (storage units), an auxiliary storage unit 4, an operation unit 5, a display unit 6 , A weighing unit 7, an imaging unit 8, a printing unit 9, a communication unit 10, an audio output unit 11 (speaker), and the like. The above components are electrically connected by a communication line 12 such as a bus (see FIG. 3A).

  The control unit 1 (CPU) controls each component of the merchandise sales data processing device 100 as a whole.

The ROM 2 stores various programs and set values according to the present invention. The RAM 3 has a work area for executing a program. Further, in the present embodiment, the RAM 3 as a storage unit has a product information storage unit, a container information storage unit, and the like.
The product information storage unit stores the unit price of the product and the like. The container information storage unit stores specific information indicating whether the sales form of the product contained in the container is a sales form of weighing sales or piece sales, that is, specific information for specifying the container as the container information (the imaging unit 8 side). , Etc.), mass data of the container, etc. are stored in association with each other.
The specific information includes the area of the container (the number of dots corresponding to the area of the container, etc.), the shape and color of the seal described (attached) to the container, or identification information for identifying the container (for example, code information, etc.). ) Includes the state of the printed label (seal). The control unit 1 can determine whether the container is a commodity for sale by mass or a commodity for sale by quantity based on the specific information.
The RAM 3 serving as a storage unit stores imaging data (image data) of the container (commodity) captured by the imaging unit 8.

The auxiliary storage unit 4 is a storage device such as a removable flash memory, for example, and can store setting information and the like regarding the product sales data processing device 100.
The operation unit 5 is a switch, a button, a touch panel, or the like, and is operated by an operator (customer or the like), and outputs a signal corresponding to a predetermined operation input to the control unit 1.
The display unit 6 performs a display according to the present invention under the control of the control unit 1. In the present embodiment, a display unit 6 of a touch panel type is employed.

  The weighing unit 7 has a placement unit and the like, and weighs the mass of a product, a container (tray), or the like as an object to be weighed placed on a placement member disposed above the placement unit. The information indicating the mass data is output to the control unit 1.

  The imaging unit 8 captures an image of a mounting member, a product or a container as an object to be weighed, or the like. In the present embodiment, an image obtained by imaging the weighing object placed in the imaging range 80 (recognition range) on the mounting member is output to the control unit 1. As the imaging unit 8, an imaging device capable of identifying and photographing the color of the mounting member, the color of the mark shown on the mounting member, the color of the product, and the like, specifically, a color CCD imaging device, A color CMOS imaging device can be used. Note that a light emitting unit such as a light that illuminates the imaging range 80 (recognition range) of the measuring unit 7 may be provided near the imaging unit 8.

  The printing unit 9 prints, on the label, the sales data (such as the type and amount of the product) of the product in which is stored under the control of the control unit 1.

  The communication unit 10 can perform data communication with a computer such as a cash register or a host computer via a wired or wireless communication path under the control of the control unit 1.

  The sound output unit 11 (speaker) can emit a sound such as an operation guide and an error sound for the product sales data processing device 100 (self-type weighing device) at a predetermined timing under the control of the control unit 1.

  As described above, the control unit 1 (CPU) causes the merchandise sales data processing device 100 as a computer to realize the functions according to the present invention by executing the control program stored in the storage unit. As shown in FIG. 3B, the control unit 1 includes a position determination unit 131, a container determination unit 132, an invalidation processing unit 133, a notification unit 134, a product registration unit 135, and the like.

  The position determining unit 131 as a position determining unit determines whether or not the mounting member is located at a predetermined position on the mounting surface, for example, at a region indicated by a mark. In the placing member, a place where the product to be placed can be placed is set.

  The container determination unit 132 serving as a container determination unit is configured to capture the product (container) captured by the imaging unit 8 based on the image obtained by capturing the product by the imaging unit 8 and the specific information for specifying the product (container). Is determined, and it is determined whether or not the sales form of the specified product (container) is sales by weight, specifically, whether sales by weight or sales by quantity.

The invalidation processing unit 133 performs image processing (deletion processing or the like) for invalidating or ignoring a mark indicating a target area provided on the mounting member on an image obtained by imaging by the imaging unit. .
Further, when a hand of a customer or the like is included in an image obtained by the imaging unit, the invalidation processing unit 133 may perform a process of invalidating or ignoring a part of the hand illustrated in the image.
These invalid processes can be easily realized by, for example, removing a region of a predetermined color in the image (for example, a process of converting the color to the color of the mounting surface of the mounting member).

The notification unit 134 notifies the product placement guidance on condition that the position determination unit 131 determines that the product is not located at a position on the placement surface of the placement member that can be imaged by the imaging unit. I do. In more detail, the notification unit 134 correctly places the product in a predetermined position (placement member, for example, "place the product in the center of the placement member according to the mark") as the placement guide of the product. At the center of the display, etc.). Note that the notification may include displaying that effect on the display unit 6 or generating sound from a speaker or the like.
In addition, when the product is located at a predetermined position in the central region having a predetermined width including the approximate center of the mounting member, does not exceed the mountable area, and when the product cannot be specified, the notification unit 134 sets the mounting member to A candidate for a product to be placed is displayed so as to be selectable.

The product registration unit 135 performs a registration process on an image obtained by capturing an image of the product by the imaging unit 8 and a product placed on the mounting member based on the product information. More specifically, in the present embodiment, the product registration unit 135 invalidates or ignores the mark indicating the target area provided on the placing member by the invalidation processing unit 133 based on the image. The product placed on the member is specified, and registration processing is performed on the specified product.
When the position determining unit 131 determines that the product is located at a predetermined position on the placing member, the product registering unit 135 performs a registration process on the product placed on the placing member.
Further, in the present embodiment, when the sales form of the container specified by the container determination unit 132 is a product to be sold by weighing, the product registration unit 135 uses the mass data of the product or the like weighed by the weighing unit 7. , Generate and register the sales data of the product. In addition, the product registration unit 135 determines the sales form of the container specified by the container determination unit 132, the mass data of the product measured by the weighing unit 7, and the unit price of the product stored in the product information storage unit. Generate and register product sales data.
The merchandise registration unit 135 also stores the mass data obtained by subtracting the mass data of the container (tare) from the mass data of the container containing the merchandise weighed by the weighing unit 7 and the sales data based on the unit price of the merchandise. Generate and register.

  Further, in the process of specifying the product or the container that stores the product by the container determination unit 132, the control unit 1 uses the specific information that specifies the container stored by the container information storage unit to store the product that has been imaged by the imaging unit 8. When the information corresponding to the container is not included, a process of displaying a plurality of container type candidates stored in the storage unit such as the RAM 3 in a selectable manner on the touch panel display unit 6 is performed.

In addition, the control unit 1 does not mount the mounting member 71 or the mounting unit 7a on the product sales data processing device based on the detection result of the imaging unit (the imaging unit 8) or the weighing unit (the weighing unit 7). If it is detected, the process of notifying that the placing member 71 or the placing portion 7a is not mounted on the product sales data processing device, or the process of prohibiting the issuance of the label by the printing means (printing portion 9) is performed. Do.
In detail, the control unit 1 mounts the mounting member 71 or the mounting unit 7a on the product sales data processing device based on a difference between a plurality of time-series images captured by the imaging unit (imaging unit). Judge that there is no. Further, the control unit 1 determines that the placing member 71 or the placing unit 7a is not mounted on the merchandise sales data processing device based on the difference in the weight measured by the weighing unit (the weighing unit 7).
That is, when the placing member 71 or the placing portion 7a is not mounted on the merchandise sales data processing device, the operator (user) is notified of the fact and the operator places the placing member 71 or the placing portion 7a. It is possible to prompt the user to attach the product sales data processing device.
At this time, by performing processing for prohibiting the issuance of the label by the printing means (printing unit 9), the label can be printed when the mounting member 71 or the mounting unit 7a is not mounted on the product sales data processing device. Without being issued, it is possible to urge the operator to mount the mounting member 71 or the mounting portion 7a on the product sales data processing device.

  FIG. 5 is a diagram illustrating an example of information stored in a RAM or the like as a storage unit of the product sales data processing device. Specifically, FIG. 5A is a diagram illustrating an example of product information, and FIG. 5B is a diagram illustrating an example of container information.

Product information (product information) is stored in association with product classification, product code (product code), product names such as croquettes and salads, production locations, unit weights (unit mass data), standard units, container codes, unit prices, etc. are doing.
In the case where an article (article) is specified by image data (image data) obtained by imaging the article (article) by the imaging unit (imaging means), the product information is specified in the product information. (Data obtained by digitizing the size, color, shape, etc.).

  Container information includes container code, container name (container type) such as rectangular container and round container, container identification information (specific information), sales form information, product code (article code), container mass data (tare weight data) , Or tare mass data). The container identification information is information indicating the area of the container (the area of the container when the image is taken by the imaging unit 8), the shape of the container, and the like. The information indicating the shape and the like of the container is not limited to the shape, area, color, and the like when the container is imaged from above. For example, the imaging unit 8 (imaging means) images the bottom of the article (product) and obtains image data. When (image data) is obtained, the shape of the bottom of the container, the area of the bottom, the color of the bottom, and the like become container specifying information (specific information), and the imaging direction of the imaging unit 8 (imaging means) is set to the side end of the container. In the case of (front, rear, left and right), the shape of the side end of the container, the area of the side end, the color of the side end, and the like are the container specifying information (specific information). As the sales form information, for example, it is indicated by 0 in the case of unit sales, and is indicated by 1 in the case of mass sales. That is, the sales form information indicates whether or not the sales form of the container is weighing sales. The setting of the container identification information is performed on the setting screen. The image of the empty container placed on the placing member 71 of the weighing unit 7 is captured by the image capturing unit 8 and binarization processing is performed to obtain the area of the container. The acquired area is stored in a storage unit such as the RAM 3 as container specification information (specific information) of the container. In addition, the container specifying information is not limited to the area, and may be, for example, the number of binarized dots of the container, or the external shape (silhouette), the actual three-dimensional dimensions (length, width, height). Alternatively, a combination of the colors and patterns of the container surface may be used.

  In the present embodiment, the type of container (tray) and the type of product stored in the container (tray) are stored in the storage unit in association with each other. Further, the type of the container (tray) and the sales form information are stored in the storage unit in association with each other.

FIG. 6 is a diagram showing an example of a label printed by the printing unit of the product sales data processing device.
The printing section prints information on the product on the medium (label). In the example shown in FIG. 6, the label describes the product name (salad or the like), the price per 100 g, the internal capacity, the expiration date, the processing date and time, the product price, the store name, the store address, and the like.
Note that the content described on the label is not limited to this mode as long as the content is predetermined content related to the product.

FIG. 7 is a diagram illustrating an example of a container (tray) selection screen displayed on the display unit of the product sales data processing device.
If the product or container is located at a predetermined position in the central area of a predetermined width including the approximate center of the mounting member, does not exceed the mountable area, and if the product cannot be specified, as shown in FIG. , Information of a product candidate to be placed on the placing member is displayed as selectable.

  In the above-described embodiment, the type of the container is specified based on the image data (image data) captured by the image capturing unit 8, and based on the type of the container, the content is previously associated with the type of the container. Although the type and sales form of a certain product (article) have been specified, the present invention is not limited to this form. For example, the type of a product (article) such as a croquette or a horsefly may be specified based on image data (image data) captured by the image capturing unit 8. In the embodiment, the container mounted on the mounting unit is imaged from above. However, the present invention is not limited to this. For example, the imaging unit 8 (imaging unit) may image the bottom of a product (article) and obtain image data. (Image data) may be obtained, or the imaging direction of the imaging unit 8 (imaging means) may be the side end (both front and rear, left and right) of the container. In this case, when the imaging direction of the imaging unit 8 (imaging means) is from the bottom of the container, the container specification information (specific information) for specifying the container includes the shape of the bottom of the container, the area of the bottom, the color of the bottom, and the like. The container specifying information (specific information) becomes container specifying information (specific information), and when the imaging direction of the imaging unit 8 (imaging means) is the side end (front and rear, left and right) of the container, the container specifying information (specific information) for specifying the container is the container The shape of the side end, the area of the side end, the color of the side end, and the like are container specification information (specific information).

FIG. 8 is a diagram illustrating an example of an image obtained by an imaging unit (camera) in a state where a product (container) is not mounted on the mounting member.
As described above, the placing member 72 has a mark 72 (a character string 72a shown near the central portion 71t of the placing member) indicating a target area on which a product or a container (tray) to be weighed is placed. , Frame 72b, frame 72c, etc.).

  An image (captured image 61) obtained by imaging a product, a mounting member, or the like by the imaging unit has a product recognition range 61a set therein. The recognition range 61a is set, for example, near the edge of the mounting member and along the edge. When the product is out of the recognition range 61a or when the operator's hand or the like appears in the captured image 61, the control unit determines that the container of the product cannot be accurately specified, and performs an error process. The error processing by the control unit includes a process of displaying an error on the display unit, a process of displaying a display (placing guidance information) prompting the user to place a product in the recognition range 61a, and the like. be able to.

  Specifically, in the present embodiment, a plurality of protrusion detection units 61c are provided around the recognition range 61a. When the pixel value of the protrusion detection unit 61c is equal to or larger than the threshold value, the control unit 1 determines that an error has occurred, such as a product protruding from the recognition range 61a, an operator's hand or the like being captured in the captured image 61, or the like. And performs error processing.

  When the pixel value of the protrusion detection unit 61c is equal to or larger than the threshold, the control unit 1 determines that there is an error and performs error processing. As the error processing, a container selection screen is displayed on the display unit. Processing may be performed. On the container selection screen, images indicating the types of the plurality of containers stored in the storage unit are displayed. The operator (user or the like) looks at the container selection screen displayed on the display unit and selects the same type of container as the actual one. The control unit 1 performs a process of specifying a container based on a signal input from the operation unit. By doing so, even in the case of an error in the image recognition processing, the control unit 1 can easily specify the container based on the signal from the operation unit.

  Further, when an error is detected by the plurality of protrusion detection units 61c, and when the number of increase / decrease in the number of the “protrusion detection units 61c” less than the threshold value is less than a predetermined number, the control unit 1 may determine an error. . By doing so, the accuracy of error detection can be improved.

  In addition, since the hand is actually judged as a part of the container, the area of the container (for example, the total number of dots) may happen to coincide with another container. The protruding detection unit 61c is provided because there is a possibility that the processing is performed by making a judgment.

  As shown in FIG. 8, a range 61d indicating an area for more efficiently determining the placement state of a product or the like is defined. When a product or the like is placed in this range 61d, the recognition rate of the product or the like is high.

  Further, in this embodiment, the mounting surface of the mounting member is set to a predetermined color such as black or gray, and the color of the mark 72 shown on the mounting surface of the mounting member is red or pink. It is set to a predetermined color (see FIG. 8). The color of the mark 72, the color of the mounting surface of the mounting member, and the like are initially stored in the storage unit based on an image obtained by imaging the mounting member and the mark by the imaging unit.

FIG. 9 is a diagram illustrating an example of an image obtained by the imaging unit (camera) in a state where the product 76 (container) is placed on the placing member.
As described above, the mounting surface of the mounting member is set to a predetermined color such as black or gray, and the color of the mark 72 shown on the mounting surface of the mounting member is a predetermined color such as red or pink. The colors are set, and they are defined in colors that can be distinguished from the products 76 and containers placed on the placing member.

FIG. 10 is a diagram illustrating an example of an image 61B in which a mark 72 (a character string 72a, a frame 72b, a frame 72c, etc.) indicating a target area has been deleted by image processing.
The control unit of the product data processing apparatus according to the present embodiment erases the mark 72 shown on the mounting surface of the mounting member from the image 61 (FIG. 9) obtained by the imaging unit by image processing. . In detail, the control unit erases a portion of the same color as the mark 72 shown on the mounting surface of the mounting member from the image 61 obtained by the imaging unit by image processing, and FIG. The image 61B shown is obtained. Specifically, the control unit performs a process of converting a portion having the same color as the mark 72 shown on the mounting surface of the mounting member into the same color as the mounting surface of the mounting member, thereby performing image processing. An image 61B in which the mark 72 has been removed from the image 61 by image processing can be easily generated.
By doing so, a binarized image in which a portion corresponding to the product 76 (container) and other portions are distinguished with high precision can be obtained by the binarization process of an image described later.

FIG. 11 is a diagram illustrating an example of the image 79 subjected to the binarization processing. Specifically, the control unit performs a binarization process on the image 61B (FIG. 10) obtained by deleting the mark 72 from the image 61 (FIG. 9) obtained by the imaging unit based on a predetermined threshold. A binarized image 79 is generated. Specifically, the control unit performs a binarization process for setting the pixel value indicating the brightness of each pixel of the image 61 to white when the threshold value is equal to or greater than a specified threshold value and black when the pixel value is less than the threshold value.
In the binarized image 79, the part corresponding to the product 76 (container) and the other part 78 are distinguished with high accuracy.

  For example, when the image 61 (FIG. 9) is subjected to the binarization processing (comparative example), the pixel value of the mark 72 of the predetermined color is smaller than the threshold value of the pixel corresponding to the product 76 (container). When the value is close to the value, the mark 72 and the product 76 (container) are integrated into a binarized image, and an appropriate binarized image for specifying the size of the product (container) can be obtained. Can not.

<Example of the operation of the product sales data processing device>
FIG. 12 is a flowchart showing an example of the operation of the product sales data processing device. An example of the operation of the merchandise sales data processing device will be described with reference to the above-described drawings and FIG.

  In the present embodiment, first, a mounting member 71 made of cardboard or the like is detachably mounted on the mounting section 7a of the measuring section 7. A mark 72 indicating a target area on which a product (container) is placed is shown on the placement member 71. The user visually observes the mark 72, places the product (container) on a predetermined area of the placing member 71, and causes the product sales data processing device to weigh the product and register the product.

  More specifically, in step S101, the control unit 1 determines whether or not a product (container) has been placed on the placement member 71 on the placement unit 7a of the measurement unit 7 based on a signal from the measurement unit 7. If it is determined that a product (container) is placed, the process proceeds to step S102. If no product (container) is placed, the process of step S101 is repeated.

  In step S102, the weight of the product (container) is measured by the measuring unit 7, and the control unit 1 receives information indicating the mass of the product from the measuring unit 7.

  In step S103, the control unit 1 performs a process of causing the imaging unit 8 to image a product or the mounting member 71 placed on the mounting member 71, and performs a process of receiving an image (image data) from the imaging unit 8. (See FIGS. 8 and 9).

  In step S <b> 104, the invalidation processing unit 133 of the control unit 1 performs image processing for deleting the mark 72 indicating the target area provided on the placing member 71 on the image obtained by the imaging unit 8. Then, an image 61B in which the mark 72 (mark) is deleted is generated (see FIG. 10).

  In step S105, the position determination unit 131 of the control unit 1 determines whether or not a product is placed on the placement member at a position where the imaging unit 8 can capture an image based on the image 61B. When the position determining unit 131 determines that the product is not located at a position where the image can be taken on the mounting member, a process of notifying the mounting guide of the product by the notification unit 134 is performed in step S106. As a product placement guide, for example, the product is correctly placed at a predetermined position (such as the center of the placement member), such as "Please place the product at the center of the placement member according to the mark." Is displayed on the display unit, and the process proceeds to step S101.

  When it is determined in step S105 that the product is located at a position where the image can be taken on the mounting member, the process proceeds to step 107.

In step S107, the container determination unit 132 of the control unit 1 determines the type of the product (container) based on the size (area) of the product 76 (container) in the image 79 (see FIG. 11) obtained by binarizing the image 61. Is performed. Specifically, the control unit 1 specifies the type of the product (container) based on the image data captured by the imaging unit 8 and the information that specifies the product stored in the storage unit.
In the present embodiment, the container determination unit 132 performs a process of specifying a container based on the size (area) of the container obtained from the binarized image data. Note that the container may be specified by the number of dots of the binarized image data, or may be specified by an appearance shape or the like (identification information or specific information). In this case, the information for specifying the container stored in the storage unit includes information on the external shape of the container (contour shape, dimensional information (length, width, height)), color and pattern of the container surface, and the like. You may make it. Further, a combination of various types of information may be stored.

  In step S108, the control unit 1 determines whether or not the container has been specified. If the container has been specified, the process proceeds to step S111. If the container has not been specified, the process proceeds to step S109.

  In step S109, the control unit 1 performs a process of displaying a plurality of containers stored in a storage unit (storage unit) such as the RAM 3 on the display unit 6 as selectable candidates. Specifically, the control unit 1 performs a process of displaying image data and illustrations of the container corresponding to the container information on the display unit 6 (see FIG. 7).

  In step S110, the control unit 1 determines whether or not a container has been selected by an operator (such as a customer). If a container has been selected, the process proceeds to step S111. Proceed to step S109.

  In step S111, the control unit 1 calls (reads) container information and product information from a storage unit such as the RAM 3.

  In step S112, the control unit 1 determines whether or not the product associated with the container is a weigh-selling product. If the product is a weigh-selling product, the process proceeds to step S114; otherwise, the process of step S113. Proceed to.

  In step S113, the control unit 1 generates sales data for quantity selling, and proceeds to the processing in step S115. In addition, the sales data of the quantity sale is calculated by calculating the number of articles based on the mass data obtained by subtracting the mass data of the container from the mass data of the weighed product and the unit mass data of the article, and calculating the calculated number and the article. The sales data of the product is generated based on the unit price of. If the product does not contain a plurality of products in a container, the sales data of the product is generated based on the unit price of the product without using the measured mass of the product.

  In step S114, the control unit 1 generates sales data for weighing sale, and proceeds to the process in step S112. The sales data generation of the weighing sale generates the sales data of the merchandise based on the mass data obtained by subtracting the mass data of the container from the weighed mass data of the merchandise and the unit price of the article.

  In step S115, the control unit 1 causes the printing unit 9 to perform a printing process according to the sales data, and performs a process of issuing a label. It should be noted that the label to be issued uses a mountless label, and the label whose label issuing direction is variable based on the print data amount according to the product is cut and issued after printing.

In step S116, the control unit 1 performs a process of registering sales data. More specifically, the control unit 1 performs a process of storing sales data in a storage unit such as the RAM 3, a process of registering the sales data in a cash register or a host computer via the communication unit 10, and the like.
The purchaser (customer) of the product affixes the label to the container, and at a place (accounting office) where a cash register (POS register) is installed, through a store clerk, or a self-service cash dispenser (self POS register). ) Directly pay a predetermined amount. In the case where the merchandise sales data processing device 100 is a self-contained weighing scale device having an accounting settlement function (payment settlement function), the merchandise sales data processing device 100 performs settlement for the goods purchased by the customer himself (self accounting settlement). ) May be performed.

In the embodiment described above, the product placement unit 700 of the product sales data processing device 100 is configured to be locked by the locking unit provided in the device.
The product placing section 700 is composed of a placing section 7a and a placing member 71, and is disposed vertically above a weighing means (a weighing section 7) of the apparatus. Either one or both of the mounting portion 7a and the mounting member 71 are configured to be detachable from the apparatus main body. Hereinafter, an example of the product sales data processing device 100 will be described.

FIG. 13 is a perspective view showing an example of a commodity sales data processing device 100 to which a mounting member 71 having a locking portion can be freely attached.
The placing section 7a of the measuring section 7 and the placing member 71 attached to the placing section 7a may include a means for preventing displacement.
As the displacement prevention means, for example, as shown in FIG. 13, a protrusion as a locking portion 7 k provided on the mounting portion 7 a of the measuring portion 7, a locking portion 71 k provided on the mounting member 71 And the like. In the commodity sales data processing device 100 of the present embodiment, the engaging member 7k provided on the mounting portion 7a and the engaging portion 71k provided on the mounting member 71 engage, so that the mounting member 71 It is structured to be detachably fixed to the mounting portion 7a.
In this way, for example, the used mounting member 71 that is soiled with food or the like can be easily replaced with a new mounting member 71.
The position shift preventing means is not limited to the above-described embodiment, and may be, for example, a mode in which the mounting member 71 includes a concave portion capable of housing the mounting portion 7a.

As described above, the merchandise sales data processing apparatus 100 according to the embodiment of the present invention includes the merchandise placing section 700 having the mark 72 indicating the target area on which the merchandise is to be placed, and the imaging section 8 serving as an imaging unit. A product registration unit 135 as a registration unit that specifies a product placed on the product placement unit 700 and performs a product registration process based on an image obtained by imaging by the imaging unit (the imaging unit 8); Is provided.
For this reason, a product sales data processing device that can prompt the user to place a product or a container to be weighed at a predetermined position (such as a substantially central portion) on the product placement portion 700 with a simple configuration is provided. Can be provided. In detail, since the mark (mark) is directly provided on the product placing portion 700 on which the product is placed, the customer visually checks the mark (mark) and places the product at a predetermined position on the product placing portion 700. (Approximately the center), the product can be easily placed.
In addition, since the product is placed at a predetermined position (approximately at the center) of the product placement section 700, it is possible to provide a product sales data processing device capable of performing product registration with high accuracy.

  In the present embodiment, the product mounting surface of the mounting member 71 of the product mounting section 700 is formed flat. For this reason, an easy-to-clean and hygienic product sales data processing device can be provided. In addition, the mounting member 71 can be easily formed at low cost with a flat member without being processed into a cage shape or a shape having a depression.

  Further, in the merchandise sales data processing apparatus 100 according to the embodiment of the present invention, the merchandise placing section 700 is configured to be detachable from the apparatus main body. Specifically, the mounting member 71 is configured to be detachable from the mounting portion 7a. For this reason, when it becomes dirty, it can be easily replaced, it is hygienic, and it is possible to prevent a reduction in the recognition rate in image processing due to dirt or the like.

Further, the product sales data processing apparatus 100 according to the embodiment of the present invention has an issuing unit such as a printing unit 9 for issuing a medium (label) indicating information on the product, and the product mounting unit 700 includes a device main body. It is configured to be more detachable. The issuance unit prohibits or stops the issuance of a medium (label) when the entire product mounting unit 700 or the mounting unit 7a or the mounting member 71 that configures the product mounting unit 700 is detached from the device. When a product placing section is mounted on the placing section, a medium (label) is issued. More specifically, the control unit 1 performs processing to prohibit or stop the issuance of the medium (label) by the issuing unit (printing unit 9) when the product placement unit 700 is detached from the device, and When the unit 700 is mounted on the placement unit, a process of issuing a medium (label) by the issuing unit (printing unit 9) is performed.
That is, it is possible to control the issuance of the medium (label) by the issuance unit (printing unit 9) depending on whether or not the product placement unit 700 is mounted on the device. In addition, it is possible to urge the operator (user) to attach the product placement unit 700 to the apparatus main body.

  In the merchandise sales data processing apparatus 100 according to the embodiment of the present invention, the merchandise registration unit 135 as a registration unit is configured to store an image captured by the imaging unit (the imaging unit 8) with the mounting member 71. The image processing unit 133 performs image processing for invalidating or ignoring the mark 72 indicating the target area provided on the product mounting unit 700 by the invalidation processing unit 133, and based on the image on which the image processing has been performed. The product placed on 700 is specified. Therefore, the product recognition rate is high. More specifically, since the mark (mark) provided on the product placement unit is invalidated or ignored by the image processing from the captured image, the product is specified and the product is registered. And the image recognition rate is high.

Further, in the product sales data processing apparatus 100 according to the embodiment of the present invention, the position of the product placement unit 700 for determining whether or not a product is placed at a position where an image can be captured by the imaging unit (the imaging unit 8). When the determination unit (position determination unit 131) and the position determination unit (position determination unit 131) determine that the product is not located at a position that can be imaged by the imaging unit, a notification unit that notifies a placement guide of the product ( Notification unit 134).
In this case, in addition to the mark (mark) of the product placement portion, the product can be placed at a predetermined correct position, so that the recognition rate of the product can be further increased. That is, it is possible to provide the product sales data processing device 100 capable of performing product registration with high accuracy.

As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to these embodiments, and there may be a design change or the like without departing from the gist of the present invention. This is also included in the present invention.
In addition, the embodiments shown in the above-described drawings can be combined with each other as long as there is no particular inconsistency or problem in the purpose, configuration, or the like.
Further, the contents described in each drawing can be independent embodiments, and the embodiments of the present invention are not limited to one embodiment combining the drawings.

In the above-described embodiment, the placing member 71 such as a cardboard is provided detachably with respect to the weighing dish (the placing portion 7a) of the weighing section 7. However, the present invention is not limited to this mode. When detaching for cleaning or the like, the placing member 71 and the weighing plate (the placing portion 7a) are removed together from the apparatus main body, and when returning, the placing member 71 and the weighing plate (the placing portion 7a) are put together. May be attached to the apparatus body. That is, the mounting member 71 and the weighing dish (the mounting portion 7a) can be easily attached and detached and cleaned.
Alternatively, the mounting member 71 may be formed in a concave shape instead of a plate-shaped member, and may be fitted and integrated by covering the measuring portion 7. In the case where such a configuration is adopted, a locking portion for locking the mounting member 71 may not be provided in the product sales data processing device. Thereby, at the time of cleaning, the placing member 71 and the weighing plate (the placing portion 7a) can be easily attached and detached integrally, and the placing member 71 and the weighing plate (the placing portion 7a) do not become separate. Handling is easy, and troubles such as loss of the placing member 71 or the weighing pan (the placing portion 7a) can be reduced. In addition, the replacement of the mounting member 71 can be performed at a place away from the device after the device is detached from the device, which is safe.
Further, a form of a product placing section in which the placing member 71 and the weighing dish (the placing section 7a) are integrally formed may be used. In this case, it is possible to reduce the cost by using a material such as hard cardboard as the material of the product placing portion, and it is easy to replace (or replace) the product placing portion. Can be easily disposed of.
Further, when the material of the integrally formed product mounting portion is made of metal (for example, aluminum alloy), it can be used continuously, is easy to clean, and is economical because it can be handled integrally. Thus, troubles such as loss of the placing member 71 or the weighing dish (the placing portion 7a) can be reduced.

1 control unit (CPU)
2 ROM (storage unit: storage means)
3 RAM (storage unit: storage means)
4 auxiliary storage unit 5 operation unit (operation means: touch panel)
6. Display unit (display means: touch panel)
7 Measuring part (measuring means)
7a mounting section 7k locking section 8 imaging section (acquisition section, reading section, imaging section, scanner section (scanner device))
9 Printing unit (issuing means)
100 Commodity sales data processing device (Self-type sales device)
131 Position determination unit 132 Container determination unit 133 Invalidation processing unit 134 Notification unit 135 Product registration unit 700 Product placement unit

Claims (7)

A product placement unit having a mark indicating a target area for placing the product,
Imaging means;
A registration unit configured to specify a product placed on the product placement unit and perform a product registration process based on an image obtained by imaging by the imaging unit;
In the product placement unit, a position determination unit that determines whether a product is placed in the area indicated by the mark,
When the position determining unit determines that the product is not located in the area indicated by the mark, a notifying unit that notifies a placement guide of the product,
With
The indicia, including the character string shown in the vicinity of the center portion of the product placement portion, a first frame surrounding the periphery of the character string, and the second frame surrounding the first frame, the See
The position determination unit is configured to include, in a case where a product protrudes from a recognition range set to include the second frame in an image obtained by imaging by the imaging unit, in a region indicated by the mark. A merchandise sales data processing device for determining that a merchandise is not located .   The merchandise placement data processing device according to claim 1, wherein the merchandise placing portion is configured to be detachable from the device main body.   The merchandise sales data processing device according to claim 2, wherein the merchandise placing portion is locked by a locking portion provided in the device. The product placing section is configured by a placing section and a placing member, and is disposed vertically above the weighing means of the apparatus,
The merchandise sales data processing device according to claim 1, wherein either one or both of the mounting portion and the mounting member are configured to be detachable from the device main body. Further comprising issuing means for issuing a medium in which information on the product is described,
The issuance means prohibits or stops the issuance of the medium when the entirety of the product mounting portion or the mounting portion or the mounting member constituting the product mounting portion is detached from the apparatus, and the product mounting portion controls the product mounting. The merchandise sales data processing apparatus according to any one of claims 2 to 4, wherein the medium is issued when the storage section arrives at the apparatus.   The registration unit performs image processing on the image obtained by the imaging unit so as to invalidate or ignore the mark indicating the target area provided on the product placement unit. The product sales data processing device according to any one of claims 1 to 5, wherein a product placed on the product placement unit is specified based on the processed image. Based on the detection result of the imaging unit or the weighing unit, when it is detected that the mounting member or the mounting unit is not mounted on the device, the mounting member or the mounting unit is mounted on the device. 5. The merchandise sales data processing device according to claim 4, further comprising a control unit for performing a process of notifying that the device is not attached to the device or a process of prohibiting the issuance of a label .

Images