JP6291091B2 - Product sales data processing apparatus and program - Google Patents

Description

  Embodiments described herein relate generally to a merchandise sales data processing apparatus and a program.

  2. Description of the Related Art Conventionally, a POS (Point Of Sales) device for registering a reason for a return together with product information of the returned product when a product purchased by a customer is returned at a retail store or a specialty store is used. The store side can improve the store operation by using the registered return reason data.

  There are many reasons for returning goods, such as damaged goods, defects, different sizes of clothing, furniture, miscellaneous goods, etc., and returned goods due to wrong purchase by customers. When the damage or defect of the product is the reason for the return, there is a demand to leave the image of the returned product as an image and utilize it for improving the method of handling the product.

  The problem to be solved by the present invention is to provide a merchandise sales data processing apparatus and program capable of storing images of returned merchandise.

The merchandise sales data processing apparatus of the embodiment includes merchandise information accepting means, return reason accepting means, imaging control means, calculation means, display control means, and notification means . The merchandise information accepting unit accepts merchandise information of the returned merchandise. The reason for accepting the reason for return accepts the input of the reason for return. The imaging control means captures an image of the returned product by the imaging means only when the reason for the return is that the return product is a return due to a difference in appearance from the normal product. The calculating unit calculates a value indicating how similar the captured image of the product imaged by the imaging unit and the reference image of the product corresponding to the product information received by the product information receiving unit. The display control means surrounds a place where the value satisfies a predetermined return condition or a place where the value does not satisfy the return condition, overlaid on the image of the return product imaged by the imaging means. Is displayed. If the value does not become a predetermined return object value in any image area of the captured image of the product, the notification means includes an area in which the appearance that is the reason for the return is captured. If it is not, the user is notified to re-image the returned product.

FIG. 1 is a perspective view illustrating an example of a checkout system according to the embodiment. FIG. 2 is a block diagram illustrating a hardware configuration of the POS device and the scanner. FIG. 3 is a conceptual diagram illustrating the data structure of a PLU file. FIG. 4 is an explanatory diagram illustrating a data configuration example of the return data storage unit. FIG. 5 is a block diagram showing a functional configuration of the POS device. FIG. 6 is a diagram illustrating an example of a confirmation screen. FIG. 7 is a diagram illustrating a display example of an error message that prompts re-imaging. FIG. 8 is a flowchart showing the procedure of the return registration process executed by the POS device.

  FIG. 1 is a perspective view illustrating an example of a checkout system 1 according to the embodiment. As shown in FIG. 1, the checkout system 1 includes a POS device 11 and a scanner 101 connected to the POS device 11 so that data communication is possible. In the present embodiment, an example in which the POS device 11 is applied as a product sales data processing device according to the present embodiment will be described.

  The POS device 11 is placed on the upper surface of the drawer 21 on the checkout table 41. The POS device 11 controls the opening / closing operation of the drawer 21. A keyboard 22 and a display device 23 for a store clerk are provided on the upper surface of the POS device 11. A touch panel 26 is disposed on the display surface 23 a of the display device 23. Further, a customer display device 24 is erected in a rotatable manner behind the store clerk display device 23. The customer display device 24 is supported by a pole on the top of the casing of the POS device 11 so that the orientation of the display surface 24a can be changed.

  The scanner 101 is erected on the load receiving surface 152 of the counter table 151. The scanner 101 includes a thin rectangular housing 102. A reading window 103 is disposed in front of the housing 102. An operation display unit 104 is attached to the upper part of the housing 102. The operation display unit 104 includes a display device 106 having a touch panel 105 disposed on the surface thereof. A keyboard 107 is provided on the right side of the display device 106. A card reading groove 108 of a card reader is provided on the right side of the keyboard 107. On the back side of the operation display unit 104, a customer display device 109 for providing information to the customer is installed.

  The customer places a shopping basket 153 containing the product G to be purchased on the receiving surface 152. The operator picks up the product G from the shopping cart 153 and holds it over the reading window 103 of the scanner 101. The scanner 101 includes an imaging unit 164 (see FIG. 2) inside the reading window 103. The imaging unit 164 images the product G. The scanner 101 transmits the captured image of the imaging unit 164 to the POS device 11.

  The POS device 11 decodes a code symbol included in the captured image and reads code information such as a product code and a discount code. Further, the POS device 11 extracts and identifies the image area of the product G from the captured image using the object recognition technology, and specifies the product G included in the captured image. Then, the POS device 11 reads the product information of the specified product G from the PLU file F1 (see FIG. 2). The POS device 11 performs processing such as sales registration, checkout processing, and return registration of the product using the code information or product information read in this way.

  FIG. 2 is a block diagram illustrating the hardware configuration of the POS device 11 and the scanner 101. The POS device 11 includes a microcomputer 60 that executes information processing. The microcomputer 60 is configured by connecting a ROM (Read Only Memory) 62 and a RAM (Random Access Memory) 63 to a CPU (Central Processing Unit) 61 that executes various arithmetic processes and controls each unit.

  A keyboard 22, HDD (Hard Disk Drive) 64, communication interface 25, display device 23, touch panel 26, customer display device 24, connection interface 65, drawer 21, and printer 66 are connected to the CPU 61 of the POS apparatus 11 through various interfaces. Has been. The CPU 61 controls these units.

  The communication interface 25 is an interface for performing data communication with the store computer SC. The connection interface 65 is an interface for performing data communication with the scanner 101. The printer 66 prints a receipt, a journal, a return slip, etc. under the control of the CPU 61.

  The HDD 64 stores a program PR, a PLU file F1, a return data storage unit 64b, and the like. The program PR is a program for performing a return registration process according to the present embodiment. The functional configuration of the program PR will be described later with reference to FIG. The program PR may be stored in the ROM 62. In addition, the HDD 64 stores programs for performing product sales registration processing and object recognition processing.

  The PLU file F1 is a file that stores product information of each product, data used for object recognition, and the like. The PLU file F1 is distributed and updated from the store computer SC and stored in the HDD 64 of the POS device 11. The PLU file F1 may be stored in the store computer SC, and the CPU 61 may access the PLU file F1 of the store computer SC via a network.

  FIG. 3 is a conceptual diagram illustrating the data configuration of the PLU file F1. As shown in FIG. 3, the PLU file F1 includes, for each product, a product ID uniquely assigned, product information to which the product belongs, product information such as a product name, a unit price, and a product image obtained by capturing the product (standard). Image) as product information of the product. The reference image is a captured image (photograph) obtained by capturing a product of normal quality (normal product) that will not be returned, and is used when calculating the similarity described later. The data structure of the PLU file F1 is not limited to the example of FIG. For example, instead of the reference image, a feature amount indicating a color read from the reference image, a surface unevenness state, or the like may be stored.

  FIG. 4 is an explanatory diagram showing a data configuration example of the return data storage unit 64b. As shown in FIG. 4, the return data storage unit 64b has a date (return date) for accepting a return, a product code of the returned product, a product classification, a product name, a number of returned products, a return reason code, and an image file of the returned product. This is a memory area for storing information related to returned merchandise such as names. Instead of the image file name of the returned product, information such as a link indicating the storage location of the file may be stored. Of course, the return data storage unit 64b may store the image file itself.

  Returning to FIG. 2, the scanner 101 includes a microcomputer 160. The microcomputer 160 is configured by connecting a ROM 162 and a RAM 163 to a CPU 161 via a bus. The ROM 162 stores a program executed by the CPU 161. An imaging unit 164, an audio output unit 165, a connection interface 175, and an operation display unit 104 are connected to the CPU 161 of the scanner 101 via various input / output circuits. The CPU 161 controls the operation of these units.

  The imaging unit 164 is a color CCD image sensor, a color CMOS image sensor, or the like. The imaging unit 164 performs imaging under the control of the CPU 161 or the CPU 61 of the POS device 11. For example, the imaging unit 164 captures a 30 fps moving image. Frame images (captured images) sequentially captured at a predetermined frame rate by the imaging unit 164 are stored in the RAM 163.

  The audio output unit 165 is an audio circuit and a speaker for generating a preset warning sound or the like. The audio output unit 165 performs warning sound or audio notification under the control of the CPU 161. The connection interface 175 is an interface for performing data communication with the POS device 11.

  As described above with reference to FIG. 1, the operation display unit 104 includes the keyboard 107, the display device 106, the touch panel 105, and the customer display device 109. The CPU 161 of the scanner 101 or the CPU 61 of the POS device 11 controls the operation of each unit included in the operation display unit 104. The keyboard 107 is provided with a return registration key 107a, a numeric keypad 107b, a confirmation key 107c and the like for starting the return registration process.

  Next, the functional configuration of the POS device 11 realized by the CPU 61 of the POS device 11 executing the program PR will be described with reference to FIG.

  FIG. 5 is a block diagram showing a functional configuration of the POS device 11. As shown in FIG. 5, the program PR executed by the POS device 11 of the present embodiment includes a product information reception unit 51, a return reason reception unit 52, an imaging control unit 53, a similarity calculation unit 54, a display control unit 55, The module configuration includes a return data management unit 56 and a print control unit 57. As actual hardware, the CPU 61 (processor) reads the program PR from the HDD 64 and executes the program PR, so that the above-described units are loaded onto the main storage device and generated.

  The merchandise information receiving unit 51 accepts merchandise information of returned merchandise. In other words, the product information receiving unit 51 recognizes an image of a barcode included in the image captured by the imaging unit 164. And the merchandise information reception part 51 decodes the said barcode, reads a merchandise code, and accepts this as a merchandise code of returned goods. Further, the product information receiving unit 51 reads product information corresponding to the product code from the PLU file F1 into the RAM 63.

  Note that the product information reception unit 51 may perform object recognition processing on the captured image, specify the product, and read the product code of the specified product from the PLU file F1. Further, the product information receiving unit 51 may receive an input of a product code from the numeric keypad 107b of the keyboard 107 or other keys.

  The reason for accepting return part 52 accepts the input of the reason for return. For example, there are a plurality of codes such as 1: damaged product (product deformation), 2: product deterioration (product discoloration), 3: package breakage, 4: size difference, 5: purchase error, 6: other A return reason code is available. When one of the code numbers is input from the numeric keypad 107b of the keyboard 107 and the confirmation key 107c is selected and operated, the return reason reception unit 52 receives the input of the code number.

  In addition, the return reason reception unit 52 may accept the return reason input by text input, handwriting input, voice input or the like in addition to the return reason code.

  The return reason reception unit 52 determines whether the received return reason is a return reason suitable as a return reason for the product received by the product information reception unit 51. In other words, the return reason reception unit 52 determines whether the return reason is appropriate based on the product information of the returned product read by the product information reception unit 51. When the product standard of the returned product is only one size, the above “4: Size difference” is inappropriate as the reason for the return. In such a case, the return reason reception unit 52 outputs an error because the return reason is inappropriate. Examples of the error output include display of an error message on the display device 106 and buzzer output by the audio output unit 165, but are not particularly limited. Thereby, an input error of the return reason code can be prevented.

  The imaging control unit 53 controls the imaging operation of the imaging unit 164 of the scanner 101. That is, the imaging control unit 53 outputs an ON signal to the imaging unit 164 to start an imaging operation. In addition, the imaging control unit 53 outputs an off signal to the imaging unit 164 to stop the imaging operation. In addition, the imaging control unit 53 images a product to be registered for return.

  Here, the reason for return may be due to a defect in the product or due to a customer error. Therefore, it is not efficient to leave evidence photographs for all returned products, and the data capacity is wasted. Therefore, in the present embodiment, imaging is limited to returned goods when the appearance of returned goods is different from that of normal goods. A normal product is a product that can be sold at a normal price without any apparent damage or defect.

  More specifically, the return reason reception unit 52 determines whether or not the return reason received as described above is the return reason for imaging. In the above example, for example, “1: damaged product (product deformation)”, “2: product alteration (product discoloration)”, and “3: packaging breakage” correspond to the return reason codes to be imaged. The imaging control unit 53 captures an image of the returned product when the return reason receiving unit 52 determines that the return reason code is an imaging target.

  The similarity calculation unit 54 refers to the PLU file F1 to what extent the returned product image captured by the imaging unit 164 and the reference image corresponding to the product code received by the product information receiving unit 51 are similar. A value (similarity) indicating whether or not is calculated.

  The method for calculating the similarity is not particularly limited. As an example, the similarity calculation unit 54 reads the color of the product, the uneven state of the surface, and the like as the feature amount from the reference image of each product registered in the PLU file F1. Further, the similarity calculation unit 54 calculates a feature amount for the image of the returned merchandise imaged by the imaging unit 164. Then, the similarity between the captured image of the returned merchandise and the reference image of the PLU file F1 is calculated by comparing both feature amounts.

  Here, when the operator takes an image of the returned product while holding it over the reading window 103, a captured image that supports the reason for the return may not be obtained. For example, there is a problem that the direction in which the returned product is held over the reading window 103 is inappropriate, or the color of the portion that has changed color due to the lighting condition cannot be captured properly. Therefore, the POS device 11 according to the present embodiment notifies the photographed image to retake the product image when no damage, discoloration, or alteration that confirms the reason for the return is recognized in the captured image.

  As a specific example, a description will be given of an example in which a threshold value of similarity to be returned is provided in advance. The similarity calculation unit 54 extracts an area in which the product is captured in the captured image (that is, an area excluding the background and the operator's hand). And the similarity calculation part 54 determines whether at least one part of the extracted product image becomes the similarity of return object.

  If at least a part of the product image includes an image region having a similarity lower than the threshold value, the similarity calculation unit 54 determines that the product image is an image obtained by capturing the return target product. On the other hand, when the similarity is equal to or greater than the threshold value in the entire region of the product image, the similarity calculation unit 54 determines that the product image does not include an image region that is the similarity to be returned.

  The determination method is not particularly limited as long as it has the same purpose as described above. For example, an allowable range of similarity is provided for discriminating non-returned standard products (ordinary products), and the similarity calculation unit 54 determines the return condition when the similarity is outside the allowable range. You may determine with satisfy | filling. Further, this determination may be made at the time of product identification by object recognition, and notification that the product is a return object may be made at the time of product registration.

  The display control unit 55 controls display processing on the display devices 23 and 106. For example, the display control unit 55 displays on the display device 106 of the scanner 101 a confirmation screen 106a (see FIG. 6) showing registration items related to the returned goods.

  FIG. 6 is a diagram illustrating an example of the confirmation screen 106a. As shown in FIG. 6, the confirmation screen 106 a includes the product information of the returned product received by the product information receiving unit 51, the return reason code received by the return reason receiving unit 52 or the return reason corresponding to the code, the imaging unit 164. The picked-up image 80 etc. of the product imaged by is displayed.

  In addition, when the similarity calculation unit 54 determines that the similarity of the captured image does not satisfy the return condition, the display control unit 55 causes the display device 106 to display an error message indicating that the returned product is to be imaged again. .

  FIG. 7 is a diagram illustrating a display example of an error message 106b that prompts re-imaging. Assume that the reason for return is “2: discoloration” as in the example of FIG. 7, but the similarity calculation unit 54 determines that the similarity is within the range of normal products and is not an image indicating the reason for return. In this case, the display control unit 55 pops up an error message 106b prompting re-imaging on the confirmation screen 106a.

  In the above description, the error message 106b is displayed on the display device 106 to notify the operator of the content, but the notification method is not limited to this. As another notification method, the POS device 11 may output the same notification content by the voice output unit 165 or may output a buzzer sound.

  The display control unit 55 may continuously display the captured images for each frame captured from the imaging unit 164 on the display device 106 as needed. In addition, the display control unit 55 may superimpose the image of the product captured by the imaging unit 164 and display a location where the similarity satisfies the return condition condition or a location where the return condition is not satisfied by surrounding the image with a frame. . If it does in this way, it can be checked in real time, holding up goods, whether a defective part of goods is contained in an imaging field, or a defective part is imaged appropriately.

  The return data management unit 56 functions as a recording unit. That is, the return data management unit 56 associates the product information of the returned product received by the product information receiving unit 51, the return reason code received by the return reason receiving unit 52, and the image of the returned product captured by the imaging unit 164. In addition, it is stored in the return data storage unit 64b.

  Note that the return data management unit 56 may store the similarity calculated by the similarity calculation unit 54 for the image area including the returned product in the return data storage unit 64b. The product image similarity need not be managed for all returns. Therefore, when the return reason received by the return reason reception unit 52 is a reason that the return product is returned because the appearance of the returned product is different from that of the normal product, the return data management unit 56 takes an image including the returned product. The similarity calculated by the similarity calculation unit 54 for the region may be stored in the return data storage unit 64b in association with the product information and the reason for the return.

  The print controller 57 prints a return slip (not shown) by the printer 66. The print contents of the return slip are not particularly limited, but the return date, product information, reason for return, return amount, information on the operator in charge, etc. are printed. Further, the print control unit 57 uses the printer 66 or another printer connected to the POS device 11 to print a return journal in which registration information of a plurality of returns is collectively printed. In the return journal, presence / absence of a captured image of the returned product, a file name of image data, or a captured image may be printed. When printing a captured image, a color image may be printed with a similarity.

  Next, the procedure of the return registration process executed by the POS device 11 will be described. FIG. 8 is a flowchart showing the procedure of the return registration process executed by the POS device 11.

  The merchandise information receiving unit 51 determines whether or not the return registration key 107a (see FIG. 2) on the keyboard 107 has been selected (step S1). While the return registration key 107a is not selected (step S1: No), the operation waits (step S1). When the return registration key 107a is selected and operated (step S1: Yes), the imaging control unit 53 outputs an ON signal to the imaging unit 164 to start imaging (step S2). The imaging unit 164 stores the captured image in the RAM 163. The merchandise information receiving unit 51 reads the merchandise code from the barcode image included in the captured image, and accepts the merchandise code as the merchandise code of the returned merchandise (step S3). Further, the product information receiving unit 51 reads product information corresponding to the product code from the PLU file F1. The imaging control unit 53 outputs an off signal to the imaging unit 164 and stops imaging (step S4).

  Next, the return reason reception unit 52 receives an input of the return reason code from the numeric keypad 107b (see FIG. 2) of the keyboard 107 (step S5). The return reason acceptance unit 52 determines whether or not the return reason code received in step S5 is suitable for the return reason of the product having the product code received in step S3 (step S6). If the return reason is inappropriate (step S6: No), the return reason reception unit 52 outputs an error (step S7). That is, a buzzer sound is output by the audio output unit 165 and an error message (not shown) is displayed on the display device 106. The error message is not particularly limited, but a message such as “Please select the return reason code again” can be used. Then, the return reason reception unit 52 receives the return reason code again (step S5). When the reason for return is appropriate (step S6: Yes), the reason for return reasoning unit 52 determines whether or not the reason for return is the return reason for imaging (step S8). If it is not the reason for return of the imaging target (step S8: No), the process proceeds to step S13.

  When it is the reason for returning the imaging target (step S8: Yes), the imaging control unit 53 outputs an ON signal to the imaging unit 164 to start imaging (step S9). The imaging unit 164 stores the captured image in the RAM 163. The display control unit 55 displays a confirmation screen 106a (see FIG. 6) on the display device 106 (step S10). The confirmation screen 106a includes a captured image 80 by the imaging unit 164, a product code of the returned product received in step S3, product information such as a product name and price, a return reason code received in step S5 or a return reason corresponding to the code. Etc. are displayed.

  The similarity calculation unit 54 determines whether or not the similarity of the image area including the product is the similarity to be returned (step S11). When the similarity is not the return target (step S11: No), the display control unit 55 displays the error message 106b (see FIG. 7) (step S12). When the reshoot button 106c is selected and operated, the imaging control unit 53 captures the product again, and the display control unit 55 updates and displays the confirmation screen 106a with the recaptured image (step S10). Thereafter, the determination process in step S11 is performed again. When the similarity calculation unit 54 determines that the similarity of the image area including the product is the similarity of the return target (step S11: Yes), the imaging control unit 53 outputs an off signal to the imaging unit 164, Imaging is stopped (step S13).

  Next, the merchandise information receiving unit 51 determines whether or not the add button 106d is selected on the confirmation screen 106a (see FIG. 6) (step S14). When the add button 106d is selected and operated (step S14: Yes), the process returns to step S2. If the add button 106d is not selected (step S14: No), it is determined whether or not the refund button 106e is selected on the confirmation screen 106a (step S15). If the refund button 106e is not selected (step S15: No), the process returns to step S14. When the refund button 106e is selected (step S15: Yes), the CPU 61 controls to open the drawer 21 (step S16). The operator takes out the refund amount displayed on the confirmation screen 106a from the drawer 21 and returns it to the customer.

  Next, the print control unit 57 prints the return slip (step S17). Further, the return data management unit 56 stores the product information temporarily stored in the work memory, the return reason code, the return amount, the captured image of the returned product, the similarity when the similarity is calculated, and the like. Information is stored in the return data storage unit 64b, and return registration is performed (step S18).

  Then, the return data management unit 56 determines whether or not a data output instruction has been received from the store computer SC (step S19). If there is no data output instruction (step S19: No), the process returns to step S1. If there is a data output instruction (step S19: Yes), the return data management unit 56 outputs the data stored in the return data storage unit 64b to the store computer SC (step S20). When the store computer SC already stores the return data that was backed up last time, the return data is updated. The return data management unit 56 may determine whether or not a predetermined time has come, and output data to the store computer SC when the predetermined time has come.

  In FIG. 8, the returned product is imaged in step S9, which is different from the product code imaging (step S2), but the imaging timing is not limited to this. When imaging is performed for code reading as shown in FIG. 8, if the image captured in step S <b> 2 satisfies the similarity condition of the return target, the image may be stored as it is as an image of the returned product.

  In the above description, the checkout system 1 is configured by the POS device 11 and the scanner 101, but the embodiment is not limited thereto. The above-described embodiment may be applied to a single device having the functions of the POS device 11 and the scanner 101. As an example, a self POS device may be used.

  Further, in the above description, the image of the returned product is captured when the return reason code is an imaging target. However, the determination criterion for the imaging target may be another determination criterion. For example, when fresh food is returned, all images are taken, and when the product classification is fresh food, the returned product may be taken. By determining the imaging target based on the product information in this way, the return data can be efficiently stored as described above.

  The program PR executed by the POS device 11 of the present embodiment is a file in an installable or executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), etc. It may be configured to be recorded on a computer-readable recording medium.

  Further, the program PR executed by the POS device 11 of the present embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Further, the program PR executed by the POS device 11 of the present embodiment may be provided or distributed via a network such as the Internet.

  In the above description, the POS device 11 performs processing such as code information reading processing and object recognition processing. However, the scanner 101 may perform these processing.

  As described above, the POS device 11 of the present embodiment captures an image of a returned product, and records the image, product information, and the reason for return in association with each other. Therefore, it is possible to provide a merchandise sales data processing apparatus and a program that can store a captured image indicating the state of the returned merchandise.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 1 ... Checkout system, 11 ... POS apparatus, 51 ... Merchandise information reception part, 52 ... Return reason reception part, 53 ... Imaging control part, 54 ... Similarity calculation part, 55 ... Display control part, 56 ... Return data management part 57 ... Print control unit, 60 ... Microcomputer, 64b ... Returned data storage unit, 80 ... Captured image, 101 ... Scanner, 103 ... Reading window, 106 ... Display device, 106a ... Confirmation screen, 106b ... Error message, 106c ... Re-photograph button, 106d ... add button, 106e ... refund button, 164 ... imaging unit, 165 ... audio output unit, 175 ... connection interface, F1 ... PLU file.

JP-A-5-101277

Claims (5)

Product information receiving means for receiving product information of returned products;
Return reason acceptance means for accepting the input of the reason for return,
Only when the reason for the return is a reason that the appearance of the returned product is a return due to a difference from the normal product, an imaging control unit that captures an image of the returned product by an imaging unit;
A calculation unit that calculates a value indicating how similar the captured image of the product imaged by the imaging unit and the reference image of the product corresponding to the product information received by the product information receiving unit;
Display control for displaying a place where the value satisfies a predetermined return condition or a place where the value does not satisfy the return condition, surrounded by a frame, overlaid on the image of the returned product imaged by the imaging means Means,
If the value does not become a predetermined return target value in any image area of the captured image of the product, it is assumed that the captured image does not include an area that captures the appearance that is the reason for the return. Informing means for re-imaging the returned goods; and
Product sales data processing device with The display control means displays the product information of the returned product, the reason for the return, and the image of the returned product, and the value is the value to be returned in any image area of the captured image of the product. If not turned to displays a message indicating that re-imaging the return merchandise, merchandise sales data processing apparatus according to claim 1. The display control means continuously displays captured images for each frame captured from the imaging means, and the value is the value to be returned on the continuously displayed captured images. and notifies the display image area, merchandise sales data processing apparatus according to claim 1 or 2.   The merchandise sales data processing apparatus according to claim 1, further comprising a print control unit that prints a file name of a captured image of the returned merchandise on a journal. A computer that controls the merchandise sales data processing device;
Product information receiving means for receiving product information of returned products;
Return reason acceptance means for accepting the input of the reason for return,
Only when the reason for the return is a reason that the appearance of the returned product is a return due to a difference from the normal product, an imaging control unit that captures an image of the returned product by an imaging unit;
A calculation unit that calculates a value indicating how similar the captured image of the product imaged by the imaging unit and the reference image of the product corresponding to the product information received by the product information receiving unit;
Display control for displaying a place where the value satisfies a predetermined return condition or a place where the value does not satisfy the return condition, surrounded by a frame, overlaid on the image of the returned product imaged by the imaging means Means,
If the value does not become a predetermined return target value in any image area of the captured image of the product, it is assumed that the captured image does not include an area that captures the appearance that is the reason for the return. Informing means for re-imaging the returned goods; and
Program to function as.

Images