JP6426905B2 - User information management system and user information management method - Google Patents

Description

  The present invention relates to a user information management system and a user information management method for managing information on a user of a sales apparatus that automatically performs sales processing.

  2. Description of the Related Art Conventionally, a sales apparatus that performs sales processing automatically is widely used. The sales apparatus includes an apparatus for selling articles such as beverages, an apparatus for selling services such as arcade games and public telephones, an apparatus for selling food tickets and tickets, and the like.

  Also, attach a camera to the sales device, estimate the user's attributes (sex, age, etc.) from the user's image taken by the camera, associate the user's attributes with the sold items, and analyze the user There are known techniques for utilizing for product development and planning (see, for example, Patent Documents 1 and 2).

  Furthermore, in addition to estimating individual attributes of users, there is also known a technology for identifying the number and configuration (numbers of couples, parents and children, etc.) of users, associating them with products sold, and utilizing them in product planning ( See, for example, Patent Document 3).

  As described above, by acquiring the attribute of the user who has purchased the product or the like from the sales apparatus and using it for marketing, it is possible to effectively replace the product.

Japanese Patent Application Laid-Open No. 7-262274 JP 2000-149105 A JP, 2004-543796, A

  However, in the prior art, although the attribute can be acquired for the user who has purchased the product, the information can not be obtained for the user who has not purchased the product, and the marketing effect is insufficient. There was a problem.

  Explaining this point concretely, the case where the user stands in front of the sales device and confirms the lineup of the products, and the case where it does not lead to the purchase indicates that the product expected by the user can not be provided. Although the information is very important in marketing, the conventional technology can not obtain such information.

  The present invention is intended to solve the problems of the prior art described above, and it is possible to obtain information on non-purchasers who did not purchase a product, and to use the user information management system and use that can be used for marketing etc. The purpose is to provide a person information management method.

To solve the above problems and achieve the object, the present invention provides a user information management system for managing information about the user of the row intends sales apparatus selling process, located in the vicinity of the vending machine human Personal information extraction means for extracting personal information of an object, sales history data acquisition means for acquiring sales history data indicating the history of sales processing by the sales apparatus, sales history data acquired by the sales history data acquisition means, and A user identification process in which the personal information extracted by the personal information extraction means is subjected to a matching process, the personal information corresponding to the sales process is identified as the purchaser data, and the personal information not corresponding to the sales process is identified as the non purchaser data and means, said user identification means, using said person information and the sales history data alone the user, duo, one of three or more groups Classified, it characterized that you include a classification result to the purchaser data or the non-buyer data.
Further, the present invention is a user information management system that manages information on a user of a sales apparatus that performs sales processing, and includes personal information extraction means for extracting personal information of a person located in the vicinity of the sales apparatus; Sales history data acquisition means for acquiring sales history data indicating the history of sales processing by the sales apparatus, sale history data acquired by the sales history data acquisition means and personal information extracted by the personal information extraction means And user identification means for identifying personal information corresponding to sales processing as purchaser data and identifying personal information that is not compatible with sales processing as non-purchaseer data; The personal information extracted by the personal information extraction unit from the image which is taken by a predetermined imaging device before the start of the sales processing and the user is approaching the sales device is used. And wherein the Rukoto.

Further, according to the present invention, in the above-mentioned invention, the user identification means is continuously imaged for a predetermined time or more by the predetermined imaging device from the end time of the sales processing of 1 to the start time of the next sales processing. It is characterized in that the above person is determined as a non-purchaser, and personal information of the person is used as the non-purchaser data.

  Further, the present invention is characterized in that, in the above-mentioned invention, when the sales processing is completed without completion, the user identification means identifies personal information corresponding to the sales processing as non-purchaser data. Do.

  Further, in the present invention according to the above-mentioned invention, the personal information extraction means estimates gender and age of a person, and the user identification means includes gender and age in the purchaser data and the non-purchaser data. It is characterized by

Further, the present invention provides a user information management method for managing information about the user's intends rows sales processing sales apparatus, personal information extraction step of extracting personal information of the person thereof, located in the vicinity of the vending machine A sales history data acquisition step of acquiring sales history data indicating a history of sales processing by the sales device; sales history data acquired in the sales history data acquisition step; and personal information extracted in the personal information extraction step and butt processing to identify personal information corresponding to the sales processing purchaser data, see contains a user identification step of identifying a person information to be sales processing and incompatible as non purchaser data, the user identification step Classifies the user into one of a group of two, a group of three, and a group of three or more, using the sales history data and the personal information. The features that you want to include in the purchaser data or the non-buyer data.
Further, the present invention is a user information management method for managing information on a user of a sales apparatus which performs sales processing, and a personal information extraction step of extracting personal information of a person located in the vicinity of the sales apparatus; A sales history data acquisition step for acquiring sales history data indicating a history of sales processing by the sales apparatus, sales history data acquired in the sales history data acquisition step, and personal information extracted in the personal information extraction step And a user identification step of identifying personal information corresponding to sales processing as purchaser data and identifying personal information that is not compatible with sales processing as non-purchaseer data, the user identification step comprising the steps of: The person information extraction step is performed from an image captured by a predetermined imaging device before the start of sales processing and the user is approaching the sales device. There is characterized by using the extracted personal information.

According to the present invention, to obtain information about the non-buyers did not buy the goods, it is possible to take advantage of the marketing and the like.

FIG. 1 is an explanatory diagram for describing a concept of acquisition of user information according to an embodiment. FIG. 2 is a diagram showing a system configuration of the user information management system. FIG. 3 is an explanatory diagram for describing user data held by the user data storage unit. FIG. 4 is an explanatory view for explaining the operation of the meal ticket vending machine and the image processing apparatus. FIG. 5 is a flowchart showing the processing procedure of the user identification unit. FIG. 6 is an explanatory view of a case where a single purchaser is identified. FIG. 7 is an explanatory diagram of a case where a pair of purchasers is identified. FIG. 8 is an explanatory diagram of a case of identifying a non-purchaser. FIG. 9 is an explanatory diagram of a case where a face image is not detected during sales processing.

  Hereinafter, preferred embodiments of a user information management system and a user information management method according to the present invention will be described in detail with reference to the accompanying drawings.

  First, the concept of acquisition of user information according to the present embodiment will be described. FIG. 1 is an explanatory diagram for describing a concept of acquisition of user information according to an embodiment. As shown in FIG. 1, the camera 10 is attached to the meal ticket vending machine 30, which is a meal ticket sales apparatus, and it is possible to approach the meal ticket vending machine 30 and capture an image of a user who operates.

  The food ticket vending machine 30 updates the sales history by correlating the sold item with the sales time when the food ticket sales process is performed according to the operation of the user. With this sales history, it is possible to manage how many products are sold at what time.

  Further, by performing image processing on the imaging data captured by the camera 10, information of a person is extracted from the imaging data. Specifically, pattern matching or the like is performed to detect a face image, and the detected face image is tracked over a plurality of frames. Such face tracking allows the user to approach the meal ticket vending machine 30, operate the meal ticket vending machine 30, and follow a series of actions from leaving to taking place in chronological order. Further, attributes such as the age and gender of the user can be estimated from the face image.

  If the sales history acquired in this manner and the imaging data are subjected to a matching process, information of a person corresponding to the sales process can be obtained as purchaser data. That is, the person whose face was tracked at the time when the sales process was performed is the purchased user, and the age and sex of this person are the information of the purchaser.

  Furthermore, as a result of the matching process, information of persons who do not correspond to the sales process can be obtained as non-purchasers data. That is, although it is approaching the meal ticket vending machine 30 as with the purchaser, there is no corresponding sales process, so it is indicated that the user has gone away without purchasing the product. And the age and sex of the person become the information of the non-buyer.

  As described above, the user information management system according to the present embodiment can obtain information on non-purchasers who did not purchase goods in addition to information on purchasers who have purchased goods, and can use it for marketing etc. .

  Next, the system configuration of the user information management system will be described. FIG. 2 is a diagram showing a system configuration of the user information management system. As shown in FIG. 2, a camera 10 is attached to the food ticket vending machine 30, and the camera 10 outputs imaging data to the image processing apparatus 20. The meal ticket vending machine 30 and the image processing apparatus 20 are communicably connected to the server 40, respectively.

  The image processing apparatus 20 internally includes a person detection unit 21, a personal attribute estimation unit 22, a time management unit 23, a person data storage unit 24, and a communication unit 25. The person detection unit 21 performs pattern matching or the like on the image in the imaging data to detect a face image, and performs face tracking in which the detected face image is tracked over a plurality of frames, whereby the person from the imaging data is detected. It is a processing unit that performs detection. When a plurality of persons are shown at the same time, the person detection unit 21 detects a plurality of persons respectively.

  The personal attribute estimation unit 22 estimates the age and gender of the person detected by the person detection unit 21. Then, using the time information acquired from the time management unit 23, the time in which the person is shown is associated with the personal attribute and stored in the person data storage unit 24.

  The time management unit 23 is a processing unit that manages time information and outputs the time information to the personal attribute estimation unit 22. Further, the time management unit 23 inquires of the meal ticket vending machine 30 about time information when the image processing apparatus 20 is activated, and synchronizes the time information.

  The person data storage unit 24 is a storage device including a hard disk drive, a non-volatile memory, and the like, and holds person data which is information about a person detected from imaging data. The communication unit 25 is a processing unit that transmits the person data accumulated in the person data accumulation unit 24 to the server 40.

  The food ticket vending machine 30 internally includes an input / output processing unit 31, a sales processing unit 32, a time management unit 33, a sales history storage unit 34, and a communication unit 35. The input / output processing unit 31 is a processing unit that performs input and output related to sales processing. Specifically, the product selection operation, acceptance of payment, acceptance of change, withdrawal of meal ticket, acceptance of cancellation operation, and the like are performed.

  The sales processing unit 32 is a processing unit that performs sales processing of food tickets according to the operation received by the input / output processing unit 31. The sales processing unit 32 specifies the start time and the end time of the sales process using the time information output by the time management unit 33, and transmits the specified time to the sales history storage unit 34 in association with the sold item. The start time of the sales process is the timing when the input / output processing unit 31 first receives an operation. For example, the earlier of the payment and the product selection is the start time of the sales process. The end time of the sales process is the timing when the sale is completed and the subsequent operation is not necessary. For example, the point in time at which the delivery of the meal ticket is made is the end time of the sales process. After the start of the sales processing, if the sales are not completed by the cancellation operation, the sales history is also left for the canceled sales processing.

  The time management unit 33 is a processing unit that manages time information and outputs the time information to the sales processing unit 32. In addition, the time management unit 33 responds to the inquiry from the image processing apparatus 20 as time information.

  The sales history storage unit 34 is a storage device including a hard disk drive, a non-volatile memory, and the like, and holds sales history. The communication unit 35 is a processing unit that transmits the sales history stored in the sales history storage unit 34 to the server 40.

  The server 40 includes a communication unit 41, a user identification unit 42, and a user data storage unit 43. The communication unit 41 receives person data from the image processing apparatus 20, and receives a sales history from the meal ticket vending machine 30.

  The user identification unit 42 collates the person data obtained from the imaging data and the sales history, generates purchaser data and non-purchaseer data, and stores the data in the user data storage unit 43. The user data storage unit 43 is a storage device including a hard disk drive, a non-volatile memory, etc., and holds purchaser data and non-purchaseer data. The buyer data and the non-purchaser data are referred to as user data.

  FIG. 3 is an explanatory diagram for explaining user data held by the user data storage unit 43. As shown in FIG. As shown in FIG. 3, the user data is data in which date and time, type, configuration, personal attribute, sales amount, and sales item are associated.

  The date indicates the date and time when the user used or tried to use the meal vending machine 30. The type indicates whether the data is purchaser data or non-purchaseer data. The configuration indicates whether the user is an individual, a pair, or a group of three or more. Here, the reason why the pair and the group are divided is to distinguish and treat the pair such as a couple and the group such as a family member in marketing. The personal attribute indicates the age and gender of the user. The sales amount indicates the sales of a product sold in sales processing, and the sales item indicates the type and number of products sold in sales processing.

  In the example shown in FIG. 3, the purchaser data of the date and time "2014/04/01 10:32" is registered, the configuration is "two-piece group", and the personal attribute is "male in thirties" and "male in twenties" The sales amount is "2300", and the item for sale is "two for main A4 and one for side B3". Note that "main" of the item for sale indicates that the menu is for ordering one item for one item, and the number of orders corresponds to the number of users. The "side" of the item for sale indicates that the menu is for ordering with the main item.

  Also, in the example shown in FIG. 3, the non-purchaser data of the date "2014/04/01 11:05" is registered, the configuration is "only", and the personal attribute is "male in twenties". It shows. Non-buyer data has no value for sales amounts and items sold, as there is no corresponding sales process.

  Furthermore, in the example shown in FIG. 3, the purchaser data of the date "2014/04/01 11:40" is registered, the configuration is "group", the personal attribute is "male in 40s" and "40s male" The figure shows that the sales amount is “4200” and the items to be sold include “four main A1”.

  Next, the operation of the meal ticket vending machine 30 and the image processing apparatus 20 will be described. FIG. 4 is an explanatory view for explaining the operation of the meal ticket vending machine 30 and the image processing apparatus 20. As shown in FIG. First, when the meal ticket vending machine 30 and the image processing apparatus 20 are powered on before the start of business hours, synchronization of time information is performed between the meal ticket vending machine 30 and the image processing apparatus 20.

  In synchronization of time information, first, the time management unit 23 of the image processing apparatus 20 inquires of the meal ticket vending machine 30 about time information. In response to the inquiry from the image processing device 20, the time management unit 33 of the meal ticket vending machine 30 transmits the time information of the own device. The time management unit 23 of the image processing apparatus 20 corrects the time information of the own apparatus in accordance with the time information received from the meal ticket vending machine 30. The inquiry and response of the time information are performed using, for example, FTP (File Transfer Protocol).

  During the subsequent business hours, the meal ticket vending machine 30 repeats the sales processing and accumulates the sales history. Similarly, the image processing apparatus 20 acquires imaging data from the camera 10, estimates personal attributes, and repeats processing of accumulating personal data.

  When the business hours end, the meal ticket vending machine 30 performs a closing process, and transmits the accumulated sales history to the server 40. Similarly, the image processing apparatus transmits the accumulated person data to the server 40. Here, the case where sales history and person data are collectively transmitted to the server 40 after the business hours end is shown, but transmission to the server 40 may be performed at predetermined time intervals, or may be performed as needed. Further, the meal ticket vending machine may collectively transmit the sales history for one day, and the image processing apparatus 20 may transmit at predetermined time intervals.

  Next, processing by the user identification unit 42 of the server 40 will be described. As a premise of the processing by the user identification unit 42, for a two-piece user, it is assumed that "two persons of interest are arranged at the angle of view of the camera 10". If sales processing is performed with two people lined up like this, even if it is a case where two persons were purchased in one sales processing, one for each in two sales processing. Even if the case is purchased, the age and gender are estimated as a pair.

  Further, with regard to the group, the condition is that the number of persons is purchased in one sales process, and the faces of all persons are captured at the time corresponding to the sales process. That is, when the number of detected face images is small with respect to the number of persons (the number of purchased mains) indicated in the sales process, the group is not identified. For example, the case may be the case where one of three families is seated first without buying a meal ticket, or the face is out of the angle of view of the camera 10. Then, even if a plurality of people are coming, if they are individually operated and purchased in different sales processes, they will not be distinguished from the group.

  FIG. 5 is a flowchart showing the processing procedure of the user identification unit 42. First, the user identification unit 42 determines whether the person data indicates that there is a person in front of the meal ticket vending machine 30 (step S101). As a result, if there is no person in front of the meal ticket vending machine 30 (step S101; No), the process is ended as it is.

  If there is a person in front of the food ticket vending machine 30 (step S101; Yes), the user identifying unit 42 determines whether or not sales processing exists at the corresponding time (step S102). If the sales process does not exist at the corresponding time (step S102; No), the user identification unit 42 identifies the person as a non-purchaser (step S110), and ends the process. If the sales process exists at the corresponding time (step S102; Yes), the user identification unit 42 determines whether cancellation has been performed after the start of the sales process (step S103). If the cancellation is performed after the start of the sales process (step S103; Yes), the user identification unit 42 identifies the person as a non-purchaser (step S110), and ends the process.

  If the sale is completed without canceling the sale process (Step S103; No), the user identification unit 42 determines whether the number of main dishes is "1" in the sale item of the sale process. (Step S104). If the number of main dishes of the item for sale is "1" (step S104; Yes), whether or not the person data indicates that two persons are lined up within T1 seconds from the start of the sales process It determines (step S105).

  If two persons are not lined up within T1 seconds from the start of the sales processing, that is, if it is indicated from the person data and the item for sale that the user is alone (step S105; No), use The person identification unit 42 identifies the user as a single purchaser (step S106), and ends the process.

  If the number of main dishes of the item for sale is not "1" (step S104; No), the user identification unit 42 determines whether the number of main dishes for the item for sale is "2" (step S107). ).

  When the number of main dishes of the item for sale is "2" (step S107; Yes), or when two persons are lined up within T1 seconds from the start of the sales process in step S105 (step S105; Yes), The user identification unit 42 identifies the user as a set of two buyers (step S108), and ends the process. Then, when the number of main dishes of the item for sale is "3 or more" (step S107; No), the user identifying unit 42 identifies the user as a purchaser of the group (step S109), and the process is ended. Do.

  Next, matching between person data and sales history will be specifically described. FIG. 6 is an explanatory view of a case where a single purchaser is identified. As shown in FIG. 6, if a face image is detected between T2 seconds before and T3 seconds after the start time of the sales process, the estimation result of the gender and age of the person is associated with the sales process. At this time, an inter-eye pixel, which is the number of pixels between the eyes of the face image, is calculated, and is used as a value corresponding to the distance between the person in the image and the food ticket vending machine 30.

  Specifically, if two face images having substantially the same inter-eye pixel number exist at the same time, it is determined that two persons are lined up at substantially the same distance from the meal ticket vending machine 30, and the main items for sale are Even if the number of dishes is "1", it identifies not as a single but as a pair of buyers.

  FIG. 7 is an explanatory diagram of a case where a pair of purchasers is identified. In FIG. 7 (a), two users each buy their own. That is, there are two consecutive sales processes where the number of main dishes is "1", and two face images exist simultaneously throughout the two sales processes, and the number of inter-eye pixels of the two face images is substantially the same. . In this case, the contents of the two sales processes are summarized, and purchaser data in which the age and sex of the two persons are associated is generated.

  In FIG. 7 (b), a user of two sets purchases for two persons at a time. That is, the sales process of the number of main dishes "2" is 1, two face images exist simultaneously, and the number of inter-eye pixels of the two face images is substantially the same. In this case, purchaser data in which the age and sex of two persons are associated with the contents of the sales process is generated.

  In FIG. 7B, when three or more face images exist simultaneously, two face images having a large number of inter-eye pixels are selected. In addition, when the number of main dishes in the sales process does not meet the number of face images, it is assumed that the age and gender of the shortage are unknown.

  FIG. 8 is an explanatory diagram of a case of identifying a non-purchaser. A person detected between the two sales processes and having no corresponding sales process is identified as a non-purchaser. Specifically, it is a face image detected after T4 seconds or more have elapsed from the end time of the previous sales process, which is continuously imaged for T5 seconds or more, and the next sales process after the face image is not displayed. It is a condition that T6 seconds or more have elapsed until the start time of. In addition, it is also a condition that it is different from the face image of the person corresponding to the sales processing before and after. Furthermore, it may be set as a condition that the number of inter-eye pixels is a predetermined value or more and imaging is continuously performed for T5 seconds or more.

  FIG. 9 is an explanatory diagram of a case where a face image is not detected during sales processing. When the height of the user is short, or depending on the standing position when the pair is lined up, the user may not fit within the angle of view of the camera 10. Even in this case, since the face image is associated from T2 seconds before the start time of the sales process, the age and gender estimated from the face image can be associated. That is, before the start of the sales process, the image at the time when the user is approaching the meal ticket vending machine 30 is used.

  As described above, in the embodiment, the person 10 in the vicinity of the food ticket vending machine 30 is imaged by the camera 10, the imaged imaging data is acquired, the information of the person is extracted by the image processing on the imaging data, and the meal ticket is sold. The sales history indicating the history of sales processing by machine 30 is collated with the personal information, the personal information corresponding to the sales processing is identified as the purchaser data, and the personal information not corresponding to the sales processing is the non-purchaseer data Identified as Therefore, in addition to the information on the purchaser who has purchased the item, the information on the non-purchaseer who has not purchased the item can be acquired and used for marketing and the like.

  In the above embodiment, the meal ticket vending machine 30 has been described as an example, but the present invention may be applied to any vending machine such as a beverage vending machine, a ticket vending machine such as a amusement facility of an amusement park, etc. it can. Alternatively, a camera may be installed in each of the plurality of vending apparatuses, and the purchaser data and the non-purchaser data may be identified based on the information obtained from the cameras corresponding to the plurality of vending apparatuses.

  In addition, although it is not a sales device, at the entrance gate of a play facility such as an amusement park, a person present near the gate is photographed with a camera, and the user actually passes the entrance gate and plays at the play facility or tries to pass By linking events such as whether the person has canceled, and the attributes of the person or group, it is possible to know which play facilities the person or group is interested in, which play facility, etc., and operates the facility Can also be used.

  Further, each configuration shown in the drawings is functionally schematic, and does not necessarily have to be physically configured as shown in the drawings. That is, the form of distribution and integration of each device is not limited to the illustrated one, and all or a part thereof is functionally or physically dispersed or integrated in any unit according to various loads, usage conditions, etc. It can be configured. For example, the functions of the image processing apparatus 20 and the server 40 may be realized by one apparatus. Also, the server 40 may be connected via any communication line.

  As described above, the user information management system and the user information management method according to the present invention are suitable for acquiring information on non-purchasers who did not purchase a product and utilizing it for marketing and the like.

DESCRIPTION OF SYMBOLS 10 Camera 20 Image processing apparatus 21 Person detection part 22 Personal attribute estimation part 23, 33 Time management part 24 Person data storage part 25, 35, 41 Communication part 30 Food ticket vending machine 31 Input-output processing part 32 Sales processing part 34 Sales history accumulation part Part 40 Server 42 User identification part 43 User data storage part

Claims (7)

The sales processing a user information management system for managing information about the user of the line intends vending machine,
And the person information extraction means for extracting personal information of the person thereof, located in the vicinity of the sales device,
Sales history data acquisition means for acquiring sales history data indicating a history of sales processing by the sales device;
The sales history data acquired by the sales history data acquisition means and the personal information extracted by the personal information extraction means are collated, the personal information corresponding to the sales process is identified as the purchaser data, and the sales process is not compatible User identification means for identifying the identified person information as non-purchaser data ;
The user identification means classifies the user into one of a group of two, a group of three or more, and a classification result based on the purchaser data or the non-user using the sales history data and the personal information. Include in Buyer Data
User information management system which is characterized a call.   A user information management system for managing information on users of sales devices that perform sales processing, comprising:
  Personal information extraction means for extracting personal information of a person located in the vicinity of the sales apparatus;
  Sales history data acquisition means for acquiring sales history data indicating a history of sales processing by the sales device;
  The sales history data acquired by the sales history data acquisition means and the personal information extracted by the personal information extraction means are collated, the personal information corresponding to the sales process is identified as the purchaser data, and the sales process is not compatible User identification means for identifying the identified personal information as non-purchaser data and
  Equipped with
  The user identification means uses person information extracted by the person information extraction means from an image in which the user is approaching the sales device, which is imaged by a predetermined imaging device before the start of the sales process.
  User information management system characterized in that. The user identification unit determines a person who has been imaged continuously for a predetermined time or more by the predetermined imaging device from the end time of one sales process to the start time of the next sales process as a non-purchaser. The user information management system according to claim 2 , wherein personal information of the person is the non-purchaser data. The said user identification means identifies the person information corresponding to the said sales processing as non-purchaser data, when the said sales processing is complete | finished and is complete | finished, It is characterized by the above-mentioned. user information management system according to One. The person information extracting means estimates the gender and age of the person, the user identification means, according to claim 1-4, characterized in the inclusion of gender and age on the purchaser data and the non-buyer data The user information management system described in any one. The sales processing a user information management method for managing information about the user of the line intends vending machine,
And the person information extraction step of extracting personal information of the person thereof, located in the vicinity of the sales device,
A sales history data acquisition step of acquiring sales history data indicating a history of sales processing by the sales device;
The sales history data acquired in the sales history data acquisition step is collated with the personal information extracted in the personal information extraction step, the personal information corresponding to the sales processing is identified as the purchaser data, and the sales processing is not compatible with the sales processing. the person information to be viewed including a user identification step of identifying as non-purchaser data,
The user identification step uses the sales history data and the personal information to classify the user into one of a group of two, a group of three or more, and a classification result of the purchaser data or the non-user. Include in Buyer Data
User information management wherein a call.   A user information management method for managing information on a user of a sales apparatus that performs sales processing, comprising:
  A personal information extraction step of extracting personal information of a person located in the vicinity of the sales apparatus;
  A sales history data acquisition step of acquiring sales history data indicating a history of sales processing by the sales device;
  The sales history data acquired in the sales history data acquisition step is collated with the personal information extracted in the personal information extraction step, the personal information corresponding to the sales processing is identified as the purchaser data, and the sales processing is not compatible with the sales processing. User identification step of identifying the identified person information as non-purchaser data and
  Including
  The user identification step uses the person information extracted by the person information extraction step from the image in which the user is approaching the sales device, which is imaged by a predetermined imaging device before the start of the sales process.
  User information management method characterized by

Images