WO2018042549A1 - Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme - Google Patents

Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme Download PDF

Info

Publication number
WO2018042549A1
WO2018042549A1 PCT/JP2016/075483 JP2016075483W WO2018042549A1 WO 2018042549 A1 WO2018042549 A1 WO 2018042549A1 JP 2016075483 W JP2016075483 W JP 2016075483W WO 2018042549 A1 WO2018042549 A1 WO 2018042549A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
information
store visit
information display
terminal
Prior art date
Application number
PCT/JP2016/075483
Other languages
English (en)
Japanese (ja)
Inventor
俊二 菅谷
Original Assignee
株式会社オプティム
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社オプティム filed Critical 株式会社オプティム
Priority to PCT/JP2016/075483 priority Critical patent/WO2018042549A1/fr
Publication of WO2018042549A1 publication Critical patent/WO2018042549A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions

Definitions

  • the present invention relates to a subject information display system, a subject information display method, and a program for managing the usage status of customers visiting or visiting various facilities such as restaurants, hotels, event venues, and stores.
  • a store visit status management system in which a customer's visit status is managed by capturing a face image of a customer passing through an entrance and analyzing the captured face image.
  • Patent Document 1 since the configuration of Patent Document 1 is only for managing the visit of a customer, it is difficult to grasp various personal information such as the name, age, and gender of the customer. For this reason, customers receive different services for each service provider, and it is difficult to reduce the difference in service provider capabilities.
  • An object of the present invention is to provide a subject information display system, a subject information display method, and a program capable of reducing a capability difference of a service provider by detecting and displaying attribute information and store visit information of a customer who is a subject.
  • the purpose is to provide.
  • the present invention provides the following solutions.
  • the invention according to the first feature is a captured image acquisition means for acquiring a captured image of a subject captured by a camera; Image analysis means for image analysis of the acquired captured image; Subject specifying means for specifying the subject based on the result of the image analysis; Attribute information detection means for detecting attribute information of the identified subject; Attribute information display means for displaying the detected attribute information on a terminal; Store visit information detecting means for detecting store visit information of the identified subject; Store visit information display means for displaying the detected store visit information on a terminal; An object information display system is provided.
  • a captured image of a subject captured by a camera is acquired, the acquired captured image is subjected to image analysis, and the subject is identified based on the image analysis result.
  • the attribute information of the identified subject is detected, the detected attribute information is displayed on the terminal, the store visit information of the identified subject is detected, and the detected store visit information is displayed on the terminal.
  • the invention according to the first feature is the category of the subject information display system, but the same operation and effect corresponding to the category are exhibited in other categories such as a method or a program.
  • the invention according to the second feature is a notification means for notifying the terminal when the identified subject is a regular customer or a customer of a first visit.
  • a subject information display system that is an invention according to a first feature is provided.
  • the subject information display system notifies the terminal when the specified subject is a regular customer or a first-time customer. .
  • the invention according to a third feature is a notification means for notifying the terminal when the identified subject is a suspicious person;
  • a subject information display system that is an invention according to a first feature is provided.
  • the subject information display system notifies the terminal when the specified subject is a suspicious person.
  • the invention according to a fourth feature provides a subject information display system according to the first feature, wherein the attribute information is an age and sex of the subject.
  • the attribute information is the age and sex of the subject.
  • the invention according to a fifth feature provides a subject information display system according to the first feature, wherein the store visit information is the number of visits to the subject and the store visit frequency.
  • the store visit information includes the number of visits to the subject and the store visit frequency.
  • the invention according to a sixth feature is subject information according to the fifth feature, wherein the store visit information display means displays the number of visits to the subject and the store visit frequency in a predetermined period in a graph. Provide a display system.
  • the subject information display system displays the number of visits and the visit frequency of the subject in a predetermined period in a graph.
  • the invention according to a seventh aspect includes a step of acquiring a captured image of a subject captured by a camera; Analyzing the acquired captured image; and Identifying the subject based on the image analysis results; Detecting attribute information of the identified subject; Displaying the detected attribute information on a terminal; Detecting store visit information of the identified subject; Displaying the detected store visit information on a terminal;
  • a subject information display method characterized by comprising:
  • the invention according to the eighth feature provides a subject information display system, Obtaining a captured image of a subject imaged by a camera; Image analysis of the acquired captured image; Identifying the subject based on the image analysis result; Detecting attribute information of the identified subject; Displaying the detected attribute information on a terminal; Detecting store visit information of the identified subject; Displaying the detected store visit information on a terminal; Provide a program to execute.
  • the present invention it is possible to provide a subject information display system, a subject information display method, and a program that can reduce the difference in ability of service providers.
  • FIG. 1 is a diagram showing an outline of the subject information display system 1.
  • FIG. 2 is an overall configuration diagram of the subject information display system 1.
  • FIG. 3 is a functional block diagram of the computer 10, the camera 100, and the terminal 200.
  • FIG. 4 is a flowchart of personal information registration processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. 5 is a flowchart illustrating personal information registration processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. 6 is a flowchart of subject information display processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. 7 is a diagram illustrating a flowchart of subject information display processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. 1 is a diagram showing an outline of the subject information display system 1.
  • FIG. 2 is an overall configuration diagram of the subject information display system 1.
  • FIG. 3 is a functional block diagram of the computer 10, the camera 100, and the terminal 200.
  • FIG. 4 is a flowchar
  • FIG. 8 is a diagram illustrating an example of a personal information input screen displayed on the terminal 200.
  • FIG. 9 is a diagram illustrating an example of a personal information input screen in a state where the terminal 200 accepts input of personal information.
  • FIG. 10 is a diagram illustrating an example of a subject information display screen displayed on the terminal 200.
  • FIG. 11 is a diagram illustrating an example of a subject information display screen displayed on the terminal 200.
  • FIG. 12 is a diagram illustrating an example of a subject information display screen displayed on the terminal 200.
  • FIG. 13 is a diagram illustrating an example of a subject information display screen displayed on the terminal 200.
  • FIG. 1 is a diagram for explaining an outline of a subject information display system 1 which is a preferred embodiment of the present invention.
  • the subject information display system 1 includes a computer 10, a camera 100, and a terminal 200.
  • the number of cameras 100 and terminals 200 is not limited to one and may be plural.
  • the computer 10 is not limited to an actual device, and may be a virtual device. Each process described below may be realized by any one or a combination of the computer 10, the camera 100, and the terminal 200.
  • the computer 10 is a computer device capable of data communication with the camera 100 and the terminal 200.
  • the camera 100 is an imaging device that can perform data communication with the computer 10 and capture a moving image, a still image, or the like of a customer as a subject.
  • the camera 100 is, for example, an imaging device provided in various portable terminals, or an imaging device provided in a wearable terminal such as a smart glass or a head-mounted display, in addition to a stationary or portable imaging device such as an NW camera or a surveillance camera. It is an imaging device provided in the apparatus and other articles.
  • the terminal 200 is a terminal device possessed by a service provider as a user and capable of data communication with the computer 10.
  • the terminal 200 is, for example, a mobile phone, a portable information terminal, a tablet terminal, a personal computer, an electronic product such as a netbook terminal, a slate terminal, an electronic book terminal, a portable music player, a smart glass, a head mounted display, or the like. Wearable terminals and other items.
  • the camera 100 captures a captured image of a visitor who is the subject (step S01).
  • the camera 100 captures an image when a customer comes to a predetermined place.
  • the camera 100 images one or more customers.
  • the camera 100 transmits captured image data, which is captured image data, to the computer 10 (step S02).
  • the computer 10 receives captured image data.
  • the computer 10 acquires captured images captured by the camera 100 by receiving captured image data from the camera 100.
  • the computer 10 analyzes the captured image data (step S03).
  • the computer 10 extracts the customer face image data included in the captured image data using a face recognition technique or the like.
  • the computer 10 transmits the extracted face image data to the terminal 200 as a result of the image analysis (step S04).
  • Terminal 200 receives face image data.
  • the terminal 200 displays a face image based on the face image data and accepts input of the customer's personal information (step S05).
  • Personal information refers to, for example, attribute information that indicates customer attributes such as customer name, age, gender, address, occupation, etc., and customer visit status such as the number of customer visits, store visit frequency, and visit date / time.
  • the store visit information may not be input by the terminal 200 but may be input by the computer 10 and the terminal 200 may display the information input by the computer 10.
  • the terminal 200 transmits the face image data and the personal information that has been accepted to the computer 10 (step S06). Note that the terminal 200 may transmit only personal information without transmitting the face image data.
  • the computer 10 receives face image data and personal information.
  • the computer 10 stores the face image data and the personal information in association with each other (step S07).
  • the subject information display system 1 stores the customer's face image and the customer's personal information in association with each other through the processes of steps S01 to S07.
  • the subject information display system 1 uses the stored face image and personal information in the processing after step S08 described later.
  • the camera 100 captures a captured image of the customer who visited the store (step S08). This process is the same process as step S01 described above.
  • the camera 100 transmits captured image data, which is captured image data, to the computer 10 (step S09).
  • the computer 10 receives captured image data.
  • the computer 10 acquires captured images captured by the camera 100 by receiving captured image data from the camera 100.
  • the computer 10 analyzes the captured image data (step S10).
  • the computer 10 extracts the customer face image data included in the captured image data using a face recognition technique or the like.
  • the computer 10 specifies the subject based on the result of the image analysis (step S11).
  • the computer 10 compares the face image data stored by itself with the face image data extracted this time, thereby extracting from the face image data storing the matching face image data and specifying the subject.
  • the computer 10 detects personal information associated with the identified subject (step S12).
  • the computer 10 detects the above-described attribute information and store visit information as personal information.
  • the computer 10 detects, for example, a name, age, sex, and address as attribute information.
  • the computer 10 detects, for example, the number of visits, the visit frequency, and the previous visit date as the store visit information.
  • the computer 10 transmits the face image data of the captured image captured by the camera 100 and the detected personal information to the terminal 200 (step S13).
  • Terminal 200 receives face image data and personal information.
  • the terminal 200 displays a face image based on the face image data and personal information (step S14).
  • the terminal 200 displays the above-described attribute information and store visit information as personal information.
  • the computer 10 sends a notification to that effect to the terminal 200, and the terminal 200 sends this notification in addition to the display contents described above. It may be displayed.
  • the computer 10 may transmit a notification to that effect to the terminal 200, and the terminal 200 may display this notification together with the face image.
  • the terminal 200 may display the number of visits to the subject and the visit frequency in a predetermined period in a graph based on the visit information.
  • FIG. 2 is a diagram showing a system configuration of a subject information display system 1 which is a preferred embodiment of the present invention.
  • the subject information display system 1 includes a computer 10, a camera 100, a terminal 200, and a public line network (Internet network, third and fourth generation communication network, etc.) 5. Note that the number of cameras 100 and terminals 200 is not limited to one and may be plural. Further, the computer 10 is not limited to a real device, and may be a virtual device. In addition, each process described below may be realized by any one or a combination of the computer 10, the camera 100, and the terminal 200.
  • the computer 10 is the above-described computer device having the functions described below.
  • the camera 100 is the above-described imaging device having the functions described below.
  • the terminal 200 is the above-described terminal device having the functions described later.
  • FIG. 3 is a functional block diagram of the computer 10, the camera 100, and the terminal 200.
  • the computer 10 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc. as the control unit 11, and a device for enabling communication with other devices as the communication unit 12.
  • a WiFi (Wireless Fidelity) compatible device compliant with IEEE 802.11 is provided.
  • the computer 10 also includes a data storage unit such as a hard disk, a semiconductor memory, a recording medium, or a memory card as the storage unit 13.
  • control unit 11 reads a predetermined program, thereby realizing the data transmission / reception module 20 and the data analysis module 21 in cooperation with the communication unit 12.
  • control unit 11 reads a predetermined program, thereby realizing the data detection module 30 and the data storage module 31 in cooperation with the storage unit 13.
  • the camera 100 includes a CPU, RAM, ROM, and the like as the control unit 110, and a WiFi compatible device for enabling communication with other devices as the communication unit 120.
  • the camera 100 includes an imaging device such as an imaging device or a lens as the imaging unit 140.
  • the control unit 110 when the control unit 110 reads a predetermined program, the data transmission / reception module 150 is realized in cooperation with the communication unit 120. In the camera 100, the control unit 110 reads a predetermined program, thereby realizing the imaging module 170 in cooperation with the imaging unit 140.
  • the terminal 200 includes a CPU, RAM, ROM, and the like as the control unit 210, and a WiFi compatible device for enabling communication with other devices as the communication unit 220. Further, the terminal 200 includes, as the input / output unit 240, a display unit that outputs and displays data and images controlled by the control unit 210, an input unit such as a touch panel, a keyboard, and a mouse that receives input from the user.
  • the control unit 210 when the control unit 210 reads a predetermined program, the data transmission / reception module 250 is realized in cooperation with the communication unit 220. In the terminal 200, the control unit 210 reads a predetermined program, thereby realizing the display module 270 and the input reception module 271 in cooperation with the input / output unit 240.
  • FIGS. 4 and 5 are flowcharts showing personal information registration processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. The processing executed by the modules of each device described above will be described together with this processing.
  • the subject information display system 1 will be described as executing this processing for visitors to various facilities, but the present invention can be applied to other than visitors.
  • the subject information display system 1 can also apply this processing to visitors such as events and tournaments.
  • the imaging module 170 captures a captured image of a visitor who is a subject (step S20).
  • the imaging module 170 captures a captured image when the customer has come to a predetermined location.
  • the predetermined place is, for example, a place where customers such as entrances, receptions, service counters, etc. visit the facility when visiting the facility.
  • the imaging module 170 images one or more customers as subjects.
  • the data transmission / reception module 150 transmits captured image data that is captured image data to the computer 10 (step S21).
  • the data transmission / reception module 150 transmits device-specific information for identifying the camera 100, such as its own location information, facility information, MAC address, and IP address, along with the captured image data.
  • the data transmission / reception module 20 receives captured image data.
  • the computer 10 acquires captured images by receiving captured image data from the camera 100.
  • the data analysis module 21 performs image analysis on the captured image data (step S22).
  • step S22 the data analysis module 21 extracts customer face image data included in the captured image data by image analysis.
  • the data analysis module 21 recognizes the customer face image data included in the captured image data by the face recognition technique, and extracts the recognized face image data.
  • each face image data of the plurality of customers is recognized, and each recognized face image data is extracted.
  • the data analysis module 21 may perform image analysis of the face image data by other methods.
  • the data detection module 30 determines whether or not the extracted face image data is already stored in the data storage module 31 (step S23).
  • step S23 the data detection module 30 compares the face image data stored in the data storage module 31 with the face image data extracted this time, and determines whether there is matching face image data. This determination is executed by comparing the feature value of each part between the stored face image data and the extracted face image data, and calculating the degree of coincidence indicating how much the amounts match. For example, if there is face image data with a matching degree of 90% or more, the data detection module 30 determines that it has already been stored. Note that the method of calculating the degree of coincidence can be changed as appropriate. Further, the value of the degree of coincidence for determining that they are coincident can be changed as appropriate.
  • step S23 If the data detection module 30 determines in step S23 that the data is stored (YES in step S23), the subject information display system 1 executes subject information display processing to be described later, but here, this processing ends. It will be explained as a thing.
  • step S23 if it is determined in step S23 that the data detection module 30 does not store the data (NO in step S23), the data transmission / reception module 20 transmits the extracted face image data to the terminal 200 (step S24).
  • step S ⁇ b> 24 the data transmission / reception module 20 specifies the terminal 200 arranged in this facility based on the device specific information, and transmits the face image data to the specified terminal 200.
  • the data transmission / reception module 20 transmits personal information input screen data which is data of the personal information input screen in addition to the face image data.
  • This personal information input screen is a screen for executing input of attribute information, which is information indicating attributes such as a customer's name, sex, age, occupation, and address.
  • attribute information which is information indicating attributes such as a customer's name, sex, age, occupation, and address.
  • the data transmission / reception module 20 transmits a first visit notification indicating that the customer is a first visit to the terminal 200.
  • the data transmission / reception module 250 receives face image data. Further, the data transmission / reception module 250 receives the personal information input screen data and the first store visit notification.
  • the display module 270 displays a personal information input screen for displaying a customer's face image, personal information input screen, and first store notification based on the face image data, personal information input screen data, and first store notification ( Step S25).
  • FIG. 8 is a diagram illustrating an example of a personal information input screen displayed by the display module 270.
  • the display module 270 displays a face image display area 300, an attribute information input area 310, a store visit information display region 320, and a first store visit notification 330 as personal information input screens.
  • the face image display area 300 displays a face image based on the face image data.
  • the display module 270 displays the first visit notification 330 while being superimposed on a part of the face image display area 300.
  • the first store visit notification 330 may be any configuration as long as it can notify the user that the customer of the face image is the first store visit. For example, notification by voice may be used.
  • the input receiving module 271 may receive a user input operation to the face image display area 300. For example, it may be possible to accept an input operation from a user for a face image, accept an input from a virtual keyboard or the like, or directly input a feature amount or other information about a customer's face or body.
  • Attribute information input area 310 accepts input of name, age, sex, and address as attribute information.
  • the display module 270 displays a virtual keyboard, and the input receiving module 271 receives an input to the virtual keyboard. , Accepts input of attribute information.
  • the attribute information displayed in the attribute information input area 310 is not limited to the information described above, other information may be displayed, and any of the information described above may be displayed. In this case, it is desirable to accept at least input of name, age, and gender.
  • the store visit information display area 320 displays the store visit information, store visit frequency, store visit frequency, and previous store visit date and time. In this embodiment, since this customer is the first visit, the number of visits is the first, the visit frequency is the first, and the previous visit date is none.
  • the store visit information display area 320 may not be displayed.
  • the store visit information display area 320 may receive input from the user and input store visit information in each item, similarly to the attribute information input area 310 described above.
  • the store visit information displayed in the store visit information display area 320 is not limited to the information described above, and other information may be displayed, or any of the information described above may be displayed. In this case, it is desirable to display at least the number of visits and the frequency of visits.
  • the display position, display contents, display form, display mode, and the like of the face image display area 300, the attribute information input area 310, the store visit information display area 320, and the first store visit notification 330 can be changed as appropriate.
  • the input reception module 271 receives input of personal information (step S26). In step S26, the input reception module 271 receives input of attribute information as personal information.
  • FIG. 9 is a diagram illustrating an example of a personal information input screen in a state where the input receiving module 271 receives input of personal information.
  • the same components as those in FIG. 8 described above are denoted by the same reference numerals, and detailed description thereof is omitted.
  • the display module 270 displays a face image display area 300, an attribute information input area 310, a store visit information display area 320, and a first store visit notification 330 as personal information input screens.
  • the display module 270 displays the received input content in each item of the attribute information input area 310.
  • FIG. 9 is a diagram illustrating an example of a personal information input screen in a state where the input receiving module 271 receives input of personal information.
  • the same components as those in FIG. 8 described above are denoted by the same reference numerals, and detailed description thereof is omitted.
  • the display module 270 displays a face image display area 300, an attribute information input area 310, a store visit information display area 320, and a first store
  • the display module 270 displays the input contents input in the items of name, age, sex, and address as attribute information. Note that the input receiving module 271 may not receive input of all attribute information displayed by the display module 270. For example, input to some items may not be performed.
  • the data transmission / reception module 250 transmits the input information received on the personal information input screen that has received the input to the computer 10 (step S27).
  • the data transmission / reception module 250 displays the contents input in the face image display area 300, the contents input in the personal information input area 310, the contents input in the store visit information display area 320, and other input contents. Is transmitted to the computer 10 as input information that has received the input.
  • the data transmission / reception module 250 also transmits date / time data indicating the date / time at this time to the computer 10 at the same time.
  • the data transmission / reception module 20 receives this input information and date / time data.
  • the data analysis module 21 analyzes the customer visit information based on the received date and time data and the visit information stored by itself (step S28).
  • the data analysis module 21 calculates the number of visits and the frequency of visits based on the store visit date and time and the current visit date and time of the stored store visit information.
  • the data storage module 31 stores face image data, input information, calculated store visit information, and date / time data in association with each other (step S29).
  • the above is the personal information registration process.
  • FIGS. 6 and 7 are flowcharts of subject information display processing executed by the computer 10, the camera 100, and the terminal 200.
  • FIG. 6 and 7 The processing executed by the modules of each device described above will be described together with this processing.
  • step S40 the imaging module 170 captures a captured image of the customer (step S40).
  • the process of step S40 is the same as the process of step S20 described above.
  • the data transmission / reception module 150 transmits the captured image data to the computer 10 (step S41).
  • the process of step S41 is the same as the process of step S21 described above.
  • the data transmission / reception module 20 receives captured image data.
  • the computer 10 acquires captured images by receiving captured image data from the camera 100.
  • the data analysis module 21 performs image analysis on the captured image data (step S42).
  • the process of step S42 is the same as the process of step S22 described above.
  • the data analysis module 21 determines whether or not a suspicious person is included in the captured image data based on the image analysis result (step S43).
  • step S43 the data analysis module 21 determines whether the face image data has been determined, whether the face image data matches the face image data registered in the wanted crime database, etc., whether the person is a behavior suspicious person, or the like. Based on the above, it is determined whether or not a suspicious person is included. For example, the data analysis module 21 determines that the customer is a suspicious person when the face image data recognizes a full-face helmet, an article or clothing that hides the face such as a balaclava, and the like. The data analysis module 21 determines that the customer is a suspicious person when the face image data matches the face image data of the wanted person.
  • the data analysis module 21 determines that the customer is a suspicious person when the movement of the customer is different from the normal movement of the customer. In addition, when the data analysis module 21 recognizes by image recognition that a part of the customer's image possesses an article or the like that is not suitable for this place, such as a weapon or blunt weapon, the customer is a suspicious person. Judge.
  • step S43 if the data analysis module 21 determines that a suspicious person is included (YES in step S43), the customer's face image data and a suspicious person notification are transmitted to the terminal 200 (step S44). Suspicious person notification is for notifying the user that this customer is a suspicious person.
  • step S43 determines in step S43 that no suspicious person is included (NO in step S43)
  • the data detection module 30 has already stored the extracted face image data in the data storage module 31. It is judged whether it is (step S45).
  • the process of step S45 is the same as the process of step S23 described above.
  • step S45 when the data detection module 30 determines that the data is not stored (NO in step S45), the subject information display system 1 executes the personal information registration process described above, but here, the process ends. It will be explained as a thing.
  • step S45 if it is determined in step S45 that the data detection module 30 stores the data (YES in step S45), the data detection module 30 identifies the subject based on the result of the image analysis (step S46).
  • step S46 the data detection module 30 compares the face image data stored by itself with the face image data extracted this time by using a face recognition technique or the like, extracts matching or similar face image data, and is a subject. Identify customers.
  • the data detection module 30 compares the facial image data to be stored with the feature quantities of each part of the extracted facial image data, and extracts facial image data that matches or is similar.
  • the data detection module 30 determines whether one customer has been identified (step S47). In step S47, the data detection module 30 determines whether or not there are a plurality of customers having a matching degree equal to or greater than a predetermined value. The data detection module 30 compares the feature amount of each part such as eyes, ears, nose, and mouth of the face image data extracted this time with the feature amount of each similar part of the stored face image data, and calculates the coincidence. It is determined whether or not the degree is a predetermined value, for example, 90% or more, 60% or more, or 50% or more.
  • step S47 when the data detection module 30 determines that one customer could not be identified (NO in step S47), the data detection module 30 detects personal information associated with each of the identified plurality of customers. (Step S48). In step S48, the data detection module 30 detects attribute information and store visit information associated with each face image data as personal information. In step S48, the data detection module 30 also detects the calculated degree of coincidence.
  • step S47 determines in step S47 that one customer has been identified (YES in step S47)
  • step S49 the data detection module 30 detects personal information associated with the identified customer (step S49).
  • step S49 the data detection module 30 detects attribute information and store visit information associated with the face image data as personal information.
  • the data detection module 30 determines whether or not the identified customer is a regular customer (step S50).
  • the data detection module 30 determines whether or not the customer is a regular customer based on the store visit information associated with the identified customer face image data. Being a regular customer means that the customer is more frequent than the general store visit frequency, or the second and subsequent visitor. This determination is based on whether the store visit frequency exceeds a predetermined number of times, for example, once a month or once in several weeks, or whether the number of store visits exceeds a predetermined number of times, for example, a plurality of times. Or, it is executed based on whether it is within a predetermined period, for example, one week or several days from the previous visit date.
  • step S50 when the data detection module 30 determines that the customer is not a regular customer (step S50 NO), the customer's face image data and personal information are transmitted to the terminal 200 (step S51).
  • step S51 when there are a plurality of customer face image data, the degree of coincidence of each face image data is also transmitted to the terminal 200.
  • step S50 if the data detection module 30 determines in step S50 that the customer is a regular customer (YES in step S50), the data transmission / reception module 20 sends the customer's face image data, personal information, and regular customer notification to the terminal. 200 (step S52).
  • the regular customer notification is for notifying the user that the customer is a regular customer.
  • step S52 when there are a plurality of customer face image data, the degree of coincidence of each face image data is also transmitted to the terminal 200.
  • the data transmission / reception module 250 receives face image data and personal information. In addition, when there is a matching degree, a suspicious person notification, or a regular customer notification, the data transmission / reception module 250 also receives the matching degree, a suspicious person notification, or a regular customer notification.
  • the display module 270 displays a subject information display screen based on the face image data and the personal information (step S53).
  • step S53 the display module 270 displays attribute information and store visit information as personal information. Further, the display module 270 displays a graph of the number of visits and the visit frequency of the customer in a predetermined period based on the visit information. Further, when a plurality of face image data exist, the display module 270 displays a plurality of persons on the subject information display screen based on the degree of coincidence between each face image data and personal information. Further, when there is a suspicious person notification, the display module 270 displays the suspicious person notification on the subject information display screen. Moreover, the display module 270 displays the regular customer notification on the subject information display screen when the regular customer notification exists.
  • FIG. 10 is a diagram illustrating an example of a subject information display screen displayed by the display module 270.
  • the display module 270 displays a face image display area 400, an attribute information display area 410, a store visit information display area 420, a store visit information graph display area 430, and a regular customer notice 440 as subject information display screens.
  • the face image display area 400 displays a face image based on the face image data.
  • the display module 270 displays a regular customer notification 440 so as to be superimposed on a part of the face image display area 400.
  • the shape, notification content, and display mode of the regular customer notification 440 can be changed as appropriate.
  • the regular customer notification 440 may be anything as long as it can notify the user that the customer of the face image is a regular customer. For example, notification by voice may be used.
  • Attribute information display area 410 displays name, age, sex, and address as attribute information. Note that the attribute information displayed in the attribute information display area 410 is not limited to the information described above, and other information may be displayed, or any of the information described above may be displayed. It is desirable to display at least name, age and gender.
  • the store visit information display area 420 displays the store visit information, store visit frequency, store visit frequency, and previous store visit date and time. This customer is a regular customer, the number of visits is the fifth, the visit frequency is once a month, and the previous visit date is July 7, 2016.
  • the store visit information displayed in the store visit information display area 420 is not limited to the information described above, and other information may be displayed, or any of the information described above may be displayed. It is desirable to display at least the number of visits and the frequency of visits.
  • the store visit information graph display area 430 displays the number of store visits and store visit frequency in a predetermined period as a graph.
  • the store visit information graph display area 430 displays a graph 450.
  • This graph 450 is displayed as a bar graph with the number of visits as the number of visits on the vertical axis and the visit frequency as the date and time on the horizontal axis.
  • the contents of the vertical axis and the horizontal axis of the graph 450 displayed in the store visit information graph display area 430 can be changed as appropriate, and the shape of the graph 450 is not limited to a bar graph, but other shapes such as a line graph and a pie graph. Can be appropriately changed.
  • FIG. 11 is a diagram illustrating an example of a subject information display screen displayed by the display module 270.
  • the display module 270 displays a face image display area 400, an attribute information display area 410, a store visit information display area 420, and a suspicious person notification 540 as a subject information display screen.
  • the face image display area 400 displays a face image based on the face image data.
  • the display module 270 displays the suspicious person notification 540 so as to be superimposed on a part of the face image display area 400.
  • the suspicious person notification 540 may be anything as long as it can notify the user that the customer of the face image is a suspicious person. For example, notification by voice may be used.
  • Attribute information display area 410 displays name, age, gender, and address as attribute information, but since this customer is a suspicious person, it is displayed as unknown in each item.
  • the attribute information display area 410 may not be displayed.
  • the store visit information display area 420 displays the store visit information, store visit frequency, store visit frequency, and the previous store visit date and time, since this customer is a suspicious person, it is displayed as unknown in each item.
  • the store visit information display area 420 may not be displayed.
  • FIG. 12 is a diagram illustrating an example of a subject information display screen displayed by the display module 270.
  • the display module 270 displays a face image display area 400, an attribute information display area 410, and a store visit information display area 420 as subject information display screens.
  • the face image display area 400 displays a face image based on the face image data.
  • the difference from FIG. 10 is that the regular customer notice 440 is not displayed in the face image display area 400.
  • Attribute information display area 410 displays name, age, sex, and address as attribute information, as in FIG. 10 described above.
  • the store visit information display area 420 displays the store visit information, store visit frequency, and store visit date and time as store visit information, as in FIG. 10 described above.
  • This customer is a regular customer who is not a regular customer.
  • the number of visits is the second, the visit frequency is once a year, and the previous visit date is July 7, 2015.
  • the display module 270 may display the store visit information graph display area 430 described above as a subject information display screen, as in FIG. 10 described above.
  • FIG. 13 is a diagram illustrating an example of a subject information display screen displayed by the display module 270.
  • the display module 270 displays a first candidate display area 600, a second candidate display area 610, and a third candidate display area 620.
  • a face image display area 400, an attribute information display area 410, and a store visit information display area 420 are displayed in each of the first candidate display area 600, the second candidate display area 610, and the third candidate display area 620.
  • the degree of coincidence is displayed by being superimposed on a part of each face image display area 400. If the customer is a regular customer, a regular customer notification 440 is displayed in a part of each face image display area 400.
  • the number of face image candidates is not limited to the number described above, but may be at least better or more than that. Moreover, you may display the store visit information graph display area 430 similarly to FIG. 10 mentioned above.
  • the face image and personal information of the customer with the highest degree of matching are displayed.
  • the face image and personal information of the customer with the second highest degree of coincidence are displayed.
  • the face image and personal information of the customer with the third highest match are displayed.
  • the display module 270 determines that the customer with the highest degree of coincidence is likely to be an actual customer. Therefore, the display module 270 performs notification to that effect by highlighting or voice notification. Also good.
  • the user can call this customer for the first time in a long time, guide to the customer's preferred seat, and analogize necessary services. It becomes. Since the face image and the personal information are displayed on the terminal 200, it is not necessary for the user to memorize the visit status of the customer, so that individual differences are less likely to occur when providing the service.
  • the means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program.
  • the program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, CD (CD-ROM, etc.), DVD (DVD-ROM, DVD-RAM, etc.).
  • the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it.
  • the program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Le problème décrit par la présente invention est de fournir un système d'affichage d'informations de sujet, et un procédé et un programme d'affichage d'informations de sujet, qui sont capables de réduire les différences dans les capacités de fournisseurs de service. Dans la présente invention, une image capturée d'un sujet capturé par une caméra est acquise, l'image capturée acquise est analysée par image, le sujet est spécifié sur la base du résultat analysé par image, des informations d'attribut du sujet spécifié sont détectées, les informations d'attribut détectées sont affichées sur un terminal, des informations de visite du sujet affiché sont détectées, et les informations de visite détectées sont affichées sur le terminal.
PCT/JP2016/075483 2016-08-31 2016-08-31 Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme WO2018042549A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/075483 WO2018042549A1 (fr) 2016-08-31 2016-08-31 Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/075483 WO2018042549A1 (fr) 2016-08-31 2016-08-31 Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme

Publications (1)

Publication Number Publication Date
WO2018042549A1 true WO2018042549A1 (fr) 2018-03-08

Family

ID=61300237

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/075483 WO2018042549A1 (fr) 2016-08-31 2016-08-31 Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme

Country Status (1)

Country Link
WO (1) WO2018042549A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020066444A1 (fr) * 2018-09-26 2020-04-02 日本電気株式会社 Dispositif d'enregistrement d'informations de client
WO2020066443A1 (fr) * 2018-09-26 2020-04-02 日本電気株式会社 Dispositif d'enregistrement d'informations de client

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005173763A (ja) * 2003-12-09 2005-06-30 Matsushita Electric Ind Co Ltd 顧客情報処理装置、顧客情報処理方法
JP2008003753A (ja) * 2006-06-21 2008-01-10 Hitachi Kokusai Electric Inc 情報収集システム
JP2008242931A (ja) * 2007-03-28 2008-10-09 Eye Medical System:Kk 顧客認識方法および顧客認識システム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005173763A (ja) * 2003-12-09 2005-06-30 Matsushita Electric Ind Co Ltd 顧客情報処理装置、顧客情報処理方法
JP2008003753A (ja) * 2006-06-21 2008-01-10 Hitachi Kokusai Electric Inc 情報収集システム
JP2008242931A (ja) * 2007-03-28 2008-10-09 Eye Medical System:Kk 顧客認識方法および顧客認識システム

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020066444A1 (fr) * 2018-09-26 2020-04-02 日本電気株式会社 Dispositif d'enregistrement d'informations de client
WO2020066443A1 (fr) * 2018-09-26 2020-04-02 日本電気株式会社 Dispositif d'enregistrement d'informations de client
JPWO2020066444A1 (ja) * 2018-09-26 2021-08-30 日本電気株式会社 顧客情報登録装置
JPWO2020066443A1 (ja) * 2018-09-26 2021-08-30 日本電気株式会社 顧客情報登録装置
JP7092205B2 (ja) 2018-09-26 2022-06-28 日本電気株式会社 顧客情報登録装置
JP7184089B2 (ja) 2018-09-26 2022-12-06 日本電気株式会社 顧客情報登録装置
US11830002B2 (en) 2018-09-26 2023-11-28 Nec Corporation Customer information registration apparatus
US11978068B2 (en) 2018-09-26 2024-05-07 Nec Corporation Customer information registration apparatus

Similar Documents

Publication Publication Date Title
KR102192882B1 (ko) 정산 방법, 입구 제어 방법 및 장치
WO2018015988A1 (fr) Système d'identification de portrait de personne, procédé d'identification de portrait de personne, et programme
CN104102927B (zh) 执行用户验证的显示设备及其方法
JP5740210B2 (ja) 顔画像検索システム、及び顔画像検索方法
JP6139364B2 (ja) 人物特定装置、人物特定方法及びプログラム
JP4991440B2 (ja) 商品販売装置、商品販売管理システム、商品販売管理方法およびプログラム
JP5780348B1 (ja) 情報提示プログラム及び情報処理装置
JPWO2011148884A1 (ja) コンテンツ出力装置、コンテンツ出力方法、コンテンツ出力プログラム、及びコンテンツ出力プログラムが記録された記録媒体
US20150088637A1 (en) Information processing system, information processing method, and non-transitory computer readable storage medium
JP2014191416A (ja) サービス利用者確認装置
JP2018005691A (ja) 情報処理システム、情報処理装置及び情報処理方法
JP2014160394A (ja) サービス提供システム
CN110533440A (zh) 一种基于视频摄像头的互联网广告信息投放应用方法
JP5423740B2 (ja) 映像提供装置、映像利用装置、映像提供システム、映像提供方法、および、コンピュータ・プログラム
WO2018042549A1 (fr) Système d'affichage d'informations de sujet, procédé d'affichage d'informations de sujet et programme
JP5192842B2 (ja) 注視商品データ取得方法および商品販売管理システム
JP2019028559A (ja) 作業分析装置、作業分析方法及びプログラム
US20200005199A1 (en) Vacancy management system, vacancy management method, and program
US20230169506A1 (en) Store system, information processing apparatus, and information processing method
JP2019079127A (ja) 顧客管理プログラム、容器、特徴抽出プログラム、顧客管理方法、特徴抽出方法および情報処理装置
JP7237871B2 (ja) 対象検出方法
JP2017010581A (ja) コンピュータ装置、サービス提供システム、サービス提供方法およびプログラム
JP2017167983A (ja) 出力制御プログラム、出力制御方法及び出力制御装置
US20220269890A1 (en) Method and system for visual analysis and assessment of customer interaction at a scene
JP5108635B2 (ja) 商品販売装置、商品販売管理システム、顧客視線データ取得方法および顧客注視商品データ取得方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16915110

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.06.2019)

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 16915110

Country of ref document: EP

Kind code of ref document: A1