WO2021205875A1 - 店舗システム、処理方法及びプログラム - Google Patents

店舗システム、処理方法及びプログラム Download PDF

Info

Publication number
WO2021205875A1
WO2021205875A1 PCT/JP2021/012195 JP2021012195W WO2021205875A1 WO 2021205875 A1 WO2021205875 A1 WO 2021205875A1 JP 2021012195 W JP2021012195 W JP 2021012195W WO 2021205875 A1 WO2021205875 A1 WO 2021205875A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
entrance
store
person
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/012195
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
悦 程
充敬 森崎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to JP2022514386A priority Critical patent/JP7586170B2/ja
Priority to US17/914,832 priority patent/US20230120970A1/en
Publication of WO2021205875A1 publication Critical patent/WO2021205875A1/ja
Anticipated expiration legal-status Critical
Priority to JP2024186495A priority patent/JP7790517B2/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/50—Maintenance of biometric data or enrolment thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/186—Video door telephones

Definitions

  • the present invention relates to a store system, a processing method and a program.
  • Non-Patent Document 1 discloses a system used in an unmanned store, which enables a person to enter the store by taking a picture of his / her face at the entrance.
  • Patent Document 1 analyzes an image taken so as to include a user operating a kiosk terminal and a person behind it, and when a suspicious person is detected, generates an image to which information for identifying the user and the suspicious person is added. , Discloses a technique for displaying the image on an operator terminal for an operator resident in a call center or the like.
  • Patent Document 2 discloses a technique for controlling admission by face recognition.
  • Patent Document 3 discloses a technique for displaying a processed image obtained by processing a captured image without displaying the captured image as it is in the preview display.
  • Unmanned stores and labor-saving stores require technology to identify who has entered the store in order to ensure safe transactions.
  • a technique that requires facial photography as a condition for entering the store such as the technique disclosed in Non-Patent Document 1
  • the person who entered the store can be identified by the photograph of the person who entered the store.
  • some people are reluctant to take a face shot when entering the store. For this reason, if face photography is a condition for entering the store, the number of store users may decrease.
  • Patent Documents 1 to 3 and Non-Patent Document 1 disclose the subject.
  • An object of the present invention is to suppress a decrease in the number of store users due to the condition of entering the store by taking a face.
  • An acquisition method for acquiring an entrance image generated by a camera installed at the store entrance A detection means for detecting a person's face in the entrance image, A processing means for generating a processed image obtained by processing the entrance image in which a person's face is detected, and A display control means for displaying the processed image on the display means, A means for determining whether or not the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined shooting timing.
  • the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered.
  • the computer Acquire the entrance image generated by the camera installed at the store entrance and A person's face is detected in the entrance image, A processed image obtained by processing the entrance image in which a person's face is detected is generated.
  • the processed image is displayed on the display means, and the processed image is displayed. It is determined whether the entrance image before processing of the processed image displayed by the display means satisfies the predetermined condition at a predetermined shooting timing. When the predetermined condition is satisfied, the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered.
  • a processing method is provided.
  • Computer Acquisition means to acquire the entrance image generated by the camera installed at the store entrance, A detection means for detecting a person's face in the entrance image, A processing means for generating a processed image obtained by processing the entrance image in which a person's face is detected, A display control means for displaying the processed image on the display means, A means for determining whether or not the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined shooting timing. When the predetermined condition is satisfied, the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered. Processing means, A program is provided that functions as.
  • the decrease in the number of store users due to the condition of entering the store is suppressed.
  • FIG. 1 shows a store entry control device 20, a controller 30, a camera 40, and a display device 50.
  • the store system has at least a controller 30.
  • the store system may further include at least one of the store entry control device 20, the camera 40, and the display device 50.
  • the controller 30, the store entry control device 20, the camera 40, and the display device 50 are each connected by wire and / or wirelessly so that they can communicate with each other.
  • the store entry control device 20, the camera 40, and the display device 50 are installed at the entrance of the store.
  • the store entry control device 20 is a device that controls entry into a store, and examples thereof include gates and automatic doors.
  • the camera 40 is installed to photograph the face of the visitor.
  • the display device 50 displays the image generated by the camera 40 so that the visitor can view it.
  • entering a store means passing through the store entry control device 20 and entering the store.
  • Visit means to come to the store, and does not indicate whether or not the person has entered the store.
  • the visitor performs the work of having the camera 40 take a picture of his / her face before entering the store. Specifically, first, the visitor positions his / her face in front of the camera 40, then browses the image displayed by the display device 50, and adjusts the position and facial expression of his / her face. At this time, the controller 30 does not display the image generated by the camera 40 on the display device 50 as it is, but displays the processed image after processing the image on the display device 50. In this way, during the shooting work for entering the store, not the image itself of the photographed face of the visitor but the processed image obtained by processing the image is displayed so that the visitor can view the processed image. While enjoying the images, you can take pictures to enter the store.
  • the controller 30 puts the entrance control device 20 into a state where the store can be entered.
  • the gate entity control device 20
  • the automatic door entity control device 20
  • the functional unit included in the store system of the present embodiment is a CPU (Central Processing Unit) of an arbitrary computer, a memory, a program loaded into the memory, and a storage unit such as a hard disk for storing the program (from the stage of shipping the device in advance).
  • a storage unit such as a hard disk for storing the program (from the stage of shipping the device in advance).
  • it can also store programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet), and any combination of hardware and software centered on the network connection interface. Realized by. And, it is understood by those skilled in the art that there are various modifications of the realization method and the device.
  • FIG. 2 is a block diagram illustrating the hardware configuration of the store system of the present embodiment.
  • the store system includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A.
  • the peripheral circuit 4A includes various modules.
  • the peripheral circuit 4A does not have to be provided.
  • the store system may be composed of one physically and / or logically integrated device, or may be composed of a plurality of physically and / or logically separated devices. When composed of a plurality of physically and / or logically separated devices, each of the plurality of devices can be provided with the above hardware configuration.
  • the bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to send and receive data to and from each other.
  • the processor 1A is, for example, an arithmetic processing unit such as a CPU or a GPU (Graphics Processing Unit).
  • the memory 2A is, for example, a memory such as a RAM (RandomAccessMemory) or a ROM (ReadOnlyMemory).
  • the input / output interface 3A is an interface for acquiring information from an input device, an external device, an external server, an external sensor, a store entry control device 20, a camera 40, a display device 50, etc., an output device, an external device, an external server, and the like.
  • the input device is, for example, a keyboard, a mouse, a microphone, a touch panel, a physical button, a camera, or the like.
  • the output device is, for example, a display, a speaker, a printer, a mailer, or the like.
  • the processor 1A can issue commands to each module and perform calculations based on the calculation results thereof.
  • FIG. 3 shows an example of a functional block diagram of the store system 10.
  • the store system 10 includes an acquisition unit 11, a detection unit 12, a processing unit 13, a display control unit 14, a determination unit 15, a processing unit 16, and a storage unit 17.
  • the acquisition unit 11 acquires an image (hereinafter referred to as "entrance image") generated by the camera 40 installed at the store entrance.
  • the acquisition unit 11 acquires an entrance image from the camera 40 by real-time processing.
  • the detection unit 12 detects the face of a person in the entrance image. Since "a technique for detecting a person's face in an image" is widely known, the description thereof is omitted here.
  • the processing unit 13 generates a processed image obtained by processing the entrance image in which the face of a person is detected.
  • the processing unit 13 may or may not execute the processing process on the entrance image in which the face of the person is not detected. However, there is a high possibility that no one will view the entrance image in which the face of the person is not detected. By omitting the processing process for such an entrance image, the processing load of the processing unit 13 can be reduced.
  • the content of processing is various.
  • the face portion of a person in the image may be processed.
  • the processing may be performed so that the feature amount extracted from the face of the person included in the entrance image and the feature amount extracted from the face of the person included in the processed image do not match.
  • the size of a person's eyes changes due to processing.
  • background part human body part, etc.
  • a process of superimposing a frame, decoration, etc. on the background portion may be performed, a process of superimposing a predetermined clothing (tuxedo, dress, etc.) on the body part of the person may be performed, or other processing. May be done.
  • the display control unit 14 causes the display device 50 (display means) to display the processed image generated by the processing unit 13.
  • the display device 50 displays the processed image so that a visitor (a visitor photographed by the camera 40) who is performing a shooting operation for entering the store in front of the camera 40 can view the processed image.
  • the display device 50 may be a display installed in a position and orientation that can be viewed by a visitor who is performing a shooting operation for entering the store in front of the camera 40.
  • the display device 50 may be a projection device that projects information at a position that can be viewed by a visitor who is performing a shooting operation for entering the store in front of the camera 40.
  • the determination unit 15 determines whether the unprocessed entrance image of the processed image displayed by the display device 50 at a predetermined shooting timing satisfies the predetermined condition.
  • the predetermined shooting timing may be the timing when the visitor inputs the shooting instruction.
  • the visitor inputs a shooting instruction via an arbitrary input device such as a touch panel, a physical button, a microphone, a mouse, and a keyboard.
  • the predetermined shooting timing may be a timing at which a predetermined time has elapsed from a predetermined reference time point.
  • the predetermined reference time point may be, for example, the timing when a visitor detects that the visitor has approached the camera 40 with a motion sensor, a camera, or the like, or the processed image obtained by processing the entrance image including the visitor's face. It may be the timing when the display (display by the display device 50) is started, or it may be other than that.
  • the determination unit 15 When the determination unit 15 detects the arrival of a predetermined shooting timing, it identifies the processed image displayed by the display device 50 at that time, and then acquires the entrance image of the specified processed image before processing. For example, the entrance image acquired by the acquisition unit 11 and the processed image generated by the processing unit 13 may be temporarily stored in the storage unit 17 in association with each other. Then, the determination unit 15 may acquire the entrance image associated with the specified processed image from the entrance image stored in the storage unit 17. In addition, the determination unit 15 may acquire the entrance image of the specified processed image before processing by performing processing to return the processed image to the entrance image.
  • the determination unit 15 determines whether the acquired entrance image satisfies a predetermined condition.
  • the predetermined condition is "the content of the entrance image is content that can identify an individual", for example, “the predetermined feature amount of the person's face can be extracted", “the predetermined condition of the person's face”.
  • the parts eyes, nose, mouth, etc.
  • the processing unit 16 registers the entrance image determined to satisfy the predetermined condition in the store entrant information stored in the storage unit 17, and sets the store entry control device 20. Make it possible to enter the store.
  • FIG. 5 schematically shows an example of store occupant information.
  • the entrant identification information for identifying the entrants and the information (file name, etc.) for identifying the entrance image determined to satisfy a predetermined condition are registered in association with each other. ..
  • the store clerk information makes it possible to identify the store clerk.
  • the processed image displayed at the shooting timing is saved, and the image before processing is not saved.
  • the store system 10 whose main purpose is to acquire information (face image) for identifying a store entrant and which generates and displays a processed image in order to reduce resistance to shooting is displayed at the shooting timing. Save the unprocessed image of the processed image.
  • the technique of processing an image for the main purpose of providing entertainment and displaying it so that it can be viewed is different from the store system 10.
  • the store entry control device 20 is a device that controls entry into a store, for example, a gate or an automatic door.
  • Store entry control device 120 the first state (gate or door is open) that allows passage (entrance to the store) and the second state (gate or door) that refuses passage (entrance to the store) The door is closed). Then, the store entry control device 20 executes an operation of transitioning between the first state and the second state based on the control signal (electric signal) transmitted by the processing unit 16.
  • the processing unit 16 transmits a control signal in the first state to the store entry control device 20.
  • the store entry control device 20 is in the first state based on the control signal.
  • the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S10).
  • the acquisition unit 11 acquires an entrance image from the camera 40 by real-time processing.
  • the camera 40 may constantly generate an image.
  • the camera 40 may execute image generation while the motion sensor or the like detects that a person is at a predetermined position in front of the camera 40.
  • the detection unit 12 detects the face of the person in the entrance image (S11).
  • the process returns to S10 and the same process is repeated.
  • the processing unit 13 processes the entrance image to generate a processed image (S12). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S13).
  • the display control unit 14 may display the live image (an image that does not include the face of a person) acquired by the acquisition unit 11 from the camera 40 on the display device 50.
  • Other information may be displayed or nothing may be displayed.
  • the predetermined shooting timing may be the timing at which the visitor inputs the shooting instruction, the timing at which a predetermined time has elapsed from the predetermined reference time, or any other timing.
  • the determination unit 15 identifies the processed image displayed by the display device 50 at that time, and then acquires the unprocessed entrance image of the specified processed image (Yes). S15). Then, the determination unit 15 determines whether the acquired entrance image satisfies a predetermined condition.
  • the predetermined condition is "the content of the entrance image is such that the content can identify an individual", for example, “the predetermined feature amount of the face of the person can be extracted", “the person”. The predetermined parts (eyes, nose, mouth, etc.) of the face can be extracted.
  • the process returns to S10 and the same process is repeated.
  • the store system 10 may display an error message such as "The face image could not be taken correctly. Please take a picture again.” On the display device 50.
  • the processing unit 16 when the acquired entrance image satisfies a predetermined condition (Yes in S16), the processing unit 16 newly registers the acquired entrance image in the store entrant information stored in the storage unit 17 (S17). Next, the processing unit 16 controls to bring the store entry control device 20 into a store-accessible state (a state in which the gate and the door are open) (S18).
  • the store system 10 of the present embodiment processes the image of the visitor's face, not the image itself, while the visitor is performing the work of photographing the face before entering the store. Display the processed image so that the visitor can view it. According to such a store system 10, the visitor can perform the shooting work for entering the store while enjoying the processed image. Therefore, it is possible to reduce the resistance of the visitor to the shooting work. As a result, the decrease in the number of store users due to the condition of entering the store is suppressed.
  • the store system 10 may process the image so that the feature amount extracted from the face of the person included in the entrance image and the feature amount extracted from the face of the person included in the processed image do not match. can. By processing the face of a person in this way, viewing the processed image becomes more enjoyable. As a result, it is possible to further reduce the resistance of the visitor to the shooting work before entering the store.
  • the store system 10 of the present embodiment is different from the first embodiment in that it has a function of storing the processed image displayed at the shooting timing and providing the processed image to the customer.
  • the processing unit 16 stores the processed image displayed by the display device 50 in the storage unit 17 at a predetermined shooting timing, and executes a process of providing the processed image to the visitor. That is, the processing unit 16 of the present embodiment stores both the “processed image displayed by the display device 50 at a predetermined shooting timing” and the “entrance image of the processed image before processing” in the storage unit 17. Let me.
  • the processing unit 16 provides the visitor with storage location information (URL or the like) of the processed image.
  • the processing unit 16 may create a code (two-dimensional code or the like) indicating the storage location information and display it on the display device 50.
  • the visitor can acquire the storage location information by operating his / her own user terminal and performing an operation of reading the code.
  • the processing unit 16 transmits the storage location information to the user terminal by short-range wireless communication in response to the operation of the visitor holding the user terminal (smartphone, smart watch, tablet terminal, mobile phone, etc.) at a predetermined position. You may.
  • the visitor After acquiring the storage location information, the visitor operates his / her own user terminal to access the storage location indicated by the storage location information and acquires the processed image.
  • the processing unit 16 accepts the input of the customer identification information and provides the processed image to the customer identified by the customer identification information.
  • the customer identification information and the e-mail address may be linked and registered in the center server in advance. Then, the processing unit 16 may transmit the processed image or the above-mentioned storage location information to the e-mail address associated with the input customer identification information.
  • processing unit 16 may provide the processed image and the above-mentioned storage location information on the My Page (the page after login using the customer identification information) of the application or the homepage.
  • the processing unit 16 may accept an input from the visitor as to whether or not he / she wants to acquire the processed image at an arbitrary timing while performing the shooting work for entering the store. Then, when the input to the effect that it is desired is accepted, the processed image is saved and provided to the visitor, and when the input to the effect that it is not desired is accepted, these processes are not executed. good.
  • the processing unit 16 deletes the entrance image and the processed image stored in the storage unit 17 from the storage unit 17 at a predetermined timing. As a result, privacy protection and the like are realized.
  • the timing of deleting each is different due to the difference in the purpose of saving the processed image and saving the entrance image. Specifically, the timing of deleting the processed image is earlier than the timing of deleting the entrance image.
  • the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S20).
  • the acquisition unit 11 acquires an entrance image from the camera 40 by real-time processing.
  • the camera 40 may constantly generate an image.
  • the camera 40 may execute image generation while the motion sensor or the like detects that a person is at a predetermined position in front of the camera 40.
  • the detection unit 12 detects the face of the person in the entrance image (S21).
  • the process returns to S20 and the same process is repeated.
  • the processing unit 13 processes the entrance image to generate a processed image (S22). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S23).
  • the display control unit 14 may display the live image (an image that does not include the face of a person) acquired by the acquisition unit 11 from the camera 40 on the display device 50.
  • Other information may be displayed or nothing may be displayed.
  • the predetermined shooting timing may be the timing at which the visitor inputs the shooting instruction, the timing at which a predetermined time has elapsed from the predetermined reference time, or any other timing.
  • the determination unit 15 identifies the processed image displayed by the display device 50 at that time, and then acquires the unprocessed entrance image of the specified processed image (Yes). S25). Then, the determination unit 15 determines whether the acquired entrance image satisfies a predetermined condition.
  • the predetermined condition is "the content of the entrance image is such that the content can identify an individual", for example, “the predetermined feature amount of the face of the person can be extracted", “the person”. The predetermined parts (eyes, nose, mouth, etc.) of the face can be extracted.
  • the process returns to S20 and the same process is repeated.
  • the store system 10 may display an error message such as "The face image could not be taken correctly. Please take a picture again.” On the display device 50.
  • the processing unit 16 when the acquired entrance image satisfies a predetermined condition (Yes in S26), the processing unit 16 newly registers the acquired entrance image in the store entrant information stored in the storage unit 17 (S27). Further, the processing unit 16 saves the processed image displayed by the display device 50 at a predetermined shooting timing, and executes a process of providing the processed image to the customer (S28).
  • An example of the process of providing the processed image to the customer is as described above.
  • the processing unit 16 may accept an input from the visitor as to whether or not he / she wants to acquire the processed image at an arbitrary timing while performing the shooting work for entering the store. Then, it is not necessary to execute the process of S28 when the input to the effect that it is desired is received, and not to execute the process of S28 when the input to the effect that it is not desired is received.
  • the processing unit 16 controls the store entry control device 20 so that it can enter the store (the gate and the door are open) (S29).
  • the same effects as those of the first embodiment are realized. Further, according to the store system 10 of the present embodiment, the processed image can be stored and provided to the visitor. As a result, visitors can look forward to the shooting work before entering the store. As a result, the resistance to the shooting work before entering the store can be further reduced.
  • the store system 10 of the present embodiment is different from the first and second embodiments in that the person attribute is estimated based on the face image included in the entrance image and the entrance image is processed by a method according to the estimation result.
  • the processing unit 13 estimates the person attribute based on the face of the person detected in the entrance image. For example, the processing unit 13 estimates any attribute among the attributes that can be estimated from the face image, such as gender, age, and nationality.
  • the processing unit 13 processes the entrance image by a method according to the estimation result (personal attribute).
  • a processing method is defined in advance for each person attribute.
  • “hairstyle is cut into corners” when the person attribute is “female” and “teen”
  • “hairstyle” is used when the person attribute is "male” and “teen”. Examples include, but are not limited to, "make a braid” and “enlarge the eyes” in the case of a person attribute "female” and "20s, 30s”.
  • the acquisition unit 11 acquires an image (entrance image) generated by the camera 40 installed at the store entrance (S40).
  • the acquisition unit 11 acquires an entrance image from the camera 40 by real-time processing.
  • the camera 40 may constantly generate an image.
  • the camera 40 may execute image generation while the motion sensor or the like detects that a person is at a predetermined position in front of the camera 40.
  • the detection unit 12 detects the face of the person in the entrance image (S41).
  • the process returns to S40 and the same process is repeated.
  • the processing unit 13 estimates the person's personal attributes based on the person's face included in the entrance image (S42). Next, the processing unit 13 processes the entrance image by a method according to the estimation result of S42 to generate a processed image (S43). Then, the display control unit 14 causes the display device 50 to display the generated processed image (S44).
  • the display control unit 14 may display the live image (an image that does not include the face of a person) acquired by the acquisition unit 11 from the camera 40 on the display device 50.
  • Other information may be displayed or nothing may be displayed.
  • the predetermined shooting timing may be the timing at which the visitor inputs the shooting instruction, the timing at which a predetermined time has elapsed from the predetermined reference time, or any other timing.
  • the determination unit 15 identifies the processed image displayed by the display device 50 at that time, and then acquires the unprocessed entrance image of the specified processed image (Yes). S46). Then, the determination unit 15 determines whether the acquired entrance image satisfies a predetermined condition.
  • the predetermined condition is "the content of the entrance image is such that the content can identify an individual", for example, “the predetermined feature amount of the face of the person can be extracted", “the person”. The predetermined parts (eyes, nose, mouth, etc.) of the face can be extracted.
  • the process returns to S40 and the same process is repeated.
  • the store system 10 may display an error message such as "The face image could not be taken correctly. Please take a picture again.” On the display device 50.
  • the processing unit 16 when the acquired entrance image satisfies a predetermined condition (Yes in S47), the processing unit 16 newly registers the acquired entrance image in the store entrant information stored in the storage unit 17 (S48). Next, the processing unit 16 controls the store entry control device 20 so that it can enter the store (the gate and the door are open) (S49).
  • the display device 50 may display the processing method so that it can be selected. Then, the processing unit 13 may process the entrance image by the selected method.
  • the processing method executed may be registered in association with each visitor. Then, when the processing unit 13 visits the store next time, the entrance image may be processed by a method different from the method performed in the past. It should be noted that, based on the feature amount of the face image of the visitor, the information of each visitor's past visit can be extracted from the information registered in the visitor information.
  • the same effects as those of the first and second embodiments are realized.
  • the image can be processed not by the same method for all the visitors but by the method according to the personal attributes of the visitors. Since the image can be processed by a method suitable for each visitor, the satisfaction with the processed image is increased. As a result, visitors can look forward to the shooting work before entering the store. As a result, the resistance to the shooting work before entering the store can be further reduced.
  • the store system 10 may have a means for accepting an input for specifying the number of visitors from the store. Then, the processing unit 16 may make the store entry control device 20 in a state where the store can be entered according to the registration of the entrance images for the designated number of people in the store entrant information.
  • the store entry control device 20 When a group of store visitors are performing shooting work, if the store entry control device 20 is made available for entering the store each time the entrance image of each store visitor is registered in the store visitor information, each store visitor himself / herself. I think that I have to enter the store when the store entry control device 20 becomes ready to enter the store according to the completion of the shooting work. Further, if the store entry control device 20 is made available for entry at an unnecessary timing, there is an inconvenience that an unrelated person enters the store in that gap, and the processing burden is caused by operating the store entry control device 20 unnecessarily. May occur, such as an increase in. The inconvenience can be alleviated in the case of a configuration in which the store entry control device 20 is in a state where the store can be entered in response to the registration of the entrance images for the specified number of people in the store visitor information as in the modification.
  • acquisition means “the own device goes to fetch the data stored in another device or storage medium” based on the user input or the instruction of the program (active). Acquisition) ”, for example, requesting or inquiring about another device to receive the data, accessing another device or a storage medium to read the data, and the like. Further, “acquisition” means “inputting data output from another device to the own device (passive acquisition)” based on user input or program instruction, for example, distribution (or distribution (or). , Transmission, push notification, etc.) may be included. In addition, “acquisition” means to select and acquire from received data or information, and “edit data (text conversion, data sorting, partial data extraction, file format change, etc.)". It may include “to generate new data and acquire the new data”.
  • An acquisition method for acquiring an entrance image generated by a camera installed at the store entrance A detection means for detecting a person's face in the entrance image, A processing means for generating a processed image obtained by processing the entrance image in which a person's face is detected, and A display control means for displaying the processed image on the display means, A means for determining whether or not the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined shooting timing. When the predetermined condition is satisfied, the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered.
  • Processing means to make Store system with 2.
  • the predetermined condition is that a predetermined feature amount of a person's face can be extracted.
  • 4. The store system according to any one of 1 to 3, wherein the feature amount extracted from the face of the person included in the entrance image and the feature amount extracted from the face of the person included in the processed image do not match. 5.
  • the processing means deletes the entrance image and the processed image stored in the storage means from the storage means at a predetermined timing. 5.
  • the processing means estimates a person attribute based on the face of a person detected in the entrance image, and processes the entrance image by a method according to the estimation result.
  • the computer Acquire the entrance image generated by the camera installed at the store entrance and A person's face is detected in the entrance image, A processed image obtained by processing the entrance image in which a person's face is detected is generated. The processed image is displayed on the display means, and the processed image is displayed.
  • the entrance image before processing of the processed image displayed by the display means satisfies the predetermined condition at a predetermined shooting timing.
  • the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered. Processing method to make. 9.
  • Computer Acquisition means to acquire the entrance image generated by the camera installed at the store entrance, A detection means for detecting a person's face in the entrance image, A processing means for generating a processed image obtained by processing the entrance image in which a person's face is detected, A display control means for displaying the processed image on the display means, A means for determining whether or not the entrance image before processing of the processed image displayed by the display means satisfies a predetermined condition at a predetermined shooting timing. When the predetermined condition is satisfied, the entrance image determined to satisfy the predetermined condition is registered in the store entrant information stored in the storage means, and the store entrance control device installed at the store entrance can be entered.
  • Processing means A program that functions as.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Business, Economics & Management (AREA)
  • Surgery (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Marketing (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Processing (AREA)
  • Collating Specific Patterns (AREA)
PCT/JP2021/012195 2020-04-10 2021-03-24 店舗システム、処理方法及びプログラム Ceased WO2021205875A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2022514386A JP7586170B2 (ja) 2020-04-10 2021-03-24 店舗システム、処理方法及びプログラム
US17/914,832 US20230120970A1 (en) 2020-04-10 2021-03-24 Shop system, processing method, and non-transitory storage medium
JP2024186495A JP7790517B2 (ja) 2020-04-10 2024-10-23 店舗システム、処理方法及びプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-070797 2020-04-10
JP2020070797 2020-04-10

Publications (1)

Publication Number Publication Date
WO2021205875A1 true WO2021205875A1 (ja) 2021-10-14

Family

ID=78024107

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/012195 Ceased WO2021205875A1 (ja) 2020-04-10 2021-03-24 店舗システム、処理方法及びプログラム

Country Status (3)

Country Link
US (1) US20230120970A1 (https=)
JP (2) JP7586170B2 (https=)
WO (1) WO2021205875A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002236683A (ja) * 2000-09-19 2002-08-23 Konica Corp 画像データ処理システム
JP2005056213A (ja) * 2003-08-06 2005-03-03 Matsushita Electric Ind Co Ltd 情報提供システム、情報提供サーバ、情報提供方法
JP2006202014A (ja) * 2005-01-20 2006-08-03 Fuji Photo Film Co Ltd 電子マネー機能を有する携帯端末装置の認証システム
JP2006244301A (ja) * 2005-03-04 2006-09-14 Nec Corp 画像証明システム及び証明書発行システム並びにこれらを用いた証明書発行支援システム

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3584333B2 (ja) * 1997-11-27 2004-11-04 オムロン株式会社 来訪者識別装置
JP2009009231A (ja) 2007-06-26 2009-01-15 Toshiba Corp セキュリティ管理システムおよびセキュリティ管理方法
JP2013196043A (ja) * 2012-03-15 2013-09-30 Glory Ltd 特定人物監視システム
US9734644B2 (en) * 2014-04-25 2017-08-15 The Chamberlain Group, Inc. Wireless camera facilitated building security
CN105957108A (zh) 2016-04-28 2016-09-21 成都达元科技有限公司 基于人脸检测及跟踪的客流量统计系统
US11019349B2 (en) * 2017-01-20 2021-05-25 Snap Inc. Content-based client side video transcoding
JP6911435B2 (ja) * 2017-03-23 2021-07-28 富士フイルムビジネスイノベーション株式会社 情報処理装置、表示システム、及びプログラム
JP6601513B2 (ja) 2018-01-31 2019-11-06 日本電気株式会社 情報処理装置
JP7015430B2 (ja) 2018-04-27 2022-02-03 達広 佐野 見込み客情報収集システム及びその収集法
US11055514B1 (en) * 2018-12-14 2021-07-06 Snap Inc. Image face manipulation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002236683A (ja) * 2000-09-19 2002-08-23 Konica Corp 画像データ処理システム
JP2005056213A (ja) * 2003-08-06 2005-03-03 Matsushita Electric Ind Co Ltd 情報提供システム、情報提供サーバ、情報提供方法
JP2006202014A (ja) * 2005-01-20 2006-08-03 Fuji Photo Film Co Ltd 電子マネー機能を有する携帯端末装置の認証システム
JP2006244301A (ja) * 2005-03-04 2006-09-14 Nec Corp 画像証明システム及び証明書発行システム並びにこれらを用いた証明書発行支援システム

Also Published As

Publication number Publication date
JP7586170B2 (ja) 2024-11-19
JP7790517B2 (ja) 2025-12-23
JPWO2021205875A1 (https=) 2021-10-14
JP2025013930A (ja) 2025-01-28
US20230120970A1 (en) 2023-04-20

Similar Documents

Publication Publication Date Title
US20200026906A1 (en) Face authentication device and face authentication method
CN114402355B (zh) 个性化自动视频裁切
KR20170027477A (ko) 디스플레이 장치 및 그 제어 방법
JP7258857B2 (ja) 撮像装置によって以前キャプチャされた動画データに基づく、撮像装置による動画データキャプチャの修正
US8954498B2 (en) Digital image communication
JP2013141215A (ja) 撮像装置で撮像された画像の選択方法、システム及び装置
US12200352B2 (en) Information processing apparatus, information processing method, and non-transitory storage medium
CN111800574B (zh) 成像方法、装置和电子设备
CN111275874B (zh) 基于人脸检测的资讯显示方法、装置、设备及存储介质
JP2018081662A (ja) 画像プリントシステム
JP7586170B2 (ja) 店舗システム、処理方法及びプログラム
CN114511754A (zh) 样本图像生成方法、装置、电子设备及存储介质
CN108875670A (zh) 信息处理方法、装置和存储介质
KR20220013235A (ko) 영상 통화 수행 방법, 그 방법을 수행하는 디스플레이 기기, 및 그 방법을 수행하는 프로그램이 저장된 컴퓨터 판독 가능 저장 매체
JP2003263396A (ja) 情報伝達支援システム、端末およびサーバ並びに情報伝達支援方法
JP6891489B2 (ja) 画像提供システム
JP7375047B2 (ja) 表示制御装置、管理装置、表示制御システム、表示制御方法、管理方法及びプログラム
JP6889191B2 (ja) ゲームプログラムおよびゲーム装置
US20250068854A1 (en) Electronic device for generating event on basis of conversation content, control method, and non-transitory computer-readable storage medium
JP6889192B2 (ja) ゲームプログラムおよびゲーム装置
JP2019115381A (ja) ゲームプログラムおよびゲーム装置
JP2025051765A (ja) システム
JP2026016241A (ja) システム
WO2024261802A1 (ja) 処理装置、処理方法、及びプログラム
JP2024043863A (ja) 情報処理装置、情報処理方法、および情報処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21784846

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022514386

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21784846

Country of ref document: EP

Kind code of ref document: A1