CN113887540A - Face recognition sales counter recognition method and system - Google Patents
Face recognition sales counter recognition method and system Download PDFInfo
- Publication number
- CN113887540A CN113887540A CN202111476150.6A CN202111476150A CN113887540A CN 113887540 A CN113887540 A CN 113887540A CN 202111476150 A CN202111476150 A CN 202111476150A CN 113887540 A CN113887540 A CN 113887540A
- Authority
- CN
- China
- Prior art keywords
- face
- face data
- recognition
- sales counter
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Computer Security & Cryptography (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a face recognition sales counter recognition method, which comprises the following steps: when the human body is detected to exist in front of the sales counter, the residence time is counted, and the camera shooting component is awakened after the set time is reached; under the condition that the person leaves is not checked, if shopping operation on the vending cabinet is detected, the camera shooting assembly is controlled to shoot the person in front of the vending cabinet to obtain first face data; after the shopping operation is finished, starting the camera shooting assembly to shoot the human body to obtain second face data, comparing the second face data with the first face data, carrying out face matching payment by using the second face data when the face data are consistent, stopping the transaction and reminding the user to refresh the face when the face data are inconsistent, and carrying out face matching payment by using the face data refreshed; a series of disputes caused by mistaken face brushing can be effectively avoided, the whole flow design is very natural, and a shopper is not required to perform excessive adaptability adjustment.
Description
Technical Field
The invention relates to the technical field of face recognition sales counter, in particular to a face recognition sales counter recognition method and a face recognition sales counter recognition system.
Background
The face recognition sales counter is a novel sales counter with an added face recognition payment function, the sales counter usually provides face payment fee deduction service for members who have undergone face registration, however, with popularization of the function, there is a risk of face brushing by mistake during payment, that is, a face brushing person is not uniform with a shopper, so that unnecessary disputes are caused, especially in some relatively closed areas, such as a residential quarter, a school, etc., such false brushing situations are increasing day by day, and a mode method capable of reasonably avoiding the false brushing situation is needed.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method and a system for identifying a face recognition sales counter in order to overcome the above-mentioned defects in the prior art.
The technical scheme adopted by the invention for solving the technical problems is as follows:
a face recognition sales counter recognition method is constructed, wherein the method comprises the following steps:
the first step is as follows: when the human body is detected to exist in front of the sales counter, the residence time is counted, and the camera shooting component is awakened after the set time is reached;
the second step is that: under the condition that the person leaves is not checked, if shopping operation on the vending cabinet is detected, the camera shooting assembly is controlled to shoot the person in front of the vending cabinet to obtain first face data;
the third step: after the shopping operation is finished, starting the camera shooting assembly to shoot the human body to obtain second face data, comparing the second face data with the first face data, carrying out face matching payment by using the second face data when the face data are consistent, stopping the transaction and reminding the user to refresh the face when the face data are inconsistent, and carrying out face matching payment by using the face data refreshed;
the fourth step: and after the transaction is finished, all the collected face data are cleared, and the camera shooting assembly is restored to the initial state.
The face recognition sales counter recognition method of the invention, wherein in the first step, the method further comprises:
the area right in front of the sales counter is divided into a shopping area and a non-shopping area, the two areas are subjected to subarea induction, and the residence time is counted only when a human body exists in the shopping area.
The face recognition sales counter recognition method is characterized in that the shopping area is an area which is in a range of 1.5 meters in front of the sales counter and is directly opposite to the operation panel and the commodity area.
The invention relates to a face recognition sales counter recognition method, wherein the camera assembly comprises a plurality of cameras which are annularly distributed around an operation panel; the second step further comprises the method: and screening the obtained camera data according to a set data screening rule to obtain first face data.
The face recognition sales counter recognition method of the invention, wherein in the third step, the method for starting the camera shooting component to shoot the human body to obtain the second face data comprises the following steps:
and taking a picture by utilizing the camera for shooting the first face data to acquire the second face data.
The face recognition sales counter recognition method provided by the invention is characterized in that in the first step, the retention time is 3-5 seconds.
The face recognition sales counter recognition method of the invention, wherein in the second step, the method further comprises:
and when the human body is checked to leave, the camera shooting assembly is restored to the initial state.
A face recognition sales counter recognition system comprises a human body sensing unit, a processor unit, a camera shooting assembly, a face recognition payment unit and a sales unit;
the vending unit comprises a storage cabinet, an operation panel and a delivery mechanism;
the human body sensing unit is used for sensing whether a human body exists in front of a sales counter or not;
the camera assembly comprises a plurality of cameras arranged around the operation panel;
the face recognition payment unit is used for carrying out face recognition payment;
the processor unit is used for awakening the camera shooting assembly after the human body sensing unit senses that the human body stays for a set time, and controlling the camera shooting assembly to shoot the human body in front of the sales counter when the human body sensing unit does not sense that the human body leaves and the operation panel starts to operate, so that first face data are obtained; the operation panel is used for starting the camera shooting assembly to shoot a human body after the operation is completed, second face data are obtained, the second face data are compared with the first face data, when the face data are consistent, the second face data are sent to the face recognition payment unit to pay, when the face data are inconsistent, the transaction is stopped, the user is reminded to brush the face again, and the face data after the face is brushed again are sent to the face recognition payment unit to pay.
In the face recognition sales counter recognition system of the present invention, the processor unit obtains the first face data by filtering the obtained plurality of camera data according to a set data filtering rule.
According to the face recognition sales counter recognition system, when the second face data is obtained, the camera shooting component acquires the second face data through the camera corresponding to the first face data.
The invention has the beneficial effects that: by the method, the consistency of the shopping operation personnel and the face brushing payment personnel can be effectively ensured, a series of disputes caused by face brushing by mistake can be avoided, the overall flow design is very natural, and excessive adaptive adjustment by a shopper is not needed; the awakening and sleeping design of the camera shooting assembly is also very reasonable, and electric energy can be better saved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the present invention will be further described with reference to the accompanying drawings and embodiments, wherein the drawings in the following description are only part of the embodiments of the present invention, and for those skilled in the art, other drawings can be obtained without inventive efforts according to the accompanying drawings:
FIG. 1 is a flow chart of a face recognition sales counter recognition method according to a preferred embodiment of the present invention;
FIG. 2 is a schematic block diagram of a face recognition sales counter recognition system according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without inventive step, are within the scope of the present invention.
The face recognition sales counter recognition method of the preferred embodiment of the invention, as shown in fig. 1, includes the following steps:
s01: when the human body is detected to exist in front of the sales counter, the residence time is counted, and the camera shooting component is awakened after the set time is reached;
s02: under the condition that the person leaves is not checked, if shopping operation on the vending cabinet is detected, the camera shooting assembly is controlled to shoot the person in front of the vending cabinet to obtain first face data;
s03: after the shopping operation is finished, starting the camera shooting assembly to shoot the human body to obtain second face data, comparing the second face data with the first face data, carrying out face matching payment by using the second face data when the face data are consistent, stopping the transaction and reminding the user to refresh the face when the face data are inconsistent, and carrying out face matching payment by using the face data refreshed;
s04: after the transaction is completed, all the acquired face data are cleared, and the camera shooting assembly is restored to the initial state;
by the method, the consistency of the shopping operation personnel and the face brushing payment personnel can be effectively ensured, a series of disputes caused by face brushing by mistake can be avoided, the overall flow design is very natural, and excessive adaptive adjustment by a shopper is not needed; the awakening and sleeping design of the camera shooting assembly is also very reasonable, and electric energy can be better saved.
Preferably, in the first step, the method further comprises:
dividing the area right in front of the sales counter into a shopping area and a non-shopping area, performing subarea induction on the two areas, and counting the residence time only when a human body exists in the shopping area; correspondingly, the method needs to be applied to a plurality of human body induction sensors for carrying out subarea induction; the purpose of sensing is to better identify the personnel condition right in front of the sales counter;
preferably, the shopping area is an area which is in the range of 1.5 meters in front of the sales counter and is directly opposite to the operation panel and the commodity area; preferably, the areas corresponding to the two side edges of the sales counter are set as non-shopping areas.
Preferably, the camera assembly comprises a plurality of cameras annularly distributed around the operating panel; the second step also includes the method: screening the obtained camera data according to a set data screening rule to obtain first face data; in the third step, the method for starting the camera shooting component to shoot the human body to obtain the second face data comprises the following steps: shooting by using a camera for shooting the first face data to obtain second face data;
after multi-angle shooting is carried out through the multiple cameras, screening according to conditions is carried out to obtain shooting data which best meets the conditions, then the cameras which obtain the shooting data are adopted to carry out subsequent shooting actions to obtain second face data, so that a better face recognition effect can be obtained, meanwhile, data shooting and collecting actions can still be normally carried out under the condition that damage, dirt shielding and the like occur in the multiple cameras individually, and stable operation of equipment is guaranteed; in addition, the front face data and the rear face data are obtained by the same camera, so that comparison errors caused by the difference of the cameras can be eliminated during comparison, and the face identification accuracy is improved;
the screening conditions can be set as required, and the definition, the inclination angle and the like of the five sense organs can be preferably considered, and the screening method can adopt the existing shooting data optimization method and is not described herein;
preferably, in the first step, the residence time is 3 to 5 seconds; preferably, in the second step, the method further comprises: under the condition that the human body is detected to leave, the camera shooting assembly is recovered to the initial state; .
A face recognition sales counter recognition system is shown in figure 2 and comprises a human body induction unit 1, a processor unit 2, a camera component 3, a face recognition payment unit 4 and a sales unit 5;
the vending unit 5 includes a storage cabinet 50, an operation panel 51, and a delivery mechanism 52;
the human body sensing unit 1 is used for sensing whether a human body exists in front of a sales counter or not;
the camera module 3 includes a plurality of cameras 30 disposed around the operation panel;
the face recognition payment unit 4 is used for carrying out face recognition payment;
the processor unit 2 is used for awakening the camera shooting assembly after the human body sensing unit senses that the human body stays for a set time, and controlling the camera shooting assembly to shoot the human body in front of the sales counter when the human body sensing unit does not sense that the human body leaves and the operation panel starts to operate, so that first face data are obtained; the system is also used for starting the camera shooting assembly to shoot a human body after the operation on the operation panel is finished, obtaining second face data, comparing the second face data with the first face data, sending the second face data to the face recognition payment unit for payment when the face data are consistent, stopping the transaction and reminding a user to refresh the face when the face data are inconsistent, and sending the face data refreshed to the face recognition payment unit for payment;
by the method, the consistency of the shopping operation personnel and the face brushing payment personnel can be effectively ensured, a series of disputes caused by face brushing by mistake can be avoided, the overall flow design is very natural, and excessive adaptive adjustment by a shopper is not needed; the awakening and sleeping design of the camera shooting assembly is also very reasonable, and electric energy can be better saved.
Preferably, the first face data is obtained by screening the obtained multiple camera data by the processor unit according to a set data screening rule, and the camera assembly acquires the second face data by acquiring a camera corresponding to the first face data;
after multi-angle shooting is carried out through the multiple cameras, screening according to conditions is carried out to obtain shooting data which best meets the conditions, then the cameras which obtain the shooting data are adopted to carry out subsequent shooting actions to obtain second face data, so that a better face recognition effect can be obtained, meanwhile, data shooting and collecting actions can still be normally carried out under the condition that damage, dirt shielding and the like occur in the multiple cameras individually, and stable operation of equipment is guaranteed; in addition, the front face data and the rear face data are obtained by the same camera, so that comparison errors caused by the difference of the cameras can be eliminated during comparison, and the face identification accuracy is improved;
the screening conditions can be set as required, and the definition of the five sense organs, the inclination angle of the five sense organs, and the like can be preferably considered, and the screening method can adopt the existing shooting data optimization method, which is not described herein again.
It will be understood that modifications and variations can be made by persons skilled in the art in light of the above teachings and all such modifications and variations are intended to be included within the scope of the invention as defined in the appended claims.
Claims (10)
1. A face recognition sales counter recognition method is characterized by comprising the following steps:
the first step is as follows: when the human body is detected to exist in front of the sales counter, the residence time is counted, and the camera shooting component is awakened after the set time is reached;
the second step is that: under the condition that the person leaves is not checked, if shopping operation on the vending cabinet is detected, the camera shooting assembly is controlled to shoot the person in front of the vending cabinet to obtain first face data;
the third step: after the shopping operation is finished, starting the camera shooting assembly to shoot the human body to obtain second face data, comparing the second face data with the first face data, carrying out face matching payment by using the second face data when the face data are consistent, stopping the transaction and reminding the user to refresh the face when the face data are inconsistent, and carrying out face matching payment by using the face data refreshed;
the fourth step: and after the transaction is finished, all the collected face data are cleared, and the camera shooting assembly is restored to the initial state.
2. The face recognition sales counter recognition method of claim 1, further comprising, in the first step, the method of:
the area right in front of the sales counter is divided into a shopping area and a non-shopping area, the two areas are subjected to subarea induction, and the residence time is counted only when a human body exists in the shopping area.
3. The face recognition sales counter recognition method of claim 2, wherein the shopping area is an area within 1.5 meters directly in front of a sales counter to which the operation panel and the goods area are directly facing.
4. The face recognition sales counter identification method of claim 1, wherein the camera assembly comprises a plurality of cameras distributed annularly around the operating panel; the second step further comprises the method: and screening the obtained camera data according to a set data screening rule to obtain first face data.
5. The face recognition sales counter recognition method of claim 4, wherein in the third step, the method for starting the camera module to take a picture of a human body to obtain the second face data comprises:
and taking a picture by utilizing the camera for shooting the first face data to acquire the second face data.
6. The face recognition sales counter recognition method of any one of claims 1 to 5, wherein in the first step, the dwell time is 3 to 5 seconds.
7. The face recognition sales counter recognition method of any one of claims 1 to 5, further comprising, in the second step, the method of:
and when the human body is checked to leave, the camera shooting assembly is restored to the initial state.
8. A face recognition sales counter recognition system is characterized by comprising a human body induction unit, a processor unit, a camera shooting assembly, a face recognition payment unit and a sales unit;
the vending unit comprises a storage cabinet, an operation panel and a delivery mechanism;
the human body sensing unit is used for sensing whether a human body exists in front of a sales counter or not;
the camera assembly comprises a plurality of cameras arranged around the operation panel;
the face recognition payment unit is used for carrying out face recognition payment;
the processor unit is used for awakening the camera shooting assembly after the human body sensing unit senses that the human body stays for a set time, and controlling the camera shooting assembly to shoot the human body in front of the sales counter when the human body sensing unit does not sense that the human body leaves and the operation panel starts to operate, so that first face data are obtained; the operation panel is used for starting the camera shooting assembly to shoot a human body after the operation is completed, second face data are obtained, the second face data are compared with the first face data, when the face data are consistent, the second face data are sent to the face recognition payment unit to pay, when the face data are inconsistent, the transaction is stopped, the user is reminded to brush the face again, and the face data after the face is brushed again are sent to the face recognition payment unit to pay.
9. The face recognition sales counter recognition system of claim 8, wherein the first face data is obtained by the processor unit by filtering among the obtained plurality of camera data according to a set data filtering rule.
10. The face recognition sales counter recognition system of claim 9, wherein the camera assembly acquires the second face data by acquiring a camera corresponding to the first face data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111476150.6A CN113887540A (en) | 2021-12-06 | 2021-12-06 | Face recognition sales counter recognition method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111476150.6A CN113887540A (en) | 2021-12-06 | 2021-12-06 | Face recognition sales counter recognition method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113887540A true CN113887540A (en) | 2022-01-04 |
Family
ID=79016272
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111476150.6A Pending CN113887540A (en) | 2021-12-06 | 2021-12-06 | Face recognition sales counter recognition method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113887540A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107886628A (en) * | 2017-11-22 | 2018-04-06 | 周建楚 | A kind of vending system of automatic selling cabinet |
| CN108364400A (en) * | 2018-02-06 | 2018-08-03 | 合肥美的智能科技有限公司 | sales counter and its control method |
| CN108491806A (en) * | 2018-03-28 | 2018-09-04 | 成都信达智胜科技有限公司 | A kind of fast human face recognition |
| CN108876504A (en) * | 2017-09-12 | 2018-11-23 | 北京旷视科技有限公司 | A kind of unmanned selling system and its control method |
| CN109509299A (en) * | 2018-12-13 | 2019-03-22 | 广州优里贸易有限公司 | A kind of automatic vending machine with recognition of face |
| JP2020087093A (en) * | 2018-11-28 | 2020-06-04 | サントリーホールディングス株式会社 | Vending machine settlement system, vending machine, face authentication server, vending machine settlement method, and program |
-
2021
- 2021-12-06 CN CN202111476150.6A patent/CN113887540A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108876504A (en) * | 2017-09-12 | 2018-11-23 | 北京旷视科技有限公司 | A kind of unmanned selling system and its control method |
| CN107886628A (en) * | 2017-11-22 | 2018-04-06 | 周建楚 | A kind of vending system of automatic selling cabinet |
| CN108364400A (en) * | 2018-02-06 | 2018-08-03 | 合肥美的智能科技有限公司 | sales counter and its control method |
| CN108491806A (en) * | 2018-03-28 | 2018-09-04 | 成都信达智胜科技有限公司 | A kind of fast human face recognition |
| JP2020087093A (en) * | 2018-11-28 | 2020-06-04 | サントリーホールディングス株式会社 | Vending machine settlement system, vending machine, face authentication server, vending machine settlement method, and program |
| CN109509299A (en) * | 2018-12-13 | 2019-03-22 | 广州优里贸易有限公司 | A kind of automatic vending machine with recognition of face |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5331544A (en) | Market research method and system for collecting retail store and shopper market research data | |
| CN108492431B (en) | Intelligent access control system | |
| CN108876504B (en) | Unmanned selling system and control method thereof | |
| US20080040277A1 (en) | Image Recognition Authentication and Advertising Method | |
| WO2020037933A1 (en) | Unmanned vending machine | |
| US20080040278A1 (en) | Image recognition authentication and advertising system | |
| WO2018187959A1 (en) | Identity information security monitoring method and system | |
| US11200406B2 (en) | Customer flow statistical method, apparatus and device | |
| CN107832745B (en) | Face authentication method, intelligent mirror and storage medium | |
| JP2012208854A (en) | Action history management system and action history management method | |
| CN112016485A (en) | Passenger flow statistical method and system based on face recognition | |
| JP4159159B2 (en) | Advertising media evaluation device | |
| CN109598251A (en) | Testimony of a witness checking method, device, equipment and system and storage medium | |
| US20240087435A1 (en) | System, apparatus and method for inventory | |
| CN112037076A (en) | Method, system, platform, equipment and medium for controlling local product transaction risk | |
| TWI671701B (en) | System and method for detecting trading behavior | |
| CN110415113A (en) | Finance data processing method, device, server and readable storage medium storing program for executing | |
| CN113887884A (en) | Business-super service system | |
| CN113887540A (en) | Face recognition sales counter recognition method and system | |
| US20210383667A1 (en) | Method for computer vision-based assessment of activities of daily living via clothing and effects | |
| JP4230049B2 (en) | Customer image database creation device | |
| CN107025435A (en) | A kind of face recognition processing method and system | |
| CN109978672A (en) | A kind of marketing system and method based on image recognition | |
| CN114267106A (en) | Identity recognition method, device and equipment | |
| CN114037940A (en) | Target commodity track generation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220104 |
|
| RJ01 | Rejection of invention patent application after publication |