CN111860285B - User registration method, device, electronic equipment and storage medium - Google Patents
User registration method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111860285B CN111860285B CN202010681732.7A CN202010681732A CN111860285B CN 111860285 B CN111860285 B CN 111860285B CN 202010681732 A CN202010681732 A CN 202010681732A CN 111860285 B CN111860285 B CN 111860285B
- Authority
- CN
- China
- Prior art keywords
- user
- position information
- face images
- hand position
- registration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
- G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Abstract
The embodiment of the application provides a user registration method, a device, electronic equipment and a storage medium, which relate to the technical field of user registration, wherein the user registration method comprises the following steps: acquiring a plurality of user face images in a video; acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction; according to the specified gesture, a plurality of face position information corresponding to the face images of the plurality of users and a plurality of hand position information, associating the face images of the plurality of users with the hand position information in a one-to-one correspondence manner; generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one; the registration instruction carries user name information. The user registration method, the device, the electronic equipment and the storage medium provided by the embodiment of the application can register faces of a plurality of users at the same time.
Description
Technical Field
The present document relates to the field of user registration technologies, and in particular, to a user registration method, a device, an electronic device, and a storage medium.
Background
With the increasing maturity of face recognition technology, face recognition is more and more widely applied to various industries, and as a precondition for face recognition, face registration is an indispensable step for ensuring that a face can be accurately recognized.
At present, face registration is mostly a single person registration mode, when a plurality of users are registered through one registration device, each user can only be registered in sequence, and after the previous user is registered, the next user is registered.
However, with such a registration method, the user who is ranked later needs to wait for a long time, and the registration efficiency is low, resulting in poor user experience.
Disclosure of Invention
The embodiment of the application provides a user registration method, a user registration device, electronic equipment and a storage medium, which are used for solving the problem of low multi-user registration efficiency in the prior art.
In order to solve the technical problems, the embodiment of the application is realized as follows:
in a first aspect, an embodiment of the present application provides a user registration method, including:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
Optionally, after generating a plurality of user registration information corresponding to the plurality of user face images one-to-one, the method further includes:
and tracking the plurality of user face images according to the cross-over ratio of the user face images in the adjacent frame images of the video.
Optionally, the generating, according to the registration instructions corresponding to the plurality of hand position information one-to-one and the plurality of user face images corresponding to the plurality of hand position information one-to-one, a plurality of user registration information corresponding to the plurality of user face images one-to-one includes:
responding to a confirmation operation triggered by a registered user, and generating a plurality of pieces of user registration information corresponding to the plurality of pieces of user face images one by one according to registration instructions corresponding to the plurality of pieces of hand position information one by one and the plurality of pieces of user face images corresponding to the plurality of pieces of hand position information one by one.
Optionally, before acquiring the plurality of hand position information corresponding to the plurality of users waving the specified gesture in response to the registration instruction in turn, the method further includes:
and broadcasting the content of the registration instruction in language.
Optionally, the acquiring a plurality of face images of the user in the video includes:
and acquiring a plurality of face images of the user in the video and a plurality of face position information corresponding to the face images of the user one by one.
Optionally, the acquiring a plurality of face images of the user in the video includes:
and acquiring a plurality of user face images in the video through a target detection algorithm.
Optionally, the obtaining the plurality of hand position information corresponding to the plurality of users when swiping the specified gesture in response to the registration instruction sequentially includes:
acquiring gestures which are sequentially swung by a plurality of users in response to registration instructions;
sequentially detecting whether the gestures swung by the plurality of users are matched with the appointed gestures or not through a gesture classification model;
and when the waving gesture is matched with the appointed gesture, recording hand position information corresponding to each user waving the gesture matched with the appointed gesture.
In a second aspect, an embodiment of the present application provides a user registration apparatus, including:
the first acquisition module is used for acquiring a plurality of user face images in the video;
the second acquisition module is used for acquiring a plurality of hand position information corresponding to a plurality of users when the users sequentially respond to the registration instruction and wave the appointed gesture;
the association module is used for associating the face images of the plurality of users with the hand position information one by one according to the specified gestures, the face position information corresponding to the face images of the plurality of users one by one and the hand position information;
the registration module is used for generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the bus;
a memory for storing a computer program;
and the processor is used for executing the programs stored in the memory and realizing the following processes:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing one or more programs that, when executed by an electronic device comprising a plurality of application programs, cause the electronic device to:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
The above at least one technical scheme adopted by the embodiment of the application can achieve the following beneficial effects:
the scheme provided by the embodiment of the application can simultaneously register faces of a plurality of users, thereby avoiding long waiting of registered users and improving registration efficiency and user experience.
Drawings
The accompanying drawings, which are included to provide a further understanding of the present document, illustrate and explain the present document, and are not to be construed as limiting the document. In the drawings:
fig. 1 is a flowchart of a user registration method according to an embodiment of the present application.
Fig. 2 is a flowchart of another user registration method according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 4 is a schematic structural diagram of a user registration device according to an embodiment of the present application.
Detailed Description
For the purposes, technical solutions and advantages of this document, the technical solutions of this document will be clearly and completely described below with reference to specific embodiments of this document and corresponding drawings. It will be apparent that the embodiments described are only some, but not all, of the embodiments of this document. All other embodiments, based on the embodiments in this document, which would be within the purview of one of ordinary skill in the art without the creative effort, are contemplated within the scope of protection of this document.
In order to facilitate multi-user registration, the embodiment of the application provides a user registration method, a device, electronic equipment and a storage medium.
The user registration method provided by the embodiment of the application will be described in detail.
The user registration method provided by the embodiment of the application can be applied to the user terminal with the video acquisition function, wherein the user terminal can be, but is not limited to, a personal computer provided with a camera, a smart phone, a tablet personal computer, a laptop portable computer, a personal digital assistant and the like.
It will be appreciated that the execution body is not to be construed as limiting the embodiments of the application.
Optionally, as shown in fig. 1, the flow of the user registration method may include the following steps:
step S101, a plurality of user face images in a video are acquired.
In the embodiment of the application, the user terminal has a video acquisition function, when a plurality of users need to be registered, the users can be located in the view field area of the user terminal and face the user terminal, at the moment, the user terminal can acquire videos containing face images of the users, wherein the users located in the view field area of the user terminal are preferably kept at certain intervals, and mutual shielding among the users is avoided.
After the video is acquired, user face images of a plurality of users can be acquired from the video in real time through a target detection algorithm. The target detection algorithm may be, but is not limited to, a MobileNet-SSD (MobileNet Single Shot MultiBox Detector), yolo (You Only Look Once) algorithm, etc., and the embodiment of the present application is not limited specifically.
In the embodiment of the application, after the face images of the plurality of users in the video are acquired, a plurality of face position information corresponding to the face images of the plurality of users one by one can be obtained according to the face images of the plurality of users. The face position information is used to characterize the position of the corresponding user face image in the image frame of the video, which may be represented by pixel coordinates or an otherwise newly created coordinate system.
When the face position information is represented by the pixel coordinates, the face position information may be a pixel coordinate range corresponding to the face image of the user, or may be a center coordinate corresponding to the pixel coordinate range of the face image of the user, which is not particularly limited in the embodiment of the present application.
Step S102, a plurality of hand position information corresponding to a plurality of users when waving the designated gesture in response to the registration instruction is obtained.
The user terminal can generate a registration instruction and can sequentially instruct the plurality of users to register according to specified operations in a text display mode or a voice broadcast mode. The registration instruction includes user name information, where the user name information may be a name, a mobile phone number, a work number, a sequence number, etc. of the registered user, and the user name information may be pre-recorded (e.g., name, mobile phone number, work number, etc. may be pre-recorded) or automatically generated (e.g., sequence number may be automatically generated), which is not specifically limited in the embodiment of the present application. The specified operation may be a waving operation, it being understood that in other embodiments the specified operation may also be a nodding, waving operation, etc.
When a plurality of users sequentially respond to the registration instruction to swing the corresponding hand position information when the plurality of users sequentially respond to the registration instruction, the user terminal acquires the gestures sequentially responding to the registration instruction to swing the plurality of users, sequentially judges whether the gestures swung by the plurality of users are matched with the specified gestures, and records the hand position information corresponding to each user when the gestures swung by the plurality of users are matched with the specified gestures when the swung gestures are matched with the specified gestures.
Specifically, when a plurality of users register, the user terminal can generate a registration instruction to sequentially prompt the plurality of users to swing according to the specified gesture, the gesture of each user is detected through the gesture classification model, if the swing operation of the user is matched with the specified gesture, the hand position information of the user is recorded, and therefore a plurality of hand position information corresponding to the time when the plurality of users swing the specified gesture in response to the registration instruction in sequence is obtained. The gesture classification model may be, but is not limited to, a convolutional neural network (Convolutional Neural Networks, CNN) model, a local binary (Local Binary Pattern, LBP) model, and the like.
In the embodiment of the present application, for example, the user A, B, C is used to register for the user name information in each registration instruction of the plurality of users, and the user terminal first generates a registration instruction for the user a and instructs the user a to perform the waving operation by means of voice broadcasting, for example, the content of voice broadcasting may be "please the user a wave the right hand". If the hand waving gesture of the user A is matched with the appointed gesture (waving the right hand), corresponding hand position information when the user A waving the right hand is recorded. And if the hand waving gesture of the user A is not matched with the specified gesture, re-indicating the user A to conduct hand waving operation until the hand waving gesture of the user A is matched with the specified gesture. And then sequentially indicating the user B and the user C to perform hand waving operation in the same mode, and recording the corresponding hand position information when the user B waving the right hand and the corresponding hand position information when the user C waving the right hand.
Step S103, according to the specified gesture, the face position information and the hand position information which are in one-to-one correspondence with the face images of the users, the face images of the users are in one-to-one correspondence with the hand position information.
In the process of registering a plurality of users, the user terminal can obtain a plurality of user face images and a plurality of hand position information, and after the user terminal obtains the plurality of user face images and the plurality of hand position information, the user terminal can associate the plurality of user face images with the plurality of hand position information in a one-to-one correspondence manner according to the appointed gesture.
For example, if the specified gesture is a swipe of the right hand, each user face image may be associated with hand position information nearest to the right. If the specified gesture is a waving left hand, each user face image can be associated with the hand position information nearest to the left hand.
Step S104, generating a plurality of user registration information corresponding to the plurality of user face images one by one according to the registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one.
The plurality of hand position information and the plurality of registration instructions are in one-to-one correspondence, and the plurality of hand position information and the plurality of user face images are also in one-to-one correspondence, so that the one-to-one correspondence between the plurality of registration instructions and the plurality of user face images can be established according to the plurality of registration instructions in one-to-one correspondence with the plurality of hand position information and the plurality of user face images in one-to-one correspondence with the plurality of hand position information.
Meanwhile, because different user name information is included in each registration instruction, the one-to-one correspondence between the plurality of user face images and the plurality of user name information can be established according to the one-to-one correspondence between the plurality of registration instructions and the plurality of user face images.
In the embodiment of the application, one user registration information can be generated according to one user face image and the user name information corresponding to the user face image, so that a plurality of user registration information corresponding to a plurality of user face images one by one is obtained.
In one or more embodiments of the present application, before generating the plurality of user registration information corresponding to the plurality of user face images one-to-one, a confirmation operation is further required by a registered user at the user terminal, and after the confirmation operation is performed by the registered user, the user terminal generates the plurality of user registration information corresponding to the plurality of user face images one-to-one according to the registration instructions corresponding to the plurality of hand position information one-to-one and the plurality of user face images corresponding to the plurality of hand position information one-to-one. If the registered user gives up the confirmation operation, the above-described step S102 is returned again to regenerate the user registration information.
Specifically, after associating the plurality of user face images with the plurality of hand position information one by one, a confirmation control for the registered user to perform a confirmation operation and a discard control for the registered user to discard the confirmation operation may be generated on the user terminal, and when the registered user clicks the confirmation control on the user terminal to perform the confirmation operation, the user terminal responds to the confirmation operation triggered by the registered user and generates a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one. When the registered user clicks the discard control on the user terminal to perform the discard confirmation operation, the user terminal responds to the discard operation triggered by the registered user and returns to the above step S102 again to regenerate the user registration information. If the registered user point does not click on the control on the user terminal within a certain time, the user terminal can default to the registered user clicking on the confirmation control on the user terminal or default to the registered user clicking on the discard control on the user terminal.
Referring to fig. 2, a flowchart of another user registration method according to an embodiment of the present application is shown, where the user registration method may include the following steps:
step S201, a plurality of face images of a user in a video are acquired.
Step S202, a plurality of hand position information corresponding to when the plurality of users swipe the designated gesture in response to the registration instruction sequentially is obtained.
Step S203, associating the plurality of face images with the plurality of hand position information in a one-to-one correspondence manner according to the specified gesture, the plurality of face position information and the plurality of hand position information in a one-to-one correspondence manner.
Step S204, generating a plurality of user registration information corresponding to the plurality of user face images according to the registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one.
Step S205, tracking a plurality of user face images according to the cross-over ratio of the user face images in the adjacent frame images in the video.
After the registration information of a plurality of users is finished, the user terminal can continuously acquire the videos of the plurality of users, and then track the face images of the plurality of users in the video according to the cross-correlation of the face images of the users in the adjacent frame images of the videos.
Specifically, the intersection of the areas where two face images of two users in the adjacent frame images are located may be divided by the union of the areas where the two face images of two users in the adjacent frame images are located, so as to obtain an intersection ratio, and if the intersection ratio is greater than a preset threshold value, it is indicated that the two face images of two users are face images of the same user, so that tracking of the face images of the users can be completed.
For example, the K-th frame image in the video comprises a user face image a k And a user face image b k The K+1st frame image comprises a user face imageImage a k+1 And a user face image b k+1 The threshold value is set to be 0.6, if the face image a of the user k The region and the face image a of the user k+1 Intersection of the located areas divided by the user face image a k The region and the face image a of the user k+1 The value obtained by intersection of the areas is larger than 0.6, and the face image a of the user k The region and the face image b of the user k+1 Intersection of the located areas divided by the user face image a k The region and the face image b of the user k+1 The value obtained by intersection of the areas is smaller than 0.6, and the face image b of the user k The region and the face image b of the user k+1 Intersection of the located areas divided by the user face image b k The region and the face image b of the user k+1 The value obtained by intersection of the areas is larger than 0.6, and the face image b of the user k The region and the face image a of the user k+1 Intersection of the located areas divided by the user face image b k The region and the face image a of the user k+1 The value obtained by intersection of the areas is smaller than 0.6, and the user face image a in the K frame image is described k And the user face image a in the K+1st frame image k+1 The face image b of the user in the K frame image is the face image of the same user k And the user face image b in the K+1th frame image k+1 Is a face image of the same user.
According to the user registration method provided by the embodiment of the application, the plurality of user face images and the plurality of user face images corresponding to the appointed gesture are acquired, the appointed gesture, the plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information are related one by one, and then the plurality of user registration information corresponding to the plurality of user face images one by one is generated according to the registration instructions corresponding to the plurality of hand position information and the plurality of user face images corresponding to the plurality of hand position information one by one. Therefore, face registration can be carried out on a plurality of users at the same time, long waiting of registered users is avoided, and registration efficiency and user experience are improved. Meanwhile, the user registration method provided by the embodiment of the application can be used for recognizing the face image of the user by applying the gesture, so that the face registration of the user is facilitated. In addition, the face images of the same user in adjacent frames can be found out according to the cross-over ratio of the face images of the user in the adjacent frame images of the video, so that real-time tracking of the face images of a plurality of users can be realized.
Fig. 3 is a schematic structural view of an electronic device according to an embodiment of the present application. Referring to fig. 3, at the hardware level, the electronic device includes a processor, and optionally an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, network interface, and memory may be interconnected by an internal bus, which may be an ISA (Industry Standard Architecture ) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or EISA (Extended Industry Standard Architecture ) bus, among others. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 3, but not only one bus or type of bus.
And the memory is used for storing programs. In particular, the program may include program code including computer-operating instructions. The memory may include memory and non-volatile storage and provide instructions and data to the processor.
The processor reads the corresponding computer program from the nonvolatile memory into the memory and then runs, and forms the user registration device on a logic level. The processor is used for executing the programs stored in the memory and is specifically used for executing the following operations:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
The method performed by the user registration apparatus disclosed in the embodiment of fig. 3 of the present application may be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or by instructions in the form of software. The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic diagrams in one or more embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with one or more embodiments of the application may be embodied directly in hardware, in a decoded processor, or in a combination of hardware and software modules in a decoded processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory, and the processor reads the information in the memory and, in combination with its hardware, performs the steps of the above method.
The electronic device may further execute the method of the embodiment shown in fig. 1 and fig. 2, and implement the functions of the user registration device in the embodiment shown in fig. 1 and fig. 2, which are not described herein.
Of course, other implementations, such as a logic device or a combination of hardware and software, are not excluded from the electronic device of the present application, that is, the execution subject of the following processing flows is not limited to each logic unit, but may be hardware or a logic device.
The embodiments of the present application also provide a computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a plurality of application programs, enable the portable electronic device to perform the methods of the embodiments shown in fig. 1 and 2, and in particular to perform the operations of:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
Fig. 4 is a schematic structural diagram of a user registration apparatus 400 according to an embodiment of the present application. Referring to fig. 4, in one software implementation, a user registration apparatus 400 may be provided that includes:
a first obtaining module 401, configured to obtain a plurality of face images of a user in a video;
a second obtaining module 402, configured to obtain a plurality of hand position information corresponding to when the plurality of users sequentially swipe the specified gesture in response to the registration instruction;
an association module 403, configured to associate the plurality of face images with the plurality of hand position information in a one-to-one correspondence manner according to the specified gesture, the plurality of face position information corresponding to the plurality of face images of the user, and the plurality of hand position information;
a registration module 404, configured to generate a plurality of user registration information corresponding to the plurality of user face images according to registration instructions corresponding to the plurality of hand position information one-to-one and the plurality of user face images corresponding to the plurality of hand position information one-to-one;
the registration instruction carries user name information.
Further, the user registration apparatus 400 further includes a tracking module 405, where the tracking module 405 is configured to track the plurality of user face images according to an intersection ratio of the user face images in the adjacent frame images of the video.
According to the scheme provided by the embodiment of the application, the plurality of user face images and the plurality of user face images corresponding to the appointed gesture can be acquired in the video when the appointed gesture is swung by the plurality of users in sequence in response to the registration instruction, the plurality of user face images are associated with the plurality of hand position information in a one-to-one correspondence manner according to the appointed gesture, the plurality of face position information corresponding to the plurality of user face images and the plurality of hand position information, and then the plurality of user registration information corresponding to the plurality of user face images is generated according to the registration instruction corresponding to the plurality of hand position information in a one-to-one correspondence manner and the plurality of user face images corresponding to the plurality of hand position information in a one-to-one correspondence manner. Therefore, face registration can be carried out on a plurality of users at the same time, long waiting of registered users is avoided, and registration efficiency and user experience are improved. Meanwhile, the user registration scheme provided by the embodiment of the application can apply the gestures to the recognition of the face images of the user, thereby facilitating the face registration of the user. In addition, the face images of the same user in adjacent frames can be found out according to the cross-over ratio of the face images of the user in the adjacent frame images of the video, so that real-time tracking of the face images of a plurality of users can be realized.
The foregoing describes certain embodiments of the present application. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
In summary, the foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.
The system, apparatus, module or unit set forth in the above embodiments may be implemented in particular by a computer chip or entity, or by a product having a certain function. One typical implementation is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
The embodiments of the present application are described in a progressive manner, and the same and similar parts of the embodiments are all referred to each other, and each embodiment is mainly described in the differences from the other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
Claims (10)
1. A user registration method, comprising:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
2. The method of claim 1, wherein after generating a plurality of user registration information corresponding to the plurality of user face images one-to-one, the method further comprises:
and tracking the plurality of user face images according to the cross-over ratio of the user face images in the adjacent frame images of the video.
3. The method of claim 1, wherein generating a plurality of user registration information in one-to-one correspondence with the plurality of user face images based on the registration indications in one-to-one correspondence with the plurality of hand position information and the plurality of user face images in one-to-one correspondence with the plurality of hand position information comprises:
responding to a confirmation operation triggered by a registered user, and generating a plurality of pieces of user registration information corresponding to the plurality of pieces of user face images one by one according to registration instructions corresponding to the plurality of pieces of hand position information one by one and the plurality of pieces of user face images corresponding to the plurality of pieces of hand position information one by one.
4. The method of claim 1, wherein prior to obtaining the plurality of hand position information corresponding to a plurality of users waving the specified gesture in response to the registration indication, the method further comprises:
and broadcasting the content of the registration instruction in language.
5. The method of claim 1, wherein the acquiring a plurality of user face images in the video comprises:
and acquiring a plurality of face images of the user in the video and a plurality of face position information corresponding to the face images of the user one by one.
6. The method of claim 1, wherein the acquiring a plurality of user face images in the video comprises:
and acquiring a plurality of user face images in the video through a target detection algorithm.
7. The method of claim 1, wherein the obtaining the plurality of hand position information corresponding to the plurality of users waving the specified gesture in response to the registration instruction in turn comprises:
acquiring gestures which are sequentially swung by a plurality of users in response to registration instructions;
sequentially detecting whether the gestures swung by the plurality of users are matched with the appointed gestures or not through a gesture classification model;
and when the waving gesture is matched with the appointed gesture, recording hand position information corresponding to each user waving the gesture matched with the appointed gesture.
8. A user registration apparatus, comprising:
the first acquisition module is used for acquiring a plurality of user face images in the video;
the second acquisition module is used for acquiring a plurality of hand position information corresponding to a plurality of users when the users sequentially respond to the registration instruction and wave the appointed gesture;
the association module is used for associating the face images of the plurality of users with the hand position information one by one according to the specified gestures, the face position information corresponding to the face images of the plurality of users one by one and the hand position information;
the registration module is used for generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
9. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the bus;
a memory for storing a computer program;
and the processor is used for executing the programs stored in the memory and realizing the following processes:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
10. A computer readable storage medium, wherein a computer program is stored in the storage medium, the computer program realizing the following flow when executed by a processor:
acquiring a plurality of user face images in a video;
acquiring a plurality of hand position information corresponding to a plurality of users when waving a specified gesture in sequence in response to a registration instruction;
according to the specified gesture, a plurality of face position information corresponding to the plurality of user face images one by one and the plurality of hand position information, the plurality of user face images are associated with the plurality of hand position information one by one;
generating a plurality of user registration information corresponding to the plurality of user face images one by one according to registration instructions corresponding to the plurality of hand position information one by one and the plurality of user face images corresponding to the plurality of hand position information one by one;
the registration instruction carries user name information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010681732.7A CN111860285B (en) | 2020-07-15 | 2020-07-15 | User registration method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010681732.7A CN111860285B (en) | 2020-07-15 | 2020-07-15 | User registration method, device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111860285A CN111860285A (en) | 2020-10-30 |
| CN111860285B true CN111860285B (en) | 2023-10-17 |
Family
ID=72983117
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010681732.7A Active CN111860285B (en) | 2020-07-15 | 2020-07-15 | User registration method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111860285B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004302644A (en) * | 2003-03-28 | 2004-10-28 | Sony Corp | Face identification device, face identification method, recording medium and robot device |
| CN102123306A (en) * | 2010-12-30 | 2011-07-13 | 广州杰赛科技股份有限公司 | User interaction method based on digital TV network |
| EP2418866A2 (en) * | 2010-08-11 | 2012-02-15 | LG Electronics | Method for operating image display apparatus |
| JP5037720B1 (en) * | 2011-12-06 | 2012-10-03 | 三菱電機インフォメーションシステムズ株式会社 | Portable information terminal that can communicate with IC chip |
| KR101412727B1 (en) * | 2013-11-15 | 2014-07-01 | 동국대학교 산학협력단 | Apparatus and methdo for identifying face |
| WO2017167037A1 (en) * | 2016-03-30 | 2017-10-05 | 中国银联股份有限公司 | Payment authentication method and authentication system based on face recognition and hce |
| CN107360157A (en) * | 2017-07-10 | 2017-11-17 | 绵阳美菱软件技术有限公司 | A kind of user registering method, device and intelligent air conditioner |
| WO2018006332A1 (en) * | 2016-07-07 | 2018-01-11 | 深圳企管加企业服务有限公司 | Intelligent entrance guard management method and system based on mobile terminal |
| CN107679860A (en) * | 2017-08-09 | 2018-02-09 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of user authentication, equipment and computer-readable storage medium |
| CN108875328A (en) * | 2018-05-30 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of auth method, device and storage medium |
| CN109711343A (en) * | 2018-12-27 | 2019-05-03 | 北京思图场景数据科技服务有限公司 | Behavioral structure method based on the tracking of expression, gesture recognition and expression in the eyes |
| CN110472573A (en) * | 2019-08-14 | 2019-11-19 | 北京思图场景数据科技服务有限公司 | A kind of human body behavior analysis method, equipment and computer storage medium based on body key point |
| CN110532744A (en) * | 2019-07-22 | 2019-12-03 | 平安科技（深圳）有限公司 | Face login method, device, computer equipment and storage medium |
| CN110555930A (en) * | 2019-08-30 | 2019-12-10 | 北京市商汤科技开发有限公司 | Door lock control method and device, electronic equipment and storage medium |
| WO2020096553A1 (en) * | 2018-11-07 | 2020-05-14 | Firat Universitesi Rektorlugu | A method of creating a personal bioelectric id (password) with hand movements of person and identification of behavioral biometric based person with emg signals |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11410438B2 (en) * | 2010-06-07 | 2022-08-09 | Affectiva, Inc. | Image analysis using a semiconductor processor for facial evaluation in vehicles |
-
2020
- 2020-07-15 CN CN202010681732.7A patent/CN111860285B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004302644A (en) * | 2003-03-28 | 2004-10-28 | Sony Corp | Face identification device, face identification method, recording medium and robot device |
| EP2418866A2 (en) * | 2010-08-11 | 2012-02-15 | LG Electronics | Method for operating image display apparatus |
| CN102123306A (en) * | 2010-12-30 | 2011-07-13 | 广州杰赛科技股份有限公司 | User interaction method based on digital TV network |
| JP5037720B1 (en) * | 2011-12-06 | 2012-10-03 | 三菱電機インフォメーションシステムズ株式会社 | Portable information terminal that can communicate with IC chip |
| KR101412727B1 (en) * | 2013-11-15 | 2014-07-01 | 동국대학교 산학협력단 | Apparatus and methdo for identifying face |
| WO2017167037A1 (en) * | 2016-03-30 | 2017-10-05 | 中国银联股份有限公司 | Payment authentication method and authentication system based on face recognition and hce |
| WO2018006332A1 (en) * | 2016-07-07 | 2018-01-11 | 深圳企管加企业服务有限公司 | Intelligent entrance guard management method and system based on mobile terminal |
| CN107360157A (en) * | 2017-07-10 | 2017-11-17 | 绵阳美菱软件技术有限公司 | A kind of user registering method, device and intelligent air conditioner |
| CN107679860A (en) * | 2017-08-09 | 2018-02-09 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of user authentication, equipment and computer-readable storage medium |
| CN108875328A (en) * | 2018-05-30 | 2018-11-23 | 腾讯科技（深圳）有限公司 | A kind of auth method, device and storage medium |
| WO2020096553A1 (en) * | 2018-11-07 | 2020-05-14 | Firat Universitesi Rektorlugu | A method of creating a personal bioelectric id (password) with hand movements of person and identification of behavioral biometric based person with emg signals |
| CN109711343A (en) * | 2018-12-27 | 2019-05-03 | 北京思图场景数据科技服务有限公司 | Behavioral structure method based on the tracking of expression, gesture recognition and expression in the eyes |
| CN110532744A (en) * | 2019-07-22 | 2019-12-03 | 平安科技（深圳）有限公司 | Face login method, device, computer equipment and storage medium |
| CN110472573A (en) * | 2019-08-14 | 2019-11-19 | 北京思图场景数据科技服务有限公司 | A kind of human body behavior analysis method, equipment and computer storage medium based on body key point |
| CN110555930A (en) * | 2019-08-30 | 2019-12-10 | 北京市商汤科技开发有限公司 | Door lock control method and device, electronic equipment and storage medium |
Non-Patent Citations (6)
| Title |
|---|
| A neural network-based point registration method for 3D rigid face image;Chen, JF 等;《WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS》;第18卷(第2期);197-214 * |
| Duodepth: Static Gesture Recognition Via Dual Depth Sensors;Chugunov 等;《2019 IEEE International Conference on Image Processing (ICIP)》;3467-3471 * |
| Groupwise Multichannel Image Registration;Jean-Marie Guyader 等;《 IEEE Journal of Biomedical and Health Informatics 》;第23卷(第3期);1171-1180 * |
| The application of virtual samples in Face Recognition;Lang, LY 等;《 FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE》;第44-47卷;3134 * |
| 基于无标识注册技术的思政教材互动学习游戏设计研究;张潇月;《中国优秀硕士学位论文全文数据库 信息科技辑》(第2期);I138-1051 * |
| 面向金库的近红外人脸识别系统设计与实现;张韶;《中国优秀硕士学位论文全文数据库 信息科技辑》(第4期);I138-2683 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111860285A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI716008B (en) | Face recognition method and device | |
| US10997460B2 (en) | User identity determining method, apparatus, and device | |
| US20190251623A1 (en) | Two-dimensional code identification method and device, and mobile terminal | |
| CN107274442B (en) | Image identification method and device | |
| US9007524B2 (en) | Techniques and apparatus for audio isolation in video processing | |
| CN110956275B (en) | Risk prediction and risk prediction model training method and device and electronic equipment | |
| CN108629220A (en) | A kind of two dimension code reading method, apparatus and equipment | |
| CN109086734B (en) | Method and device for positioning pupil image in human eye image | |
| CN111860502A (en) | Picture table identification method and device, electronic equipment and storage medium | |
| CN112333356B (en) | Certificate image acquisition method, device and equipment | |
| US11113998B2 (en) | Generating three-dimensional user experience based on two-dimensional media content | |
| US20170099427A1 (en) | Methods and apparatuses for providing improved autofocus using curve-fitting | |
| CN112347512A (en) | Image processing method, device, equipment and storage medium | |
| US11348254B2 (en) | Visual search method, computer device, and storage medium | |
| CN111860285B (en) | User registration method, device, electronic equipment and storage medium | |
| CN111523402B (en) | Video processing method, mobile terminal and readable storage medium | |
| CN113129298A (en) | Definition recognition method of text image | |
| US20140321747A1 (en) | Method, apparatus and terminal for detecting image stability | |
| CN110648314B (en) | Method, device and equipment for identifying flip image | |
| CN114840762A (en) | Recommended content determining method and device and electronic equipment | |
| CN110443746B (en) | Picture processing method and device based on generation countermeasure network and electronic equipment | |
| CN111612682B (en) | Watermark processing method and device | |
| CN113469017A (en) | Image processing method and device and electronic equipment | |
| CN110968513A (en) | Recording method and device of test script | |
| CN111309495A (en) | Batch processing request initiating method and device, risk identification platform and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |