CN111666550A - Interactive group photo method and device, electronic equipment and storage medium - Google Patents
Interactive group photo method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111666550A CN111666550A CN202010537603.0A CN202010537603A CN111666550A CN 111666550 A CN111666550 A CN 111666550A CN 202010537603 A CN202010537603 A CN 202010537603A CN 111666550 A CN111666550 A CN 111666550A
- Authority
- CN
- China
- Prior art keywords
- user
- scene picture
- comparison
- target user
- face image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
Abstract
The present disclosure provides a method, an apparatus, an electronic device and a storage medium for interactive group photo, wherein the method comprises: displaying an AR scene picture, capturing a screen and storing a corresponding AR scene picture, and displaying an identification code for acquiring the AR scene picture on the display screen; the AR scene picture shows a virtual object and at least one user; after an AR scene picture acquisition request initiated by a terminal device through an identification code is received, acquiring a face image to be recognized of a target user of the terminal device; determining whether a target user has the authority to acquire an AR scene picture based on a face image to be recognized; and after determining that the target user has the authority to acquire the AR scene picture, sending the AR scene picture to the terminal equipment. The method and the device realize the automatic acquisition of the AR scene pictures belonging to the authority of the target user based on the user authority verification, not only protect the privacy and safety of the user, but also meet the requirement of the user for automatically acquiring the pictures.
Description
Technical Field
The present disclosure relates to the field of augmented reality technologies, and in particular, to a method and an apparatus for interactive group photo, an electronic device, and a storage medium.
Background
Augmented Reality (AR) is a technology for superimposing real information and virtual information, and enables a user to view virtual information superimposed on a real space, so that the user can see a virtual object presented as if the virtual object exists in the real space, and the AR is widely applied to various fields such as engineering machinery, medical application, tourism, exhibition and the like.
Some exhibition areas can provide public large-scale display screens to display AR scene pictures, and users can select group photo memorandum, but because the number of field users is large, the problem that how to avoid users to take wrong photos and protect the privacy of the users is a problem needing attention is solved.
Disclosure of Invention
The embodiment of the disclosure at least provides a scheme of interactive group photo, and realizes automatic acquisition of AR scene pictures belonging to the authority of a target user based on user authority verification.
Mainly comprises the following aspects:
the embodiment of the disclosure provides an interactive group photo method, which comprises the following steps:
displaying an AR scene picture, and displaying an identification code for acquiring the AR scene picture on a display screen after the corresponding AR scene picture is captured and stored; a virtual object and at least one user are shown in the AR scene picture;
after an AR scene picture acquisition request initiated by the terminal equipment through the identification code is received, acquiring a face image to be recognized of a target user of the terminal equipment;
determining whether the target user has the authority to acquire the AR scene picture based on the face image to be recognized;
and after determining that the target user has the authority to acquire the AR scene picture, sending the AR scene picture to the terminal equipment.
In one embodiment, determining whether the target user has the authority to acquire the AR scene picture based on the facial image to be recognized includes:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
In one embodiment, comparing the face image to be recognized with the face image of each user in the AR scene picture includes:
extracting the face feature information of a target user from the face image to be recognized by adopting a trained face feature extraction network, and extracting the face feature information of each comparison user from the face image of each user in the AR scene picture;
and determining a comparison result by calculating the similarity between the face characteristic information of the target user and the face characteristic information of each comparison user.
In one embodiment, extracting the facial feature information of each comparison user from the facial image of each user in the AR scene picture includes:
detecting a face image of each user from the AR scene picture based on a trained target detection network; the target detection network is obtained by training based on an image sample which is marked with a detection target and comprises multiple users;
and extracting the face feature information of each comparison user from the detected face image of each user.
In one embodiment, determining the comparison result by calculating the similarity between the facial feature information of the target user and the facial feature information of each comparison user includes:
if the face feature similarity between the target user and any comparison user is greater than or equal to a first threshold value, determining that the comparison is successful;
if the maximum face feature similarity among the face feature similarities between the target user and each comparison user is smaller than a first threshold and larger than a second threshold, re-acquiring a face image to be identified of the target user, and performing comparison again until the face feature similarity between the target user and any comparison user is larger than the first threshold, determining that the comparison is successful, or determining that the comparison is failed until the repetition number reaches a set threshold;
if the face feature similarity between the target user and any comparison user is smaller than or equal to a second threshold, determining that the comparison fails;
wherein the second threshold is less than the first threshold.
In one embodiment, displaying an AR scene picture, and screenshot to save a corresponding AR scene picture includes:
displaying the dynamically updated AR scene picture, and triggering screen capture to store the corresponding AR scene picture when the orientation angle of the virtual object in the AR scene picture meets the preset condition.
In a second aspect, an embodiment of the present disclosure further provides an apparatus for interactive group photo, where the apparatus includes:
the display module is used for displaying the AR scene picture, capturing the screen and storing the corresponding AR scene picture, and then displaying the identification code for acquiring the AR scene picture on the display screen; a virtual object and at least one user are shown in the AR scene picture;
the acquisition module is used for acquiring a face image to be recognized of a target user of the terminal equipment after receiving an AR scene image acquisition request initiated by the terminal equipment through the identification code;
the determining module is used for determining whether the target user has the authority of acquiring the AR scene picture or not based on the face image to be recognized;
and the sending module is used for sending the AR scene picture to the terminal equipment after the target user is determined to have the authority of acquiring the AR scene picture.
In one embodiment, the determining module is configured to determine whether the target user has the right to acquire the AR scene picture according to the following steps:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the method of interactive composition as described in the first aspect and any of its various embodiments.
In a fourth aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs the steps of the method for interactive group photo as described in the first aspect and any of its various embodiments.
By adopting the scheme of interactive group photo, after displaying the AR scene picture and capturing and storing the corresponding AR scene picture, the identification code for acquiring the AR scene picture can be displayed on the display screen, so that after receiving the AR scene picture acquisition request initiated by the identification code, the face image to be recognized of the target user of the terminal equipment can be acquired, then the target user is determined to have the authority of acquiring the AR scene picture based on the face image to be recognized, and the AR scene picture can be sent to the terminal equipment when the target user is determined to have the related authority. That is, in the above-mentioned interactive group photo scheme, the terminal device may initiate an AR scene picture acquisition request in an identification code recognition manner, so that the target user to be recognized based on the terminal device may confirm the picture acquisition permission, and in a case where it is confirmed that the target user has the permission, the target user may send the corresponding stored AR scene picture to the terminal device so as to be convenient for the user to view, thus realizing automatic acquisition of the AR scene picture belonging to the permission of the target user based on user permission verification, not only protecting user privacy and security, but also meeting the requirement of the user for automatically acquiring the picture.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 is a flowchart illustrating a method for interactive group photo according to a first embodiment of the present disclosure;
fig. 2 is a schematic application diagram of a method for interactive group photo according to an embodiment of the present disclosure
Fig. 3 is a schematic diagram illustrating an apparatus for interactive group photo according to a second embodiment of the disclosure;
fig. 4 shows a schematic diagram of an electronic device provided in a third embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Research shows that some exhibition areas can provide public large-scale exhibition screens to show AR scene pictures, users can select group photo memorandum, but due to the fact that the number of field users is large, the problem that how to avoid the users to take wrong photos and protect the privacy of the users is concerned is solved.
Based on the research, the method at least provides an interactive group photo scheme, and realizes automatic acquisition of the AR scene pictures belonging to the target user in the authority of the target user based on user authority verification, so that the privacy and safety of the user are protected, and the requirement of the user for automatically acquiring the photos is met.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, first, a detailed description is given to an interactive group photo method disclosed in an embodiment of the present disclosure, an execution subject of the interactive group photo method provided in the embodiment of the present disclosure is generally an electronic device with certain computing capability, and the electronic device includes: a server or other processing device. In some possible implementations, the method for interactive group photo can be implemented by a processor calling computer readable instructions stored in a memory.
The following describes the method for interactive group photo provided by the embodiment of the present disclosure by taking the execution subject as a server.
Example one
Referring to fig. 1, a flowchart of a method for interactive group photo provided by the embodiment of the present disclosure is shown, where the method includes steps S101 to S104, where:
s101, displaying an AR scene picture, capturing a screen and storing a corresponding AR scene picture, and displaying an identification code for acquiring the AR scene picture on the display screen; the AR scene picture shows a virtual object and at least one user;
s102, after receiving an AR scene picture acquisition request initiated by a terminal device through an identification code, acquiring a face image to be recognized of a target user of the terminal device;
s103, determining whether the target user has the authority to acquire the AR scene picture based on the face image to be recognized;
and S104, after determining that the target user has the authority to acquire the AR scene picture, sending the AR scene picture to the terminal equipment.
Here, in order to facilitate understanding of the method for interactive group photo provided by the embodiments of the present disclosure, the method for interactive group photo is first described in detail. The method for interactive group photo in the embodiment of the disclosure can be applied to any activity scene where the user interacts with the virtual object. Therefore, when a user enters an activity scene of the method deployed to the interactive group photo, the user can scan the identification code displayed on the display screen by using the terminal equipment of the user, and thus, the terminal equipment can initiate an AR scene picture acquisition request through the identification code. At this moment, the server can acquire the face image to be recognized of the target user, at this moment, user permission verification can be carried out based on the face image to be recognized, and the AR scene picture corresponding to the target user can be sent to the terminal equipment when verification is passed, so that the target user can automatically acquire the AR scene picture belonging to the permission of the target user, the privacy and safety of the user are protected, and the requirement of the user for automatically acquiring the picture is met.
The facial image to be recognized of the target user acquired in the embodiment of the present disclosure may be a facial image imported from an image entry page presented by the terminal device after the user scans an identification code (such as a two-dimensional code) on the display screen with the terminal device, may also be a facial image captured in real time, and may also be a facial image determined in other manners, which is not limited specifically here. The virtual object in the embodiments of the present disclosure may be constructed based on any real object model, for example, the virtual object may be various virtual animals such as polar bears, penguins, elephants, and the like, and may also be various virtual objects such as roller coasters, trojans, and the like, which is not limited herein. The terminal device in the embodiments of the present disclosure may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, or the like.
In the embodiment of the present disclosure, the storing operation of the AR scene picture may be automatically triggered, that is, for the displayed dynamically updated AR scene picture, when the orientation angle of the virtual object in the AR scene picture meets the preset condition, the corresponding AR scene picture may be stored by triggering screen capture.
Here, taking an AR scene picture of polar bear playing at sea as an example, in the case that it is determined that the polar bear is a virtual object facing the user, screen capture may be triggered, and the stored AR scene picture is as shown in fig. 2.
The interactive group photo method provided by the embodiment of the disclosure can realize user authority verification based on an image comparison mode. In the embodiment of the disclosure, after the face image of each user is extracted from the AR scene picture, the face image to be recognized is compared with the face image of each user in the AR scene picture, if a successfully compared face image exists, it is determined that the target user has the authority to acquire the AR scene picture, and if no successfully compared face image exists, it is determined that the target user does not have the authority to acquire the AR scene picture.
In specific application, the comparison of the face images can be completed based on the feature similarity, and the method can be specifically realized by the following steps:
the method comprises the following steps that firstly, a trained face feature extraction network is adopted, face feature information of a target user is extracted from a face image to be recognized, and face feature information of each comparison user is extracted from a face image of each user in an AR scene picture;
and step two, determining a comparison result by calculating the similarity between the face characteristic information of the target user and the face characteristic information of each comparison user.
Here, the method for providing interactive group photo in the embodiments of the present disclosure may, on one hand, perform feature extraction on a to-be-recognized face image by using a trained face feature extraction network to obtain face feature information of a corresponding target user, on the other hand, may also extract face feature information of each comparison user from a face image of each user in an AR scene picture, then may calculate, for each comparison user, a similarity between the face feature information of the comparison user and the face feature information of the target user, and based on the similarity corresponding to each comparison user, may determine whether there is a comparison user successfully compared with the target user.
The face feature extraction network can be obtained by adopting recurrent neural network training, the network input data can be a face image sample, and the network output result can be corresponding face feature information, such as interocular distance information, face contour information and the like.
It should be noted that, in the embodiment of the present disclosure, the extraction of the face feature information may be realized based on the face feature extraction network, and may also be realized based on a related image processing technology, which is not described herein again.
In the embodiment of the present disclosure, the face feature information of each comparison user may be extracted according to the following steps:
step one, detecting a face image of each user from an AR scene picture based on a trained target detection network; the target detection network is obtained by training based on an image sample which is marked with a detection target and contains multiple users;
and step two, extracting the face feature information of each comparison user from the detected face image of each user.
Here, the face image of each user may be extracted from the AR scene picture based on the trained target detection network, and then the face feature information of the corresponding comparison user may be extracted from the detected face image of each user.
The target detection network may be trained based on multi-user-included image samples marked with detection targets, network input data may be multi-user image samples, and a network output result may be a pre-labeling result for multiple users, so that the AR scene picture is input to the trained target detection network, and a face image of each user can be detected.
It should be noted that, in the embodiment of the present disclosure, the detection of the face image may be realized based on the target detection network, and may also be realized based on a related image processing technology, which is not described herein again.
In addition, the process of extracting the face feature information of each comparison user from the face image of each user may refer to the above process of extracting the face feature information of the target user from the face image to be recognized, that is, the trained face feature extraction network may be used to perform feature extraction, or the image processing method may be used to perform feature extraction, which is not described herein again.
Based on the determined face feature information of the target user and the similarity between the face feature information of each comparison user, a comparison result can be determined.
And if the face feature similarity between the target user and any comparison user is determined to be less than or equal to a second threshold, the comparison is determined to be failed.
Taking the example that 3 users are shown in the AR scene picture, if the face feature similarities between the target user and the three users are 7.5, 8, and 8.5, respectively, and if the first threshold is 7, it may be determined that the comparison is successful; for another example, the face feature similarities between the target user and the three users are 3.5, 4, and 4.5, respectively, and if the second threshold is 5, it may be determined that the comparison fails.
In addition, in the case that the largest face feature similarity among the face feature similarities between the target user and each comparison user is determined to be smaller than the first threshold and larger than the second threshold, it is known that there is a high possibility that the comparison user matching the target user exists among the comparison users, which may be a weak comparison success result due to the image itself. In order to further improve the comparison accuracy, the face image to be recognized may be read again, and the comparison may be performed again until the face feature similarity between the target user and any comparison user is greater than the first threshold, and it is determined that the comparison is successful, or it is determined that the comparison fails if the threshold requirement cannot be met even after repeating many times.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, an interactive group photo device corresponding to the interactive group photo method is also provided in the embodiments of the present disclosure, and because the principle of solving the problem of the device in the embodiments of the present disclosure is similar to the above-mentioned interactive group photo method in the embodiments of the present disclosure, the implementation of the device can refer to the implementation of the method, and repeated details are not repeated.
Example two
Referring to fig. 3, which is a schematic diagram of an architecture of an interactive group photo device according to an embodiment of the present disclosure, the interactive group photo device includes: a display module 301, an acquisition module 302, a determination module 303 and a sending module 304; wherein the content of the first and second substances,
the display module 301 is configured to display an AR scene picture, capture and store a corresponding AR scene picture, and display an identification code for acquiring the AR scene picture on a display screen; the AR scene picture shows a virtual object and at least one user;
the acquiring module 302 is configured to acquire a to-be-recognized face image of a target user of a terminal device after receiving an AR scene image acquiring request initiated by the terminal device through an identification code;
the determining module 303 is configured to determine whether the target user has an authority to acquire an AR scene picture based on the face image to be recognized;
and the sending module 304 is configured to send the AR scene picture to the terminal device after determining that the target user has the authority to obtain the AR scene picture.
By adopting the interactive group photo device, the terminal equipment can initiate the AR scene picture acquisition request in an identification code identification mode, so that the picture acquisition permission can be confirmed by the face image to be identified of the target user based on the terminal equipment, and the corresponding stored AR scene picture can be sent to the terminal equipment so as to be convenient for the user to check under the condition that the target user is confirmed to have the permission.
In one embodiment, the determining module 303 is configured to determine whether the target user has the authority to acquire an AR scene picture based on a face image to be recognized according to the following steps:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
In one embodiment, the determining module 303 is configured to compare the face image to be recognized with the face image of each user in the AR scene picture according to the following steps:
extracting the face feature information of a target user from a face image to be recognized by adopting a trained face feature extraction network, and extracting the face feature information of each comparison user from the face image of each user in an AR scene picture;
and determining a comparison result by calculating the similarity between the face characteristic information of the target user and the face characteristic information of each comparison user.
In one embodiment, the determining module 303 is configured to extract facial feature information of each comparison user from a facial image of each user in the AR scene picture according to the following steps:
detecting a face image of each user from the AR scene picture based on a trained target detection network; the target detection network is obtained by training based on an image sample which is marked with a detection target and contains multiple users;
and extracting the face feature information of each comparison user from the detected face image of each user.
In one embodiment, the determining module 303 is configured to determine the comparison result by calculating a similarity between the facial feature information of the target user and the facial feature information of each comparison user according to the following steps:
if the face feature similarity between the target user and any comparison user is greater than or equal to a first threshold value, determining that the comparison is successful;
if the maximum face feature similarity among the face feature similarities between the target user and each comparison user is smaller than a first threshold and larger than a second threshold, re-acquiring the face image to be recognized of the target user, and performing comparison again until the face feature similarity between the target user and any comparison user is larger than the first threshold, determining that the comparison is successful, or determining that the comparison is failed until the repetition times reach a set threshold;
if the face feature similarity between the target user and any comparison user is smaller than or equal to a second threshold, determining that the comparison fails;
wherein the second threshold is less than the first threshold.
In one embodiment, the display module 301 is configured to show an AR scene picture and capture and store a corresponding AR scene picture according to the following steps:
displaying the dynamically updated AR scene picture, and triggering screen capture to store the corresponding AR scene picture when the orientation angle of the virtual object in the AR scene picture meets the preset condition.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
EXAMPLE III
An embodiment of the present disclosure further provides an electronic device, as shown in fig. 4, which is a schematic structural diagram of the electronic device provided in the embodiment of the present disclosure, and the electronic device includes: a processor 401, a memory 402, and a bus 403. The memory 402 stores machine-readable instructions executable by the processor 401, the processor 401 and the memory 402 communicating via the bus 403 when the electronic device is operating, the machine-readable instructions when executed by the processor 401 performing the following:
displaying an AR scene picture, capturing a screen and storing a corresponding AR scene picture, and displaying an identification code for acquiring the AR scene picture on the display screen; the AR scene picture shows a virtual object and at least one user;
after an AR scene picture acquisition request initiated by a terminal device through an identification code is received, acquiring a face image to be recognized of a target user of the terminal device;
determining whether a target user has the authority to acquire an AR scene picture based on a face image to be recognized;
and after determining that the target user has the authority to acquire the AR scene picture, sending the AR scene picture to the terminal equipment.
In an embodiment, the instructions executed by the processor 401 to determine whether the target user has the authority to acquire the AR scene picture based on the face image to be recognized includes:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
In an embodiment, the instructions executed by the processor 401 to compare the face image to be recognized with the face image of each user in the AR scene picture includes:
extracting the face feature information of a target user from a face image to be recognized by adopting a trained face feature extraction network, and extracting the face feature information of each comparison user from the face image of each user in an AR scene picture;
and determining a comparison result by calculating the similarity between the face characteristic information of the target user and the face characteristic information of each comparison user.
In one embodiment, the instructions executed by the processor 401 to extract facial feature information of each comparison user from a facial image of each user in an AR scene picture includes:
detecting a face image of each user from the AR scene picture based on a trained target detection network; the target detection network is obtained by training based on an image sample which is marked with a detection target and contains multiple users;
and extracting the face feature information of each comparison user from the detected face image of each user.
In an embodiment, the instructions executed by the processor 401 to determine the comparison result by calculating a similarity between the facial feature information of the target user and the facial feature information of each comparison user includes:
if the face feature similarity between the target user and any comparison user is greater than or equal to a first threshold value, determining that the comparison is successful;
if the maximum face feature similarity among the face feature similarities between the target user and each comparison user is smaller than a first threshold and larger than a second threshold, re-acquiring the face image to be recognized of the target user, and performing comparison again until the face feature similarity between the target user and any comparison user is larger than the first threshold, determining that the comparison is successful, or determining that the comparison is failed until the repetition times reach a set threshold;
if the face feature similarity between the target user and any comparison user is smaller than or equal to a second threshold, determining that the comparison fails;
wherein the second threshold is less than the first threshold.
In an embodiment, the instructions executed by the processor 401 to show the AR scene picture and capture and save the corresponding AR scene picture includes:
displaying the dynamically updated AR scene picture, and triggering screen capture to store the corresponding AR scene picture when the orientation angle of the virtual object in the AR scene picture meets the preset condition.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor 401, the steps of the method for interactive group photo in the above-mentioned method embodiments are executed. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The computer program product of the interactive group photo method provided in the embodiments of the present disclosure includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the steps of the interactive group photo method in the embodiments of the method.
The embodiments of the present disclosure also provide a computer program, which when executed by a processor implements any one of the methods of the foregoing embodiments. The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an electronic device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. A method of interactive group photo, the method comprising:
displaying an AR scene picture, and displaying an identification code for acquiring the AR scene picture on a display screen after the corresponding AR scene picture is captured and stored; a virtual object and at least one user are shown in the AR scene picture;
after an AR scene picture acquisition request initiated by the terminal equipment through the identification code is received, acquiring a face image to be recognized of a target user of the terminal equipment;
determining whether the target user has the authority to acquire the AR scene picture based on the face image to be recognized;
and after determining that the target user has the authority to acquire the AR scene picture, sending the AR scene picture to the terminal equipment.
2. The method of claim 1, wherein determining whether the target user has the authority to acquire the AR scene picture based on the facial image to be recognized comprises:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
3. The method of claim 2, wherein comparing the face image to be recognized with the face image of each user in the AR scene picture comprises:
extracting the face feature information of a target user from the face image to be recognized by adopting a trained face feature extraction network, and extracting the face feature information of each comparison user from the face image of each user in the AR scene picture;
and determining a comparison result by calculating the similarity between the face characteristic information of the target user and the face characteristic information of each comparison user.
4. The method of claim 3, wherein extracting the facial feature information of each comparison user from the facial image of each user in the AR scene picture comprises:
detecting a face image of each user from the AR scene picture based on a trained target detection network; the target detection network is obtained by training based on an image sample which is marked with a detection target and comprises multiple users;
and extracting the face feature information of each comparison user from the detected face image of each user.
5. The method according to claim 3, wherein determining the comparison result by calculating the similarity between the facial feature information of the target user and the facial feature information of each comparison user comprises:
if the face feature similarity between the target user and any comparison user is greater than or equal to a first threshold value, determining that the comparison is successful;
if the maximum face feature similarity among the face feature similarities between the target user and each comparison user is smaller than a first threshold and larger than a second threshold, re-acquiring a face image to be identified of the target user, and performing comparison again until the face feature similarity between the target user and any comparison user is larger than the first threshold, determining that the comparison is successful, or determining that the comparison is failed until the repetition number reaches a set threshold;
if the face feature similarity between the target user and any comparison user is smaller than or equal to a second threshold, determining that the comparison fails;
wherein the second threshold is less than the first threshold.
6. The method according to any one of claims 1 to 5, wherein displaying the AR scene picture and capturing the corresponding AR scene picture comprises:
displaying the dynamically updated AR scene picture, and triggering screen capture to store the corresponding AR scene picture when the orientation angle of the virtual object in the AR scene picture meets the preset condition.
7. An apparatus for interactive group photo, the apparatus comprising:
the display module is used for displaying the AR scene picture, capturing the screen and storing the corresponding AR scene picture, and then displaying the identification code for acquiring the AR scene picture on the display screen; a virtual object and at least one user are shown in the AR scene picture;
the acquisition module is used for acquiring a face image to be recognized of a target user of the terminal equipment after receiving an AR scene image acquisition request initiated by the terminal equipment through the identification code;
the determining module is used for determining whether the target user has the authority of acquiring the AR scene picture or not based on the face image to be recognized;
and the sending module is used for sending the AR scene picture to the terminal equipment after the target user is determined to have the authority of acquiring the AR scene picture.
8. The apparatus of claim 7, wherein the determining module is configured to determine whether the target user has the right to obtain the AR scene picture according to the following steps:
and comparing the face image to be recognized with the face image of each user in the AR scene picture, and if the face image successfully compared exists, determining that the target user has the authority to acquire the AR scene picture.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of the method of interactive group photo as claimed in any one of claims 1 to 6.
10. A computer-readable storage medium, having stored thereon a computer program for performing, when being executed by a processor, the steps of the method for interactive group photo according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010537603.0A CN111666550A (en) | 2020-06-12 | 2020-06-12 | Interactive group photo method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010537603.0A CN111666550A (en) | 2020-06-12 | 2020-06-12 | Interactive group photo method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111666550A true CN111666550A (en) | 2020-09-15 |
Family
ID=72387586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010537603.0A Pending CN111666550A (en) | 2020-06-12 | 2020-06-12 | Interactive group photo method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111666550A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112734657A (en) * | 2020-12-28 | 2021-04-30 | 杨文龙 | Cloud group photo method and device based on artificial intelligence and three-dimensional model and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110176077A (en) * | 2019-05-23 | 2019-08-27 | 北京悉见科技有限公司 | The method, apparatus and computer storage medium that augmented reality is taken pictures |
| CN110738737A (en) * | 2019-10-15 | 2020-01-31 | 北京市商汤科技开发有限公司 | AR scene image processing method and device, electronic equipment and storage medium |
| WO2020037937A1 (en) * | 2018-08-20 | 2020-02-27 | 深圳壹账通智能科技有限公司 | Facial recognition method and apparatus, terminal, and computer readable storage medium |
-
2020
- 2020-06-12 CN CN202010537603.0A patent/CN111666550A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020037937A1 (en) * | 2018-08-20 | 2020-02-27 | 深圳壹账通智能科技有限公司 | Facial recognition method and apparatus, terminal, and computer readable storage medium |
| CN110176077A (en) * | 2019-05-23 | 2019-08-27 | 北京悉见科技有限公司 | The method, apparatus and computer storage medium that augmented reality is taken pictures |
| CN110738737A (en) * | 2019-10-15 | 2020-01-31 | 北京市商汤科技开发有限公司 | AR scene image processing method and device, electronic equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112734657A (en) * | 2020-12-28 | 2021-04-30 | 杨文龙 | Cloud group photo method and device based on artificial intelligence and three-dimensional model and storage medium |
| CN112734657B (en) * | 2020-12-28 | 2023-04-07 | 杨文龙 | Cloud group photo method and device based on artificial intelligence and three-dimensional model and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107169329B (en) | Privacy information protection method, mobile terminal and computer readable storage medium | |
| CN109858371B (en) | Face recognition method and device | |
| CN107370942B (en) | Photographing method, photographing device, storage medium and terminal | |
| US20170032219A1 (en) | Methods and devices for picture processing | |
| CN109117778B (en) | Information processing method, information processing apparatus, server, and storage medium | |
| CN108563651B (en) | Multi-video target searching method, device and equipment | |
| KR102313554B1 (en) | Personal Information De-identification Method and System | |
| CN107248135B (en) | Anti-counterfeiting image generation and identification method and device and computer storage medium | |
| CN107786487B (en) | Information authentication processing method, system and related equipment | |
| CN108306886B (en) | Identity authentication method, device and storage medium | |
| CN111339420A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| EP4191513A1 (en) | Image processing method and apparatus, device and storage medium | |
| CN110889379A (en) | Expression package generation method and device and terminal equipment | |
| CN109816543B (en) | Image searching method and device | |
| CN111667590B (en) | Interactive group photo method and device, electronic equipment and storage medium | |
| CN103237165A (en) | Method and electronic equipment for checking extended name card information in real time | |
| CN112991555B (en) | Data display method, device, equipment and storage medium | |
| CN113688729B (en) | Behavior recognition method and device, electronic equipment and storage medium | |
| CN111666550A (en) | Interactive group photo method and device, electronic equipment and storage medium | |
| CN107357424B (en) | Gesture operation recognition method and device and computer readable storage medium | |
| CN111651049B (en) | Interaction method, device, computer equipment and storage medium | |
| EP3118766B1 (en) | Authentication device, authentication system, program, storage medium and authentication method | |
| CN111274602B (en) | Image characteristic information replacement method, device, equipment and medium | |
| CN111639977A (en) | Information pushing method and device, computer equipment and storage medium | |
| CN112733611A (en) | Legacy article detection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |