CN111638798A - AR group photo method, AR group photo device, computer equipment and storage medium - Google Patents
AR group photo method, AR group photo device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN111638798A CN111638798A CN202010509133.7A CN202010509133A CN111638798A CN 111638798 A CN111638798 A CN 111638798A CN 202010509133 A CN202010509133 A CN 202010509133A CN 111638798 A CN111638798 A CN 111638798A
- Authority
- CN
- China
- Prior art keywords
- group photo
- user
- image
- celebrity
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
Abstract
The present disclosure provides an AR group photo method, apparatus, computer device and storage medium, wherein the method comprises: displaying the AR character special effect of the history celebrity in a first display area of a display screen; acquiring a user image in real time, and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time; and after the fact that the user performs a preset group photo triggering action is detected, generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area. The embodiment of the disclosure utilizes the AR technology, so that the user can share a photo with the historical celebrity, certain interactive experience is brought to the user, and the user experience degree is improved.
Description
Technical Field
The present disclosure relates to the field of augmented reality technologies, and in particular, to an AR group photo method, an AR group photo device, a computer device, and a storage medium.
Background
China is a country with long history culture, and a large number of historical characters emerge in a long history river which lasts for five thousand years. In order to commemorate the historical personalities, historical exhibition halls are built in many areas of China and used for displaying pictures of some historical celebrities, life and works of the historical celebrities, or some articles related to the historical celebrities and the like, so that people can know more information related to the historical celebrities.
Generally, the information about the historical celebrities displayed in the historical exhibition hall is in a literal or picture mode, can only be watched by people, and is poor in interactivity.
Disclosure of Invention
The embodiment of the disclosure at least provides an AR group photo method, an AR group photo device, computer equipment and a storage medium.
In a first aspect, an embodiment of the present disclosure provides an augmented reality AR group photo method, where the group photo method includes:
displaying the AR character special effect of the history celebrity in a first display area of a display screen;
acquiring a user image in real time, and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
and after the fact that the user performs a preset group photo triggering action is detected, generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area.
In an optional embodiment, before displaying the AR character special effect of the history celebrity in the first display area of the display screen, the group photo method further comprises:
and monitoring whether a human body is present at a preset position in real time.
In an optional embodiment, the real-time monitoring whether a human body is present at a preset position includes:
monitoring whether a human body is present at the preset position in real time by using a sensor;
alternatively, the first and second electrodes may be,
and acquiring a detection image of a preset position in real time, and detecting whether a human body image appears in the detection image.
In an optional embodiment, before displaying the AR character special effect of the history celebrity in the first display area of the display screen, the group photo method further comprises:
playing an entrance animation of the history celebrity in the display screen;
the method for displaying the AR character special effect of the history celebrity in the first display area of the display screen comprises the following steps:
and after the playing of the entrance animation is finished, displaying the special effect of the AR character of the history celebrity in the first display area of the display screen.
In an optional embodiment, after generating a group photo of the user and the historical celebrity, the group photo method further comprises:
and storing the group photo to a preset storage position, and displaying the two-dimensional code for accessing the preset storage position to a user through the display screen.
In an optional embodiment, the group photo method further includes:
determining head pose information of the user based on the user image;
and adjusting the shooting position of the image acquisition equipment based on the head posture information.
In an alternative embodiment, the head pose information comprises: pitch angle of the face, and yaw angle.
In an optional embodiment, the adjusting the shooting position of the image capturing apparatus based on the head pose information includes:
adjusting the shooting height of the image acquisition equipment under the condition that the absolute value of the pitch angle is smaller than a pitch angle threshold;
and adjusting the horizontal rotation angle of the image acquisition equipment under the condition that the absolute value of the yaw angle is smaller than a yaw angle threshold value.
In a second aspect, an embodiment of the present disclosure provides an augmented reality AR group photo device, where the group photo device includes:
the display module is used for displaying the AR character special effect of the history celebrity in a first display area of the display screen;
the detection module is used for acquiring a user image in real time and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
and the generating module is used for generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area after detecting that the user performs a preset group photo triggering action.
In an optional embodiment, the group photo device further includes:
and the monitoring module is used for monitoring whether a human body appears at a preset position.
In an optional implementation manner, the monitoring module is specifically configured to:
monitoring whether a human body is present at the preset position in real time by using a sensor;
alternatively, the first and second electrodes may be,
and acquiring a detection image of a preset position in real time, and detecting whether a human body image appears in the detection image.
In an optional embodiment, the group photo device further includes:
the playing module is used for playing the entrance animation of the history celebrity in the display screen;
the display module is specifically configured to:
and after the playing of the entrance animation is finished, displaying the special effect of the AR character of the history celebrity in the first display area of the display screen.
In an optional embodiment, the group photo device further includes:
and the storage module is used for storing the group photo to a preset storage position and displaying the two-dimensional code for accessing the preset storage position to a user through the display screen.
In an optional embodiment, the group photo device further includes:
a determination module to determine head pose information of the user based on the user image;
and the adjusting module is used for adjusting the shooting position of the image acquisition equipment based on the head posture information.
In an alternative embodiment, the head pose information comprises: pitch angle of the face, and yaw angle.
In an optional implementation manner, the adjusting module is specifically configured to:
adjusting the shooting height of the image acquisition equipment under the condition that the absolute value of the pitch angle is smaller than a pitch angle threshold;
and adjusting the horizontal rotation angle of the image acquisition equipment under the condition that the absolute value of the yaw angle is smaller than a yaw angle threshold value.
In a third aspect, an embodiment of the present disclosure further provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect described above, or any possible implementation of the first aspect.
In a fourth aspect, this disclosed embodiment also provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps in the first aspect or any one of the possible implementation manners of the first aspect.
According to the AR group photo method provided by the embodiment of the disclosure, the AR character special effect of the historical celebrity is displayed in the first display area of the display screen; acquiring a user image in real time, and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time; after the fact that the user makes a preset group photo triggering action is detected, the group photo of the user and the historical celebrity is generated based on the AR character special effect displayed in the first area and the user image displayed in the second area, and then the interaction between the user and the historical celebrity can be based on, so that the user can share a commemoration with the historical celebrity, and the interactivity is improved.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 shows a flowchart of an augmented reality AR group photo method provided by an embodiment of the present disclosure;
FIG. 2a is a diagram illustrating a specific example of providing an approach animation provided by an embodiment of the present disclosure;
fig. 2b illustrates an example diagram of presenting a group photo action trigger prompt in a presentation screen according to an embodiment of the present disclosure;
fig. 3 shows a flowchart of a specific method for adjusting a shooting position in the augmented reality AR group photo method provided by the embodiment of the present disclosure;
fig. 4 illustrates a schematic diagram of an augmented reality AR group photo device provided by an embodiment of the present disclosure;
fig. 5 shows a schematic diagram of another augmented reality AR group photo device provided by the embodiment of the present disclosure;
fig. 6 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Researches show that the information related to the historical celebrities displayed in the historical exhibition hall is character or picture information which can only be watched by visitors, cannot be interacted with the visitors, is poor in interactivity and is poor in immersion of the visitors.
Based on the above research, the embodiments of the present disclosure provide an AR group photo method, apparatus, computer device, and storage medium, which may utilize an augmented reality AR technology, based on a trigger of a user, obtain a group photo of the user and a history celebrity by displaying an AR character special effect of a user image and the history celebrity, increase interaction between the user and the history celebrity, and simultaneously improve an immersion feeling of the user.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, first, an augmented reality AR group photo method disclosed in the embodiments of the present disclosure is described in detail, where an execution subject of the augmented reality AR group photo method provided in the embodiments of the present disclosure is generally an AR group photo device with certain computing capability, and the AR group photo device includes, for example: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle mounted device, a wearable device, or a server or other processing device. In some possible implementations, the augmented reality AR group photo method may be implemented by a processor calling computer readable instructions stored in a memory.
The following describes the augmented reality AR group photo method provided by the embodiment of the present disclosure by taking the execution subject as an AR group photo device as an example.
Referring to fig. 1, which is a flowchart of an augmented reality AR group photo method provided in an embodiment of the present disclosure, the method includes steps S101 to S103, where:
s101: displaying the AR character special effect of the history celebrity in a first display area of a display screen;
s102: acquiring a user image in real time, and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
s103: and after the fact that the user performs a preset group photo triggering action is detected, generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area.
The method comprises the steps of displaying an AR character special effect of a historical celebrity in a first display area of a display screen, acquiring a user image in real time, displaying the user image in a second area of the display screen, and detecting whether the user performs a preset group photo triggering action or not based on the user image acquired in real time; after the fact that the user makes a preset group photo triggering action is detected, the group photo of the user and the historical celebrity is generated based on the AR character special effect displayed in the first area and the user image displayed in the second area, and then the group photo of the user and the historical celebrity can be realized based on the interaction between the user and the historical celebrity, so that the group photo of the user and the historical celebrity can be commented, and the interactivity is improved.
The following describes each of the above-mentioned steps S101 to S103 in detail.
Firstly, the method comprises the following steps: in the above S101, the AR character special effect of the history celebrity may include: the whole-body model or the half-body model or the head portrait of the historical celebrity can also comprise the name, the life level, the representative works and the like of the historical celebrity.
The AR character special effect can be a preset poster or a built three-dimensional model of a historical celebrity.
The AR character special effects of the history celebrity can have different actions, expressions, clothing accessories and the like, for example: for the actions, actions such as hunch, fist, back hand and the like can be included; for the expression, expressions such as smile, serious, thinking and the like can be included; the garment accessories may also be changed periodically or according to user preferences. In addition, different historical celebrity images can be displayed based on a preset algorithm according to the personal image of the user.
The AR character special effect of the history celebrity may be constructed based on an image included in the history data corresponding to the history celebrity, for example, an AR character special effect of a desertliving disease.
In another embodiment of the present disclosure, before displaying the AR character special effect of the history celebrity in the first display area of the display screen, whether a human body is present at a preset position may also be monitored in real time. Here, the preset position is located within a shooting visual field range of a camera which is installed in advance and used for acquiring a user image, and the preset position can be specifically set according to an actual installation position of the camera and a site position of a group photo with a history celebrity.
Specifically, the method for monitoring whether a human body is present at a preset position in real time includes, but is not limited to, the following examples:
example one: and monitoring whether a human body is present at the preset position in real time by using a sensor.
For example, a sensor may be installed on the display screen or in a region of a predetermined range, such as: the method comprises the steps that a pressure sensor is installed on the ground position close to the front of a display screen, when a user is located in the ground area, the pressure sensor senses pressure, pressure signals are generated, the pressure signals are transmitted to AR group photo equipment, and the AR group photo equipment can control the AR character special effects of historical celebrities to be displayed in a first display area of the display screen. Or, an infrared detector is installed in a preset space close to the display screen, when a user is located in the space, the infrared detector senses a temperature rise signal to generate a temperature signal, the temperature signal is transmitted to the AR group photo device, and the AR group photo device can control the AR character special effect of the historical celebrity to be displayed in the first display area of the display screen.
Example two: and acquiring a detection image of a preset position in real time, and detecting whether a human body image appears in the detection image.
Illustratively, the detection image of the preset position can be acquired in real time through the camera. Specifically, the camera may be a dedicated camera connected to the display screen, or may be another camera arranged in the group photo site, for example, a monitoring camera for monitoring, and the monitoring camera may be linked with a main body, such as a terminal device or a server, for executing the method, so as to obtain a detection image of the preset position in real time.
After the camera acquires the detection image of the preset position in real time, the acquired detection image can be sent to the AR group photo equipment. After the AR group photo equipment acquires the detection image of the preset position, the AR group photo equipment directly carries out subsequent processing on the detection image, and if the detection image is detected to have human body images, the AR group photo equipment directly carries out subsequent processing on the detection image. The detection method comprises the following steps: and identifying the image by using a human body identification algorithm or a human body identification neural network model so as to detect whether a human body image appears in the image.
In addition, before the AR character special effect of the history celebrity is displayed in the first display area of the display screen, the entrance animation of the history celebrity can be played in the display screen, so that the interaction process is enriched, and the interest is increased.
Specifically, the entrance animation of the historical celebrity may be related to the historical celebrity; for example, an entrance animation of an ancient poem may be an opening animation created based on a scene described in a poem created by the poem; the scene of the entry of the fighting hero may be, for example, a scene of the opening created based on the hero track of the fighting hero.
Illustratively, referring to FIG. 2a, FIG. 2a provides a specific exemplary view of an incoming animation; in the approach animation presented on the presentation screen 21, the scene 22 in which the approach animation is presented is a scene of an opening animation created based on a scene described in poetry created by a poetry person.
II, secondly: in the above S102, the camera for acquiring the user image and the camera for detecting whether a human body appears at the preset position may be the same camera or different cameras.
In the case where both are the same camera, the camera will always be on. Under the condition that the two cameras are different, the camera for acquiring the user image can be always in an open state, and can also be opened after the human body is detected to be present at a preset position.
After the user image is acquired in real time, the user image is displayed in a second area of the display screen, wherein the first display area and the second display area can be arranged in parallel.
In one possible embodiment, the first display area and the second display area may be strictly defined display areas, and there may be an overlapping portion between the two; after the user image is obtained, the user image is subjected to matting to obtain an image of the user, and the image is displayed in a second display area.
In one possible embodiment, the first display area and the second display area are not strictly defined display areas on the display screen. In practice, the AR character special effect of the history character is displayed in the first display area based on, for example, a sticker technique; the first display area is actually an area which has a certain relative position relation with a camera for acquiring the user image; when the user is located in the shooting visual field range of the camera for acquiring the user image, the mutual position relation with the special effect of the AR character or the interactive action and the like can be changed by adjusting the position and the posture of the user.
After the user image is acquired, whether the user performs a preset group photo triggering action is detected based on the user image acquired in real time. The preset group photo triggering action can be displayed in a text or graphic form on a display screen, for example, to prompt a user to make a corresponding action to trigger group photo.
In addition, a prompt board can be arranged near the display screen, and the group photo triggering action is displayed on the prompt board in a text or graphic mode so as to prompt a user to make a corresponding action to trigger group photo.
Illustratively, the group photo trigger action includes, for example: the boxing tool can be used for holding a fist, waving hands and the like and can be set according to actual needs.
Illustratively, after the user image is acquired, an action prompt graphic pops up in the central area or other highlighted areas of the display screen, and is used for instructing the user to make a corresponding group photo trigger action according to the action prompt graphic.
As shown in fig. 2b, fig. 2b provides an example diagram showing a group photo action triggering prompt in a show screen, in which the group photo triggers as a "clench" and a user can trigger the group photo by making an action consistent with the "clench" prompted in the show screen. In this example, 23 denotes an AR character special effect; 24 denotes a user image; and 25, group action trigger cues.
Thirdly, the method comprises the following steps: in the above S103, the preset group photo triggering action sent by the user is equivalent to sending an instruction to capture the currently displayed screen display image, and due to the difference between the shooting opportunities and the shooting environments, the generated image may not meet the expectations of the user, so that the group photo of the user and the historical celebrity can be generated each time the user sends the preset triggering action, and the user can select the group photo.
In another embodiment of the present disclosure, after a group photo of the user and the history celebrity is generated, the group photo may be stored in a preset storage location, and a two-dimensional code for accessing the preset storage location is displayed to the user through the display screen. The user uses the terminal equipment of the user to scan the two-dimensional code, can access to the preset storage position for storing the group photo, and can check the generated group photo. The user can select a favorite image from the images, download or print.
In another embodiment, the user may also trigger a subsequent charging operation when selecting to print a group photo, providing the user with a way to pay for printing the image.
In another embodiment of the present disclosure, since the heights of the users who take the group pictures are different, the camera may be adjusted before taking the group pictures with a better effect. Referring to fig. 3, fig. 3 is a flowchart of a specific method for adjusting a shooting position in an augmented reality AR group photo method provided by the embodiment of the present disclosure, where the adjusting method includes steps S301 to S302, where:
s301: determining head pose information of the user based on the user image;
s302: and adjusting the shooting position of the image acquisition equipment based on the head posture information.
In the above S301, the head posture information includes: pitch angle of the face, and yaw angle.
Specifically, based on the acquired user image, the pitch angle and yaw angle information of the corresponding face in the image can be identified based on a certain head identification algorithm or a head identification model.
In the above S302, a specific adjustment method for the shooting position of the image capturing apparatus may include:
adjusting the shooting height of the image acquisition equipment under the condition that the absolute value of the pitch angle is smaller than a pitch angle threshold;
and adjusting the horizontal rotation angle of the image acquisition equipment under the condition that the absolute value of the yaw angle is smaller than a yaw angle threshold value.
When the head pose of the face image is detected, for example, a plurality of face key points in the face image can be identified; and then determining a rotation matrix and a translation matrix of the head pose according to the coordinates of the key points of the human face in the human face image. Head pose information is then determined based on the rotation matrix and the translation matrix.
Wherein the head pose information is represented as: (yaw, pitch, roll).
Wherein, yaw represents the pitch angle, namely the angle of raising or lowering the head of a person; pitch represents the yaw angle, i.e. the angle at which the person's head turns left and right; roll represents the roll angle, i.e., the angle of the human yaw.
If the absolute value of the pitch angle is larger than or equal to the pitch angle threshold value, or the absolute value of the yaw angle is larger than or equal to the yaw angle threshold value, the number of areas of the face appearing in the face image is reduced; the worse the resulting group effect of the group photo is.
Therefore, based on the user image, the head posture information of the user is determined, the pitch angle of the face and the absolute value of the yaw angle are determined, and compared with the preset pitch angle threshold and yaw angle threshold of the face, for example: and respectively setting the pitch angle threshold and the yaw angle threshold of the human face to be 10 degrees, and determining that the angle of the image acquisition equipment needs to be adjusted if the absolute values of the pitch angle and the yaw angle of the human face in the image are greater than 10 degrees. And then, determining an adjusting direction based on the positive and negative values of the pitch angle and the yaw angle of the human face, wherein the pitch angle corresponds to the up-down direction, and the yaw angle corresponds to the left-right direction.
Therefore, the obtained group photo effect is better through adjusting the shooting angle of the camera.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, a group photo device corresponding to the group photo method is also provided in the embodiments of the present disclosure, and since the principle of solving the problem of the device in the embodiments of the present disclosure is similar to the group photo method described above in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are not described again.
Referring to fig. 4 and 5, fig. 4 is a schematic view of a group photo device according to an embodiment of the present disclosure; fig. 5 is a schematic view of another group photo device according to an embodiment of the present disclosure. The group photo device includes: a display module 410, a monitoring module 420, and a generation module 430, wherein:
the display module 410 is used for displaying the AR character special effect of the history celebrity in a first display area of the display screen;
the detection module 420 is configured to acquire a user image in real time and display the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
a generating module 430, configured to generate a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area after detecting that the user performs a preset group photo triggering action.
The embodiment of the disclosure provides an augmented reality AR group photo device, which utilizes augmented reality AR technology to detect that after a user performs a preset group photo triggering action, the AR character special effects of a user image and a historical celebrity are displayed simultaneously, so that the user can share a commemoration with the historical celebrity, certain interactive experience is brought to the user, and the user experience degree is improved.
In an alternative embodiment, as shown in fig. 5, the group photo device further includes:
and a monitoring module 440 for monitoring whether a human body is present at a predetermined position.
In an optional implementation manner, the monitoring module 440 is specifically configured to:
monitoring whether a human body is present at the preset position in real time by using a sensor;
alternatively, the first and second electrodes may be,
and acquiring a detection image of a preset position in real time, and detecting whether a human body image appears in the detection image.
In an optional embodiment, the group photo device further includes:
a playing module 450, configured to play the incoming animation of the history celebrity in the display screen;
the display module 410 is specifically configured to:
and after the playing of the entrance animation is finished, displaying the special effect of the AR character of the history celebrity in the first display area of the display screen.
In an optional embodiment, the group photo device further includes:
the storage module 460 is configured to store the group photo to a preset storage location, and display a two-dimensional code for accessing the preset storage location to a user through the display screen.
In an optional embodiment, the group photo device further includes:
a determining module 470 for determining head pose information of the user based on the user image;
and an adjusting module 480, configured to adjust a shooting position of the image capturing apparatus based on the head posture information.
In an alternative embodiment, the head pose information comprises: pitch angle of the face, and yaw angle.
In an optional implementation manner, the adjusting module 480 is specifically configured to:
adjusting the shooting height of the image acquisition equipment under the condition that the absolute value of the pitch angle is smaller than a pitch angle threshold;
and adjusting the horizontal rotation angle of the image acquisition equipment under the condition that the absolute value of the yaw angle is smaller than a yaw angle threshold value.
An embodiment of the present disclosure further provides a computer device, as shown in fig. 6, which is a schematic structural diagram of the computer device provided in the embodiment of the present disclosure, and the computer device includes:
a processor 11 and a memory 12; the memory 12 stores machine-readable instructions executable by the processor 11, which when executed by a computer device are executed by the processor to perform the steps of:
acquiring a second face image matched with the first face image from a database based on the first face image acquired immediately;
determining a first avatar score of the first facial image and a second avatar score of the second facial image;
determining a target face image from the first face image and the second face image based on the first avatar score and the second avatar score;
and displaying the target face image.
In an alternative embodiment, the instructions executed by processor 11 for determining the first avatar score of the first face image include:
carrying out face state detection on the face included in the first face image to obtain state information corresponding to each face state in at least one face state;
determining a state score corresponding to each face state based on the state information corresponding to each face state;
and obtaining a first image score of the first human face image based on the state score of each human face state in at least one human face state.
In an alternative embodiment, the processor 11 executes instructions that include at least one of the following face states: eye pose, mouth pose, head pose, degree of occlusion, and expression.
In an alternative embodiment, the instructions executed by the processor 11 for performing face state detection on the face included in the first face image for the case that the face state includes an eye pose includes: detecting eye postures of the human faces included in the first human face image to obtain state information corresponding to the eye postures; the state information corresponding to the eye posture comprises: degree of eye opening and closing;
for a case that the face state includes a mouth pose, the performing face state detection on the face included in the first face image includes: performing mouth angle inclination direction detection on a face included in the first face image, and determining state information corresponding to the mouth posture based on a result of the mouth angle inclination direction detection;
for a case that the face state includes a head pose, the performing face state detection on the face included in the first face image includes: performing head posture detection on the face in the first face image to obtain state information corresponding to the head posture; the state information corresponding to the head pose includes: the pitch angle and yaw angle of the human face;
for the case that the face state includes the occlusion degree, the detecting the face state of the face included in the first face image includes:
performing key point detection on the first face image to obtain key point detection results corresponding to a plurality of face key points in the first face image respectively; and determining the state information corresponding to the shielding degree based on the key point detection results respectively corresponding to the plurality of face key points.
In an optional implementation manner, in the instructions executed by the processor 11, the group photo method further includes:
performing quality detection on the first face image to obtain a quality detection score of the first face image;
the obtaining a first avatar score of the first face image based on the state score of each of the at least one face state comprises:
and obtaining a first image score of the first human face image based on the state score of each human face state in at least one human face state and the quality detection score.
In an alternative embodiment, the processor 11 executes instructions that include at least one of: brightness detection, blur level detection, and resolution detection.
In an alternative embodiment, the instructions executed by processor 11 for determining the second appearance score of the second facial image include:
and reading a second shape score corresponding to the second face image from the database.
In an optional implementation manner, in the instructions executed by the processor 11, the group photo method further includes:
and displaying the first face image after the second face image matched with the first face image does not exist in the database.
In an optional implementation manner, in the instructions executed by the processor 11, the group photo method further includes:
and under the condition that the target face image is the first face image, storing the first face image into the database, and deleting the second face image stored in the database.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the group photo method described in the above method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The computer program product of the group photo method provided in the embodiments of the present disclosure includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the steps of the group photo method described in the above method embodiments, which may be referred to specifically for the above method embodiments, and are not described herein again.
The embodiments of the present disclosure also provide a computer program, which when executed by a processor implements any one of the methods of the foregoing embodiments. The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (11)
1. An Augmented Reality (AR) group photo method, comprising:
displaying the AR character special effect of the history celebrity in a first display area of a display screen;
acquiring a user image in real time, and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
and after the fact that the user performs a preset group photo triggering action is detected, generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area.
2. The AR group photo method of claim 1, wherein before displaying the AR character special effect of the history celebrity in the first display area of the display screen, the group photo method further comprises:
and monitoring whether a human body is present at a preset position in real time.
3. The AR group photo method of claim 2, wherein said real-time monitoring whether a human being is present at a predetermined location comprises:
monitoring whether a human body is present at the preset position in real time by using a sensor;
alternatively, the first and second electrodes may be,
and acquiring a detection image of a preset position in real time, and detecting whether a human body image appears in the detection image.
4. The AR group photo method according to any one of claims 1 to 3, wherein before displaying the AR character special effect of the history celebrity in the first display area of the display screen, the group photo method further comprises:
playing an entrance animation of the history celebrity in the display screen;
the method for displaying the AR character special effect of the history celebrity in the first display area of the display screen comprises the following steps:
and after the playing of the entrance animation is finished, displaying the special effect of the AR character of the history celebrity in the first display area of the display screen.
5. The AR group photo method of any of claims 1-4, wherein after generating a group photo of the user with the historical celebrity, the group photo method further comprises:
and storing the group photo to a preset storage position, and displaying the two-dimensional code for accessing the preset storage position to a user through the display screen.
6. The AR group photo method according to any one of claims 1-5, further comprising:
determining head pose information of the user based on the user image;
and adjusting the shooting position of the image acquisition equipment based on the head posture information.
7. The AR group photo method of claim 6, wherein the head pose information comprises: pitch angle of the face, and yaw angle.
8. The AR group photo method according to any one of claims 6 or 7, wherein the adjusting the shooting position of the image capturing device based on the head pose information comprises:
adjusting the shooting height of the image acquisition equipment under the condition that the absolute value of the pitch angle is smaller than a pitch angle threshold;
and adjusting the horizontal rotation angle of the image acquisition equipment under the condition that the absolute value of the yaw angle is smaller than a yaw angle threshold value.
9. An Augmented Reality (AR) group photo device, comprising:
the display module is used for displaying the AR character special effect of the history celebrity in a first display area of the display screen;
the detection module is used for acquiring a user image in real time and displaying the user image in a second area of the display screen; detecting whether the user makes a preset group photo triggering action or not based on the user image acquired in real time;
and the generating module is used for generating a group photo of the user and the historical celebrity based on the AR character special effect displayed in the first area and the user image displayed in the second area after detecting that the user performs a preset group photo triggering action.
10. A computer device, comprising: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating over the bus when a computer device is run, the machine readable instructions when executed by the processor performing the steps of the augmented reality AR group photo method of any of claims 1 to 8.
11. A computer-readable storage medium, having stored thereon a computer program for performing, when executed by a processor, the steps of the method for augmented reality AR group photo according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010509133.7A CN111638798A (en) | 2020-06-07 | 2020-06-07 | AR group photo method, AR group photo device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010509133.7A CN111638798A (en) | 2020-06-07 | 2020-06-07 | AR group photo method, AR group photo device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111638798A true CN111638798A (en) | 2020-09-08 |
Family
ID=72329990
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010509133.7A Pending CN111638798A (en) | 2020-06-07 | 2020-06-07 | AR group photo method, AR group photo device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111638798A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112437226A (en) * | 2020-09-15 | 2021-03-02 | 上海传英信息技术有限公司 | Image processing method, apparatus and storage medium |
| CN112511739A (en) * | 2020-11-20 | 2021-03-16 | 上海盛付通电子支付服务有限公司 | Interactive information generation method and equipment |
| CN112906467A (en) * | 2021-01-15 | 2021-06-04 | 深圳市慧鲤科技有限公司 | Group photo image generation method and device, electronic device and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
| WO2017036516A1 (en) * | 2015-09-01 | 2017-03-09 | Deutsche Telekom Ag | Externally wearable treatment device for medical application, voice-memory system, and voice-memory-method |
| CN108021896A (en) * | 2017-12-08 | 2018-05-11 | 北京百度网讯科技有限公司 | Image pickup method, device, equipment and computer-readable medium based on augmented reality |
| CN108182730A (en) * | 2018-01-12 | 2018-06-19 | 北京小米移动软件有限公司 | Actual situation object synthetic method and device |
| US20180181719A1 (en) * | 2016-12-28 | 2018-06-28 | Cerner Innovation, Inc. | Virtual healthcare personal assistant |
| CN108447159A (en) * | 2018-03-28 | 2018-08-24 | 百度在线网络技术（北京）有限公司 | Man face image acquiring method, apparatus and access management system |
| CN108595012A (en) * | 2018-05-10 | 2018-09-28 | 北京光年无限科技有限公司 | Visual interactive method and system based on visual human |
| CN108737715A (en) * | 2018-03-21 | 2018-11-02 | 北京猎户星空科技有限公司 | A kind of photographic method and device |
| CN111026261A (en) * | 2018-10-09 | 2020-04-17 | 上海奈飒翱网络科技有限公司 | Method for AR interactive display of tourist attractions |
| CN111240482A (en) * | 2020-01-10 | 2020-06-05 | 北京字节跳动网络技术有限公司 | Special effect display method and device |
-
2020
- 2020-06-07 CN CN202010509133.7A patent/CN111638798A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017036516A1 (en) * | 2015-09-01 | 2017-03-09 | Deutsche Telekom Ag | Externally wearable treatment device for medical application, voice-memory system, and voice-memory-method |
| CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
| US20180181719A1 (en) * | 2016-12-28 | 2018-06-28 | Cerner Innovation, Inc. | Virtual healthcare personal assistant |
| CN108021896A (en) * | 2017-12-08 | 2018-05-11 | 北京百度网讯科技有限公司 | Image pickup method, device, equipment and computer-readable medium based on augmented reality |
| CN108182730A (en) * | 2018-01-12 | 2018-06-19 | 北京小米移动软件有限公司 | Actual situation object synthetic method and device |
| CN108737715A (en) * | 2018-03-21 | 2018-11-02 | 北京猎户星空科技有限公司 | A kind of photographic method and device |
| CN108447159A (en) * | 2018-03-28 | 2018-08-24 | 百度在线网络技术（北京）有限公司 | Man face image acquiring method, apparatus and access management system |
| CN108595012A (en) * | 2018-05-10 | 2018-09-28 | 北京光年无限科技有限公司 | Visual interactive method and system based on visual human |
| CN111026261A (en) * | 2018-10-09 | 2020-04-17 | 上海奈飒翱网络科技有限公司 | Method for AR interactive display of tourist attractions |
| CN111240482A (en) * | 2020-01-10 | 2020-06-05 | 北京字节跳动网络技术有限公司 | Special effect display method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112437226A (en) * | 2020-09-15 | 2021-03-02 | 上海传英信息技术有限公司 | Image processing method, apparatus and storage medium |
| CN112437226B (en) * | 2020-09-15 | 2022-09-16 | 上海传英信息技术有限公司 | Image processing method, apparatus and storage medium |
| CN112511739A (en) * | 2020-11-20 | 2021-03-16 | 上海盛付通电子支付服务有限公司 | Interactive information generation method and equipment |
| CN112511739B (en) * | 2020-11-20 | 2022-05-06 | 上海盛付通电子支付服务有限公司 | Interactive information generation method and equipment |
| CN112906467A (en) * | 2021-01-15 | 2021-06-04 | 深圳市慧鲤科技有限公司 | Group photo image generation method and device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106170083B (en) | Image processing for head mounted display device | |
| CN106355153B (en) | A kind of virtual objects display methods, device and system based on augmented reality | |
| CN105027033B (en) | Method, device and computer-readable media for selecting Augmented Reality object | |
| CN112348969A (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| CN111638798A (en) | AR group photo method, AR group photo device, computer equipment and storage medium | |
| CN111627117B (en) | Image display special effect adjusting method and device, electronic equipment and storage medium | |
| WO2016122973A1 (en) | Real time texture mapping | |
| JP6750046B2 (en) | Information processing apparatus and information processing method | |
| CN111640202B (en) | AR scene special effect generation method and device | |
| CN105279795A (en) | Augmented reality system based on 3D marker | |
| KR101510798B1 (en) | Portable Facial Expression Training System and Methods thereof | |
| CN111640197A (en) | Augmented reality AR special effect control method, device and equipment | |
| CN113507621A (en) | Live broadcast method, device, system, computer equipment and storage medium | |
| CN108090968B (en) | Method and device for realizing augmented reality AR and computer readable storage medium | |
| CN111640165A (en) | Method and device for acquiring AR group photo image, computer equipment and storage medium | |
| CN111625100A (en) | Method and device for presenting picture content, computer equipment and storage medium | |
| CN111639613B (en) | Augmented reality AR special effect generation method and device and electronic equipment | |
| CN111640192A (en) | Scene image processing method and device, AR device and storage medium | |
| CN111667588A (en) | Person image processing method, person image processing device, AR device and storage medium | |
| CN111696215A (en) | Image processing method, device and equipment | |
| CN111640200A (en) | AR scene special effect generation method and device | |
| JP2020087277A (en) | Video synthesizer, method for synthesizing video, and video synthesizing program | |
| CN112150349A (en) | Image processing method and device, computer equipment and storage medium | |
| CN112905014A (en) | Interaction method and device in AR scene, electronic equipment and storage medium | |
| CN112637665A (en) | Display method and device in augmented reality scene, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |