WO2019218879A1

WO2019218879A1 - Photographing interaction method and apparatus, storage medium and terminal device

Info

Publication number: WO2019218879A1
Application number: PCT/CN2019/085459
Authority: WO
Inventors: 刘耀勇; 陈岩
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-05-16
Filing date: 2019-05-05
Publication date: 2019-11-21
Also published as: CN108921815A

Abstract

Provided in the embodiments of the present application are a photographing interaction method and apparatus, a storage medium and a terminal device. The method comprises: acquiring pose three-dimensional data of the imaging part by means of the recognition camera; recognizing the pose three-dimensional data by means of a pre-set imaging evaluation model so as to determine imaging pose evaluation information of the imaging part; and determining the corresponding photographing prompt content according to the imaging pose evaluation information.

Description

Photo interaction method, device, storage medium and terminal device

The present disclosure claims priority to Chinese Patent Application No. 20181046954, filed on May 16, 2018, the entire disclosure of which is incorporated herein by reference.

Technical field

The embodiments of the present invention relate to the technical field of terminal devices, for example, to a photo interaction method, device, storage medium, and terminal device.

Background technique

With the development of camera technology for terminal devices, most users have terminal devices that can take pictures. Different from the traditional camera, it is very easy to take pictures through the terminal device. When shooting with a traditional camera, it is generally necessary to perform parameter setting or adjust the focal length of the lens. However, the user only needs to take a picture after the camera. Press the camera button to complete.

Therefore, as the terminal device is more and more convenient to take pictures, people's attitude towards taking pictures will become more casual. The user may take multiple photos and then select satisfactory photos from them. Generally, it is difficult for people to directly take satisfactory photos, so The camera technology of the terminal device needs to be optimized.

Summary of the invention

The photographing interaction method, device, storage medium and terminal device provided by the embodiments of the present application can optimize the photographing operation of the user.

An embodiment of the present application provides a method for photographing interaction, including:

Obtaining three-dimensional posture data of the imaging portion by the recognition camera in a case where the recognition camera captures an imaging portion of the user;

Identifying the posture three-dimensional data by a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion;

Corresponding photographing prompt content is determined according to the imaging posture evaluation information.

An embodiment of the present application provides a camera interaction device, including:

a three-dimensional data acquisition module, configured to acquire, by the recognition camera, three-dimensional data of the posture of the imaging portion, in a case where the recognition camera captures an imaging portion of the user;

An evaluation determining module configured to identify the posture three-dimensional data by a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion;

The prompt determination module is configured to determine a corresponding shooting prompt content according to the imaging posture evaluation information.

The embodiment of the present application provides a computer readable storage medium. The computer readable storage medium stores a computer program, and when the program is executed by the processor, the photo interaction method as described in the embodiment of the present application is implemented.

The embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and operable by the processor, and the processor executes the computer program to implement the embodiment of the present application. Photo interaction method.

The photographing interaction scheme provided in the embodiment of the present application obtains the three-dimensional data of the posture of the imaged portion by using the recognition camera in the case that the image capturing portion of the user is captured by the recognition camera; The posture three-dimensional data is identified to determine imaging posture evaluation information of the imaging portion; and the corresponding shooting prompt content is determined according to the imaging posture evaluation information. By adopting the above technical solution, the imaging effect of the imaging part can be evaluated according to the three-dimensional data of the imaging part in the case of capturing the imaging part of the user, and the shooting prompt content is determined according to the evaluation information to prompt the user to take a better photo. .

DRAWINGS

FIG. 1 is a schematic flowchart of a photo interaction method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a scenario of a photo interaction method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of another scenario of a photo interaction method according to an embodiment of the present disclosure;

FIG. 4 is a schematic flowchart diagram of another method for photographing interaction according to an embodiment of the present application;

FIG. 5 is a schematic flowchart of another method for photographing interaction according to an embodiment of the present application;

FIG. 6 is a schematic flowchart diagram of another method for photographing interaction according to an embodiment of the present application;

FIG. 7 is a schematic diagram of initial three-dimensional data according to an embodiment of the present application;

FIG. 8 is a schematic flowchart diagram of another method for photographing interaction according to an embodiment of the present application;

FIG. 9 is a structural block diagram of a photo interaction device according to an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of another terminal device according to an embodiment of the present disclosure.

Detailed ways

The technical solutions of the present application will be described below with reference to the accompanying drawings and specific embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting. In addition, it should be noted that, for the convenience of description, only some but not all of the structures related to the present application are shown in the drawings.

In the case of taking pictures, the effect of shooting is very different even if the same person is photographed due to the difference in shooting angle and shooting distance. When an ordinary user takes a picture through the terminal device, the composition and shooting angle of the photograph may not be considered, so the effect of the photograph taken is often not very beautiful. The embodiment of the present application can provide an optimization prompt for the user's photographing operation, so that the user can take a more beautiful photo.

FIG. 1 is a schematic flowchart of a method for photographing interaction according to an embodiment of the present disclosure. The method may be implemented by a photo interaction device, where the device may be implemented by software and/or hardware, and may be integrated into a terminal device or integrated. In other devices with an operating system installed. As shown in FIG. 1, the method includes the following steps.

In S1100, when the recognition camera captures an imaging portion of the user, the three-dimensional data of the posture of the imaging portion is acquired by the recognition camera.

In this embodiment, the image forming portion is a body part of a user included in the captured image by taking a picture by the recognition camera. Illustratively, if the photo taken by the user is a bust, the imaged portion includes a body part above the waist of the user.

The identification camera may be a camera on the terminal device, may be a front camera of the terminal device, and/or a rear camera. Illustratively, at least one camera is generally provided in the terminal device, and generally includes a front camera and a rear camera. If the user being photographed is the current user of the terminal device, the recognition camera may be a front camera of the terminal device, so that the user can know the captured picture through the screen of the terminal device. For another example, if the user being photographed is not the current user of the terminal device, but other users, the identification camera may be a rear camera of the terminal device; the current user of the current terminal device uses the terminal device to capture images of other users. Part.

The image acquired by a conventional camera is generally two-dimensional data, that is, a color value (Red Green Blue (RGB) value) or a set of gray values of pixels arranged in a matrix of rows and columns. Compared with the two-dimensional data, the three-dimensional data also includes the depth information of the captured imaging portion, that is, the distance between the different spatial points on the body part of the captured user and the camera, so the three-dimensional data can represent the spatial information of the captured object. The recognition camera may be a camera with a distance sensor, and the distance sensor may acquire the distance between the different spatial points on the captured object and the camera, so that the three-dimensional data of the captured imaging portion can be acquired.

The posture three-dimensional data includes: three-dimensional data of the imaging portion captured by the recognition camera; and position data of the imaging portion in the captured image.

The posture three-dimensional data may be a set of three-dimensional data acquired when the imaging portion is in a stationary posture. The attitude three-dimensional data may also be a plurality of sets of three-dimensional data acquired when the imaging part makes a dynamic posture.

In an embodiment, the imaging site comprises a user's head. Correspondingly, acquiring the three-dimensional posture data of the imaging portion by the recognition camera comprises: determining a posture feature portion of the head, and acquiring three-dimensional posture three-dimensional data of the posture feature portion of the head by the recognition camera.

In an embodiment, if the imaged portion is the user's head, it indicates that the user is taking a self-portrait through the terminal device, or is taking a photo of the user's ID. Illustratively, if the user is taking a self-portrait, since the camera is close to the user, the shooting angle is limited, so if you want to take a good-looking photo during self-timer, you must select a suitable angle. For example, if the user's ID photo is being taken, the ID photo of the ID is more demanding. If the standard is not met, the photo ID of the document will not be used.

Since the posture of the user's head is difficult to judge by the whole, it is necessary to judge based on the posture feature portion of the head. The posture feature portion may be a feature portion for determining a posture of a user's head. Illustratively, the posture feature portion includes two ears, and the posture of the head may be determined according to the positions of the two ears; the posture feature portion may further include a facial position of the face, such as the position of the eyes, the nose, and the mouth, etc. According to the position of the facial features, the posture of the head can be determined.

Therefore, in the case where the imaging part is the user's head, the three-dimensional data of the posture characteristic part can accurately determine the specific posture of the head, and the accuracy of the imaging posture evaluation can be further improved.

S1110: Identify the posture three-dimensional data by using a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion.

The posture three-dimensional data is actually a set of one or more sets of data, and further needs to analyze and recognize the three-dimensional data according to the set of data, which actually corresponds to the specific posture of the imaging part.

The imaging posture evaluation information includes: evaluation information of a photographing screen of an imaging portion of the user captured by the recognition camera, the evaluation information may be a difference between the photographing screen and an imaging standard, and the imaging standard may be a system pre- Assume. Illustratively, if the user's ID avatar is taken, the imaging avatar of the ID avatar includes the head at the center of the screen, the binocular front camera position, and the like.

The imaging evaluation model may be an identification system that has been trained to determine imaging posture evaluation information based on the posture three-dimensional data of the imaging site, and the imaging evaluation model may be pre-stored in the terminal device or pre-stored in the background server. When the three-dimensional data of the posture needs to be recognized, the pre-stored imaging evaluation model is called to identify the three-dimensional image of the posture to determine the imaging posture evaluation information of the photographed body part.

S1120: Determine corresponding shooting prompt content according to the imaging posture evaluation information.

In an embodiment, the shooting prompt content corresponding to the posture evaluation information may be determined according to the preset mapping table.

The shooting prompt content may be a prompt content for prompting the user for the evaluation information of the currently captured shooting screen; the shooting prompt content may also be a prompt content for prompting the user to adjust the shooting operation, and the shooting operation may be a pair identification The operation of the camera can also be the gesture adjustment operation of the user being photographed.

Exemplarily, the shooting prompt content may be display data output through a screen of the terminal device, and may be text data, picture data or animation data, etc.; the shooting prompt content may also be sound data output through a speaker of the terminal device. The content of the shooting prompt can be set according to the system preset or the user's selection, or can be set according to the actual application, which is not limited herein.

The user can make adjustments according to the content of the shooting prompt, so that the recognition camera can take a better photo.

In an embodiment, the imaging posture evaluation information includes an error value of the imaging portion and an imaging standard; the error value includes an attitude error value and/or a composition error value.

Correspondingly, determining the corresponding shooting prompt content according to the imaging posture evaluation information comprises: determining shooting priority content according to the error value; wherein the shooting prompt content is used to prompt the user to perform corresponding movement to reduce the error value .

In an embodiment, prompting the user to perform the corresponding movement may include: the user controls the recognition camera to move and/or the user adjusts the movement of the imaging portion; after the user performs the corresponding movement, the error value is reduced, correspondingly the imaging portion and the imaging standard The error value is also reduced and the user can get a better photo.

Illustratively, as shown in FIG. 2, the currently photographed is a photo of the user's ID, the user is photographed by the recognition camera 113, and the imaging posture evaluation information obtained by acquiring the three-dimensional image of the posture of the imaging portion includes: an imaging portion The composition error value with the imaging standard is large. Because in the currently photographed picture, the lens angle is too high, the head is located in the middle and lower position of the picture, and the head of the imaging standard of the document avatar is located at the center of the picture, so the composition error of the imaging part and the imaging standard in FIG. 2 The value is larger.

Corresponding to the determined shooting prompt content may include: prompting the user to lower the shooting angle of the recognition camera, or prompting to increase the height of the user's head. As shown in FIG. 3, after the user adjusts the photographing operation according to the content of the photographing prompt, the head of the user who recognizes the photographing of the camera is located at the center of the screen, which is closer to the imaging standard. Therefore, the recognition camera captures the adjusted imaging portion, and can generate a better photo of the ID card.

For another example, if the user does not face the recognition camera and is biased to the right side; the imaging evaluation information obtained by the acquired imaging posture three-dimensional data may include: the posture error value of the imaging portion and the imaging standard is large. The user can be prompted to adjust the gesture by shooting the prompt content, and/or adjust the position of the recognition camera.

The photographing interaction method provided in the embodiment of the present application is configured to acquire the three-dimensional data of the posture of the imaged portion by using the recognition camera in the case that the image capturing portion of the user is captured by the recognition camera; The posture three-dimensional data is identified to determine imaging posture evaluation information of the imaging portion; and the corresponding shooting prompt content is determined according to the imaging posture evaluation information. By adopting the above technical solution, the imaging effect of the imaging part can be evaluated according to the three-dimensional data of the imaging part in the case of capturing the imaging part of the user, and the shooting prompt content is determined according to the evaluation information to prompt the user to take a better photo. .

FIG. 4 is a schematic flowchart of another method for photographing interaction according to an embodiment of the present invention. Based on the technical solution provided by the foregoing embodiment, a description is given of determining a corresponding photographing prompt content according to the imaging posture evaluation information. In an embodiment, as shown in FIG. 4, the method includes the following steps.

S1200. Determine, when the recognition camera captures the head of the user, determine a posture feature portion of the head, and acquire, by the recognition camera, three-dimensional data of the posture of the posture feature portion of the head; and acquire the illumination of the head. Information, and determining the position of the light source based on the illumination information.

For a specific implementation manner of determining the posture feature of the head and acquiring the three-dimensional data of the posture of the posture of the head by the identification camera, reference may be made to the related description above, and details are not described herein again.

In an embodiment, the illumination information of the head is the illumination value distribution information of the spatial point included in the head in the picture captured by the recognition camera; the illumination value may be performed according to the pixel value of the captured picture. determine. Illustratively, if the average illumination value of the head in the captured picture is lower than the average illumination value of the overall picture, it may be determined that the current shooting angle is backlit, and the picture of the head of the captured picture user may be too dark. Therefore, it is necessary to determine the position of the light source, and thus the user's face can be directed toward the light source to obtain a clear photographing picture.

The position of the light source may be determined according to the distribution information of the illumination values of the spatial points of the head; exemplarily, if the average illumination value of the left side of the head is greater than the average illumination value of the right side, it may be determined that the light source is located at the left of the head side. After the position of the light source is determined, the user can be further assisted in capturing a clearer picture.

S1210: Identify the posture three-dimensional data by using a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion.

For details, refer to the related description above, and details are not described herein again.

S1220. Determine corresponding shooting prompt content according to the imaging posture evaluation information and the light source position.

The posture evaluation information includes an evaluation of the posture of the imaging portion in the photographing screen, and the light source position can determine the clear effect of the imaging portion in the photographing screen; therefore, the photographing image captured by the recognizing camera can be integrated according to the imaging posture evaluation information and the position of the light source. Judging, the corresponding can improve the accuracy of the evaluation of the shooting picture.

Exemplarily, if the current photo is taken by the user's ID card, the obtained imaging posture evaluation information includes: in the currently photographed picture, the lens angle is high, causing the face to be located in the middle and lower position of the screen, deviating from the imaging standard. . At the same time, the average illumination value of the user's head is not uniform, and the average value of the illumination on the left side of the head is higher than the average value of the illumination on the right side, which does not meet the requirement of uniform illumination of the face of the document. According to the imaging posture evaluation information and the position of the light source to determine the corresponding shooting prompt content, the user can further improve the posture adjustment or adjust the accuracy of the camera.

In the embodiment of the present application, by determining the corresponding shooting prompt content according to the imaging posture evaluation information and the light source position, the accuracy of the evaluation of the captured image of the recognition camera can be improved, and the accuracy of the shooting prompt content can be further improved.

FIG. 5 is a schematic flowchart of another method for photographing interaction according to an embodiment of the present disclosure. On the basis of the technical solution provided by any of the foregoing embodiments, the three-dimensional data of the gesture is identified by using a preset imaging evaluation model. The operation of determining the imaging posture evaluation information of the imaging site has been described. In an embodiment, as shown in FIG. 5, the method includes the following steps.

S1300. Acquire the three-dimensional posture data of the imaging part by the recognition camera when the recognition camera captures the imaging part of the user.

S1310: Identify the posture three-dimensional data by using a preset imaging evaluation model to determine an imaging category of the imaging portion, and determine imaging posture evaluation information of the imaging portion according to the imaging category.

In this embodiment, the types of photos include various types, for example, portrait photos include avatar photos, self photos, full body photos and photos, and the like, and different types of photos have different imaging standards. Illustratively, the avatar requires a higher angle and posture for the head, while the half-length and full-body photos require a higher picture composition. Therefore, in the case that the user performs photographing by recognizing the camera, the imaging category may be first determined according to the three-dimensional data of the posture of the imaging portion, and then the corresponding imaging standard may be determined according to the imaging category, so that the imaging posture evaluation information of the imaging portion may be improved. Sex.

S1320. Determine corresponding shooting prompt content according to the imaging posture evaluation information.

The embodiment of the present application identifies the three-dimensional data of the posture by using a preset imaging evaluation model to determine an imaging category of the imaging portion, and determines imaging posture evaluation information of the imaging portion according to the imaging category, by first determining The imaging category, thereby selecting an imaging standard corresponding to the imaging category, improves the accuracy of the evaluation of the imaging posture evaluation information, and further improves the operation efficiency of the user's photographing.

FIG. 6 is a schematic flowchart of another method for photographing interaction according to an embodiment of the present disclosure. On the basis of the technical solution provided by any of the foregoing embodiments, an operation of acquiring three-dimensional data of the posture of the imaged portion by using the identification camera is performed. It was explained. In an embodiment, as shown in FIG. 6, the method includes the following steps.

S1400. When the recognition camera captures an imaged portion of the user, the part depth data of the imaged portion and the part infrared data are acquired by the recognition camera.

The recognition camera is a three-dimensional (3D, three Dimensional) camera, and the three-dimensional camera includes various hardware structures, and may include: an infrared sensor, a distance sensor, a lens, and the like.

The part depth data is a set of distance values of the spatial point included in the imaging part from the recognition camera; the part depth data of the imaging part can be acquired by identifying the distance sensor in the camera.

The portion infrared data is a collection of infrared data reflected by a spatial point included in the imaging site. Wherein, in the case of the three-dimensional camera, the infrared sensor emits an infrared signal to the imaging site, and the imaging portion reflects the infrared information, and the infrared sensor can image the imaging portion according to the received infrared data.

S1410. Determine initial three-dimensional data of the imaging part according to the part depth data.

Wherein, the location depth data includes the distance value of the spatial point included in the imaging part, so the initial three-dimensional data of the imaging part can be determined according to the part depth data. Illustratively, as shown in FIG. 7, points a, b, c, and d in FIG. 7 are four spatial points, and X, Y, and Z axes represent spaces, wherein the Z axis represents depth data of spatial points, X and Y axes Indicates the coordinates of the plane position of the spatial point. The depth data of point a is the largest, that is, the point a is the farthest distance from the recognition camera. It can be seen from Fig. 7 that a three-dimensional vertebral body can be formed according to the plane coordinates and depth data of the four spatial points, thereby The depth data of the location of the spatial point and the planar coordinates of the spatial point can determine the initial three-dimensional data.

However, if some details of the imaged portion are occluded or data loss occurs, the corresponding detail position in the initial three-dimensional data may cause data loss, so it is further necessary to correct the initial three-dimensional data according to the part infrared data.

S1420: Correct the initial three-dimensional data according to the part infrared data to obtain three-dimensional posture data of the imaging part.

In this embodiment, for the spatial points included in the imaging portion, the depth data of each spatial point and the infrared data are in one-to-one correspondence. For the depth data of the spatial point where the data is missing, the infrared data corresponding to the depth data of the spatial point can measure and compare the overall initial three-dimensional data, and then perform feature complementation on the missing spatial points. The infrared signal is an electromagnetic wave, and the human eye cannot see the infrared signal. However, if the infrared light can still propagate at night or when the environment is dark and there is no visible light, in a dark environment, the infrared data can also be generated. Clear imaging; in turn, the initial 3D data can be corrected based on the location infrared data.

In an embodiment, the fitting relationship function may be established according to the depth data of the adjacent points and the infrared data, and the corresponding depth data is calculated according to the fitting relationship function and the infrared data of the missing space point, thereby obtaining the corrected posture three-dimensional. Data; wherein the missing spatial point is a spatial point where the depth data is missing, and the adjacent spatial point is an adjacent spatial point of the missing spatial point.

S1430: Identify the posture three-dimensional data by using a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion.

S1440. Determine corresponding shooting prompt content according to the imaging posture evaluation information.

For specific implementations of the foregoing operations, reference may be made to the related description above, and details are not described herein again.

Although the image of the imaged portion, that is, the acquired two-dimensional image of the imaged portion, is captured by an ordinary camera, the posture of the imaged portion can be recognized by the image processing and recognition technique. However, the two-dimensional data only includes the data of the planar image, and the requirements for the light are high. If the user poses the posture of the imaging part in a dark environment, the accurate imaging posture evaluation information may not be recognized in the acquired image data. , so the accuracy of 2D data is lower.

In the embodiment of the present application, the initial three-dimensional data of the imaging part is determined according to the part depth data, and the initial three-dimensional data is corrected according to the part infrared data to obtain three-dimensional data of the posture of the imaging part. The dark position is identified, and the initial three-dimensional data can be corrected by the infrared data of the part to obtain the complete three-dimensional image of the posture, thereby improving the accuracy of the recognition of the imaging posture evaluation information.

FIG. 8 is a schematic flowchart of another method for photographing interaction according to an embodiment of the present disclosure. On the basis of the technical solution provided by any of the foregoing embodiments, as shown in FIG. 8 , the method includes the following steps.

S1500: Input preset sample data into a preset classifier for training, and obtain an imaging evaluation model.

In this embodiment, the imaging evaluation model is configured to determine corresponding imaging posture evaluation information according to the captured three-dimensional data of the imaging portion; the preset sample data includes sample three-dimensional data of the imaging portion, and a corresponding sample imaging posture. Evaluation information.

In an embodiment, the preset sample data may include a plurality of different sample data, and the different sample data corresponds to the acquired sample three-dimensional data and the corresponding sample imaging posture evaluation information; If the imaging part is the head, the preset sample data may be sample three-dimensional data of different document avatar photos and corresponding sample imaging posture evaluation information, and the sample three-dimensional data includes sample three-dimensional data with different imaging posture evaluation information.

If the posture three-dimensional data is identified by a preset imaging evaluation model to determine an imaging category of the imaging portion, and imaging posture evaluation information of the imaging portion is determined according to the imaging category, the corresponding preset sample The data includes sample three-dimensional data of the imaging site, corresponding imaging categories, and corresponding sample imaging posture evaluation information. Since the three-dimensional data of the samples of each imaging category are different, the corresponding imaging standards are also different, so the attitude evaluation information is also different. Therefore, the sample three-dimensional data, the corresponding imaging category and the corresponding sample imaging posture evaluation information are used as preset sample data input value preset classifiers for training, to obtain an imaging evaluation model, which can be identified according to the input posture three-dimensional data, and determined. Corresponding imaging categories, and determining imaging posture evaluation information of the imaging portion according to the imaging category.

The preset classifier may be a neural network, and the preset sample data is input into a preset classifier for training, and the preset classifier may extract feature data of the sample three-dimensional data, and the corresponding sample imaging posture is marked by the sample three-dimensional data. The information and/or imaging category are evaluated, so corresponding imaging posture evaluation information and/or imaging categories can be determined based on the extracted feature data.

After the preset classifier is trained by the preset sample data, the obtained imaging evaluation model can identify the postures made by the imaging parts of different users, and determine the corresponding imaging posture evaluation information.

S1510. Acquire the three-dimensional posture data of the imaging part by the recognition camera when the recognition camera captures the imaging part of the user.

S1520: Identify the posture three-dimensional data by using a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion.

S1530. Determine corresponding shooting prompt content according to the imaging posture evaluation information.

In the embodiment of the present application, by inputting preset sample data into a preset classifier for training, the obtained imaging evaluation model can perform feature extraction on the three-dimensional data of the posture and classify and determine corresponding imaging posture evaluation information, thereby improving imaging posture evaluation information. The accuracy.

FIG. 9 is a structural block diagram of a camera interaction device according to an embodiment of the present disclosure. The device may perform a photo interaction method. As shown in FIG. 9 , the device includes: a three-dimensional data acquisition module 210 configured to capture a user in a recognition camera. Obtaining three-dimensional posture data of the imaging portion by the recognition camera; the evaluation determination module 211 is configured to identify the three-dimensional data of the posture by a preset imaging evaluation model to determine the imaging The imaging posture evaluation information of the part; the prompt determination module 212 is configured to determine the corresponding shooting prompt content according to the imaging posture evaluation information.

The photographing interaction device provided in the embodiment of the present application acquires the three-dimensional data of the posture of the imaged portion by using the recognition camera in the case that the image capturing portion of the user is captured by the recognition camera; The posture three-dimensional data is identified to determine imaging posture evaluation information of the imaging portion; and the corresponding shooting prompt content is determined according to the imaging posture evaluation information. By adopting the above technical solution, the imaging effect of the imaging part can be evaluated according to the three-dimensional data of the imaging part in the case of capturing the imaging part of the user, and the shooting prompt content is determined according to the evaluation information to prompt the user to take a better photo. .

In an embodiment, the imaging portion includes a user's head; correspondingly, the three-dimensional data acquisition module is configured to acquire three-dimensional data of the posture of the imaging portion by the recognition camera by: determining a posture characteristic of the head And acquiring, by the recognition camera, three-dimensional data of the posture of the posture feature portion of the head.

In an embodiment, the device further includes: a light source determining module, configured to acquire illumination information of the head in the case that the recognition camera captures the imaged portion of the user, and determine a position of the light source according to the illumination information; The prompt determination module is configured to: determine corresponding shooting prompt content according to the imaging posture evaluation information and the light source position.

In an embodiment, the evaluation determining module is configured to: identify the three-dimensional data of the posture by a preset imaging evaluation model, determine an imaging category of the imaging portion, and determine the imaging portion according to the imaging category. Imaging posture evaluation information.

In an embodiment, the imaging posture evaluation information includes an error value of the imaging portion and an imaging standard; correspondingly, the prompt determination module is configured to: determine a shooting prompt content according to the error value; wherein the shooting prompt The content is used to prompt the user to perform a corresponding movement to reduce the error value.

In an embodiment, the recognition camera is a three-dimensional camera; correspondingly, the three-dimensional data acquisition module is configured to: acquire the depth data of the portion of the imaged portion by the recognition camera, and the infrared data of the portion; The data determines initial three-dimensional data of the imaged portion; the initial three-dimensional data is corrected according to the portion of the infrared data to obtain three-dimensional data of the posture of the imaged portion.

In an embodiment, the apparatus further includes: a training module, configured to input the preset sample data into the preset classifier for training before the gesture three-dimensional data is recognized by the preset imaging evaluation model, and obtain An imaging evaluation model; wherein the imaging evaluation model is configured to determine corresponding imaging posture evaluation information according to the captured three-dimensional data of the imaging portion; the preset sample data includes sample three-dimensional data of the imaging portion, and corresponding sample imaging Posture evaluation information.

In an embodiment, the prompt determination module is configured to determine the shooting prompt content corresponding to the imaging posture evaluation information according to the preset mapping table.

In an embodiment, the shooting hint content includes one of the following: text data, picture data, animation data, and sound data.

A storage medium containing computer-executable instructions, which is not limited to the photographing interaction operation as described above, and may be related to the photographing interaction method provided by any embodiment of the present application. operating.

The embodiment of the present application further provides a storage medium including computer executable instructions, when executed by a computer processor, for performing a photographing interaction method, the method comprising: capturing an imaged portion of a user at a recognition camera And acquiring, by the recognition camera, the three-dimensional data of the posture of the imaging part; identifying the three-dimensional data of the posture by using a preset imaging evaluation model to determine imaging posture evaluation information of the imaging part; The imaging posture evaluation information determines the corresponding shooting prompt content.

Storage media - any type of storage device or storage device. The term "storage medium" is intended to include: a mounting medium such as a Compact Disc Read-Only Memory (CD-ROM), a floppy disk or a tape device; a computer system memory or a random access memory such as a dynamic random Random Random Access Memory (DRAM), Double Data Rate Random Access Memory (DDR RAM), Static Random Access Memory (SRAM), Extended Data Output Random Extended Data Output Random Access Memory (EDO RAM), Rambus Random Access Memory (RAM), etc.; non-volatile memory such as flash memory, magnetic media (such as hard disk or light) Storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or multiple types of memory combinations. Additionally, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system, the second computer system being coupled to the first computer system via a network, such as the Internet. The second computer system can provide program instructions to the first computer for execution. The term "storage medium" can include two or more storage media that can reside in different locations (eg, in different computer systems connected through a network). A storage medium may store program instructions (eg, program instructions implemented as a computer program) executable by one or more processors.

The embodiment of the present application provides a terminal device, where the camera interaction device provided by the embodiment of the present application can be integrated.

FIG. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure. The embodiment of the present application provides a terminal device 30, including a memory 31, a processor 32, and a computer stored in the memory 31 and operable on the processor. The program, when the processor executes the computer program, implements the photographing interaction method described in the foregoing embodiment. The terminal device provided by the embodiment of the present application can optimize the photographing operation of the user.

FIG. 11 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure. As shown in FIG. 11, the terminal device may include: a casing (not shown in FIG. 11), a touch screen (not shown in FIG. 11), a touch button (not shown in FIG. 11), a memory 301, and a central processing unit. (Central Processing Unit, CPU) 302 (also referred to as a processor, hereinafter referred to as CPU), a circuit board (not shown in FIG. 11), and a power supply circuit (not shown in FIG. 11). The circuit board is disposed inside a space enclosed by the casing; the CPU 302 and the memory 301 are disposed on the circuit board; and the power circuit is configured to be a plurality of circuits or devices of the terminal device The memory 301 is configured to store executable program code; the CPU 302 runs a computer program corresponding to the executable program code by reading executable program code stored in the memory 301 to implement the following steps Obtaining three-dimensional posture data of the imaging portion by the recognition camera in a case where the recognition camera captures an imaging portion of the user; and identifying the three-dimensional image of the posture by a preset imaging evaluation model to determine the imaging The imaging posture evaluation information of the part; determining the corresponding shooting prompt content according to the imaging posture evaluation information.

The terminal device further includes: a peripheral interface 303, a radio frequency (RF) circuit 305, an audio circuit 306, a speaker 311, a power management chip 308, an input/output (I/O) subsystem 309, a touch screen 312, and others. Input/control device 310 and external port 304 are communicated via one or more communication buses or signal lines 307.

It should be understood that the terminal device 300 shown in FIG. 11 is only one example of the terminal device, and the terminal device 300 may have more or fewer components than those shown in FIG. 11, and two or more may be combined. Many components, or can have different component configurations. The various components shown in Figure 11 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The following describes a terminal device for implementing a photo interaction provided by the embodiment, where the terminal device takes a mobile phone as an example.

The memory 301 can be accessed by the CPU 302, the peripheral interface 303, etc., and the memory 301 can include a high speed random access memory, and can also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices. Or other volatile solid-state storage devices.

Peripheral interface 303, which can connect the input and output peripherals of the device to CPU 302 and memory 301.

I/O subsystem 309, which can connect input and output peripherals on the device, such as touch screen 312 and other input/control devices 310, to peripheral interface 303. I/O subsystem 309 can include display controller 3091 and one or more input controllers 3092 that are configured to control other input/control devices 310. In one embodiment, one or more input controllers 3092 receive electrical signals from other input/control devices 310 or transmit electrical signals to other input/control devices 310, and other input/control devices 310 may include physical buttons (press buttons, Rocker button, etc.), dial, slide switch, joystick, click wheel. In an embodiment, the input controller 3092 can be connected to any of the following: a keyboard, an infrared port, a Universal Serial Bus (USB) interface, and a pointing device such as a mouse.

The touch screen 312 is an input interface and an output interface between the user terminal device and the user, and displays the visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

Display controller 3091 in I/O subsystem 309 receives an electrical signal from touch screen 312 or an electrical signal to touch screen 312. The touch screen 312 detects the contact on the touch screen, and the display controller 3091 converts the detected contact into an interaction with the user interface object displayed on the touch screen 312, that is, realizes human-computer interaction, and the user interface object displayed on the touch screen 312 can be operated. The icon of the game, the icon of the network to the corresponding network, and the like. In an embodiment, the device may also include a light mouse, which is a touch sensitive surface that does not display a visual output, or an extension of a touch sensitive surface formed by the touch screen.

The RF circuit 305 is mainly configured to establish communication between the mobile phone and the wireless network (ie, the network side), and implement data reception and transmission between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, and the like. In one embodiment, RF circuit 305 receives and transmits an RF signal, also referred to as an electromagnetic signal, and RF circuit 305 converts the electrical signal into an electromagnetic signal or converts the electromagnetic signal into an electrical signal, and through the electromagnetic signal and communication network And other devices to communicate. RF circuitry 305 may include known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, CODER-DECoder (CODEC) chipset, Subscriber Identity Module (SIM), etc.

The audio circuit 306 is primarily configured to receive audio data from the peripheral interface 303, convert the audio data into an electrical signal, and transmit the electrical signal to the speaker 311.

The speaker 311 is arranged to restore the voice signal received by the handset from the wireless network via the RF circuit 305 to sound and play the sound to the user.

The power management chip 308 is configured to provide power and power management for the hardware connected to the CPU 302, the I/O subsystem, and the peripheral interface.

The terminal device provided by the embodiment of the present application can optimize the photographing operation of the user.

The photographing interaction device, the storage medium, and the terminal device provided in the foregoing embodiments may perform the photographing interaction method provided by any embodiment of the present application, and have the corresponding functional modules and beneficial effects of executing the method. For the technical details that are not described in the foregoing embodiments, refer to the photographing interaction method provided by any embodiment of the present application.

Claims

A photo interaction method includes:

Obtaining three-dimensional posture data of the imaging portion by the recognition camera in a case where the recognition camera captures an imaging portion of the user;

Identifying the posture three-dimensional data by a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion;

Corresponding photographing prompt content is determined according to the imaging posture evaluation information.
The method of claim 1 wherein said imaged portion comprises a user's head;

Obtaining the three-dimensional data of the posture of the imaging portion by the recognition camera includes:

Determining the posture feature portion of the head, and acquiring three-dimensional posture data of the posture feature portion of the head by the recognition camera.
The method of claim 2, wherein, in the case that the recognition camera captures the imaged portion of the user, the method further comprises:

Obtaining illumination information of the head, and determining a position of the light source according to the illumination information;

Determining the corresponding shooting prompt content according to the imaging posture evaluation information includes:

Corresponding photographing prompt content is determined according to the imaging posture evaluation information and the light source position.
The method of claim 1, wherein the determining the three-dimensional data of the posture by the predetermined imaging evaluation model to determine the imaging posture evaluation information of the imaging portion comprises:

The posture three-dimensional data is identified by a preset imaging evaluation model to determine an imaging category of the imaging portion, and imaging posture evaluation information of the imaging portion is determined according to the imaging category.
The method of claim 1, wherein the imaging posture evaluation information comprises an error value of the imaging portion and an imaging standard;

Determining the corresponding shooting prompt content according to the imaging posture evaluation information includes:

The shooting prompt content is determined according to the error value; wherein the shooting prompt content is used to prompt the user to perform corresponding movement to reduce the error value.
The method according to any one of claims 1 to 5, wherein the recognition camera is a three-dimensional camera;

Obtaining the three-dimensional data of the posture of the imaging portion by the recognition camera includes:

Obtaining part depth data of the imaged portion and the part infrared data by the recognition camera;

Determining initial three-dimensional data of the imaged portion according to the part depth data;

The initial three-dimensional data is corrected according to the part infrared data to obtain three-dimensional data of the posture of the imaging part.
The method according to any one of claims 1 to 5, before the gesture three-dimensional data is identified by a preset imaging evaluation model, further comprising:

Inputting preset sample data into a preset classifier for training to obtain an imaging evaluation model;

The imaging evaluation model is configured to determine corresponding imaging posture evaluation information according to the captured three-dimensional data of the imaged portion;

The preset sample data includes sample three-dimensional data of the imaging portion, and corresponding sample imaging posture evaluation information.
The method according to any one of claims 1 to 7, wherein the determining the corresponding shooting prompt content according to the imaging posture evaluation information comprises:

The shooting prompt content corresponding to the imaging posture evaluation information is determined according to a preset mapping table.
The method according to any one of claims 1 to 8, wherein the photographing hint content comprises one of: text data, picture data, animation data, and sound data.
A photo interaction device includes:

a three-dimensional data acquisition module, configured to acquire, by the recognition camera, three-dimensional data of the posture of the imaging portion, in a case where the recognition camera captures an imaging portion of the user;

An evaluation determining module configured to identify the posture three-dimensional data by a preset imaging evaluation model to determine imaging posture evaluation information of the imaging portion;

The prompt determination module is configured to determine a corresponding shooting prompt content according to the imaging posture evaluation information.
The device of claim 10 wherein said imaged portion comprises a user's head;

The three-dimensional data acquisition module is configured to acquire three-dimensional posture three-dimensional data of the imaging portion by the recognition camera by: determining a posture feature portion of the head, and acquiring the posture of the head by the recognition camera Three-dimensional data of the posture of the feature part.
The apparatus according to claim 11, further comprising: a light source determining module configured to acquire illumination information of the head in a case where the recognition camera captures an imaging portion of the user, and determine a light source position according to the illumination information;

The prompt determination module is configured to: determine corresponding photographing prompt content according to the imaging posture evaluation information and the light source position.
The apparatus according to claim 10, wherein the evaluation determining module is configured to: identify the three-dimensional image of the posture by a preset imaging evaluation model to determine an imaging category of the imaging portion, and according to the imaging category The imaging posture evaluation information of the imaging site is determined.
The apparatus according to claim 10, wherein said imaging posture evaluation information includes an error value of said imaging portion and an imaging standard;

The prompt determination module is configured to: determine the shooting prompt content according to the error value; wherein the shooting prompt content is used to prompt the user to perform corresponding movement to reduce the error value.
The apparatus according to any one of claims 10 to 14, wherein the recognition camera is a three-dimensional camera;

The three-dimensional data acquisition module is configured to: acquire depth data of the portion of the imaged portion and the infrared data of the portion by using the identification camera; and determine initial three-dimensional data of the imaged portion according to the depth data of the portion; The infrared data corrects the initial three-dimensional data to obtain three-dimensional data of the posture of the imaging portion.
The apparatus according to any one of claims 10 to 14, further comprising: a training module configured to input the preset sample data to the preset classification before the gesture three-dimensional data is recognized by the preset imaging evaluation model Training in the device to obtain an imaging evaluation model;

The imaging evaluation model is configured to determine corresponding imaging posture evaluation information according to the captured three-dimensional data of the imaged portion;

The preset sample data includes sample three-dimensional data of the imaging portion, and corresponding sample imaging posture evaluation information.
The apparatus according to any one of claims 10-16, wherein the prompt determination module is configured to determine a photographing prompt content corresponding to the imaging posture evaluation information according to a preset mapping table.
The apparatus according to any one of claims 10-17, wherein the photographing hint content comprises one of: text data, picture data, animation data, and sound data.
A computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the photographing interaction method according to any one of claims 1-9.
A terminal device comprising a memory, a processor, and a computer program stored on the memory and operable by the processor, the processor executing the computer program to implement the photographing interaction according to any one of claims 1-9 method.