WO2021135601A1 - Procédé et appareil de photographie auxiliaire, équipement terminal, et support d'enregistrement - Google Patents

Procédé et appareil de photographie auxiliaire, équipement terminal, et support d'enregistrement Download PDF

Info

Publication number
WO2021135601A1
WO2021135601A1 PCT/CN2020/125204 CN2020125204W WO2021135601A1 WO 2021135601 A1 WO2021135601 A1 WO 2021135601A1 CN 2020125204 W CN2020125204 W CN 2020125204W WO 2021135601 A1 WO2021135601 A1 WO 2021135601A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
posture
target
scene
photographing
Prior art date
Application number
PCT/CN2020/125204
Other languages
English (en)
Chinese (zh)
Inventor
杨建业
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021135601A1 publication Critical patent/WO2021135601A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Definitions

  • This application belongs to the technical field of terminal technology, and in particular relates to an artificial intelligence (AI) terminal assisted photographing method, device, terminal device, and computer-readable storage medium.
  • AI artificial intelligence
  • the embodiments of the present application provide an auxiliary photographing method, a device, a terminal device, and a computer-readable storage medium, which can quickly guide a photographed subject to adjust the posture and improve the photographing effect of an image.
  • an embodiment of the present application provides an auxiliary photographing method, including:
  • the posture image and the original image are superimposed and displayed as a preview image, so as to guide the photographic subject to perform posture adjustment according to the target posture in the preview image.
  • the original image may be the first frame preview image previewed in the display interface, or may also be the Nth frame preview image after the first frame previewed in the display interface.
  • the original image may be the first frame image captured by the camera in real time, or it may be the Nth frame image after the first frame captured by the camera in real time, where N is an integer greater than 1.
  • the original image may be recognized by artificial intelligence recognition technology first to determine whether there is a photographed object in the original image. If there is a photographed object in the original image, the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located can be further identified. Among them, the target characteristics of the photographed object may include one or more of the number of photographed objects, gender, age, height, body type, and the like.
  • a TOF depth camera set by a terminal device can be used to obtain target features such as the height and body shape of the subject.
  • a face recognition model set in the terminal device can be used to recognize target characteristics such as the number, gender, and age of the subject in the original image.
  • the scene characteristics of the scene where the shooting object in the original image is located can be obtained through a scene recognition model set in the terminal device.
  • the superimposing and displaying the posture image and the original image as a preview image may include:
  • a layer mask is added to the posture image, and the posture image with the added layer mask and the original image are superimposed and displayed as the preview image, and the position corresponding to the target posture in the layer mask is set to White, the position in the layer mask except the target pose is set to black.
  • the posture image superimposed on the original image can be a binary mask of the same size as the original image, and each pixel in the binary mask corresponds to each pixel in the original image one-to-one.
  • the pixel value of the pixel corresponding to the target posture in the binary mask is 1 (that is, the pixel corresponding to the target posture in the binary mask is white), and the pixel value of the pixel other than the target posture in the binary mask is The pixel value is 0 (that is, pixels other than the target posture in the binary mask are black), and the target posture in the posture image is merged into the current photographing scene to guide the subject to adjust the posture.
  • a layer mask can be added to the posture image, where the position corresponding to the target posture in the layer mask (that is, the pixel corresponding to the target posture) can be set to white, and the layer The position of the mask other than the target pose (that is, the pixel points other than the target pose) can be set to black to obtain the binary mask corresponding to the pose image, and the pose image with the layer mask (that is, the pose The binary mask of the image) and the original image are superimposed and displayed as a preview image, that is, the target posture in the posture image is superimposed on the original image to obtain a preview image, and the obtained preview image can be displayed on the display interface. This guides the subject to make posture adjustments.
  • the superimposing and displaying the posture image and the original image as a preview image may include:
  • the target posture is superimposed on the original image, and the original image superimposed on the target posture is displayed as a preview image.
  • the superimposing the target pose on the original image may include:
  • the second position of the target posture in the original image is determined according to the first position, and the target posture is superimposed at the second position of the original image.
  • the image segmentation technology can also be used to segment the target posture from the posture image, and the segmented target posture can be superimposed on the original image, and then the original image superimposed on the target posture can be displayed as Preview image.
  • the first position of the target posture in the posture image can be determined first, and then according to the correspondence between the pixels in the posture image and the pixels in the original image, the original image and the pixel points in the original image can be found.
  • the target pixel point corresponding to the target posture, so that the second position of the target posture in the original image can be determined according to the target pixel point.
  • the acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located may include:
  • the photographing characteristic is a photographing preference characteristic corresponding to the photographing object
  • the posture image is acquired according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.
  • the photographic characteristics of the subject can also be acquired, and the characteristics of the subject can be obtained according to the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the shooting The photographic features of the subject acquire the posture image.
  • the photographing feature may be a characteristic of photographing preferences or photographing habits corresponding to the photographed subject.
  • the photographic characteristics of the photographed object may be obtained according to the identity mark information of the photographed object.
  • the photographing feature corresponding to the terminal device may also be acquired according to the device identification information of the terminal device, and the acquired photographing characteristic corresponding to the terminal device may be determined as the photographing characteristic of the subject.
  • the photographic characteristics of each photographed object may be obtained by image analysis of the historical photographed images of each photographed object in advance, and the photographed characteristics of each photographed object may be associated and saved with the identity mark information of each photographed object.
  • the acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located includes:
  • a target sample image is selected from the at least one sample image according to the recommended value, and the posture image is acquired according to the target sample image.
  • the posture image when the posture image is acquired according to the target characteristics of the subject and the scene characteristics of the scene where the subject is located, or according to the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the photographic characteristics of the subject
  • one or more sample images can be acquired, and the posture image can be acquired according to the acquired sample images.
  • the sample image may be an image collected in advance and stored in a terminal device or stored in a cloud server connected to the terminal device, or it may be an image captured from the network in real time during the photographing process.
  • the obtained sample image can be directly determined as a posture image; and when multiple sample images are obtained, one can be selected from the multiple sample images.
  • the target sample image, and the selected target sample image can be determined as a posture image.
  • the recommended value corresponding to each sample image can be obtained first, and then the sample image with the highest recommended value can be selected as the target sample image, and the selected one can be selected as the target sample image.
  • a target sample image is determined as a posture image, and the posture image is recommended through the recommended value, which helps to improve the recommendation accuracy and recommendation efficiency of the posture image.
  • the recommended value corresponding to the sample image may be determined according to the number of historical recommendations of the sample image within a preset time. For example, it can be determined according to the number of historical recommendations of the sample images in the past week. The sample images with more historical recommendations have higher recommended values; the sample images with fewer historical recommendations have corresponding values. The recommended value of is lower.
  • multiple target sample images can be selected from the multiple sample images, and the selected multiple target sample images can be displayed, so that the photographer or the photographed object can be selected from these multiple sample images.
  • the target sample image can be selected according to the recommended value corresponding to each sample image, that is, the first N sample images with high recommended value can be selected from the sample images as the target sample image, where N is greater than or equal to 2. Integer.
  • the display order corresponding to each target sample image can be determined according to the recommended value corresponding to each target sample image, wherein the target sample image with the larger recommended value is displayed on the display interface first, and the target sample with the smaller recommended value The image is later displayed on the display interface.
  • the method may include:
  • the second image size corresponding to the posture image is adjusted according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size.
  • the first image size corresponding to the original image and the posture image corresponding to the The second image size, and the second image size corresponding to the posture image can be adjusted according to the first image size, so as to adjust the second image size corresponding to the posture image to the first image size.
  • the superimposing and displaying the posture image and the original image as a preview image may include:
  • the degree of matching between the current posture and the target posture is determined, and the shooting object is guided to adjust the posture according to the degree of matching.
  • the current posture of the subject can also be obtained in real time, and the current posture and the target posture can be determined
  • the degree of matching between the two can guide the subject to adjust the posture according to the degree of matching.
  • the matching degree can also be displayed on the display interface in real time, so that the subject and/or the photographer can clearly understand the photographing posture and posture image of the subject The specific fit of the target posture.
  • posture comparison can be performed to find the difference between the current posture and the target posture Position, so that the subject can be prompted to adjust the posture according to the distinguished position.
  • the subject may be prompted to adjust the posture through voice playback and/or the subject may be prompted to adjust the posture through text display.
  • an auxiliary photographing device including:
  • the target feature recognition module is used to obtain the original image, and recognize the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;
  • a posture image acquisition module configured to acquire a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, the posture image contains the target posture to be recommended;
  • the posture image superimposing module is configured to superimpose and display the posture image and the original image as a preview image, so as to guide the subject to perform posture adjustment according to the target posture in the preview image.
  • the posture image superimposing module may include:
  • the first posture image superimposing unit is used to add a layer mask to the posture image, and superimpose and display the posture image with the added layer mask and the original image as the preview image, in the layer mask
  • the position corresponding to the target posture is set to white, and the position other than the target posture in the layer mask is set to black.
  • the posture image superimposing module may further include:
  • a posture image segmentation unit for segmenting the target posture from the posture image
  • the second posture image superimposing unit is configured to superimpose the target posture on the original image, and display the original image superimposed on the target posture as a preview image.
  • the second posture image superimposing unit may include:
  • the first position acquisition subunit is configured to acquire the first position of the target posture in the posture image
  • the second position determination subunit is configured to determine the second position of the target posture in the original image according to the first position, and superimpose the target posture on the second position of the original image.
  • the posture image acquisition module may include:
  • a photographing feature acquiring unit configured to acquire a photographing characteristic of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;
  • the first posture image obtaining unit is configured to obtain the posture image according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.
  • the posture image acquisition module may include:
  • a sample image acquisition unit configured to acquire at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;
  • a recommended value obtaining unit configured to obtain a recommended value corresponding to the at least one sample image
  • the second posture image obtaining unit is configured to select a target sample image from the at least one sample image according to the recommended value, and obtain the posture image according to the target sample image.
  • the auxiliary photographing device may further include:
  • An image size obtaining module configured to obtain a first image size corresponding to the original image and a second image size corresponding to the posture image;
  • the image size adjustment module is configured to adjust the second image size corresponding to the posture image according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size .
  • the auxiliary photographing device may further include:
  • the current posture acquisition module is used to acquire the current posture of the photographed object
  • the current posture matching module is used to determine the degree of matching between the current posture and the target posture, and guide the subject to adjust the posture according to the degree of matching.
  • an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor.
  • the processor executes the computer program,
  • the auxiliary photographing method according to any one of the above-mentioned first aspects is realized.
  • an embodiment of the present application provides a computer-readable storage medium that stores a computer program that, when executed by a processor, implements any one of the above-mentioned aspects of the first aspect
  • the auxiliary method of taking pictures
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a terminal device, causes the terminal device to execute the auxiliary photographing method described in any one of the above-mentioned first aspects.
  • the embodiment of the present application can identify the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located, and obtain a match with the shooting object by combining the target feature of the shooting object and the scene feature of the scene where the shooting object is located And the posture image of the scene where the shooting object is located can improve the accuracy and effectiveness of the posture image acquisition, so that the obtained posture image meets the photographing requirements of the shooting object and the scene where the shooting object is currently located.
  • the posture image and the original image as a preview image, and by displaying the target posture in the preview image, it is convenient to quickly guide the subject to adjust the posture according to the target posture in the preview image, which improves the efficiency of posture adjustment and the efficiency of taking pictures. , In order to effectively improve the shooting effect of the image and enhance the user experience.
  • Fig. 1 is a schematic diagram of posture image selection in the prior art
  • Fig. 2 is a schematic diagram of posture image display in the prior art
  • FIG. 3 is a schematic flowchart of an auxiliary photographing method provided by an embodiment of the present application.
  • 4 and 5 are schematic diagrams of starting the auxiliary photographing mode in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of scene features obtained by a scene recognition model in an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a preview image provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a preview image provided by another embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of an auxiliary photographing device provided by an embodiment of the present application.
  • Figure 10 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a mobile phone to which the auxiliary photographing method provided by an embodiment of the present application is applicable.
  • the term “if” can be construed as “when” or “once” or “in response to determination” or “in response to detecting “.
  • the phrase “if determined” or “if detected [described condition or event]” can be interpreted as meaning “once determined” or “in response to determination” or “once detected [described condition or event]” depending on the context ]” or “in response to detection of [condition or event described]”.
  • the auxiliary photographing method provided by the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, and super mobile personal computers
  • AR augmented reality
  • VR virtual reality
  • UMPC ultra-mobile personal computer
  • netbooks netbooks
  • PDA personal digital assistant
  • FIG. 1 In order to improve the shooting effect, many applications currently have a posture recommendation function. As shown in Figure 1, some fixed posture images are built in the application. When the user selects a certain posture image, as shown in Figure 2, The posture image is displayed in a fixed position in the display interface (for example, displayed in the lower left corner or the lower right corner of the display interface) for the subject's posture reference.
  • this method can improve the shooting effect to a certain extent, because the built-in posture images in the application are limited, it is often unable to meet the user’s current photographing needs, and the built-in posture images in the application do not necessarily meet the current photographing scene.
  • the photographing effect is poor; in addition, fixing the posture image in the left small corner or the lower right corner of the display interface cannot provide sufficient reference value for the subject, which makes posture adjustment efficiency and thus low photographing efficiency.
  • embodiments of the present application provide an auxiliary photographing method, device, terminal device, and computer-readable storage medium.
  • the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located are combined to obtain the corresponding photographic object and the photographed object.
  • the posture image of the scene can improve the accuracy and effectiveness of the posture image acquisition, so that the acquired posture image meets the photographing requirements of the subject and the scene where the subject is currently located.
  • by superimposing the posture image and the original image as a preview image, and by displaying the target posture in the preview image it is convenient to quickly guide the subject to adjust the posture according to the target posture in the preview image, which improves the efficiency of posture adjustment and the efficiency of taking pictures. , In order to effectively improve the shooting effect of the image and enhance the user experience.
  • Fig. 3 shows a schematic flowchart of an auxiliary photographing method provided by an embodiment of the present application.
  • the auxiliary photographing method may be applied to a terminal device that has a photographing function, that is, the terminal device A camera for taking pictures can be set in the.
  • the auxiliary photographing method may include:
  • S301 Obtain an original image, and identify the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;
  • the terminal device can start the camera of the terminal device according to the detected camera start instruction, and can preview the image collected by the camera in real time through the display interface of the terminal device.
  • the user can start the camera of the terminal device by inputting a camera start instruction.
  • the camera start instruction may be an instruction that triggers the generation of a preset button, or an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword, which is not limited in the embodiment of the present application.
  • the terminal device can preset the "volume +" button to generate a camera start instruction when triggered twice, or preset the "volume +" button and the "volume -” button to generate a camera start instruction when triggered at the same time, then when the user presses " The volume +" button twice, or when the user presses the "volume +” button and the "volume -” button at the same time, the terminal device can generate and obtain the camera start instruction.
  • the terminal device may be preset to generate a camera start instruction when a preset gesture such as an "O"-shaped gesture is collected, and then when the user inputs a gesture that matches the preset gesture such as an "O"-shaped gesture, the terminal device Then the camera start instruction can be generated and obtained.
  • the terminal device can be preset to generate a camera start instruction when a preset voice keyword such as "photograph” is detected. Then when the user input voice contains the preset voice keyword such as "photograph", the terminal device is Can generate and get the camera start instruction.
  • the original image may be the first frame preview image previewed on the display interface of the terminal device, or may also be the Nth frame preview image after the first frame previewed on the display interface of the terminal device.
  • the original image may be the first frame image captured by the camera in real time, or it may be the Nth frame image after the first frame captured by the camera in real time, where N is an integer greater than 1.
  • the terminal device may obtain the original image according to a preset trigger event or a preset duration.
  • the terminal device may obtain the image currently previewed in the display interface of the terminal device or the image currently captured by the camera according to the detected specific instruction, and may determine the currently previewed image or the currently captured image as The original image.
  • the terminal device can obtain the image currently previewed by the display interface or the image currently collected by the camera when detecting a click operation of the user clicking any position on the display interface.
  • the terminal device may obtain the image currently previewed by the display interface or obtain the image currently collected by the camera when the time period when the camera is activated reaches the preset time period.
  • the auxiliary photographing mode can be set in advance in the terminal device for the user to select. Specifically, after the camera of the terminal device is started, the user can input the auxiliary photographing instruction to turn on the auxiliary photographing mode of the camera, that is, when the user inputs the auxiliary photographing instruction, the terminal device can obtain the original image, and can obtain the original image according to the original.
  • the target feature of the subject in the image and the scene feature of the scene where the subject is located acquire a posture image, so that the acquired posture image and the original image can be superimposed and displayed as a preview image to assist the subject to perform according to the target posture in the preview image Posture adjustment; and when the user does not input an auxiliary photographing instruction, the terminal device can directly perform conventional photographing processing, that is, no posture image acquisition is performed.
  • auxiliary photographing instruction may be an instruction that triggers the generation of a preset button, or an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword, which is not limited in the embodiment of the present application.
  • the user can select the photographing mode on the display interface of the terminal device, and the terminal device can start the auxiliary photographing mode according to the user's selection.
  • a virtual button for assisting taking pictures can be presented on the display interface of the terminal device. If the user triggers the virtual button, the terminal device can turn on the camera’s assisting taking pictures. Mode; if the user does not trigger the virtual button, the terminal device can directly perform conventional photographing processing.
  • the user can also enter a preset gesture such as an "M" gesture in the display interface of the terminal device to turn on the camera's auxiliary photographing mode, or may include "assisted photographing" through voice input Wait for the preset voice keywords to turn on the auxiliary camera mode of the camera.
  • a preset gesture such as an "M” gesture in the display interface of the terminal device to turn on the camera's auxiliary photographing mode, or may include "assisted photographing" through voice input Wait for the preset voice keywords to turn on the auxiliary camera mode of the camera.
  • the terminal device may first perform image recognition on the original image through artificial intelligence (AI) technology to determine whether there is a photographed object in the original image. If there is a photographed object in the original image, the terminal device can further identify the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located. Among them, the target characteristics of the photographed object may include one or more of the number of photographed objects, gender, age, height, body type, and the like.
  • AI artificial intelligence
  • the terminal device may be provided with a TOF (Time of Flight) depth camera, and the terminal device may use the TOF depth camera to obtain target features such as the height and body shape of the photographed subject.
  • TOF Time of Flight
  • the terminal device may be provided with a face recognition model, and the terminal device may use the face recognition model to recognize target characteristics such as the number, gender, and age of the subject in the original image.
  • the face recognition model may be a recognition model constructed based on a convolutional neural network.
  • the embodiment of the present application does not limit the specific construction process and specific training process of the face recognition model, and the existing construction process may be used for construction.
  • the existing training process can also be used for training.
  • the face recognition model set in the terminal device may be trained by a cloud server, and the face recognition model set in the terminal device may be updated in real time according to the update operation of the cloud server.
  • the face recognition model receives the original image, it can first perform preprocessing such as information conversion, denoising, smoothing, and transformation on the original image to enhance the important features of the image; then face recognition can be used
  • preprocessing such as information conversion, denoising, smoothing, and transformation
  • face recognition can be used
  • the technology performs face recognition on the preprocessed original image to obtain target characteristics such as the number, gender, and age of the subject in the original image according to the face recognition result.
  • the face recognition technology may be any existing face recognition technology, which is not limited in the embodiment of the present application.
  • the terminal device may be provided with a scene recognition model, and the terminal device may use the scene recognition model to obtain the scene characteristics of the scene where the shooting object in the original image is located.
  • the scene recognition model may be a hierarchical scene recognition model based on a convolutional neural network.
  • the hierarchical scene recognition model can be used to extract features of different scales of the original image, and can mix the features of different scales, and then the mixed features can be extracted again, and the extracted features can be used as The scene features of the original image enable the extracted scene features to contain more image information, thereby improving the accuracy of the posture image acquisition.
  • the terminal device can first perform multiple downsampling operations on the original image to obtain A1 (320*240), A2 (160*120), ..., An, Then you can perform a series of feature extraction operations (such as convolution operations) on A1, A2,..., An to obtain feature images F1, F2...Fn, and finally you can combine the features of F1, F2,..., Fn After the images are combined, feature extraction is performed again, and the last extracted feature can be used as the scene feature of the original image.
  • feature extraction operations such as convolution operations
  • the embodiment of the present application does not limit the specific construction process and specific training process of the hierarchical scene recognition model, and the existing construction process can be used for construction, or the existing training process can be used for training.
  • the layered scene recognition model can be trained by the cloud server through the AI training and simulation training platform MTP, or the cloud server can be trained by the AI training and the Xiangyun simulation execution platform MEP.
  • the hierarchical scene recognition model set in the terminal device may also be updated in real time according to the update operation of the cloud server.
  • the layered scene recognition model can first perform preprocessing such as information conversion, denoising, smoothing, and transformation on the original image to enhance the important features of the image; then, image segmentation technology can be used,
  • image instance segmentation technology Mask Region-based Convolutional Neural Networks, Mask RCNN
  • Mask RCNN Mask Region-based Convolutional Neural Networks
  • S302 Acquire a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, where the posture image contains the target posture to be recommended;
  • the terminal device may be provided with a posture recommendation model
  • the posture recommendation model can obtain the posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, so as to obtain the posture image by comprehensively considering the target feature and the scene feature Precise and effective posture images, which can assist and guide the subject to adjust posture according to the target posture contained in the posture image, improve the image shooting effect, and enhance the user experience.
  • the posture recommendation model may be a recommendation model constructed based on a neural network.
  • the embodiment of the present application does not limit the specific construction process and specific training process of the posture recommendation model, and the existing construction process may be used for construction, or the existing training process may be used for training.
  • the posture recommendation model set in the terminal device can be trained by the cloud server based on a large number of sample images, and the posture recommendation model set in the terminal device can also be updated in real time according to the update operation of the cloud server.
  • the pose recommendation model can take the target feature of the subject and the scene feature of the scene where the subject is located as input, and can take a pose that matches the target feature and scene feature. Image as output. Specifically, after the terminal device obtains the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located, the target feature and the scene feature can be formed into a two-tuple, and the formed two-tuple can be combined Input to the posture recommendation model, and the posture recommendation model can output a posture image containing the target posture based on the two-tuple.
  • the pose recommendation model can take the target feature of the shooting object, the scene feature of the scene where the shooting object is located, and the shooting feature of the shooting object as input as a triplet, and can be related to the target feature , The scene feature and the posture image matching the photo feature as output.
  • the photographing feature may be a characteristic of photographing preferences or photographing habits corresponding to the photographed subject.
  • the terminal device obtains the target feature of the shooting object in the original image, the scene feature of the scene where the shooting object is located, and the shooting feature of the shooting object, the target feature, the scene feature, and the shooting feature can be formed into a triplet , And the composed triples can be input to the posture recommendation model, and the posture recommendation model can output a posture image containing the target posture based on the triples.
  • the terminal device after the terminal device recognizes the subject in the original image, it can also acquire the photographic characteristics of the subject, and can acquire the posture based on the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the photographic characteristics of the subject image.
  • the terminal device may obtain the photographic characteristics of the photographed object according to the identity mark information of the photographed object.
  • the terminal device may also acquire the photographing feature corresponding to the terminal device according to the device identification information of the terminal device, and may determine the acquired photographing characteristic corresponding to the terminal device as the photographing characteristic of the photographing object.
  • the photographic characteristics of each photographed object can be obtained by image analysis of the historical photographed images of each photographed object in advance, and the photographic characteristics of each photographed object can be compared with the identity mark information of each photographed object. Save associatively.
  • the terminal device acquires the posture image according to the target characteristics of the photographed object and the scene characteristics of the scene where the photographed object is located, or the terminal device is based on the target characteristic of the photographed object, the scene characteristic of the scene where the photographed object is located, and
  • the terminal device is based on the target characteristic of the photographed object, the scene characteristic of the scene where the photographed object is located, and
  • the sample image may be an image collected in advance and stored in the terminal device or stored in a cloud server connected to the terminal device, or it may be an image captured from the network in real time during the photographing process.
  • the terminal device when the terminal device acquires a sample image, the terminal device can directly determine the acquired sample image as the posture image acquired by the terminal device; and when the terminal device acquires multiple sample images , The terminal device can select a target sample image from the multiple sample images, and can determine the selected target sample image as the posture image acquired by the terminal device.
  • the terminal device can first obtain the recommended value corresponding to each sample image, and then can select the sample image with the highest recommended value as the target sample image, and can determine the selected target sample image as the target sample image.
  • the posture image acquired by the terminal device is used to recommend the posture image through the recommended value, which helps to improve the recommendation accuracy and recommendation efficiency of the posture image.
  • the recommended value corresponding to the sample image may be determined according to the number of historical recommendations of the sample image within a preset time. For example, it can be determined according to the number of historical recommendations of the sample images in the past week. The sample images with more historical recommendations have higher recommended values; the sample images with fewer historical recommendations have corresponding values. The recommended value of is lower.
  • the terminal device can select multiple target sample images from the multiple sample images, and can display the selected multiple target sample images, so that the photographer or The subject selects a pose image from the multiple target sample images.
  • the terminal device can also select the target sample image according to the recommended value corresponding to each sample image, that is, the first N sample images with high recommended value can be selected from the sample images as the target sample image, where N is An integer greater than or equal to 2.
  • the terminal device can first sort the multiple sample images in descending order according to the recommended values to obtain a descending sorted group.
  • the recommended value is higher. The higher the order of the sample images, the higher the order of the sample images, and the lower the order of the sample images of the lower the recommended value; then, the top N sample images in the descending order can be selected as the target sample images.
  • the multiple target sample images may be sequentially displayed on the display interface of the terminal device.
  • these multiple target sample images can be displayed in the lower left corner, lower right corner, upper left corner, or upper right corner of the display interface in sequence, so that the photographer or the subject can select pose images from the multiple target sample images .
  • the photographer or the subject can select the posture image by double-clicking the target sample image, or can select the posture image by triple-clicking the target sample image. This is not limited.
  • the photographer or the shooting object can switch the target sample image through a sliding operation. For example, you can switch to the previous target sample image by swiping to the left, and switch to the next target sample image by swiping to the right. For example, you can switch to the next target sample image by swiping to the left, and switch to the previous target sample image by swiping to the right. For example, you can switch to the previous target sample image by swiping up, and switch to the next target sample image by swiping down. For example, it is possible to switch to the next target sample image by swiping up, and switch to the previous target sample image by swiping down, which is not limited in the embodiment of the present application.
  • the terminal device may determine the display sequence corresponding to each target sample image, and may sequentially display the target sample images on the display interface of the terminal device according to the display sequence.
  • the terminal device may determine the display sequence corresponding to each target sample image, and may sequentially display the target sample images on the display interface of the terminal device according to the display sequence.
  • the terminal device can determine the display sequence corresponding to each target sample image according to the recommended value corresponding to each target sample image, wherein the target sample image with a larger recommended value is displayed on the display interface first, and the recommended value is smaller The target sample image of is later displayed on the display interface.
  • the terminal device when the terminal device displays each target sample image on the display interface, it can also display the recommended value corresponding to each target sample image, so that it is convenient for the subject and/or the photographer to select the posture image according to the recommended value
  • the recommended value may be a specific value, for example, it may be a specific value such as 90 or 95.
  • the recommendation value may also be a recommendation index, for example, it may be a 5-star recommendation index, a 4-star recommendation index, a 3-star recommendation index, and so on.
  • the posture image can be superimposed on the original image, that is, the target posture contained in the posture image can be superimposed on the original image, and the original image superimposed on the target posture can be used as
  • the preview image is displayed on the display interface of the terminal device.
  • the preview image as shown in FIG. 7 can be displayed on the display interface of the terminal device, so that the target posture in the preview image can be passed Guide the subject to adjust the posture and/or standing position, improve the efficiency of posture adjustment, improve the efficiency of photographing, and enhance the user experience.
  • the terminal device may instruct the photographed subject to adjust the posture and/or standing position through the form of voice playback and/or text display, for example, instruct the photographed subject to be embedded in the target posture.
  • the terminal device may first obtain the first image size and size corresponding to the original image.
  • the second image size corresponding to the posture image, and the second image size corresponding to the posture image can be adjusted according to the first image size, so as to adjust the second image size corresponding to the posture image to the first image size.
  • the posture image superimposed on the original image may be a binary mask with the same size as the original image.
  • the original image may be a first layer
  • the binary mask may be a second layer
  • the posture image and the original image are superimposed by superimposing the second layer on the first layer.
  • each pixel in the binary mask corresponds to each pixel in the original image respectively.
  • the pixel value of the pixel corresponding to the target posture in the binary mask is 1 (that is, the pixel corresponding to the target posture in the binary mask is white), and the pixel value of the pixel other than the target posture in the binary mask is
  • the pixel value is 0 (that is, the pixels other than the target pose in the binary mask are black), that is, when the pose image is superimposed on the original image, the target pose can completely hide the content of the corresponding position in the original image.
  • the position other than the target pose is completely transparent, that is, the position other than the target pose can display the content of the corresponding position in the original image, so that the target pose in the pose image can be merged into the current photo scene To guide the subject in posture adjustments.
  • the terminal device after the terminal device obtains the posture image, it can add a layer mask to the posture image, where the position corresponding to the target posture in the layer mask (that is, the pixel corresponding to the target posture) can be set to white, and The position of the layer mask other than the target pose (that is, the pixel points other than the target pose) can be set to black to obtain the binary mask corresponding to the pose image, and the pose image with the layer mask (ie The binary mask of the posture image) and the original image are superimposed and displayed as a preview image, that is, the target posture in the posture image is superimposed on the original image to obtain a preview image, and the obtained preview image can be displayed on the terminal device In the display interface of to guide the subject to adjust the posture.
  • the position corresponding to the target posture in the layer mask that is, the pixel corresponding to the target posture
  • the position of the layer mask other than the target pose that is, the pixel points other than the target pose
  • the pose image with the layer mask ie
  • the terminal device can also use image segmentation technology to segment the target posture from the posture image, the segmented target posture can be superimposed on the original image, and the target posture can be superimposed on the target posture.
  • the original image is displayed as a preview image.
  • the terminal device may first obtain the first position of the target posture in the posture image, and then determine the second position of the target posture in the original image according to the first position, and can superimpose the target posture To the second position of the original image.
  • the terminal device may first determine the first position of the target posture in the posture image, and then can find the original image according to the correspondence between the pixels in the posture image and the pixels in the original image In the target pixel point corresponding to the target posture, the second position of the target posture in the original image can be determined according to the target pixel point.
  • the photographer can adjust the shooting angle and/or shooting position by moving the terminal device, and in the process of adjusting the shooting angle and/or shooting position, the terminal The device can obtain the adjusted original image in real time, and can obtain the posture image according to the adjusted original image, and can superimpose the obtained posture image and the adjusted original image and display it as a preview image, so that the target posture can change with the scene Dynamically adjust the position to improve the recommendation effect of the target posture, improve the photographing effect, and enhance the user experience.
  • the photographer can adjust the shooting angle and/or shooting position by moving the terminal device, and in the process of adjusting the shooting angle and/or shooting position, the terminal The device can determine the target position of the target pose in the preview image of the current frame according to the relative position of the target pose in the preview image of the previous frame and the foreground part and/or background part of the preview image, and can preview the target pose in the current frame
  • the target posture is displayed at the target position of the image, so that the target posture may not move with the movement of the terminal device, which reduces the difficulty of use by the photographer and improves the photographing effect.
  • the current frame preview as shown in FIG. 8 may be displayed on the display interface of the terminal device. Image, so that the target posture and the shooting scene remain relatively fixed.
  • the terminal device can obtain the current posture of the subject in real time, and can determine the current posture and The degree of matching between the target postures can thereby guide the subject to adjust the posture according to the degree of matching.
  • the matching degree between the current posture and the target posture may be determined by any existing matching degree calculation method, which is not limited in the embodiment of the present application.
  • the matching degree can also be displayed on the display interface of the terminal device in real time, so that the subject and/or the photographer can clearly understand the subject’s photo pose The specific fit with the target posture in the posture image.
  • the terminal device can perform posture comparison to find out the current posture and the target posture Therefore, the subject can be prompted to adjust the posture according to the different position. For example, the subject may be prompted to adjust the posture through voice playback and/or the subject may be prompted to adjust the posture through text display.
  • the preset threshold value should be understood as a threshold value preset in the terminal device. The preset threshold value may be set by the user where the terminal device is located, or may be set by default by the terminal device system.
  • the terminal device can also generate a three-dimensional model corresponding to the target posture according to the current scene, and can fuse the three-dimensional model into the original image and display it as a preview image to pass Three-dimensional AR image for more precise and vivid posture guidance.
  • the embodiment of the present application can identify the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located, and obtain a match with the shooting object by combining the target feature of the shooting object and the scene feature of the scene where the shooting object is located And the posture image of the scene where the shooting object is located can improve the accuracy and effectiveness of the posture image acquisition, so that the obtained posture image meets the photographing requirements of the shooting object and the scene where the shooting object is currently located.
  • the posture image and the original image as a preview image, and by displaying the target posture in the preview image, it is convenient to quickly guide the subject to adjust the posture according to the target posture in the preview image, which improves the efficiency of posture adjustment and the efficiency of taking pictures. , In order to effectively improve the shooting effect of the image and enhance the user experience.
  • FIG. 9 shows a structural block diagram of an auxiliary photographing device provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.
  • the auxiliary photographing device may include:
  • the target feature recognition module 901 is configured to obtain an original image, and recognize the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;
  • the posture image acquisition module 902 is configured to obtain a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, and the posture image contains the target posture to be recommended;
  • the posture image superimposing module 903 is configured to superimpose and display the posture image and the original image as a preview image, so as to guide the subject to perform posture adjustment according to the target posture in the preview image.
  • the posture image superimposing module 903 may include:
  • the first posture image superimposing unit is used to add a layer mask to the posture image, and superimpose and display the posture image with the added layer mask and the original image as the preview image, in the layer mask
  • the position corresponding to the target posture is set to white, and the position other than the target posture in the layer mask is set to black.
  • the posture image superimposing module 903 may further include:
  • a posture image segmentation unit for segmenting the target posture from the posture image
  • the second posture image superimposing unit is configured to superimpose the target posture on the original image, and display the original image superimposed on the target posture as a preview image.
  • the second posture image superimposing unit may include:
  • the first position acquisition subunit is configured to acquire the first position of the target posture in the posture image
  • the second position determination subunit is configured to determine the second position of the target posture in the original image according to the first position, and superimpose the target posture on the second position of the original image.
  • the posture image acquisition module 902 may include:
  • a photographing feature acquiring unit configured to acquire a photographing characteristic of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;
  • the first posture image obtaining unit is configured to obtain the posture image according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.
  • the posture image acquisition module 902 may include:
  • a sample image acquisition unit configured to acquire at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;
  • a recommended value obtaining unit configured to obtain a recommended value corresponding to the at least one sample image
  • the second posture image obtaining unit is configured to select a target sample image from the at least one sample image according to the recommended value, and obtain the posture image according to the target sample image.
  • the auxiliary photographing device may further include:
  • An image size obtaining module configured to obtain a first image size corresponding to the original image and a second image size corresponding to the posture image;
  • the image size adjustment module is configured to adjust the second image size corresponding to the posture image according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size .
  • the auxiliary photographing device may further include:
  • the current posture acquisition module is used to acquire the current posture of the photographed object
  • the current posture matching module is used to determine the degree of matching between the current posture and the target posture, and guide the subject to adjust the posture according to the degree of matching.
  • FIG. 10 is a schematic structural diagram of a terminal device provided by an embodiment of this application.
  • the terminal device 10 of this embodiment includes: at least one processor 1000 (only one is shown in FIG. 10), a memory 1001, and stored in the memory 1001 and can be stored in the at least one processor 1000.
  • the processor 1000 executes the computer program 1002 the steps in any of the foregoing embodiments of the auxiliary photographing method are implemented.
  • the terminal device 10 may include, but is not limited to, a processor 1000 and a memory 1001. Those skilled in the art can understand that FIG. 10 is only an example of the terminal device 10, and does not constitute a limitation on the terminal device 10. It may include more or less components than shown in the figure, or a combination of certain components, or different components. , For example, can also include input and output devices, network access devices, and so on.
  • the processor 1000 may be a central processing unit (Central Processing Unit, CPU), and the processor 1000 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), and application specific integrated circuits (Application Specific Integrated Circuits). , ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the memory 1001 may be an internal storage unit of the terminal device 10 in some embodiments, such as a hard disk or a memory of the terminal device 10. In other embodiments, the memory 1001 may also be an external storage device of the terminal device 10, for example, a plug-in hard disk equipped on the terminal device 10, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card, flash card (Flash Card), etc. Further, the memory 1001 may also include both an internal storage unit of the terminal device 10 and an external storage device.
  • the memory 1001 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 1001 can also be used to temporarily store data that has been output or will be output.
  • the terminal device involved in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, and the like. Take the terminal device as a mobile phone as an example.
  • FIG. 11 shows a block diagram of a part of the structure of a mobile phone provided in an embodiment of the present application.
  • the mobile phone includes: a radio frequency (RF) circuit 1110, a memory 1120, an input unit 1130, a display unit 1140, a sensor 1150, an audio circuit 1160, a wireless fidelity (WiFi) module 1170, and a processor 1180 , And power supply 1190 and other components.
  • RF radio frequency
  • the structure of the mobile phone shown in FIG. 11 does not constitute a limitation on the mobile phone, and may include more or fewer components than those shown in the figure, or a combination of some components, or different component arrangements.
  • the RF circuit 1110 can be used for receiving and sending signals during the process of sending and receiving information or talking. In particular, after receiving the downlink information of the base station, it is processed by the processor 1180; in addition, the designed uplink data is sent to the base station.
  • the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like.
  • the RF circuit 1110 can also communicate with the network and other devices through wireless communication.
  • the above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), Email, Short Messaging Service (SMS), etc.
  • GSM Global System of Mobile Communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • Email Short Messaging Service
  • the memory 1120 may be used to store software programs and modules.
  • the processor 1180 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1120.
  • the memory 1120 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc.
  • the memory 1120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the input unit 1130 may be used to receive inputted digital or character information, and generate key signal input related to user settings and function control of the mobile phone.
  • the input unit 1130 may include a touch panel 1131 and other input devices 1132.
  • the touch panel 1131 also called a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 1131 or near the touch panel 1131. Operation), and drive the corresponding connection device according to the preset program.
  • the touch panel 1131 may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 1180, and can receive and execute the commands sent by the processor 1180.
  • the touch panel 1131 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the input unit 1130 may also include other input devices 1132.
  • other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick.
  • the display unit 1140 may be used to display information input by the user or information provided to the user and various menus of the mobile phone.
  • the display unit 1140 may include a display panel 1141.
  • the display panel 1141 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.
  • the touch panel 1131 can cover the display panel 1141. When the touch panel 1131 detects a touch operation on or near it, it transmits it to the processor 1180 to determine the type of touch event, and then the processor 1180 responds to the touch event. The type provides corresponding visual output on the display panel 1141.
  • the touch panel 1131 and the display panel 1141 are used as two independent components to implement the input and input functions of the mobile phone, but in some embodiments, the touch panel 1131 and the display panel 1141 can be integrated. Realize the input and output functions of mobile phones.
  • the mobile phone may also include at least one sensor 1150, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor can include an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display panel 1141 according to the brightness of the ambient light.
  • the proximity sensor can close the display panel 1141 and/or when the mobile phone is moved to the ear. Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when it is stationary.
  • the audio circuit 1160, the speaker 1161, and the microphone 1162 can provide an audio interface between the user and the mobile phone.
  • the audio circuit 1160 can transmit the electrical signal converted from the received audio data to the speaker 1161, which is converted into a sound signal by the speaker 1161 for output; on the other hand, the microphone 1162 converts the collected sound signal into an electrical signal, and the audio circuit 1160 After being received, the audio data is converted into audio data, and then processed by the audio data output processor 1180, and sent to, for example, another mobile phone via the RF circuit 1110, or the audio data is output to the memory 1120 for further processing.
  • WiFi is a short-distance wireless transmission technology.
  • the mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1170. It provides users with wireless broadband Internet access.
  • FIG. 11 shows the WiFi module 1170, it is understandable that it is not a necessary component of the mobile phone, and can be omitted as needed without changing the essence of the invention.
  • the processor 1180 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes by running or executing software programs and/or modules stored in the memory 1120, and calling data stored in the memory 1120. Various functions and processing data of the mobile phone can be used to monitor the mobile phone as a whole.
  • the processor 1180 may include one or more processing units; preferably, the processor 1180 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, application programs, etc. , The modem processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1180.
  • the mobile phone may also include a power source (such as a battery) for supplying power to various components.
  • a power source such as a battery
  • the power source may be logically connected to the processor 1180 through a power management system, so that functions such as charging, discharging, and power consumption management can be managed through the power management system.
  • the mobile phone may also include a camera 1190.
  • the position of the camera 1190 on the mobile phone may be front-mounted or rear-mounted, which is not limited in the embodiment of the present application.
  • the camera 1190 can obtain the optical image generated by the photographed object, and can convert the optical image into an electrical signal, and then can convert the electrical signal into a digital signal through analog-to-digital conversion, and then process the digital signal through the digital signal processor DSP
  • the processed digital signal can be sent to the processor 1180 for processing, and finally converted into an image that can be seen in the display unit 1140.
  • the mobile phone may include a single camera, a dual camera, or a triple camera, etc., which is not limited in the embodiment of the present application.
  • a mobile phone may include three cameras, of which one is a main camera, one is a wide-angle camera, and one is a telephoto camera.
  • the multiple cameras may be all front-mounted, or all rear-mounted, or part of the front-mounted and some rear-mounted, which is not limited in this embodiment of the present application.
  • the mobile phone may also include a Bluetooth module, etc., which will not be repeated here.
  • the embodiments of the present application also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be implemented.
  • the embodiments of the present application provide a computer program product.
  • the terminal device can implement the steps in the foregoing method embodiments when executed.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the computer program can be stored in a computer-readable storage medium.
  • the computer program can be stored in a computer-readable storage medium.
  • the steps of the foregoing method embodiments can be implemented.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms.
  • the computer-readable storage medium may at least include: any entity or device capable of carrying computer program code to the device/terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), and random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal and software distribution medium.
  • ROM read-only memory
  • RAM random access memory
  • electric carrier signal telecommunications signal and software distribution medium.
  • U disk mobile hard disk, floppy disk or CD-ROM, etc.
  • computer-readable storage media cannot be electrical carrier signals and telecommunication signals.
  • the disclosed device/terminal device and method may be implemented in other ways.
  • the device/terminal device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units.
  • components can be combined or integrated into another system, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention s'applique au domaine technique des terminaux et concerne, en particulier, un procédé et un appareil de photographie auxiliaire pour un terminal d'intelligence artificielle (IA), un équipement terminal, et un support d'enregistrement lisible par ordinateur. Le procédé de photographie auxiliaire consiste à : acquérir une image d'origine et reconnaître une caractéristique cible d'un objet de photographie et une caractéristique de scène de la scène où l'objet de photographie se situe dans l'image d'origine ; acquérir une image de posture selon la caractéristique cible de l'objet de photographie et la caractéristique de scène de la scène où l'objet de photographie se situe, l'image de posture comprenant une posture cible à recommander ; superposer l'image de posture et l'image d'origine pour afficher en tant qu'image de prévisualisation, de façon à guider l'objet de photographie pour effectuer un réglage de posture en fonction de la posture cible dans l'image de prévisualisation, de telle sorte que l'objet de photographie peut être rapidement guidé pour régler la posture en fonction de la posture cible dans l'image de prévisualisation, ce qui permet d'améliorer l'efficacité de réglage de posture et d'améliorer l'efficacité de photographie, ce qui permet d'améliorer efficacement l'effet de photographie d'image et l'expérience utilisateur.
PCT/CN2020/125204 2019-12-31 2020-10-30 Procédé et appareil de photographie auxiliaire, équipement terminal, et support d'enregistrement WO2021135601A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911423536.3 2019-12-31
CN201911423536.3A CN113132618B (zh) 2019-12-31 2019-12-31 辅助拍照方法、装置、终端设备及存储介质

Publications (1)

Publication Number Publication Date
WO2021135601A1 true WO2021135601A1 (fr) 2021-07-08

Family

ID=76686437

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/125204 WO2021135601A1 (fr) 2019-12-31 2020-10-30 Procédé et appareil de photographie auxiliaire, équipement terminal, et support d'enregistrement

Country Status (2)

Country Link
CN (1) CN113132618B (fr)
WO (1) WO2021135601A1 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113537374A (zh) * 2021-07-26 2021-10-22 百度在线网络技术（北京）有限公司 一种对抗样本生成方法
CN113596323A (zh) * 2021-07-13 2021-11-02 咪咕文化科技有限公司 智能合影方法、装置、移动终端及计算机程序产品
CN113627117A (zh) * 2021-07-19 2021-11-09 深圳新益昌科技股份有限公司 固晶路径规划方法、装置、终端设备及可读存储介质
CN113691727A (zh) * 2021-08-25 2021-11-23 广州岸边网络科技有限公司 一种基于动作控制的拍照系统
CN113705401A (zh) * 2021-08-18 2021-11-26 深圳传音控股股份有限公司 图像处理方法、终端设备及存储介质
CN113934340A (zh) * 2021-09-22 2022-01-14 青岛海信移动通信技术股份有限公司 一种终端设备和进度条显示方法
CN113938620A (zh) * 2021-11-12 2022-01-14 深圳传音控股股份有限公司 图像处理方法、移动终端及存储介质
CN116757983A (zh) * 2023-07-03 2023-09-15 北京拙河科技有限公司 一种主辅图像融合方法及装置
WO2023192771A1 (fr) * 2022-03-29 2023-10-05 Qualcomm Incorporated Recommandations pour capture d'image

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115767256A (zh) * 2021-09-03 2023-03-07 北京字跳网络技术有限公司 拍摄方法、装置、电子设备和存储介质
CN113905174A (zh) * 2021-09-18 2022-01-07 咪咕文化科技有限公司 拍照姿势推荐方法、装置、设备以及计算机可读存储介质
CN113890994B (zh) * 2021-09-30 2022-12-23 荣耀终端有限公司 图像拍摄方法、系统和存储介质
CN113942429A (zh) * 2021-11-16 2022-01-18 深圳荆虹科技有限公司 车辆座椅调节方法、车辆座椅调节系统、车辆及存储介质
CN114285988B (zh) * 2021-12-03 2024-04-09 维沃移动通信有限公司 显示方法、装置、电子设备及存储介质
CN115022543A (zh) * 2022-05-31 2022-09-06 Oppo广东移动通信有限公司 拍照方法与拍照装置、终端及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189829A1 (en) * 2003-03-25 2004-09-30 Fujitsu Limited Shooting device and shooting method
CN102891958A (zh) * 2011-07-22 2013-01-23 北京华旗随身数码股份有限公司 一种具有姿势指导功能的数码相机
CN103220466A (zh) * 2013-03-27 2013-07-24 华为终端有限公司 图片的输出方法及装置
CN105578037A (zh) * 2015-12-16 2016-05-11 天津优爱创科技有限公司 一种基于无线通讯的具有辅助姿势功能的摄影装置
CN107018333A (zh) * 2017-05-27 2017-08-04 北京小米移动软件有限公司 拍摄模板推荐方法、装置及拍摄设备
US20190159966A1 (en) * 2017-11-29 2019-05-30 International Business Machines Corporation Methods and systems for managing photographic capture
CN110476405A (zh) * 2017-12-01 2019-11-19 三星电子株式会社 用于提供与拍摄有关的推荐信息的方法和系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106502693B (zh) * 2016-10-17 2019-07-19 努比亚技术有限公司 一种图像显示方法和装置
CN108184050B (zh) * 2017-12-15 2020-04-24 维沃移动通信有限公司 一种拍照方法、移动终端
CN108347559A (zh) * 2018-01-05 2018-07-31 深圳市金立通信设备有限公司 一种拍摄方法、终端及计算机可读存储介质
CN108495029B (zh) * 2018-03-15 2020-03-31 维沃移动通信有限公司 一种拍照方法及移动终端
CN108540724A (zh) * 2018-04-28 2018-09-14 维沃移动通信有限公司 一种拍摄方法及移动终端
CN110543578B (zh) * 2019-08-09 2024-05-14 华为技术有限公司 物体识别方法及装置
CN110475069B (zh) * 2019-09-03 2021-05-07 腾讯科技（深圳）有限公司 图像的拍摄方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189829A1 (en) * 2003-03-25 2004-09-30 Fujitsu Limited Shooting device and shooting method
CN102891958A (zh) * 2011-07-22 2013-01-23 北京华旗随身数码股份有限公司 一种具有姿势指导功能的数码相机
CN103220466A (zh) * 2013-03-27 2013-07-24 华为终端有限公司 图片的输出方法及装置
CN105578037A (zh) * 2015-12-16 2016-05-11 天津优爱创科技有限公司 一种基于无线通讯的具有辅助姿势功能的摄影装置
CN107018333A (zh) * 2017-05-27 2017-08-04 北京小米移动软件有限公司 拍摄模板推荐方法、装置及拍摄设备
US20190159966A1 (en) * 2017-11-29 2019-05-30 International Business Machines Corporation Methods and systems for managing photographic capture
CN110476405A (zh) * 2017-12-01 2019-11-19 三星电子株式会社 用于提供与拍摄有关的推荐信息的方法和系统

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113596323A (zh) * 2021-07-13 2021-11-02 咪咕文化科技有限公司 智能合影方法、装置、移动终端及计算机程序产品
CN113627117A (zh) * 2021-07-19 2021-11-09 深圳新益昌科技股份有限公司 固晶路径规划方法、装置、终端设备及可读存储介质
CN113537374A (zh) * 2021-07-26 2021-10-22 百度在线网络技术（北京）有限公司 一种对抗样本生成方法
CN113537374B (zh) * 2021-07-26 2023-09-08 百度在线网络技术（北京）有限公司 一种对抗样本生成方法
CN113705401A (zh) * 2021-08-18 2021-11-26 深圳传音控股股份有限公司 图像处理方法、终端设备及存储介质
CN113691727A (zh) * 2021-08-25 2021-11-23 广州岸边网络科技有限公司 一种基于动作控制的拍照系统
CN113934340B (zh) * 2021-09-22 2024-04-19 青岛海信移动通信技术有限公司 一种终端设备和进度条显示方法
CN113934340A (zh) * 2021-09-22 2022-01-14 青岛海信移动通信技术股份有限公司 一种终端设备和进度条显示方法
CN113938620A (zh) * 2021-11-12 2022-01-14 深圳传音控股股份有限公司 图像处理方法、移动终端及存储介质
CN113938620B (zh) * 2021-11-12 2023-11-07 深圳传音控股股份有限公司 图像处理方法、移动终端及存储介质
WO2023192771A1 (fr) * 2022-03-29 2023-10-05 Qualcomm Incorporated Recommandations pour capture d'image
US11871104B2 (en) 2022-03-29 2024-01-09 Qualcomm Incorporated Recommendations for image capture
CN116757983B (zh) * 2023-07-03 2024-02-06 北京拙河科技有限公司 一种主辅图像融合方法及装置
CN116757983A (zh) * 2023-07-03 2023-09-15 北京拙河科技有限公司 一种主辅图像融合方法及装置

Also Published As

Publication number Publication date
CN113132618B (zh) 2022-09-09
CN113132618A (zh) 2021-07-16

Similar Documents

Publication Publication Date Title
WO2021135601A1 (fr) Procédé et appareil de photographie auxiliaire, équipement terminal, et support d'enregistrement
EP3965003A1 (fr) Procédé et dispositif de traitement d'images
CN111182205B (zh) 拍摄方法、电子设备及介质
CN112351185A (zh) 拍照方法和移动终端
CN109743504B (zh) 一种辅助拍照方法、移动终端和存储介质
CN107368810A (zh) 人脸检测方法及装置
CN107592459A (zh) 一种拍照方法及移动终端
CN109495616B (zh) 一种拍照方法及终端设备
CN109862266B (zh) 一种图像共享方法及终端
WO2022057435A1 (fr) Système de réponse à une question basée sur une recherche, et support de stockage
CN111159449B (zh) 一种图像显示方法及电子设备
CN110443769A (zh) 图像处理方法、图像处理装置及终端设备
CN107707762A (zh) 一种应用程序操作方法及移动终端
CN111050077B (zh) 拍摄方法及电子设备
CN108833709A (zh) 一种摄像头的启动方法和移动终端
WO2021109960A1 (fr) Procédé de traitement d'image, dispositif électronique et support d'informations
WO2021098609A1 (fr) Procédé et dispositif de détection d'image, et dispositif électronique
CN109246351B (zh) 一种构图方法及终端设备
WO2021082772A1 (fr) Procédé de capture d'écran et dispositif électronique
WO2021017713A1 (fr) Procédé de photographie et terminal mobile
CN109917988B (zh) 选中内容显示方法、装置、终端及计算机可读存储介质
CN111079030A (zh) 一种群组搜索方法及电子设备
CN110086998B (zh) 一种拍摄方法及终端
CN108345657B (zh) 一种图片筛选方法及移动终端
WO2021036504A1 (fr) Procédé de suppression d'image et dispositif terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20908928

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20908928

Country of ref document: EP

Kind code of ref document: A1