WO2022242230A1 - 一种高倍率拍摄方法及电子设备 - Google Patents

一种高倍率拍摄方法及电子设备 Download PDF

Info

Publication number
WO2022242230A1
WO2022242230A1 PCT/CN2022/074838 CN2022074838W WO2022242230A1 WO 2022242230 A1 WO2022242230 A1 WO 2022242230A1 CN 2022074838 W CN2022074838 W CN 2022074838W WO 2022242230 A1 WO2022242230 A1 WO 2022242230A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
preview image
electronic device
interface
mobile phone
Prior art date
Application number
PCT/CN2022/074838
Other languages
English (en)
French (fr)
Inventor
周文宇
龙祁峰
郭栋
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Priority to US17/909,368 priority Critical patent/US20240196085A1/en
Priority to EP22757192.4A priority patent/EP4113974A4/en
Publication of WO2022242230A1 publication Critical patent/WO2022242230A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/52Details of telephonic subscriber devices including functional features of a camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera

Definitions

  • the present application relates to the technical field of photographing, and in particular to a high-magnification photographing method and electronic equipment.
  • the mobile phone includes one or more cameras for collecting images.
  • the mobile phone may adjust the zoom ratio of the camera of the mobile phone in response to the user's focusing operation on the shooting interface. Increasing the zoom ratio can make the mobile phone clearly capture the distant scenery. For example, as shown in FIG. 1 , when the zoom ratio of the camera in the mobile phone 100 is enlarged to 50 times, the mobile phone 100 can clearly photograph a bird 200 on a distant tree.
  • the zoom ratio of the camera is large (such as 50 times)
  • the slight movement of the user's hand such as hand shaking
  • the mobile phone 100 may not be able to aim at the bird 200 to be photographed due to the shaking of the user's hand, so that a satisfactory photo cannot be taken.
  • the mobile phone 100 may display the preview image shown in FIG. 2 , and the preview image shown in FIG. 2 does not include the complete image of the bird 200 .
  • the present application provides a high magnification shooting method and electronic equipment, which can automatically adjust the zoom magnification and improve the quality of the captured image.
  • the present application provides a high-magnification photographing method, which can be applied to an electronic device, and the electronic device includes a camera.
  • the electronic device can display the first interface.
  • the first interface is a viewfinder interface for the electronic device to take pictures, and the first interface includes a first preview image collected by the camera when the zoom ratio is m.
  • the first preview image includes an image of the target object, and the image of the target object is at the center of the first preview image.
  • the electronic device can display the second interface, acquire and save the initial pose information of the electronic device.
  • the second interface includes a second preview image collected by the camera when the zoom ratio is n, and the second preview image includes an image of a target object, where n>m.
  • the above initial pose information is used to indicate the motion state and position of the electronic device when receiving the above first operation.
  • the electronic device can automatically lock the subject that needs to be photographed at a high zoom ratio in response to a user's operation in a shooting scene with a high zoom ratio. Then, the electronic device can collect and display a preview image of the subject with a suitable zoom ratio, and obtain an initial state and an initial position of the electronic device. In this way, the user does not need to manually adjust the magnification and zoom ratio, and the shaking caused by the user's manual operation can be reduced.
  • the initial state is the motion state of the electronic device (such as the posture of the electronic device) when the electronic device captures the above-mentioned initial preview image.
  • the initial position is the position of the electronic device when the electronic device captures the initial preview image.
  • the initial state and initial position may reflect the spatial position and posture of the electronic device when the electronic device captures the aforementioned initial preview image.
  • the electronic device can acquire real-time pose information of the electronic device, and the real-time pose information is used to indicate the real-time motion state and position of the electronic device. Then, the electronic device can send the first prompt information according to the real-time pose information and the initial pose information. The first prompt information is used to prompt the user to move the electronic device so that the electronic device is in the motion state and position indicated by the initial pose information.
  • the electronic device can obtain the real-time state and real-time location of the electronic device, and according to the real-time state and real-time location, remind the user to correct the position and posture of the electronic device, so that the electronic device can remain in the above-mentioned initial state and initial position or close to The initial state and the state of the initial position.
  • the shooting area ie, viewing range
  • the above initial state and initial position are the state and position of the electronic device when the electronic device captures the initial preview image of the locked object in response to the user's operation.
  • the subject locked by the electronic device is the subject that the user wants to photograph.
  • the electronic device can remind the user to correct the position and posture of the electronic device, so that the electronic device can remain in the initial state and the position and posture indicated by the initial position, which can ensure the safety of the electronic device. It is possible to capture the subject desired by the user.
  • the electronic device may receive the user's camera operation.
  • the electronic device can display the third interface.
  • the third interface includes a third preview image and a fourth preview image.
  • the third preview image is an image with the highest image parameter among multiple frames of second preview images collected by the camera, and the image parameter includes clarity and/or completeness.
  • the fourth preview image is an image captured in response to a photographing operation.
  • the electronic device may save the preview image selected by the user in response to the user's selection operation on the third preview image and/or the fourth preview image.
  • the electronic device in response to the user's photographing operation, can simultaneously display the preview image with the highest image parameter and the preview image manually taken by the user, and the user can select the desired photo to save. In this way, the electronic device can capture photos satisfactory to the user according to the requirements of the user.
  • the electronic device may display the fourth interface.
  • the fourth interface is a viewfinder interface for the electronic device to take pictures, and the fourth interface includes a fifth preview image collected by the camera when the zoom ratio is m, and the fifth preview image includes an image of a target object.
  • the electronic device may respond to the user's second operation on the fourth interface, and send out second prompt information on the fourth interface.
  • the second operation is the user's selection operation on the image of the target object, and the second prompt information is used to instruct the user
  • the mobile electronic device places the image of the target object at the center of the fifth preview image.
  • the electronic device can remind the user to move the electronic device to adjust the viewfinder range of the camera so that the image of the target object is at the center of the viewfinder frame (that is, the center of the fifth preview image).
  • the electronic device further includes an angle adjustment device of the camera, and the angle adjustment device is used to adjust the shooting angle of the camera so that the camera rotates within a preset angle range.
  • the electronic device may display a fourth interface, the fourth interface is a viewfinder interface for the electronic device to take pictures, and the fourth interface includes the fifth preview image collected by the camera when the zoom ratio is 1, The fifth preview image includes an image of the target object.
  • the electronic device can adjust the shooting angle of the camera so that the image of the target object is at the center of the fifth preview image.
  • the electronic device After the electronic device receives the user's second operation (such as a click operation) on the image of the target object, it can automatically adjust the shooting angle of the camera so that the image of the target object is in the viewfinder interface. center position, and perform automatic zooming to adjust the zoom ratio of the camera to n. In this way, shaking caused by user operations can be reduced, thereby reducing the impact of user operations on the image quality of photos taken by the electronic device.
  • the electronic device receives the user's second operation (such as a click operation) on the image of the target object, it can automatically adjust the shooting angle of the camera so that the image of the target object is in the viewfinder interface. center position, and perform automatic zooming to adjust the zoom ratio of the camera to n. In this way, shaking caused by user operations can be reduced, thereby reducing the impact of user operations on the image quality of photos taken by the electronic device.
  • the user's second operation such as a click operation
  • the electronic device may also send a third prompt message.
  • the third prompt information is used to prompt the user that the image of the target object is already at the center of the fifth preview image. That is to say, the electronic device can remind the user in time when the image of the target object is in the center of the fifth preview image.
  • the above-mentioned electronic device responds to the user's first operation on the first interface, displays the second interface, acquires and saves the initial pose information of the electronic device, and may include: the electronic device In response to the first operation, determine the area to be photographed that includes the image of the target object from the first preview image, so as to lock the target object from the first preview image; the electronic device automatically adjusts the zoom factor to n, and displays the area to be photographed that includes the enlarged
  • the second interface of the area acquires and saves the initial pose information of the electronic device.
  • the area to be photographed is a rectangular area formed with a preset length and width, with the contact area of the first operation and the touch screen of the electronic device as the center of the rectangle.
  • the aforementioned area to be photographed is a rectangular area including the target object identified by the captured image recognition technology.
  • the above-mentioned electronic device automatically adjusts the zoom ratio to n, displays the second interface including the enlarged area to be photographed, acquires and saves the initial pose information of the electronic device, which may include: the electronic device adapts to the size of the touch screen of the electronic device or The size of the viewfinder frame of the touch screen is automatically adjusted to n, and the image of the target object in the area to be photographed is enlarged, so that the image of the target object occupies the viewfinder frame of the touch screen of the electronic device.
  • the electronic device includes a gyroscope sensor and an acceleration sensor, and the gyroscope sensor and the acceleration sensor are used to collect initial pose information and real-time pose information of the electronic device.
  • the electronic device may also send fourth prompt information, the first The fourth prompt information is used to indicate that the electronic device has returned to the motion state and position indicated by the initial pose information. That is to say, the electronic device can remind the user in time when the electronic device returns to the motion state and position indicated by the initial pose information.
  • the above-mentioned zoom ratio n may be a zoom ratio to be selected by a user.
  • the above-mentioned electronic device responding to the user's first operation on the first interface, and displaying the second interface may include: the electronic device responding to the user's third operation on the first interface, sending out fifth prompt information, the fifth prompt information It is used to instruct the user to select the zoom ratio of the camera; the electronic device displays a sixth interface in response to the user's selection operation on the zoom ratio n, and the sixth interface includes the sixth preview image collected by the camera of the electronic device when the zoom ratio is n, the first The six preview images include images of the target object; the electronic device displays the second interface in response to the user's first operation on the sixth interface.
  • the above-mentioned sixth interface further includes a preset adjustment control, the preset adjustment control is used to adjust the zoom ratio of the camera, and the preset adjustment control is also used to indicate the current zoom ratio of the camera. zoom ratio.
  • the sending of the first prompt information may include: the electronic device displays the first prompt information on the second interface.
  • the first prompt information may also be voice prompt information sent by the electronic device, which is not limited in this embodiment of the present application.
  • the third preview image may be the one with the highest resolution captured by the camera of the electronic device during the period from when the mobile phone 100 displays the second interface to when the electronic device receives the camera operation.
  • the most complete second preview image may be the ratio of the image of the target object contained in the third preview image to the complete image of the target object.
  • the preview image can be cached every first preset period, the preview image cached for the first time is compared with the preview image cached for the second time, and the A preview image with higher image parameters; then compare the high-definition preview image with the next cached preview image, and still retain the high-definition photo.
  • the highest preview image is always stored in the buffer of the electronic device.
  • the method in the embodiment of the present application may further include: the electronic device periodically caches the images captured by the camera.
  • the second preview image until it is cached to the pth second preview image collected by the camera, the second preview image is the preview image displayed on the second interface and the third interface, p ⁇ 2, p is an integer;
  • the second cached preview image i and the i-1th seventh preview image are obtained and cached for the i-th seventh preview image; wherein, i is in ⁇ 1,2,..., The value in p ⁇ , i is an integer;
  • the i-th seventh preview image is the preview image with the highest image parameter among the second preview image i and the i-1th seventh preview image;
  • the image parameters include clarity and/or completeness
  • the completeness is the proportion of the image of the target object included in the preview image in the complete image of the target object;
  • the first and seventh preview image is the second preview image 1 of the
  • the present application provides a high-magnification photographing method, which can be applied to an electronic device, and the electronic device includes a camera.
  • the electronic device may display a first interface, the first interface is a viewfinder interface for the electronic device to take pictures, the first interface includes a first preview image collected by the camera when the zoom magnification is m, and the first preview image includes the target object image.
  • the electronic device may display the second interface in response to the user's zoom operation on the first interface.
  • the second interface includes the second preview image n>m collected by the camera when the zoom ratio is n.
  • the zooming operation above is used to trigger the electronic device to adjust the zoom ratio of the camera to n.
  • the electronic device may also periodically cache the second preview image.
  • the electronic device receives the user's zoom operation on the first interface, which means that the electronic device will enter a high-magnification shooting scene.
  • the electronic device can automatically lock the subject that needs to be photographed at a high magnification, enlarge and display the preview image of the subject (called the initial preview image), and obtain the initial state and initial position of the electronic device. In this way, the user does not need to manually adjust the magnification and zoom ratio, and the shaking caused by the user's manual operation can be reduced.
  • the electronic device may lock the target object in the following manner: the electronic device periodically caches the second preview image in real time; If the completeness of the image of the target object in the area is greater than the preset completeness threshold, the electronic device displays a third interface to acquire and save the initial pose information of the electronic device.
  • the third interface includes the image of the target object collected by the camera when the zoom magnification is m; the initial pose information is used to indicate that the second preset image cached in consecutive K cycles includes the same shooting area, and the image of the target object
  • K ⁇ 2 is an integer.
  • the electronic device can also acquire real-time pose information of the electronic device, and the real-time pose information is used to indicate the real-time motion state and position of the electronic device.
  • the electronic device can send the first prompt information according to the real-time pose information and the initial pose information.
  • the first prompt information is used to prompt the user to move the electronic device so that the electronic device is in the motion state and position indicated by the initial pose information.
  • the subject locked by the electronic device is the subject that the user wants to photograph.
  • the electronic device can remind the user to correct the position and posture of the electronic device when the shooting area of the camera deviates from the shooting area corresponding to the initial preview image, so that the electronic device can maintain the initial state and the position and posture indicated by the initial position, It can be ensured that the electronic device can capture the subject desired by the user.
  • the electronic device may display a fourth interface including the third preview image and the fourth preview image in response to the user's photographing operation.
  • the fourth preview image is an image captured in response to a photographing operation.
  • the third preview image is an image with the highest image parameter among multiple frames of second preview images collected by the camera, and the image parameter includes clarity and/or completeness.
  • the electronic device saves the preview image selected by the user. That is to say, in response to the user's photographing operation, the electronic device can simultaneously display the preview image with the highest image parameter and the preview image manually taken by the user, and the user can select the desired photo to save. In this way, the electronic device can capture photos satisfactory to the user according to the requirements of the user.
  • the sending of the first prompt information may include: displaying the first prompt information on a third interface.
  • the first prompt information may also be voice prompt information sent by the electronic device, which is not limited in this embodiment of the present application.
  • the electronic device displays a third interface, including the following steps:
  • the electronic device compares the second preview image j cached for the jth time with the second preview image j-1 cached for the j-1th time, and determines whether the second preview image j and the second preview image j-1 have a common pattern j-1 .
  • the common grid j-1 is the same shooting area in the second preview image j and the second preview image j-1; wherein, j is an integer, and j is in ⁇ 2,...,K ⁇ in order from small to large value.
  • the electronic device compares the second preview image j+1 and the common grid j-1 cached for the j+1th time, and judges that the j-th Whether there is a common grid j between the second preview image j+1 and the common grid j ⁇ 1 cached for +1 times.
  • the common frame j is the same shooting area as the second preview image j+1 and the common frame j-1.
  • the electron compares the second preview image j+2 cached at the j+2th time with the common grid j, and judges the second preview image j+2 and the common grid j. Whether there is a common frame j+1 between the second preview image j+2 cached for j+2 times and the common frame j.
  • the common frame j+1 is the same shooting area as the second preview image j+2 and the common frame j.
  • This loop is executed, if the second preview image K-1 cached for the K-1th time and the common grid K-3 have a common grid K-2, the electronic device compares the second preview image K cached for the Kth time with the common grid K -2. Determine whether the second preview image K and the common grid K-2 have a common grid K-1.
  • the common frame K-1 is the same shooting area in the second preview image K and the common frame K-2.
  • the electronic device determines the shooting area corresponding to the common grid K-1 as the area to be captured including the image of the target object, and displays the area including the third preview image the third interface.
  • the third preview image is a preview image corresponding to the area to be photographed.
  • the electronic device compares the second preview image j cached for the jth time with the second preview image j-1 cached for the j-1th time, and determines whether the second preview image Whether j and the second preview image j-1 have a common grid j-1 may include the following steps:
  • the electronic device divides the second preview image j-1 cached at the j-1th time into Q grid images, and divides the second preview image j cached at the jth time into Q grid images, Q ⁇ 1, and Q is an integer.
  • the electronic device obtains the image correlation coefficient of each grid image in the Q grid image of the second preview image j-1 and each grid image in the Q grid image of the second preview image j; wherein, the image correlation coefficient is used to characterize the two grid images
  • the value range of the image correlation coefficient is [0, 1]. The larger the image correlation coefficient of the two grid images, the higher the similarity of the two grid images; the smaller the image correlation coefficient of the two grid images, the The lower the similarity of grid images.
  • the electronic device determines whether at least one image correlation coefficient among multiple image correlation coefficients between the Q grid image of the second preview image j-1 and the Q grid image of the second preview image j is greater than a preset similarity threshold.
  • the second preview image j-1 and the Q grid image of the second preview image j are greater than the preset similarity threshold, it means that the second preview image j There is a common grid j-1 with the second preview image j-1; if multiple image correlation coefficients of the Q grid image of the second preview image j-1 and the Q grid image of the second preview image j are less than or equal to the preset similarity degree threshold, it means that the second preview image j and the second preview image j-1 do not have a common lattice j-1.
  • the above-mentioned electronic device acquires each grid image in the Q grid image of the second preview image j-1 and each grid image in the Q grid image of the second preview image j
  • the image correlation coefficient including: the electronic device obtains the histogram data of the first frame image and the histogram data of the second frame image; wherein, the first frame image is one frame in the Q frame image of the second preview image j-1 image, the second grid image is a grid image in the Q grid image of the second preview image j; the electronic device calculates the first grid image and the second grid image according to the histogram data of the first grid image and the histogram data of the second grid image Image correlation coefficient for binomial images.
  • the present application provides an electronic device, where the electronic device includes a memory, one or more cameras, and one or more processors.
  • the memory, the camera and the processor are coupled.
  • computer program codes are stored in the memory, and the computer program codes include computer instructions.
  • the electronic device is made to execute the method described in the first aspect or the second aspect and any possible design manner thereof.
  • the present application provides a computer-readable storage medium, the computer-readable storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device executes the first aspect and any possible ones thereof. The method described in the design method.
  • the present application provides a computer program product.
  • the computer program product runs on a computer
  • the computer executes the method described in the first aspect and any possible design manner.
  • the computer may be the electronic device described above.
  • FIG. 1 is a schematic diagram of an application scene of a high-magnification shooting method provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a display interface of an electronic device provided in an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application.
  • FIG. 4A is a flow chart of a high-magnification shooting method provided by an embodiment of the present application.
  • FIG. 4B is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 4C is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 4D is a flow chart of another high-magnification shooting method provided by the embodiment of the present application.
  • FIG. 5 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 6A is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 6B is a schematic diagram of a display interface of another electronic device provided in the embodiment of the present application.
  • FIG. 6C is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 6D is a schematic diagram of a preview image provided by the embodiment of the present application.
  • FIG. 7A is a flow chart of another high-magnification shooting method provided by the embodiment of the present application.
  • FIG. 7B is a schematic diagram of another preview image provided by the embodiment of the present application.
  • FIG. 8 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 10 is a flow chart of a high-magnification shooting method provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 12 is a schematic diagram of a display interface of another electronic device provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 14 is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 15 is a schematic diagram of a display interface of another electronic device provided by an embodiment of the present application.
  • FIG. 16 is a flow chart of a high-magnification shooting method provided by an embodiment of the present application.
  • FIG. 17A is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 17B is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 17C is a schematic diagram of a display interface of another electronic device provided by an embodiment of the present application.
  • FIG. 18 is a flow chart of a high-magnification shooting method provided by an embodiment of the present application.
  • FIG. 19A is a schematic diagram of a display interface of another electronic device provided in an embodiment of the present application.
  • FIG. 19B is a schematic diagram of a display interface of another electronic device provided in the embodiment of the present application.
  • FIG. 19C is a schematic diagram of a display interface of another electronic device provided by an embodiment of the present application.
  • FIG. 20 is a schematic diagram of a display interface of another electronic device provided by an embodiment of the present application.
  • FIG. 21 is a schematic diagram of a chip system provided by an embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present application, unless otherwise specified, “plurality” means two or more.
  • An embodiment of the present application provides a high-magnification photographing method, which can be applied to an electronic device with a photographing function.
  • the electronic device can automatically lock the subject that needs to be photographed at a high zoom ratio in response to a user's operation in a high zoom ratio shooting scene.
  • the electronic device can collect and display a preview image of the subject (called an initial preview image) with an appropriate zoom ratio, and obtain an initial state and an initial position of the electronic device. In this way, the user does not need to manually adjust the magnification and zoom ratio, and the shaking caused by the user's manual operation can be reduced.
  • the initial state is the motion state of the electronic device (such as the posture of the electronic device) when the electronic device captures the above-mentioned initial preview image.
  • the initial position is the position of the electronic device when the electronic device captures the initial preview image.
  • the initial state and initial position may reflect the spatial position and posture of the electronic device when the electronic device captures the aforementioned initial preview image.
  • the electronic device can acquire the real-time status and real-time location of the electronic device, and according to the real-time status and real-time location, remind the user to correct the position and posture of the electronic device, so that the electronic device can remain in the above-mentioned initial state and initial position or close to the initial state and the state of the initial position.
  • the shooting area ie, viewing range
  • the above initial state and initial position are the state and position of the electronic device when the electronic device captures the initial preview image of the locked object in response to the user's operation.
  • the subject locked by the electronic device is the subject that the user wants to photograph.
  • the electronic device can remind the user to correct the position and posture of the electronic device when the shooting area of the camera deviates from the shooting area corresponding to the initial preview image, so that the electronic device can maintain the initial state and the position and posture indicated by the initial position, It can be ensured that the electronic device can capture the subject desired by the user.
  • the electronic device can simultaneously display the above-mentioned initial preview image and the preview image manually captured by the user, and the user selects a desired photo to save. In this way, the electronic device can capture photos satisfactory to the user according to the requirements of the user.
  • the above zoom ratio may be an optical zoom ratio or a digital zoom ratio.
  • the aforementioned zoom factor may be 1x, 8x, 10x, 12x, 50x, or 12.8x.
  • “1x” indicates that the zoom magnification is 1x.
  • "8x” indicates a zoom factor of 8 times.
  • “50X” means the zoom ratio is 50 times.
  • a zoom ratio higher than a preset ratio threshold may be referred to as a high ratio.
  • the magnifications described in the embodiments of the present application may also be referred to as multiples. That is to say, the aforementioned zoom factor may also be called a zoom factor, the aforementioned preset factor threshold may be called a preset factor threshold, and the aforementioned high factor may be called a high factor.
  • the electronic device 300 may include: a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (universal serial bus, USB) interface 330, a charging management module 340, a power management module 341, a battery 342, antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, earphone jack 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, a display screen 394, and a subscriber identification module (subscriber identification module, SIM) card interface 395, etc.
  • SIM subscriber identification module
  • the above-mentioned sensor module 380 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.
  • sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.
  • the structure shown in this embodiment does not constitute a specific limitation on the electronic device 300 .
  • the electronic device 300 may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the electronic device 300 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is a cache memory.
  • the memory may hold instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 310 is reduced, thereby improving the efficiency of the system.
  • processor 310 may include one or more interfaces.
  • the interface connection relationship among the modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the electronic device 300 .
  • the electronic device 300 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the charging management module 340 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger. While the charging management module 340 is charging the battery 342 , it can also supply power to the electronic device through the power management module 341 .
  • the power management module 341 is used for connecting the battery 342 , the charging management module 340 and the processor 310 .
  • the power management module 341 receives the input of the battery 342 and/or the charging management module 340, and supplies power for the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393, and the wireless communication module 360, etc.
  • the wireless communication function of the electronic device 300 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 350 , the wireless communication module 360 , a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 300 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 300 .
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 350 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • the wireless communication module 360 can provide applications on the electronic device 300 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (blue tooth, BT), global navigation Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • wireless local area networks wireless local area networks, WLAN
  • WLAN wireless local area networks
  • wireless fidelity wireless fidelity, Wi-Fi
  • Wi-Fi wireless fidelity
  • BT wireless fidelity
  • GNSS global navigation Satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the antenna 1 of the electronic device 300 is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the electronic device 300 can communicate with the network and other devices through wireless communication technology.
  • the electronic device 300 implements a display function through a GPU, a display screen 394, and an application processor.
  • the GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 394 is used to display images, videos and the like.
  • the display screen 394 includes a display panel.
  • display screen 394 may be a touch screen.
  • the electronic device 300 can realize the shooting function through an ISP, a camera 393 , a video codec, a GPU, a display screen 394 , and an application processor.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 300.
  • the external memory card communicates with the processor 310 through the external memory interface 320 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 321 may be used to store computer-executable program code, which includes instructions.
  • the processor 310 executes various functional applications and data processing of the electronic device 300 by executing instructions stored in the internal memory 321 .
  • the processor 310 may execute instructions stored in the internal memory 321, and the internal memory 321 may include a program storage area and a data storage area.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 300 .
  • the electronic device 300 can implement audio functions through an audio module 370 , a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, and an application processor. Such as music playback, recording, etc.
  • Touch sensor also known as "touch panel”.
  • the touch sensor can be arranged on the display screen 394, and the touch sensor and the display screen 394 form a touch screen, also called “touch screen”.
  • the touch sensor is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations can be provided through the display screen 394 .
  • the touch sensor can also be disposed on the surface of the electronic device 300 , which is different from the position of the display screen 394 .
  • the electronic device 300 may detect a user's touch operation on the touch screen through the touch sensor, and collect one or more of the touch position of the touch operation on the touch screen, and the touch time. In some embodiments, the electronic device 300 can determine the touch position of the touch operation on the touch screen by combining the touch sensor and the pressure sensor.
  • the keys 390 include a power key, a volume key and the like.
  • the key 390 may be a mechanical key. It can also be a touch button.
  • the electronic device 300 may receive key input and generate key signal input related to user settings and function control of the electronic device 300 .
  • the motor 391 can generate a vibrating prompt.
  • the motor 391 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 391 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 394 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 392 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and the like.
  • the SIM card interface 395 is used for connecting a SIM card. The SIM card can be connected and separated from the electronic device 300 by inserting it into the SIM card interface 395 or pulling it out from the SIM card interface 395 .
  • the electronic device 300 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 395 can support Nano SIM card, Micro SIM card, SIM card etc.
  • the gyroscope sensor may be a three-axis gyroscope for tracking state changes of the electronic device 300 in six directions.
  • the acceleration sensor is used to detect the moving speed, direction and displacement of the electronic device 300 .
  • the electronic device 300 may detect the state and position of the electronic device 300 through a gyro sensor and an acceleration sensor. When the state and position of the electronic device 300 are greatly changed compared with the initial position and initial state, the electronic device 300 can remind the user on the display screen 394 to correct the state and position of the electronic device 300 in real time.
  • An embodiment of the present application provides a high-magnification photographing method, which can be applied to the above-mentioned electronic device 300 .
  • the electronic device 300 is used to introduce the method in the embodiment of the present application.
  • the high-magnification shooting method may include S401-S406.
  • the mobile phone 100 displays a first interface.
  • the first interface is a viewfinder interface for the mobile phone 100 to take pictures, and the first interface includes a first preview image collected by the camera of the mobile phone 100 when the zoom ratio is m, the first preview image includes an image of the target object, and the image of the target object Centered on the first preview image.
  • the mobile phone 100 may display the first interface 401 shown in FIG. 4B , the first interface 401 includes a first preview image 402 , and the first preview image 402 includes an image of the target object “bird” 200 .
  • the first interface 401 further includes a zoom magnification mark 403 "1 ⁇ ", indicating that the optical magnification is 1 time.
  • m can also take other values.
  • the first interface 404 includes a zoom factor mark 405 "10 ⁇ ", indicating that the optical factor is 10 times.
  • the image of the target object may not be in the center of the viewfinder frame of the mobile phone in the viewfinder interface displayed by starting the camera application on the mobile phone.
  • the mobile phone may guide the user to adjust the viewfinder range of the mobile phone so that the image of the target object is at the center of the viewfinder frame of the mobile phone.
  • the method in this embodiment of the present application may further include S401 ′ and S401 ′′.
  • the mobile phone 100 displays a fourth interface.
  • the fourth interface is a viewfinder interface for the mobile phone 100 to take pictures.
  • the fourth interface includes a fifth preview image collected by the camera of the mobile phone 100 when the zoom ratio is m, and the fifth preview image includes an image of a target object.
  • the mobile phone 100 may display the above-mentioned fourth interface in response to the user's click operation on the icon of the camera application.
  • the fourth interface is a preview interface of the mobile phone 100 in the camera mode.
  • the mobile phone 100 may display the main interface 501 shown in (a) in FIG. 5 .
  • the main interface 501 includes icons of multiple applications, such as an icon 502 of a camera application, an icon of a clock application, an icon of a calendar application, an icon of a setting application, and the like.
  • the mobile phone 100 may display the fourth interface 503 shown in (b) of FIG. 5 .
  • the fourth interface 503 is a preview interface of the mobile phone 100 in the camera mode, and the fourth interface 503 includes a fifth preview image 507 .
  • the fourth interface 503 also includes an album key 506, a camera switching key 508, a shooting key 509, and the like.
  • the photo album key 506 is used to trigger the mobile phone 100 to display the photo album of the mobile phone 100 .
  • the latest photos taken by the mobile phone 100 are displayed on the album key 506 .
  • a photo of the user's movement is displayed on the album key 506 .
  • the camera switching key 508 is used to trigger the mobile phone 100 to switch cameras, such as switching front and rear cameras.
  • the shooting key 509 is used to trigger the mobile phone 100 to save the preview image captured by the camera.
  • the zoom factor indicator 505 is used to indicate the zoom factor of the camera of the mobile phone 100.
  • the zoom magnification mark 505 "1 ⁇ " indicates that the optical magnification is 1 time.
  • the zoom ratio of the camera of the mobile phone 100 is 1.
  • the fourth interface 503 further includes a zoom factor mark 505, which is used to indicate that the zoom factor of the camera is "1x", that is, 1 times zoom.
  • m can also take other values.
  • the above fourth interface may be a preview interface for taking photos displayed on the mobile phone after the mobile phone adjusts the zoom ratio of the camera in response to the zoom operation.
  • the preview image (such as the fifth preview image 507) collected by the mobile phone 100 may include images of one or more photographed objects.
  • the fifth preview image 507 shown in (b) of FIG. 5 includes an image of the subject “tree” 504 and an image of the subject “bird” 200 .
  • the mobile phone 100 may adjust the zoom ratio of the camera. In this way, the mobile phone 100 can clearly capture distant scenes.
  • the mobile phone 100 can automatically enlarge the zoom ratio of the camera in response to the user's operation of selecting the object to be photographed (that is, the target object) on the preview interface of taking pictures. In this way, it is possible to prevent the mobile phone 100 from being unable to aim at the bird 200 to be photographed due to hand shake during the process of manually enlarging the zoom ratio, thereby failing to take a satisfactory photo.
  • the method in the embodiment of the present application may further include S401".
  • the mobile phone 100 responds to the user's second operation on the fourth interface, and sends a second prompt message on the fourth interface.
  • the second operation is the user's selection operation on the image of the target object in the fourth interface.
  • the second prompt information is used to instruct the user to move the mobile phone 100 so that the image of the target object is at the center of the viewfinder interface.
  • the mobile phone 100 may receive the user's second operation on the image of the target object “bird” 200 in the fifth preview image 507 .
  • the second operation may be a user's single-click operation or double-click operation on the location of the image of the target object "bird" 200 in the fifth preview image 507 .
  • the mobile phone 100 may display the second prompt information 601 shown in (a) in FIG. 6B.
  • the second prompt information is used to instruct the user to move the mobile phone 100 so that the image of the target object is at the center of the viewfinder interface.
  • the second prompt information 601 may be "please move the mobile phone to ensure that the target object you select is in the center of the viewfinder frame".
  • the above second prompt information may also be used to prompt the user of the location of the mobile phone.
  • the mobile phone 100 may display the second prompt information 602 shown in (b) in FIG. Move the phone to ensure that the target object you choose is in the center of the viewfinder.”
  • the second prompt information may further include a directional icon, such as a direction arrow, for prompting the user of the location of the mobile phone.
  • a directional icon such as a direction arrow
  • the mobile phone 100 may display the second prompt information 603 shown in (c) in FIG. Indicate the direction to move the phone to ensure that the target object you choose is in the center of the viewfinder" and the direction arrow.
  • the user may move the mobile phone according to the prompt of the second prompt information.
  • the field of view of the mobile phone 100 may change.
  • the user moves the mobile phone 100 according to the prompt of the second prompt information, and when the image of the above-mentioned target object (such as "bird" 200) is at the center of the viewfinder interface, the user can stop moving the mobile phone 100.
  • the mobile phone 100 may display the first interface 401 shown in FIG. 4B .
  • the first interface 401 includes a first preview image 702
  • the first preview image 702 includes an image of the target object “bird” 200 .
  • the image of the target object “bird” 200 is at the center of the first preview image 702 .
  • the mobile phone 100 can detect the position of the image of the above-mentioned target object (such as "bird" 200) in the preview image (such as the first preview image) in real time.
  • the mobile phone 100 may send a third prompt message.
  • the third prompt information is used to prompt the user: the image of the target object is already at the center of the preview interface, and it is time to stop moving the mobile phone 100 .
  • the mobile phone 100 may display the first interface 604 shown in FIG. 6C, and the first interface 604 includes a third prompt message 605, such as "the target object 'bird' is already in the center of the frame, please stop moving the mobile phone". As shown in FIG.
  • the image of the target object “bird” 200 is at the center of the first preview image 604 .
  • the mobile phone 100 may display the third prompt information 605 within a preset time period. After the above preset time period expires, the mobile phone 100 may execute S401 to display the first interface 401 shown in FIG. 4B .
  • the method for the mobile phone 100 to identify that the image of the target object is at the center of the first preview image may include: the mobile phone 100 identifying whether the image of the target object is within a preset central area of the viewfinder frame of the mobile phone 100 .
  • the preset center area is located at the center of the viewing frame of the mobile phone 100 .
  • the image of the target object is in the preset center area of the viewfinder frame of the mobile phone 100, it means that the image of the target object is in the center of the first preview image.
  • the preset center area 607 is located at the center of the viewfinder frame 606 of the mobile phone 100 in the camera mode.
  • the image 608 of the target object “bird” is within the preset center area 607 . If the image of the target object is outside the preset central area of the viewing frame of the mobile phone 100, it means that the image of the target object is at the center of the first preview image.
  • the image of the target object is within the preset central area of the viewfinder frame of the mobile phone 100 , specifically means that all images of the target object are within the preset central area of the viewfinder frame of the mobile phone 100 .
  • the image of the target object is outside the preset central area of the viewfinder frame of the mobile phone 100 , which specifically means that part or all of the image of the target object is outside the preset central area of the viewfinder frame of the mobile phone 100 .
  • the mobile phone 100 responds to the user's first operation on the image of the target object in the first interface, the mobile phone 100 displays the second interface, acquires and saves the initial pose information of the mobile phone 100.
  • the second interface includes a second preview image captured by the camera of the mobile phone 100 when the zoom ratio is n, and the second preview image includes an image of a target object, where n>m.
  • the above-mentioned first operation is used to trigger the mobile phone 100 to increase the zoom ratio to display the first preview image including the image of the target object.
  • the above-mentioned first operation may be a user's long press operation on the image of the target object in the second preview image.
  • the mobile phone 100 may receive a first operation (such as a long press operation) input by the user on the first interface 401 shown in FIG. 4B or the first interface 404 shown in FIG. 4C .
  • a first operation such as a long press operation
  • the mobile phone 100 may display the second interface 801 shown in FIG. 8 .
  • the second interface 801 includes a second preview image 802 .
  • the second interface 801 further includes a zoom factor indicator 803 , and the zoom factor indicator 803 is used to indicate that the zoom factor of the camera is "50x", that is, 50 times zoom.
  • the initial pose information of the mobile phone 100 may include initial state information and initial position information of the mobile phone 100; the initial state information is used to indicate the motion state of the mobile phone 100 when the mobile phone 100 receives the above-mentioned first operation (abbreviated as initial state).
  • the initial location information of the mobile phone 100 is used to indicate the location of the mobile phone 100 (referred to as the initial location for short). It should be understood that when the mobile phone 100 receives the above-mentioned first operation, the image of the target object is at the center of the viewfinder frame. In the case that the mobile phone 100 maintains this pose (ie, the pose indicated by the initial pose information), after the mobile phone 100 enlarges the zoom ratio, it is more likely to capture a complete target object. Therefore, the initial state and initial position can be used to correct the user to adjust the state and position of the mobile phone 100, so that the mobile phone 100 can capture a complete target object.
  • the mobile phone 100 includes a gyroscope sensor and an acceleration sensor.
  • the mobile phone 100 may obtain the initial pose information of the mobile phone 100 through the gyroscope sensor and the acceleration sensor when the mobile phone 100 displays the above-mentioned second interface.
  • the above-mentioned first operation may be that the pressing time input by the user on the above-mentioned first interface is longer than or equal to the preset The long press operation of the duration threshold.
  • the preset duration threshold may be any duration such as 2.5 seconds (s) or 2s.
  • the mobile phone 100 may not execute S402.
  • the mobile phone 100 may, in response to the first operation, determine the shooting area where the image of the target object is located (referred to as the area to be shot) from the first preview image. For example, as shown in FIG. 7B , the mobile phone 100 may determine from the first preview image 401 the area 701 to be photographed where the image of the target object "bird" is located, that is, lock the target object "bird” to be photographed. Then, the mobile phone 100 may adjust the zoom ratio of the camera to n according to the region 701 to be photographed, and display the second preview image including the image of the target object (such as "bird").
  • the mobile phone 100 can obtain the initial pose information of the mobile phone 100 when the mobile phone 100 determines the area 701 to be photographed (ie, is locked to be photographed).
  • this embodiment of the present application introduces a specific method in S402, in which the mobile phone 100 displays the second interface including the second preview image in response to the first operation, and obtains and saves the initial state information and initial location information of the mobile phone 100 .
  • S402 may include S402a-S402b.
  • the mobile phone 100 determines from the first preview image the area to be photographed that includes the image of the target object, that is, locks the target object from the first preview image.
  • the mobile phone 100 may receive a user's long press operation on the image of the target object "bird" 200 shown in FIG. 4B.
  • the mobile phone 100 may determine the area corresponding to the user's long press operation (ie, the area to be photographed including the image of the target object) according to the long press operation collected by the touch sensor in the touch screen.
  • the area to be photographed that includes the image of the target object may be: take the center of the contact area between the above-mentioned first operation (such as a long press operation) and the touch screen as the center of a rectangle, and take the preset length and width as a centimeter (cm ) and the rectangular area of b cm.
  • the above-mentioned rectangle may be a square
  • the touch screen of the mobile phone 100 may send to the processor of the mobile phone 100 an instruction including the long press operation and coordinate position information that the long press operation acts on the touch screen.
  • the processor of the mobile phone 100 can obtain the first preview image collected by the camera; then, according to the coordinate position indicated by the coordinate position information, determine the area to be photographed in the above manner.
  • FIG. 7B shows the first preview image 401 shown in FIG. 4B.
  • the area 701 where the image of the target object "bird" 200 is located in the first preview image 401 ie, the area corresponding to the dotted frame shown in FIG. 7B
  • the mobile phone 100 can lock the area 701 where the image of the target object "bird" 200 in the first preview image 401 is located as the area to be photographed.
  • the to-be-photographed area 701 includes an image of the target object “bird” 200 .
  • the mobile phone 100 in response to the above-mentioned first operation, also needs to consider the integrity of the image of the target object when determining the area to be captured including the image of the target object from the first preview image. That is to say, the mobile phone 100 needs to include a complete image of the target object in the area to be photographed determined in response to the first operation.
  • the mobile phone 100 may recognize the target object (such as a bird or a moon or the like) in the shooting area locked by the first operation through an image recognition technology. Then, the mobile phone 100 can recognize the complete image of the target object in the first preview image through an image recognition technology. Finally, the mobile phone 100 may determine the shooting area including the complete image of the target object as the area to be shot.
  • the target object such as a bird or a moon or the like
  • the mobile phone 100 automatically adjusts the zoom factor to n, displays the second interface including the enlarged area to be photographed, and acquires and saves the initial pose information of the mobile phone 100 .
  • the mobile phone 100 can automatically adjust the zoom ratio of the camera, enlarge the image of the target object in the area to be photographed, and occupy the display screen (such as the touch screen) of the mobile phone 100 or the viewfinder of the display screen frame.
  • the mobile phone 100 can adapt to the size of the display screen of the mobile phone 100 or the size of the viewfinder frame of the display screen, and determine the above-mentioned zoom ratio n, so that the image of the target object in the area to be photographed occupies the entire display screen of the mobile phone 100 or the area of the display screen. Viewfinder.
  • the area to be photographed 701 is a square with a side length of 2 cm.
  • the aspect ratio of the display screen of the mobile phone 100 is 16:9
  • the length of the mobile phone 100 is about 15.5 cm
  • the width is about 8.7 cm.
  • the zoom factor can be determined with the shortest width of the display screen of the mobile phone 100 .
  • the width direction just fills the display screen; while the length direction automatically fills the screen from the first preview image.
  • the mobile phone 100 may display the second interface 801 shown in FIG. 8 .
  • the second interface 801 includes a second preview image 802, and the second preview image 802 includes an image of the target object "bird".
  • the second interface 801 also includes a zoom factor mark 803 , which is used to indicate that the zoom rate is 50.
  • the mobile phone 100 may automatically identify and determine the area to be photographed including the complete image of the target object through image recognition technology.
  • the mobile phone 100 may first determine the length X cm and width Y cm of the area to be photographed including the complete image of the target object.
  • the zoom factor n Min(15.5/X, 8.7/Y).
  • Min(15.5/X, 8.7/Y) means to take the minimum value among 15.5/X and 8.7/Y.
  • the mobile phone 100 determines the zoom factor n, it can fill the display screen with the smaller size of the length direction or width direction of the area to be photographed; while the other direction automatically fills the screen from the first preview image.
  • the mobile phone 100 acquires real-time pose information of the mobile phone 100, and the real-time pose information is used to indicate a real-time motion state and position of the mobile phone 100.
  • the viewfinder range of the camera may change due to the movement of the user's hand, and the camera cannot capture the image of the target object, which in turn causes the preview displayed on the mobile phone 100
  • the image does not include an image of the target object. That is to say, the image of the target object cannot appear or cannot completely appear in the preview interface of the mobile phone 100 .
  • the mobile phone 100 can detect the state and position of the mobile phone 100 through the gyroscope sensor and the acceleration sensor.
  • the mobile phone 100 can remind the user on the display screen in real time to correct the state and position of the mobile phone 100 in time, so that the mobile phone 100 can collect the complete information of the target object. image, and then display the complete image of the target object on the preview interface.
  • the real-time status information of the mobile phone 100 is used to indicate the real-time motion status of the mobile phone 100 .
  • the real-time location information of the mobile phone 100 is used to indicate the real-time location of the mobile phone 100 .
  • the mobile phone 100 includes a gyro sensor and an acceleration sensor.
  • the mobile phone 100 can acquire status information (ie, real-time status information) and location information (ie, real-time location information) of the mobile phone 100 in real time through the gyroscope sensor and the acceleration sensor.
  • the above-mentioned gyroscope sensor may be a three-axis gyroscope for tracking state changes of the mobile phone 100 in six directions.
  • the acceleration sensor is used to detect the moving speed, direction and displacement of the mobile phone 100 .
  • the mobile phone 100 sends out first prompt information according to the real-time pose information and the initial pose information.
  • the first prompt information is used to prompt the user to move the mobile phone 100 so that the mobile phone 100 is in the motion state and position indicated by the initial pose information.
  • the above-mentioned initial pose information indicates that the initial motion state of the mobile phone 100 is the initial state W0, and the initial position of the mobile phone 100 is the initial position S0; the above-mentioned real-time pose information indicates that the motion state of the mobile phone 100 is the real-time state W1, and the mobile phone 100
  • the real-time location of is the real-time location S1.
  • the mobile phone 100 can compare the real-time state W1 with the initial state W0, compare the real-time position S1 with the initial position S0, and determine how the mobile phone 100 moves to return to the initial state W0 and the initial position S0.
  • the mobile phone 100 may send the above-mentioned first prompt information to prompt the user to move the mobile phone 100 so that the mobile phone 100 is in the motion state and position indicated by the initial pose information.
  • the first prompt information sent by the mobile phone may be voice prompt information.
  • the mobile phone may display the first prompt information on the second interface.
  • the method in the embodiment of the present application is introduced by taking the electronic device displaying the first prompt information on the second interface as an example.
  • the mobile phone 100 can drive the mobile phone 100 to the right through the gyro sensor and the acceleration sensor.
  • the mobile phone 100 may display the second interface 901 shown in FIG. 9 , and the second interface 901 only includes a partial image of the target object "bird".
  • the second interface 901 also displays a first prompt message 902, such as "Please move the phone to the right!”.
  • the mobile phone 100 can drive the mobile phone 100 to the upper left through the gyroscope sensor and the acceleration sensor.
  • the mobile phone 100 may display the second interface 1001 shown in FIG. 10 , and the second interface 1001 only includes a partial image of the target object "bird".
  • the second interface 1001 may also display a first prompt message 1002, such as "Please move the mobile phone to the bottom right!”.
  • the mobile phone 100 can drive the mobile phone 100 counterclockwise through the gyro sensor and the acceleration sensor. In this case, the mobile phone 100 may send out first prompt information for prompting the user to rotate the mobile phone 100 clockwise.
  • the above-mentioned first prompt information may prompt the user to move the mobile phone 100 in the form of words and moving signs, so that the mobile phone 100 is in the motion state and position indicated by the initial pose information.
  • the mobile phone 100 may display a second interface 1101 shown in (a) in FIG. 11 , where the second interface 1101 includes first prompt information 1102 .
  • the mobile phone 100 may display the second interface 1103 shown in (b) in FIG. 11 , and the second interface 1103 may display the first prompt information 1104 .
  • the mobile phone 100 may display the second interface 1105 shown in (c) in FIG. 11 , and the second interface 1105 includes the first prompt information 1106 .
  • the above-mentioned first prompt information 1102, first prompt information 1104 and first prompt information 1106 all include text "Please move the mobile phone in the direction indicated by the keyboard" and a moving icon (such as a direction indicating arrow).
  • the real-time pose (ie real-time state and real-time position) of the mobile phone 100 can return to the initial pose (ie initial state and initial position).
  • the mobile phone 100 can display a relatively complete image including the target object captured by the camera when the zoom ratio is n on the viewfinder interface.
  • the mobile phone 100 may display the preview interface 1201 shown in FIG. 12 .
  • the mobile phone 100 may send the fourth prompt message when the mobile phone 100 returns to the motion state and position indicated by the initial pose information.
  • the fourth prompt information is used to prompt the user to stop moving the mobile phone 100 and start taking photos.
  • the mobile phone 100 may send out the fourth prompt message 1202 shown in FIG. 12, such as "please keep the mobile phone still, and click the camera shutter to take a photo". It should be noted that the above fourth prompt information is optional.
  • "the mobile phone 100 is in the motion state and position indicated by the initial pose information" described in S404 may specifically be: the motion state indicated by the real-time pose information of the mobile phone 100 and the initial pose information
  • the difference of the indicated motion state is smaller than the first difference threshold; the difference between the position indicated by the real-time pose information of the mobile phone 100 and the position indicated by the initial pose information is smaller than the second difference threshold.
  • the mobile phone 100 displays a third interface including a third preview image and a fourth preview image in response to the user's camera operation.
  • the third preview image is an image with the highest image parameter among multiple frames of second preview images collected by the camera, and the fourth preview image is an image captured in response to a photographing operation.
  • the camera of the mobile phone 100 can collect multiple preview images.
  • the third preview image may be a preview image with the highest definition and the highest integrity collected by the camera of the mobile phone 100 during the process from the mobile phone 100 performing S402 to the mobile phone 100 receiving the photographing operation described in S405 .
  • the completeness of the third preview image may be the ratio of the image of the target object contained in the third preview image to the complete image of the target object.
  • the preview image can be cached every first preset period, the preview image cached for the first time is compared with the preview image cached for the second time, and the A preview image with higher image parameters; then compare the high-definition preview image with the next cached preview image, and still retain the high-definition photo.
  • the highest preview image is always saved in the cache of the mobile phone 100 .
  • the mobile phone 100 may periodically cache the second preview image captured by the camera at that time according to a preset period (such as the first preset period).
  • the mobile phone 100 caches the second preview image i in the ith first preset period.
  • the mobile phone can compare the second preview image i with the i-1th seventh preview image to obtain and cache the i-th seventh preview image.
  • the ith seventh preview image is a preview image with the highest image parameter among the second preview image i and the i-1th seventh preview image.
  • the image parameters include sharpness and/or integrity.
  • the completeness of the preview image may be the proportion of the image of the target object included in the preview image in the complete image of the target object.
  • the mobile phone 100 obtains the p-th seventh preview image, which is the above-mentioned third preview image.
  • the mobile phone 100 can also delete preview images with lower image parameters.
  • i is an integer
  • i takes values in ⁇ 2,...,p ⁇ in ascending order, p ⁇ 2, and p is an integer.
  • the i-th seventh preview image is the second preview image 1 acquired by the mobile phone 100 in the first first preset period.
  • the i-th seventh preview image is the preview image with the highest image parameter among the second preview image i and the i-1-th seventh preview image.
  • the time length of the above-mentioned first preset period may be any time length such as 0.5 second (s) or 1 s.
  • the above-mentioned first preset period is 0.5s. That is to say, starting from the execution of S402 by the mobile phone 100, the mobile phone 100 receives the photographing operation described in S405 within the period of 2.5s-3.0s.
  • the specific process of determining the third preview image by the mobile phone 100 is introduced as follows:
  • the mobile phone 100 can compare the second preview image 2 with the first seventh preview image (ie, the second preview image 1 ) to obtain the second seventh preview image. Because the image parameters (such as completeness) of the second preview image 2 are higher than the image parameters of the first seventh preview image (i.e. the second preview image 1), as shown in Table 1, the second seventh preview image is the first preview image. 2 preview image 2.
  • the mobile phone 100 can compare the second preview image 3 with the second seventh preview image (ie, the second preview image 2 ) to obtain the third seventh preview image. Because the image parameters (such as completeness) of the 2nd seventh preview image (i.e. the second preview image 2) are higher than the image parameters of the second preview image 3, as shown in Table 1, the 3rd preview image is the 3rd preview image. 2 preview image 2.
  • the mobile phone 100 can compare the second preview image 4 with the third seventh preview image (ie, the second preview image 2 ) to obtain the fourth seventh preview image. Because the image parameter of the second preview image 4 is higher than the image parameter (such as completeness) of the 3rd seventh preview image (i.e. the second preview image 2), as shown in table 1, the 4th seventh preview image is the 4th preview image. 2 preview image 4.
  • the mobile phone 100 can compare the second preview image 5 with the fourth seventh preview image (ie, the second preview image 4 ) to obtain the fifth seventh preview image. Because the image parameters (such as completeness) of the 4th seventh preview image (i.e. the second preview image 4) are higher than the image parameters of the second preview image 5, as shown in Table 1, the 5th seventh preview image is the first preview image. 2 preview image 4.
  • the p-th seventh preview image (that is, the fifth seventh preview image, that is, the second preview image 4 ) is the above-mentioned third preview image.
  • the mobile phone 100 may always cache a preview image with a higher image parameter as the third preview image. In this way, the mobile phone 100 can simultaneously present the fourth preview image and the third preview image with the highest image parameter to the user on the third interface. In this way, the user can be guaranteed to take and select high-quality photos.
  • the mobile phone 100 may receive a camera operation of the user.
  • the mobile phone 100 may receive the camera operation shown in FIG. 12 , such as the user's click operation on the "photograph shutter".
  • the mobile phone 100 can save the preview image collected by the camera in real time.
  • the mobile phone 100 may display the preview interface shown in FIG. 13 .
  • the album key in the preview interface is updated from the album key 506 to the album key 1302.
  • the preview image in the preview interface shown in FIG. 12 is displayed on the album key 1302 . That is to say, the mobile phone 100 has saved the preview image corresponding to the mobile phone 100 .
  • the mobile phone 100 does not directly save the preview image, but displays a third interface including the third preview image and the fourth preview image.
  • the user selects any preview image in the third interface to save. In this way, it can be ensured that the mobile phone 100 can save the preview image desired by the user.
  • the mobile phone 100 may display the third interface 1401 shown in (a) in FIG. 14, the third interface 1406 shown in (b) in FIG. 14, or the third interface 1406 shown in FIG.
  • the third interface 1401 , the third interface 1406 and the third interface 1501 each include a third preview image 1403 and a fourth preview image 1405 .
  • the third interface 1401, the third interface 1406 and the third interface 1501 are also used to prompt the user to select the photo to be saved.
  • the third interface 1401, the third interface 1406 and the third interface 1501 also include prompt information 1402, such as "Please select the photo to be saved!"
  • the third interface 1406 and the third interface 1501 display the above-mentioned third preview image 1403 and fourth preview image 1405 on the preview interface of the photo taken by the mobile phone 100 .
  • the third interface 1406 does not display the preview image captured by the camera in real time
  • the third interface 1501 displays the preview image 1502 captured by the camera in real time.
  • the third interface 1406 and the third interface 1501 also include an album key 506 . It can be seen from (b) in FIG. 14 or the album key 506 shown in FIG. 15 that the mobile phone 100 does not save new photos in response to the camera operation.
  • the mobile phone 100 saves the preview image selected by the user in response to the user's selection of the third preview image and/or the fourth preview image in the third interface.
  • the mobile phone 100 may receive a user's selection operation on at least one preview image among the third preview image and the fourth preview image in the third interface. In response to the user's selection operation, the mobile phone 100 may save the preview image selected by the user. For example, as shown in FIG. 15 , the mobile phone 100 may receive a user's selection operation on the third preview image 1403 . In response to the user's selection operation on the third preview image 1403 shown in FIG. 15 , the mobile phone 100 may display the preview interface shown in FIG. 13 .
  • the embodiment of the present application provides a high-magnification shooting method, and the mobile phone 100 can automatically lock the shooting object that needs high-magnification shooting in response to a user's operation in a high-zoom-magnification shooting scene. Then, the mobile phone 100 can collect and display a preview image of the subject (called an initial preview image) with an appropriate zoom ratio, and obtain the initial state and initial position of the mobile phone 100 . In this way, the user does not need to manually adjust the magnification and zoom ratio, and the shaking caused by the user's manual operation can be reduced.
  • the mobile phone 100 can obtain the real-time state and real-time position of the mobile phone 100, and according to the real-time state and real-time position, remind the user to correct the position and posture of the mobile phone 100, so that the mobile phone 100 can remain in the above-mentioned initial state and initial position or close to the initial state and the state of the initial position.
  • the subject locked by the mobile phone 100 is the subject that the user wants to photograph.
  • the mobile phone 100 can remind the user to correct the position and posture of the mobile phone 100 when the shooting area of the camera deviates from the corresponding shooting area of the initial preview image, so that the mobile phone 100 can remain in the initial state and the position and posture indicated by the initial position, It can be ensured that the mobile phone 100 can capture the subject desired by the user.
  • the mobile phone 100 may display the initial preview image and the preview image manually taken by the user in response to the user's photographing operation, and the user selects a desired photo to save. In this way, the mobile phone 100 can take photos satisfactory to the user according to the user's requirements.
  • the above-mentioned zoom factor n may be a zoom factor selected by a user.
  • the method in this embodiment of the present application may further include S1601-S1602, and the above S402 may be replaced with S1603.
  • the mobile phone 100 responds to the user's third operation on the first interface, and the mobile phone 100 sends fifth prompt information on the first interface.
  • the fifth prompt information is used to instruct the user to select the zoom ratio of the camera.
  • the third operation may be a long press operation.
  • the third operation may be a user's long press operation on the image of the target object, or a user's long press operation on any position in the first preview image.
  • the third operation may be different from or the same as the second operation.
  • S1601 may be executed instead of S402.
  • the mobile phone 100 may display a first interface 1701 shown in (a) in FIG. 17A , where the first interface 1701 includes a first preview image 1702 .
  • the mobile phone 100 may receive a third operation (such as a long press operation) performed by the user on the first interface 1701 .
  • the mobile phone 100 may issue fifth prompt information 1703 shown in (b) in FIG. 17A.
  • the fifth prompt information 1703 may include multiple zoom ratio options, such as "2x" option, "8x” option, "10x” option, "20x” option, "30x” option and "50x” option.
  • the mobile phone 100 responds to the user's selection operation on the zoom ratio n, and the mobile phone 100 displays a sixth interface.
  • the sixth interface includes a sixth preview image captured by the camera of the mobile phone 100 when the zoom ratio is n.
  • the sixth preview image includes an image of the target object.
  • the mobile phone 100 may receive the user's selection operation on the "50x" option.
  • the mobile phone 100 may display a sixth interface 1704 shown in (c) in FIG. 17A.
  • the sixth interface 1704 includes a sixth preview image 1705 captured by the camera of the mobile phone 100 when the zoom ratio is 50x.
  • the sixth preview image 1705 includes an image of the target object "bird".
  • the mobile phone 100 responds to the user's first operation on the sixth interface, the mobile phone 100 displays the second interface, acquires and saves the initial location information of the mobile phone 100.
  • the second interface includes a second preview image captured by the camera of the mobile phone 100 when the zoom ratio is n, and the second preview image includes an image of a target object, where n>m.
  • the mobile phone 100 may receive the user's first operation on the sixth interface 1705 .
  • S1603 for a detailed description of S1603, reference may be made to the introduction of S402 in the foregoing embodiments, and details are not described here in this embodiment of the present application.
  • the mobile phone 100 can lock the area to be photographed through two-stage zooming. Specifically, in response to the user's first long press operation on the first interface, the mobile phone 100 may prompt the user to select an appropriate zoom ratio. In response to the user's second long press operation, the mobile phone 100 can zoom in on the preview image at the zoom ratio selected by the user, and lock the area to be photographed including the image of the target object.
  • the mobile phone may receive the user's selection operation on the zoom ratio
  • the zoom ratio selected by the user may not be appropriate.
  • the mobile phone may display the sixth interface 1706 shown in FIG. 17B in response to the user's selection operation on the zoom factor 60x shown in (b) in FIG. 17A.
  • the sixth interface 1706 includes a sixth preview image 1707 .
  • the sixth preview image 1707 shown in FIG. 17B does not include a complete image of the target object. In view of this situation, the mobile phone also needs to adjust the zoom ratio, so that the camera can collect a complete image of the target object.
  • the above-mentioned sixth interface may also include a preset adjustment control, such as the preset adjustment control 1708 shown in FIG. 17B .
  • the preset adjustment control 1708 is used to adjust the zoom ratio of the camera.
  • the preset adjustment control 1708 is also used to indicate that the current zoom ratio of the camera is 60x.
  • the mobile phone in response to the user's upward sliding operation on the preset adjustment control 1708, after adjusting the zoom ratio from 60x to 50x, the mobile phone can display the sixth interface 1709 shown in Figure 17C.
  • the sixth interface 1709 includes a preset adjustment control 1710, and the preset adjustment control 1710 is used to adjust the zoom ratio of the camera.
  • the preset adjustment control 1708 is also used to indicate that the current zoom ratio of the camera is 50x.
  • the mobile phone 100 may receive the user's first operation on the sixth interface 1709 .
  • the camera can rotate within a preset angle range.
  • the mobile phone 100 may include an angle adjustment device for the camera, and the angle adjustment device is connected to a processor of the mobile phone 100 .
  • the angle adjusting device may include a linkage device (such as a motor) for driving the camera to rotate within a preset angle range.
  • the angle adjustment device can receive an angle adjustment instruction from the processor, and drive the camera to rotate within a preset angle range according to the angle adjustment instruction.
  • the aforementioned preset angle range may be a range of 0°-180° adjustment in at least two directions perpendicular to each other.
  • the above S401′′ can be replaced by S401 * . That is to say, the method in the embodiment of the present application may include S401', S401 * , and S401-S406.
  • the mobile phone 100 adjusts the shooting angle of the camera in response to the user's second operation on the sixth interface, so that the image of the target object is at the center of the viewfinder interface of the mobile phone 100 .
  • the mobile phone 100 can also focus on the target object in the focus mode based on object (ie target object) tracking, and adjust the shooting angle of the camera so that the target object is in the center of the camera's field of view. In this way, a preview image in which the image of the target object is at the center can be collected.
  • object ie target object
  • the mobile phone 100 can not only automatically adjust the shooting angle of the camera, so that the image of the target object is in the center of the viewfinder interface of the mobile phone 100; the mobile phone 100 can also automatically zoom, and adjust the zoom ratio of the camera to n.
  • S401′′ can be replaced by S401 #
  • S401-S402 can be replaced by S402′. That is to say, the method in the embodiment of the present application may include S401', S401 # , S402', and S403-S406.
  • the mobile phone 100 responds to the user's second operation on the sixth interface, adjusts the shooting angle of the camera so that the image of the target object is at the center of the viewfinder interface of the mobile phone 100, and performs automatic zooming to adjust the zoom ratio of the camera to n.
  • the method for determining the zoom factor n by the mobile phone 100 can refer to the detailed introduction in the above-mentioned embodiments, and details are not repeated here.
  • the mobile phone 100 adjusts the shooting angle of the camera so that the image of the target object is in the center of the viewfinder interface of the mobile phone 100, and performs automatic zooming to adjust the zoom ratio of the camera to n.
  • the specific method refer to the detailed introduction in the conventional technology, which will not be described here. repeat.
  • the mobile phone 100 displays the second interface, acquires and saves the initial pose information of the mobile phone 100.
  • the second interface includes a second preview image collected by the camera of the mobile phone 100 when the zoom ratio is n, and the second preview image includes an image of the target object.
  • the user does not need to manually input the first operation.
  • the mobile phone 100 After the mobile phone 100 receives the user's second operation (such as a click operation) on the image of the target object, it can automatically adjust the shooting angle of the camera to make the image of the target object It is in the center of the viewfinder interface, and it performs automatic zooming to adjust the zoom ratio of the camera to n.
  • the mobile phone 100 can display the second interface described in S402'. In this way, shaking caused by user operations can be reduced, thereby reducing the impact of user operations on the image quality of photos taken by the mobile phone 100 .
  • Another embodiment of the present application provides a high-magnification shooting method, which can be applied to the above-mentioned electronic device 300 .
  • the electronic device 300 is used to introduce the method in the embodiment of the present application.
  • the high-magnification shooting method may include S1801-S1807.
  • the mobile phone 100 displays a first interface.
  • the first interface is a viewfinder interface for the mobile phone 100 to take pictures, and the first interface includes a first preview image collected by the camera of the mobile phone 100 when the zoom ratio is m, and the first preview image includes an image of a target object.
  • the first interface mentioned in S1801 is equivalent to the fourth interface mentioned in S401, and the detailed description of S1801 can refer to the related introduction of S401′′ in the above-mentioned embodiment, and the embodiment of the present application will not repeat it here.
  • the mobile phone 100 displays the second interface in response to the user's zoom operation on the first interface.
  • the second interface includes a second preview image captured by the camera of the mobile phone 100 when the zoom ratio is n, where n>m.
  • the above zooming operation is used to trigger the mobile phone 100 to adjust the zoom ratio of the camera, such as adjusting the zoom ratio from m to n.
  • the mobile phone in response to the zoom operation, can activate a telephoto camera, and the telephoto camera can capture images.
  • the lens of the camera in the mobile phone 100 is generally a fixed-focus lens, and the adjustable range of the focal length is very small.
  • zooming can be achieved by switching cameras with different focal lengths.
  • zooming can be achieved by adjusting the focal length of the camera.
  • the above-mentioned zooming operation can be used to trigger a high-power camera (such as a telephoto camera) of the mobile phone 100 to capture an image. That is to say, in response to the zoom operation, the preview camera of the mobile phone can be switched from a low-magnification camera (ie, a camera with a smaller focal length, such as a main camera) to a high-magnification camera (ie, a camera with a larger focal length, such as a telephoto camera).
  • a low-magnification camera ie, a camera with a smaller focal length, such as a main camera
  • a high-magnification camera ie, a camera with a larger focal length, such as a telephoto camera.
  • the above zoom operation can be used to trigger the mobile phone 100 to start the telephoto camera, and change the focal length of the camera (such as the telephoto camera) from 1x of the default camera (such as the main camera) to 1x of the default camera (such as the primary camera). Any optical magnification of 2x, 3x, 5x, 10x, 15x or 20x.
  • the method in the embodiment of the present application is introduced by taking the zoom magnification triggered by the foregoing zooming operation as 50 times (that is, 50x) as an example.
  • the zoom ratio triggered by the above zoom operation may also be 10 times or other data, and the embodiment of the present application does not limit the specific numerical value of the zoom ratio.
  • the above-mentioned zooming operation may be an operation input on the preview interface of taking pictures when the mobile phone displays the preview interface of taking pictures, and is used to control the zooming of the camera of the mobile phone.
  • the above-mentioned image of the target object is at the center of the first interface.
  • the above-mentioned zooming operation may be a pinch-out operation input by the user on the first interface centering on the image of the target object.
  • the mobile phone 100 may display the first interface 1901 shown in (a) in FIG. 19A .
  • the first interface 1901 includes a first preview image 1902 .
  • the first preview image 1902 includes an image of the target object “bird” 200 , and the image of the target object “bird” 200 is at the center of the first preview image 1902 .
  • the mobile phone 100 may receive the user's zoom operation (such as a two-finger expansion operation) centered on the image of the target object "bird" 200 shown in (a) in FIG. 19A .
  • the mobile phone 100 may display a second interface 1903 shown in (b) of FIG. 19A .
  • the image of the upper target object may not be at the center of the first interface.
  • the mobile phone 100 may display the first interface 1905 shown in (a) of FIG. 19B .
  • the first interface 1905 includes a first preview image 1906 including an image of the target object “bird” 200 .
  • the image of the target object “bird” 200 is not at the center of the first interface 1905 .
  • the mobile phone 100 can receive the user's zoom operation (such as a two-finger expansion operation); in response to the zoom operation, the mobile phone 100 can display the second zoom operation shown in (b) in FIG. Interface 1903.
  • the second interface 1907 includes a second preview image 1908 captured by the camera of the mobile phone 100 when the zoom ratio is 50x.
  • the target object "bird” 200 in (a) in FIG. 19B is not at the center of the first interface 1905; therefore, the target object " Complete image of the Birdie 200.
  • the user may move the mobile phone 100 to adjust the viewing range of the camera, so that the camera can capture a complete image of the target object.
  • the mobile phone 100 periodically caches the second preview image in real time; if there are K consecutive second preset images cached in cycles including the same shooting area, and the integrity of the image of the target object in the same shooting area is greater than the preset integrity degree threshold, the mobile phone 100 displays a third interface to obtain and save the initial pose information of the mobile phone 100.
  • the third interface includes the image of the target object captured by the camera of the mobile phone 100 when the zoom ratio is n.
  • the preset integrity threshold may be any integrity threshold such as 60%, 75%, 70%, 75%, 80%, or 85%.
  • the above initial position information is used to indicate the motion state and position of the mobile phone 100 when the second preset images buffered for K consecutive periods include the same shooting area.
  • the second interface shown in (a) in Figure 19C, (b) in Figure 19C, (c) in Figure 19C and (d) in Figure 19C the second preview in these second interfaces
  • the image will change as the viewing range of the camera of the mobile phone 100 changes.
  • the second preview images 1912 shown in (d) are all different.
  • the user in order to ensure that the mobile phone 100 can capture the image of the target object that the user wants to capture, the user will try to ensure that most of the images of the target object are within the viewfinder frame of the mobile phone 100 when moving the mobile phone 100 .
  • the second preview images 1912 shown in (d) of FIG. 19C each include most of the captured area of the image of the target object "bird".
  • the mobile phone 100 may cache the second preview image every preset period (such as the second preset period), and combine the second preview image cached for the first time with the second preview image cached for the second time.
  • the preview images are compared to determine whether the second preview image 1 in the first cache and the second preview image 2 in the second cache have the same shooting area (namely, the common frame 1 described in the following embodiments). If the second preview image in the first cache and the second preview image in the second cache have the same shooting area 1, then judge whether the second preview image 2 in the third cache and the common frame 1 have the same shooting area (i.e. the common cell 2 described in the following embodiments).
  • the second preset images cached in K cycles include the same shooting area.
  • the time length of the second preset period may be any time length such as 0.4s, 0.5s, 0.6s or 1s.
  • the method for the mobile phone 100 to determine whether there are K consecutive second preset images buffered for periods including the same shooting area may include S1803a-S1803e:
  • the mobile phone 100 compares the second preview image j cached for the jth time with the second preview image j-1 cached for the j-1th time, and determines whether the second preview image j and the second preview image j-1 include the same shot area (called common lattice j-1).
  • S1803a may include S1-S3.
  • the mobile phone 100 divides the second preview image j-1 cached for the j-1th time into Q grid images, and divides the second preview image j cached at the jth time into Q grid images, Q ⁇ 1, and Q is an integer .
  • the mobile phone 100 divides the jth cached second preview image j into Q grid images as an example.
  • the mobile phone 100 may divide the second preview image j buffered for the jth time into Q grid images according to a preset matrix.
  • the preset matrix is a 3*2 matrix
  • the mobile phone 100 may evenly divide the second preview image j into 6 grid images in a manner of 3 rows and 2 columns.
  • the preset matrix is a 1*2 matrix
  • the mobile phone 100 may evenly divide the second preview image j into 2 grid images in a manner of 1 row and 2 columns.
  • the preset matrix is a 2*1 matrix
  • the mobile phone 100 may evenly divide the second preview image j into 2 grid images in a manner of 2 rows and 1 column.
  • the mobile phone 100 acquires an image correlation coefficient between each grid image in the Q grid image of the second preview image j-1 and each grid image in the Q grid image of the second preview image j.
  • the image correlation coefficient is used to characterize the similarity between two images.
  • the value range of the image correlation coefficient of the two grid images is [0, 1]. The closer the image correlation coefficient of the two images is to 1, the higher the similarity between the two images is, and the higher the possibility that the two images include the same shooting area. The closer the image correlation coefficient of the two grid images is to 0, the lower the similarity between the two grid images is, and the lower the possibility that the two grid images include the same shooting area.
  • the mobile phone 100 executes S2 to obtain four image correlation coefficients shown in Table 2, such as image correlation coefficient 1, image correlation coefficient 2, image correlation coefficient 3, and image correlation coefficient 4.
  • the mobile phone 100 can compare the first grid image of the second preview image j-1 with the first grid image of the second preview image j, and obtain the first grid image and the first grid image of the second preview image j-1 shown in Table 2.
  • the image correlation coefficient of the first grid image of the second preview image j is 1.
  • the mobile phone 100 can compare the first frame image of the second preview image j-1 with the second frame image of the second preview image j, and obtain the first frame image and the second preview image of the second preview image j-1 shown in Table 2
  • the image correlation coefficient of the 2nd grid image of image j is 2.
  • the mobile phone 100 can compare the second frame image of the second preview image j-1 with the first frame image of the second preview image j, and obtain the second frame image and the second preview image of the second preview image j-1 shown in Table 2.
  • the image correlation coefficient of the first grid image of image j is 3.
  • the mobile phone 100 can compare the second frame image of the second preview image j-1 with the second frame image of the second preview image j, and obtain the second frame image and the second preview image of the second preview image j-1 shown in Table 2.
  • the image correlation coefficient of the 2nd frame image of image j is 4.
  • Second preview image j-1 Second preview image j image correlation coefficient Whether common case j-1 Image 1 Image 1 Image correlation coefficient 1 (>R) Yes Image 1 2nd frame image Image correlation coefficient 2( ⁇ R) no 2nd frame image Image 1 Image correlation coefficient 3 (>R) Yes 2nd frame image 2nd frame image Image correlation coefficient 4 (>R) Yes
  • the mobile phone 100 compares the first frame image and the second frame image to obtain the image correlation coefficient between the first frame image and the second frame image as an example, and introduces the method of obtaining the image correlation coefficient by the mobile phone 100 in S2. method.
  • the first grid image may be any grid image obtained by segmentation of the mobile phone 100
  • the second grid image may be any grid image obtained by the segmentation of the mobile phone 100
  • the first frame image is different from the second frame image.
  • the mobile phone 100 can calculate the histogram data of the first frame image and the histogram data of the second frame image respectively; then, the mobile phone 100 can calculate the histogram data of the first frame image and the histogram data of the second frame image, Calculate the image correlation coefficient between the first grid image and the second grid image.
  • the value range of the image correlation coefficient between the first grid image and the second grid image is [0, 1]. The closer the image correlation coefficient between the first frame image and the second frame image is to 1, the higher the similarity between the first frame image and the second frame image is; the closer the image correlation coefficient between the first frame image and the second frame image is If it is greater than 0, it means that the similarity between the first grid image and the second grid image is lower.
  • the mobile phone 100 calculates the histogram data of the first frame image and the method for the histogram data of the second frame image, and calculates the first frame image and the second frame image according to the histogram data of the first frame image and the histogram data of the second frame image
  • the method of the image correlation coefficient of the two-grid image reference may be made to relevant descriptions in conventional technologies, and details are not described here in this embodiment of the present application.
  • the mobile phone 100 judges whether at least one of the Q*Q image correlation coefficients between the Q frame image of the second preview image j-1 and the Q frame image of the second preview image j is greater than a preset similarity threshold.
  • the preset similarity threshold may take a value in (0.5,1).
  • the preset similarity threshold may be any numerical value such as 0.7, 0.6, 0.8, 0.75 and the like.
  • the second The preview image j and the second preview image j-1 include the same shooting area (called common frame j-1).
  • the same shooting area in the second preview image 1 and the second preview image 2 may be called a common frame 1, such as the first common frame.
  • the same shooting area in the second preview image 2 and the second preview image 3 may be called a common frame 2, such as the second common frame.
  • the Q*Q image correlation coefficients of the Q grid image of the second preview image j-1 and the Q grid image of the second preview image j are all less than or equal to the preset similarity threshold, it means that the second preview image j and the second preview image j
  • the preview image j-1 does not include the same shooting area.
  • the image correlation coefficient 1, the image correlation coefficient 2, and the image correlation coefficient 4 shown in Table 2 are all greater than the preset similarity threshold R.
  • the image correlation coefficient 3 shown in Table 2 is less than or equal to the preset similarity threshold R. It can be seen from Table 2 that the second preview image j-1 and the second preview image j include the same shooting area (ie, the same frame j-1). Specifically, the second preview image j-1 and the second preview image j include three common cells j-1.
  • the mobile phone 100 can compare the second preview image j+1 cached.
  • the preview image j+1 and the second preview image j cached for the jth time are judged whether the second preview image j+1 and the second preview image j include the same shooting area. That is to say, the mobile phone 100 may start from the second preview image j cached for the jth time, and perform a next round of judgment "whether there are K consecutive second preset images cached for K cycles including the same shooting area".
  • the method of "the mobile phone 100 compares the second preview image j+1 with the second preview image j, and judges whether the second preview image j+1 and the second preview image j include the same shooting area" can refer to the above-mentioned embodiment.
  • the introduction of S1803a will not be repeated in this embodiment of the present application.
  • the mobile phone 100 may execute S1803b .
  • the mobile phone 100 compares the second preview image j+1 cached at the j+1th time with the common grid j-1, and judges whether the second preview image j+1 and the common grid j-1 cached at the j+1th time include the same The shooting area (called the common grid j).
  • S1803b may include Si-Siii.
  • the mobile phone 100 divides the second preview image j+1 cached for the j+1th time into Q grid images, where Q ⁇ 1, and Q is an integer.
  • the method for the mobile phone 100 to divide the second preview image j+1 cached in the j+1th time into Q-frame images can refer to the detailed introduction of S1 in the above-mentioned embodiment, and the embodiment of the present application will not go into details here.
  • the mobile phone 100 obtains the image correlation coefficient between each grid image and each common grid j ⁇ 1 in the Q grid images of the second preview image j+1.
  • the image correlation coefficient is used to characterize the similarity between two images.
  • the second preview image j-1 and the second preview image j include three common cells j-1. in this way.
  • the mobile phone 100 executes Sii to obtain six image correlation coefficients, such as image correlation coefficient A, image correlation coefficient B, image correlation coefficient C, image correlation coefficient D, image correlation coefficient E, and image correlation coefficient F.
  • the mobile phone 100 can compare the first grid image of the second preview image j+1 with the first common grid j-1, and obtain the first grid image and the first grid image of the second preview image j+1 shown in Table 3.
  • the image correlation coefficient A of the common lattice j-1 The mobile phone 100 can compare the first grid image of the second preview image j+1 with the second common grid j-1, and obtain the first grid image and the second common grid of the second preview image j+1 shown in Table 3
  • the image correlation coefficient B of j-1 The mobile phone 100 can compare the first grid image of the second preview image j+1 with the third common grid j-1, and obtain the first grid image and the third common grid of the second preview image j+1 shown in Table 3.
  • the image correlation coefficient C of j-1 The image correlation coefficient A of the common lattice j-1.
  • the mobile phone 100 can compare the second frame image of the second preview image j+1 with the first common frame j-1, and obtain the second frame image of the second preview image j+1 and the first common frame j-1 shown in Table 3.
  • the image correlation coefficient D of j-1 The mobile phone 100 can compare the second frame image of the second preview image j+1 with the second common frame j-1, and obtain the second frame image of the second preview image j+1 and the second common frame j-1 shown in Table 3.
  • the image correlation coefficient E of j-1 The mobile phone 100 can compare the second frame image of the second preview image j+1 with the third common frame j-1, and obtain the second frame image and the third common frame image of the second preview image j+1 shown in Table 3.
  • the image correlation coefficient F of j-1 The image correlation coefficient D of j-1.
  • Second preview image j+1 common case j-1 image correlation coefficient whether common case j Image 1 The first common case j-1 Image correlation coefficient A (>R) Yes Image 1
  • the mobile phone 100 judges whether at least one image correlation coefficient among the image correlation coefficients of the Q grid image of the second preview image j+1 and the common grid j ⁇ 1 is greater than a preset similarity threshold.
  • the second preview image j+1 and the common grid Grid j-1 includes the same shooting area (referred to as common grid j).
  • the same shooting area in the second preview image 3 and the common frame 1 may be called the common frame 2, such as the second common frame.
  • the common frame 2 such as the second common frame.
  • the correlation coefficients of the two images are greater than the preset similarity threshold R, and there are two second common lattices.
  • the Q*Q image correlation coefficients of the Q grid image of the second preview image j-1 and the Q grid image of the second preview image j are all less than or equal to the preset similarity threshold, it means that the second preview image j and the second preview image j
  • the preview image j-1 does not include the same shooting area.
  • the mobile phone 100 can compare the j+2th The second preview image in the second cache and the second preview image j+1 in the j+1th cache, and determine the second preview image j+2 in the j+2th cache and the second preview image in the j+1th cache Whether j+1 includes the same shooting area. That is to say, the mobile phone 100 can start from the second preview image j+1 cached for the j+1th time, and perform the next round of "whether there are K consecutive second preset images cached in cycles including the same shooting area" judge.
  • the mobile phone 100 compares the second preview image j+1 cached in the j+2th time with the second preview image j+1 cached in the j+1th time, and judges that the second preview image j+2 cached in the j+2th time is different from the second preview image j+2 cached in the j+2th time
  • the method of whether the second preview image j+1 cached for j+1 times includes the same shooting area you can refer to the introduction of S1803a in the above embodiment, and the embodiment of the present application will not repeat it here.
  • the mobile phone 100 may execute S1803c.
  • the mobile phone 100 compares the second preview image j and the common frame j in the j+2th cache, and judges whether the j+2th cached second preview image and the common frame j include the same shooting area (called the common frame j) +1).
  • the mobile phone 100 can compare the j+3 The second preview image j+3 of the second cache and the second preview image j+2 of the j+2th cache, determine the second preview image j+3 of the j+3rd cache and the second preview image j+3 of the j+2th cache Whether the two preview images j+2 include the same shooting area. That is to say, the mobile phone 100 can start from the second preview image j+2 cached for the j+2th time, and conduct the next round of "whether there are consecutive second preset images cached in K cycles including the same shooting area" judge.
  • the mobile phone 100 compares the second preview image j+3 cached at the j+3 time with the second preview image j+2 cached at the j+2 time, and judges that the second preview image j+3 cached at the j+3 time
  • the mobile phone 100 compares the second preview image j+3 cached at the j+3 time with the second preview image j+2 cached at the j+2 time, and judges that the second preview image j+3 cached at the j+3 time
  • the mobile phone 100 can compare the second preview image j+2 cached in the j+3th time. For the second preview image j+3 and the common frame j+1, it is judged whether the second preview image j+3 and the common frame j+1 in the j+3th cache include the same shooting area (called the common frame j+2). This cycle repeats, assuming that the second preview images cached in K-1 consecutive second preset periods all include the same shooting area. That is to say, if the second preview image K-1 cached for the K-1th time and the common frame K-3 include the same shooting area (namely, the common frame K-2), the mobile phone 100 may execute S1803d.
  • the mobile phone 100 compares the second preview image K cached for the Kth time with the common frame K-2, and judges whether the second preview image K-2 cached for the Kth time and the common frame K-2 include the same shooting area (called the common frame K -1).
  • the mobile phone 100 can compare the K+1-th cache The second preview image K+1 of the second preview image K+1 and the second preview image K of the K-th cache, judge whether the second preview image K+1 of the K+1 cache and the second preview image K of the K-th cache include the same shooting area. That is to say, the mobile phone 100 may start from the second preview image K cached for the Kth time, and perform a next round of judgment of "whether there are K consecutive second preset images cached for K cycles including the same shooting area".
  • the mobile phone 100 compares the second preview image K+1 cached for the K+1th time with the second preview image K cached for the Kth time, and judges that the second preview image K+1 cached for the K+1th time
  • the mobile phone 100 may execute S1803e.
  • the mobile phone 100 determines that the shooting area corresponding to the common grid K-1 is the area to be shot including the image of the target object, that is, locks the target object from the second preview image.
  • the third interface shown in S1803 includes an enlarged area to be photographed, and the preview image described in S1803 is a preview image corresponding to the area to be photographed.
  • the initial pose information of the mobile phone 100 in S1803 may be used to indicate that the second preset images cached in consecutive K cycles include the same shooting area, and the completeness of the image of the target object is greater than the preset completeness threshold. Movement state and position. It should be understood that when the second preset images cached in consecutive K cycles include the same shooting area, and the integrity of the image of the target object is greater than the preset integrity threshold, the relatively complete image of the target area that can be collected by the mobile phone 100 more likely. Therefore, the pose information of the mobile phone 100 at this time is used as the initial pose information.
  • the method for the mobile phone 100 to obtain the initial pose information reference may be made to the detailed description in the foregoing embodiments, and details are not described here in the embodiments of the present application.
  • the mobile phone 100 when the mobile phone 100 determines the area to be captured including the image of the target object from the second preview image, it also needs to consider the integrity of the image of the target object.
  • the mobile phone 100 acquires real-time pose information of the mobile phone 100, and the real-time pose information is used to indicate the real-time motion state and position of the mobile phone 100.
  • the mobile phone 100 sends out a first prompt message according to the real-time pose information and the initial pose information.
  • the first prompt information is used to prompt the user to move the mobile phone 100 so that the mobile phone 100 is in the motion state and position indicated by the initial pose information.
  • the mobile phone 100 may display a third interface 2001 shown in (a) in FIG. 20 , and the third interface 2001 includes first prompt information 2002, such as "Please move the mobile phone to the left!".
  • first prompt information 2002 such as "Please move the mobile phone to the left!”.
  • the mobile phone 100 displays a fourth interface including the third preview image and the fourth preview image in response to the user's photographing operation.
  • the fourth preview image is an image captured in response to the photographing operation
  • the third preview image is an image with the highest image parameter among multiple frames of second preview images collected by the camera.
  • the mobile phone 100 may receive the camera operation shown in (b) of FIG. 20 by the user.
  • the mobile phone 100 may display a fourth interface 2003 shown in (c) in FIG. 20 .
  • the fourth interface 2003 includes a fourth preview image 2004 and a third preview image 2005 .
  • the mobile phone 100 saves the preview image selected by the user.
  • the mobile phone 100 may receive a user's selection operation on at least one of the fourth preview image 2004 and the third preview image 2005 shown in (c) of FIG. 20 .
  • the fourth preview image described in S1806 and S1807 is equivalent to the fourth preview image shown in S405 and S406.
  • the method for the mobile phone 100 to obtain the fourth preview image in S1806 may refer to the method for the mobile phone 100 to obtain the fourth preview image shown in S405 , which will not be described in detail here in the embodiment of the present application.
  • the third preview image described in S1806 and S1807 is equivalent to the third preview image shown in S405 and S406, and the fourth interface described in S1806 and S1807 is equivalent to the third interface shown in S405 and S406.
  • the embodiment of the present application provides a high-magnification shooting method.
  • the mobile phone 100 can respond to the user's zoom operation to enter a high-zoom-magnification shooting scene, and automatically lock the object that needs to be shot at a high magnification, and zoom in and display the preview image of the object (called is the initial preview image), and obtain the initial state and initial position of the mobile phone 100.
  • the user does not need to manually adjust the magnification and zoom ratio, and the shaking caused by the user's manual operation can be reduced.
  • the mobile phone 100 can obtain the real-time state and real-time position of the mobile phone 100, and according to the real-time state and real-time position, remind the user to correct the position and posture of the mobile phone 100, so that the mobile phone 100 can remain in the above-mentioned initial state and initial position or close to the initial state and the state of the initial position.
  • the subject locked by the mobile phone 100 is the subject that the user wants to photograph.
  • the mobile phone 100 can remind the user to correct the position and posture of the mobile phone 100 when the shooting area of the camera deviates from the corresponding shooting area of the initial preview image, so that the mobile phone 100 can remain in the initial state and the position and posture indicated by the initial position, It can be ensured that the mobile phone 100 can capture the subject desired by the user.
  • the mobile phone 100 may display the initial preview image and the preview image manually taken by the user in response to the user's photographing operation, and the user selects a desired photo to save. In this way, the mobile phone 100 can take photos satisfactory to the user according to the user's requirements.
  • Some other embodiments of the present application provide an electronic device, and the electronic device may include: a memory, one or more cameras, and one or more processors.
  • the memory, the camera and the processor are coupled.
  • Computer program codes are stored in the memory, and the computer program codes include computer instructions.
  • the electronic device is made to execute various functions or steps as executed by the mobile phone in the above method embodiments.
  • the embodiment of the present application also provides a chip system, as shown in FIG. 21 , the chip system 2100 includes at least one processor 2101 and at least one interface circuit 2102 .
  • the above-mentioned processor 2101 and the interface circuit 2102 may be interconnected through lines.
  • interface circuit 2102 may be used to receive signals from other devices, such as memory of an electronic device.
  • the interface circuit 2102 may be used to send signals to other devices (such as the processor 2101).
  • the interface circuit 2102 can read instructions stored in the memory, and send the instructions to the processor 2101 .
  • the electronic device may be made to perform various steps performed by the mobile phone 210 in the foregoing embodiments.
  • the chip system may also include other discrete devices, which is not specifically limited in this embodiment of the present application.
  • the embodiment of the present application also provides a computer storage medium, the computer storage medium includes computer instructions, and when the computer instructions are run on the above-mentioned electronic device, the electronic device is made to perform the various functions performed by the mobile phone 100 in the above-mentioned method embodiment or step.
  • the embodiment of the present application also provides a computer program product, which, when running on a computer, causes the computer to execute the various functions or steps performed by the mobile phone 100 in the above method embodiments.
  • the computer may be the mobile phone 100 described above.
  • Each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage
  • the medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other various media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Studio Devices (AREA)

Abstract

一种高倍率拍摄方法及电子设备,涉及拍照领域,可自动调节变焦倍率提升图像质量。电子设备显示第一界面(包括变焦倍率为m的第一预览图像),目标对象的图像处于第一预览图像的中心位置;响应于对目标对象的图像的第一操作显示第二界面,获取并保存电子设备的初始位姿信息,第二界面包括变焦倍率为n的第二预览图像(包括目标对象的图像);获取实时位姿信息,n>m;根据实时位姿信息与初始位姿信息发出第一提示信息,第一提示信息用于提示用户移动电子设备使其处于初始位姿信息指示的运动状态和位置;响应于拍照操作显示包括第三预览图像和第四预览图像的第三界面;响应于对第三预览图像和/或第四预览图像的选择操作,保存选择的预览图像。

Description

一种高倍率拍摄方法及电子设备
本申请要求于2021年05月19日提交国家知识产权局、申请号为202110548528.2、发明名称为“一种高倍率拍摄方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及拍照技术领域,尤其涉及一种高倍率拍摄方法及电子设备。
背景技术
随着电子技术的发展,电子设备(如手机、平板电脑或智能手表等)的功能越来越多。例如,大多数电子设备中均安装有摄像头,具有拍摄图像的功能。以手机为例,手机中包括一个或多个摄像头,用于采集图像。
其中,用户使用手机拍摄远处的景物时,往往为了将景物拍摄清楚,需要放大手机中摄像头的变焦倍率。例如,手机可以响应于用户在拍摄界面上的调焦操作,调整手机的摄像头的变焦倍率。调大变焦倍率可以使手机清楚的拍摄到远处的景物。例如,如图1所示,手机100中摄像头的变焦倍率放大至50倍时,手机100可以清楚的拍摄到远处树上的小鸟200。
但是,当摄像头的变焦倍率较大(如50倍)时,用户手部轻微的动作(如手抖)可能会严重影响摄像头的取景范围,使得手机100的摄像头无法对准需要拍摄的景物,增大了拍摄难度。例如,可能会因为用户手抖,使得手机100无法对准需要拍摄的小鸟200,从而无法拍摄到满意的照片。例如,如图2所示,手机100可显示图2所示的预览图像,图2所示的预览图像不包括小鸟200的完整图像。
发明内容
本申请提供一种高倍率拍摄方法及电子设备,可以自动调节变焦倍率,提升拍摄的图像质量。
第一方面,本申请提供一种高倍率拍摄方法,该方法可以应用于电子设备,该电子设备包括摄像头。其中,电子设备可显示第一界面。该第一界面是电子设备拍照的取景界面,该第一界面包括摄像头在变焦倍率为m时采集的第一预览图像。该第一预览图像包括目标对象的图像,且目标对象的图像处于第一预览图像的中心位置。电子设备响应于用户在第一界面的第一操作,可显示第二界面,获取并保存电子设备的初始位姿信息。该第二界面包括摄像头在变焦倍率为n时采集的第二预览图像,该第二预览图像包括目标对象的图像,n>m。上述初始位姿信息用于指示电子设备接收到上述第一操作时的运动状态和位置。
也就是说,电子设备可以在高变焦倍率拍摄场景下,响应于用户的操作可以自动锁定需要高倍率拍摄的拍摄对象。然后,电子设备可以采用合适的变焦倍率采集并显示该拍摄对象的预览图像,并获取电子设备的初始状态和初始位置。如此,则无需用户手动调整放大变焦倍率,可以减少用户手动操作引起的抖动。
其中,该初始状态为电子设备采集上述初始预览图像时,该电子设备的运动状态 (如电子设备的姿态)。该初始位置为电子设备采集上述初始预览图像时,该电子设备所处的位置。该初始状态和初始位置可以反映出电子设备采集上述初始预览图像时,电子设备的空间位置和姿态。
之后,电子设备可获取电子设备的实时位姿信息,该实时位姿信息用于指示电子设备实时的运动状态和位置。然后,电子设备可以根据实时位姿信息与初始位姿信息,发出第一提示信息。该第一提示信息用于提示用户移动电子设备,使电子设备处于初始位姿信息所指示的运动状态和位置。
也就是说,电子设备可以获取该电子设备的实时状态和实时位置,根据该实时状态和实时位置,提醒用户纠正电子设备的位置和姿态,以便电子设备可以保持在上述初始状态和初始位置或者临近初始状态和初始位置的状态。其中,电子设备处于不同位置不同状态时,该电子设备的摄像头的拍摄区域(即取景范围)则不同。上述初始状态和初始位置是响应于用户的操作,电子设备采集锁定的拍摄对象的初始预览图像时,电子设备的状态和位置。此时,电子设备锁定的拍摄对象是用户想要拍摄的对象。
电子设备可以在摄像头的拍摄区域偏离初始预览图像对应的拍摄区域时,提醒用户纠正电子设备的位置和姿态,以便电子设备可以保持在初始状态和初始位置所指示的位置和姿态,可以保证电子设备能够拍摄到用户想要的拍摄对象。
最后,电子设备可能会接收到用户的拍照操作。响应于用户的拍照操作,电子设备可显示第三界面。该第三界面包括第三预览图像和第四预览图像。该第三预览图像是摄像头采集的多帧第二预览图像中图像参数最高的图像,该图像参数包括清晰度和/或完整度。该第四预览图像是响应于拍照操作而拍摄的图像。电子设备可以响应于用户对第三预览图像和/或第四预览图像的选择操作,可保存用户选择的预览图像。
也就是说,电子设备可以可以响应于用户的拍照操作,将上述图像参数最高的预览图像和用户手动拍摄的预览图像同时显示出来,由用户选择需要的照片来保存。如此,电子设备可以按照用户的需求,拍摄到用户满意的照片。
在第一方面的一种可能的设计方式中,在电子设备显示第一界面之前,电子设备可以显示第四界面。该第四界面是电子设备拍照的取景界面,该第四界面包括摄像头在变焦倍率为m时采集的第五预览图像,该第五预览图像包括目标对象的图像。之后,电子设备可以响应于用户在第四界面的第二操作,在第四界面发出第二提示信息,该第二操作是用户对目标对象的图像的选择操作,第二提示信息用于指示用户移动电子设备使目标对象的图像处于第五预览图像的中心位置。
采用该设计方式的方法,电子设备可以提醒用户移动电子设备,以调整摄像头的取景范围,使得目标对象的图像处于取景框的中心位置(即第五预览图像的中心位置)。
在第一方面的另一种可能的设计方式中,电子设备还包括摄像头的角度调节装置,角度调节装置用于调整摄像头的拍摄角度,使摄像头在预设角度范围内转动。
其中,在电子设备显示第一界面之前,电子设备可显示第四界面,该第四界面是电子设备拍照的取景界面,该第四界面包括摄像头在变焦倍率为1时采集的第五预览图像,该第五预览图像包括目标对象的图像。之后,电子设备响应于用户在第四界面的第二操作,可以调整摄像头的拍摄角度,使目标对象的图像处于第五预览图像的中心位置。
在该设计方式中,不需要用户手动操作,电子设备接收到用户对目标对象的图像的第二操作(如单击操作)后,便可以自动调整摄像头的拍摄角度使目标对象的图像处于取景界面的中心位置,并进行自动变焦将摄像头的变焦倍率调整为n。如此,可以减少用户操作引起的抖动,进而减少用户操作对电子设备拍摄的照片的图像质量的影响。
在第一方面的另一种可能的设计方式中,在电子设备显示第一界面之前,电子设备显示第四界面之后,该电子设备还可以发出第三提示信息。该第三提示信息用于提示用户目标对象的图像已处于第五预览图像的中心位置。也就是说,电子设备可以在目标对象的图像已处于第五预览图像的中心位置时,及时提醒用户。
在第一方面的另一种可能的设计方式中,上述电子设备响应于用户在第一界面的第一操作,显示第二界面,获取并保存电子设备的初始位姿信息,可以包括:电子设备响应于第一操作,从第一预览图像中确定包括目标对象的图像的待拍摄区域,以从第一预览图像中锁定目标对象;电子设备自动将变焦倍率调整为n,显示包括放大的待拍摄区域的第二界面,获取并保存电子设备的初始位姿信息。
在第一方面的另一种可能的设计方式中,上述待拍摄区域为以第一操作与电子设备的触摸屏的接触区域为矩形的中心,以预设的长和宽形成的矩形区域。或者,上述待拍摄区域为采集图像识别技术识别出的包括目标对象的矩形区域。
其中,上述电子设备自动将变焦倍率调整为n,显示包括放大的待拍摄区域的第二界面,获取并保存电子设备的初始位姿信息,可以包括:电子设备适配电子设备的触摸屏的尺寸或者触摸屏的取景框的尺寸,自动将变焦倍率调整为n,将待拍摄区域中目标对象的图像放大,使目标对象的图像占满电子设备的触摸屏的取景框。
在第一方面的另一种可能的设计方式中,上述电子设备包括陀螺仪传感器和加速度传感器,陀螺仪传感器和加速度传感器用于采集电子设备的初始位姿信息和实时位姿信息。
在第一方面的另一种可能的设计方式中,在电子设备发出第一提示信息之后,电子设备响应于用户的拍照操作显示第三界面之前,该电子设备还可以发出第四提示信息,第四提示信息用于指示电子设备已回到初始位姿信息所指示的运动状态和位置。也就是说,电子设备可以在电子设备回到初始位姿信息所指示的运动状态和位置时,及时提醒用户。
在第一方面的另一种可能的设计方式中,上述变焦倍率n可以是由用户需选择的变焦倍率。具体的,上述电子设备响应于用户在第一界面的第一操作,显示第二界面,可以包括:电子设备响应于用户在第一界面的第三操作,发出第五提示信息,第五提示信息用于指示用户选择摄像头的变焦倍率;电子设备响应于用户对变焦倍率n的选择操作,显示第六界面,第六界面包括电子设备的摄像头在变焦倍率为n时采集的第六预览图像,第六预览图像包括目标对象的图像;电子设备响应于用户在第六界面的第一操作,显示第二界面。
在第一方面的另一种可能的设计方式中,上述第六界面还包括预设调整控件,该预设调整控件用于调整摄像头的变焦倍率,该预设调整控件还用于指示摄像头当前的变焦倍率。
在第一方面的另一种可能的设计方式中,上述发出第一提示信息,可以包括:电子设备在第二界面显示第一提示信息。当然,上述第一提示信息还可以是电子设备发出的语音提示信息,本申请实施例对此不作限制。
在第一方面的另一种可能的设计方式中,上述第三预览图像可以是从手机100显示第二界面到电子设备接收到拍照操作的过程中,电子设备的摄像头采集的清晰度最高、且完整度最高的第二预览图像。其中,第三预览图像的完整度可以为第三预览图像中包括的目标对象的图像在该目标对象的完整图像中的占比。
示例性的,在用户锁定待拍摄区域并进行放大后,可以将预览图像每隔第一预设周期进行缓存,将第一次缓存的预览图像与第二次缓存的预览图像进行比对,保留图像参数较高的预览图像;再将该清晰度高的预览图像与下一次缓存的预览图像进行比对,依然保留清晰度高的照片。以此类推,使得电子设备的缓存器中一直保存最高的预览图像。
具体的,在电子设备响应于用户的拍照操作,显示第三界面,第三界面包括第三预览图像和第五预览图像之前,本申请实施例的方法还可以包括:电子设备周期性缓存摄像头采集的第二预览图像,直至缓存到摄像头采集的第p个第二预览图像,第二预览图像是第二界面和第三界面显示的预览图像,p≥2,p为整数;电子设备对比第i次缓存的第二预览图像i与第i-1个第七预览图像,得到并缓存第i个第七预览图像;其中,i按照由小到大的顺序依次在{1,2,……,p}中取值,i为整数;第i个第七预览图像是第二预览图像i与第i-1个第七预览图像中图像参数最高的预览图像;图像参数包括清晰度和/或完整度,完整度为预览图像中包括的目标对象的图像在目标对象的完整图像中的占比;第1个第七预览图像为第1次缓存的第二预览图像1;电子设备将第p个第七预览图像作为第三预览图像。
第二方面,本申请提供一种高倍率拍摄方法,该方法可以应用于电子设备,该电子设备包括摄像头。其中,电子设备可显示第一界面,该第一界面是电子设备拍照的取景界面,该第一界面包括摄像头在变焦倍率为m时采集的第一预览图像,该第一预览图像包括目标对象的图像。
然后,电子设备可以响应于用户在第一界面的变焦操作,显示第二界面。该第二界面包括摄像头在变焦倍率为n时采集的第二预览图像n>m。上述变焦操作用于触发电子设备将摄像头的变焦倍率调整为n。电子设备还可以按照周期性缓存第二预览图像。
其中,电子设备接收到用户在第一界面的变焦操作,则表示电子设备将进入高倍率拍摄场景。在这种情况下,电子设备可以自动锁定需要高倍率拍摄的拍摄对象,放大显示该拍摄对象的预览图像(称为初始预览图像),并获取电子设备的初始状态和初始位置。如此,则无需用户手动调整放大变焦倍率,可以减少用户手动操作引起的抖动。
具体的,电子设备可以采用以下方式锁定目标对象:电子设备周期性实时缓存所述第二预览图像;若存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域,且相同的拍摄区域中目标对象的图像的完整度大于预设完整度阈值,则电子设备则显示第三界面,获取并保存电子设备的初始位姿信息。其中,第三界面包括摄像头在变 焦倍率为m时采集的目标对象的图像;初始位姿信息用于指示连续的K个周期缓存的第二预设图像包括相同的拍摄区域,且目标对象的图像的完整度大于预设完整度阈值时电子设备的运动状态和位置,K≥2,K为整数。
之后,电子设备还可以获取电子设备的的实时位姿信息,该实时位姿信息用于指示电子设备的实时的运动状态和位置。电子设备可以根据实时位姿信息与初始位姿信息,发出第一提示信息。该第一提示信息用于提示用户移动电子设备,使电子设备处于初始位姿信息所指示的运动状态和位置。此时,电子设备锁定的拍摄对象是用户想要拍摄的对象。也就是说,电子设备可以在摄像头的拍摄区域偏离初始预览图像对应的拍摄区域时,提醒用户纠正电子设备的位置和姿态,以便电子设备可以保持在初始状态和初始位置所指示的位置和姿态,可以保证电子设备能够拍摄到用户想要的拍摄对象。
最后,电子设备可以响应于用户的拍照操作,显示包括第三预览图像和第四预览图像的第四界面。该第四预览图像是响应于拍照操作而拍摄的图像。该第三预览图像是摄像头采集的多帧第二预览图像中图像参数最高的图像,图像参数包括清晰度和/或完整度。电子设备响应于用户对第四界面中的第三预览图像和/或第四预览图像的选择,保存用户选择的预览图像。也就是说,电子设备可以可以响应于用户的拍照操作,将上述图像参数最高的预览图像和用户手动拍摄的预览图像同时显示出来,由用户选择需要的照片来保存。如此,电子设备可以按照用户的需求,拍摄到用户满意的照片。
结合第二方面,在一种可能的设计方式中,上述发出第一提示信息,可以包括:在第三界面显示所述第一提示信息。当然,上述第一提示信息还可以是电子设备发出的语音提示信息,本申请实施例对此不作限制。
结合第二方面,在另一种可能的设计方式中,上述若存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域,电子设备则显示第三界面,包括以下步骤:
电子设备对比第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1,判断第二预览图像j与第二预览图像j-1是否存在共同格j-1。共同格j-1为第二预览图像j与第二预览图像j-1中相同的拍摄区域;其中,j为整数,j按照由小到大的顺序依次在{2,……,K}中取值。
若第二预览图像j与第二预览图像j-1存在共同格j-1,电子设备则对比上述第j+1次缓存的第二预览图像j+1与共同格j-1,判断第j+1次缓存的第二预览图像j+1与共同格j-1是否存在共同格j。共同格j是为第二预览图像j+1与共同格j-1中相同的拍摄区域。
若第j+1次缓存的第二预览图像j+1与共同格j-1存在共同格j,电子则对比第j+2次缓存的第二预览图像j+2与共同格j,判断第j+2次缓存的第二预览图像j+2与共同格j是否存在共同格j+1。共同格j+1为第二预览图像j+2与共同格j中相同的拍摄区域。
如此循环执行,如果第K-1次缓存的第二预览图像K-1与共同格K-3存在共同格K-2,电子设备则对比第K次缓存的第二预览图像K与共同格K-2,判断第二预览图像K与共同格K-2是否存在共同格K-1。其中,共同格K-1为第二预览图像K与共同格K-2中相同的拍摄区域。
如果第二预览图像K与共同格K-2存在共同格K-1,电子设备则将共同格K-1对应的拍摄区域确定为包括目标对象的图像的待拍摄区域,显示包括第三预览图像的第三界面。其中,第三预览图像为为待拍摄区域对应的预览图像。
结合第二方面,在另一种可能的设计方式中,上述电子设备对比第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1,判断第二预览图像j与第二预览图像j-1是否存在共同格j-1,可以包括以下步骤:
电子设备将第j-1次缓存的第二预览图像j-1划分为Q格图像,并将第j次缓存的第二预览图像j划分为Q格图像,Q≥1,Q为整数。
电子设备获取第二预览图像j-1的Q格图像中的每格图像与第二预览图像j的Q格图像中的每格图像的图像相关系数;其中,图像相关系数用于表征两格图像的相似度,图像相关系数的取值范围为[0,1],两格图像的图像相关系数越大,则两格图像的相似度越高;两格图像的图像相关系数越小,则两格图像的相似度越低。
电子设备判断第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的多个图像相关系数中是否有至少一个图像相关系数大于预设相似度阈值。
其中,如果第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的多个图像相关系数中至少一个图像相关系数大于预设相似度阈值,则表示第二预览图像j与第二预览图像j-1存在共同格j-1;如果第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的多个图像相关系数均小于或等于预设相似度阈值,则表示第二预览图像j与第二预览图像j-1不存在共同格j-1。
结合第二方面,在另一种可能的设计方式中,上述电子设备获取第二预览图像j-1的Q格图像中的每格图像与第二预览图像j的Q格图像中的每格图像的图像相关系数,包括:电子设备获取第一格图像的直方图数据和第二格图像的直方图数据;其中,第一格图像是第二预览图像j-1的Q格图像中的一格图像,第二格图像是第二预览图像j的Q格图像中的一格图像;电子设备根据第一格图像的直方图数据和第二格图像的直方图数据,计算第一格图像与第二格图像的图像相关系数。
第三方面,本申请提供一种电子设备,该电子设备包括存储器、一个或多个摄像头和一个或多个处理器。存储器、摄像头与处理器耦合。其中,存储器中存储有计算机程序代码,计算机程序代码包括计算机指令。当计算机指令被处理器执行时,使得电子设备执行如第一方面或第二方面及其任一种可能的设计方式所述的方法。
第四方面,本申请提供一种计算机可读存储介质,该计算机可读存储介质包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行如第一方面及其任一种可能的设计方式所述的方法。
第五方面,本申请提供一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得该计算机执行如第一方面及任一种可能的设计方式所述的方法。该计算机可以是上述电子设备。
可以理解地,上述提供的第三方面及其任一种可能的设计方式所述的电子设备,第四方面所述的计算机存储介质,第五方面所述的计算机程序产品所能达到的有益效果,可参考第一方面及其任一种可能的设计方式中的有益效果,此处不再赘述。
附图说明
图1为本申请实施例提供的一种高倍率拍摄方法的应用场景示意图;
图2为本申请实施例提供的一种电子设备的显示界面示意图;
图3为本申请实施例提供的一种电子设备的硬件结构示意图;
图4A为本申请实施例提供的一种高倍率拍摄方法流程图;
图4B为本申请实施例提供的另一种电子设备的显示界面示意图;
图4C为本申请实施例提供的另一种电子设备的显示界面示意图;
图4D为本申请实施例提供的另一种高倍率拍摄方法流程图;
图5为本申请实施例提供的另一种电子设备的显示界面示意图;
图6A为本申请实施例提供的另一种电子设备的显示界面示意图;
图6B为本申请实施例提供的另一种电子设备的显示界面示意图;
图6C为本申请实施例提供的另一种电子设备的显示界面示意图;
图6D为本申请实施例提供的一种预览图像的示意图;
图7A为本申请实施例提供的另一种高倍率拍摄方法流程图;
图7B为本申请实施例提供的另一种预览图像的示意图;
图8为本申请实施例提供的另一种电子设备的显示界面示意图;
图9为本申请实施例提供的另一种电子设备的显示界面示意图;
图10为本申请实施例提供的一种高倍率拍摄方法流程图;
图11为本申请实施例提供的另一种电子设备的显示界面示意图;
图12为本申请实施例提供的另一种电子设备的显示界面示意图;
图13为本申请实施例提供的另一种电子设备的显示界面示意图;
图14为本申请实施例提供的另一种电子设备的显示界面示意图;
图15为本申请实施例提供的另一种电子设备的显示界面示意图;
图16为本申请实施例提供的一种高倍率拍摄方法流程图;
图17A为本申请实施例提供的另一种电子设备的显示界面示意图;
图17B为本申请实施例提供的另一种电子设备的显示界面示意图;
图17C为本申请实施例提供的另一种电子设备的显示界面示意图;
图18为本申请实施例提供的一种高倍率拍摄方法流程图;
图19A为本申请实施例提供的另一种电子设备的显示界面示意图;
图19B为本申请实施例提供的另一种电子设备的显示界面示意图;
图19C为本申请实施例提供的另一种电子设备的显示界面示意图;
图20为本申请实施例提供的另一种电子设备的显示界面示意图;
图21为本申请实施例提供的一种芯片系统示意图。
具体实施方式
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,除非另有说明,“多个”的含义是两个或两个以上。
本申请实施例提供一种高倍率拍摄方法,该方法可以应用于具备拍照功能的电子设备。通过该方法,电子设备可以在高变焦倍率拍摄场景下,响应于用户的操作可以自动锁 定需要高倍率拍摄的拍摄对象。然后,电子设备可以采用合适的变焦倍率采集并显示该拍摄对象的预览图像(称为初始预览图像),并获取电子设备的初始状态和初始位置。如此,则无需用户手动调整放大变焦倍率,可以减少用户手动操作引起的抖动。
其中,该初始状态为电子设备采集上述初始预览图像时,该电子设备的运动状态(如电子设备的姿态)。该初始位置为电子设备采集上述初始预览图像时,该电子设备所处的位置。该初始状态和初始位置可以反映出电子设备采集上述初始预览图像时,电子设备的空间位置和姿态。
之后,电子设备可以获取该电子设备的实时状态和实时位置,根据该实时状态和实时位置,提醒用户纠正电子设备的位置和姿态,以便电子设备可以保持在上述初始状态和初始位置或者临近初始状态和初始位置的状态。其中,电子设备处于不同位置不同状态时,该电子设备的摄像头的拍摄区域(即取景范围)则不同。上述初始状态和初始位置是响应于用户的操作,电子设备采集锁定的拍摄对象的初始预览图像时,电子设备的状态和位置。此时,电子设备锁定的拍摄对象是用户想要拍摄的对象。
也就是说,电子设备可以在摄像头的拍摄区域偏离初始预览图像对应的拍摄区域时,提醒用户纠正电子设备的位置和姿态,以便电子设备可以保持在初始状态和初始位置所指示的位置和姿态,可以保证电子设备能够拍摄到用户想要的拍摄对象。
最后,电子设备可以响应于用户的拍照操作,将上述初始预览图像和用户手动拍摄的预览图像同时显示出来,由用户选择需要的照片来保存。如此,电子设备可以按照用户的需求,拍摄到用户满意的照片。
需要说明的是,上述变焦倍率可以为光学变焦倍率或数字变焦倍率。例如,上述变焦倍率可以为1x、8x、10x、12x、50x或者12.8x等。“1x”表示变焦倍率为1倍。“8x”表示变焦倍率为8倍。“50X”表示变焦倍率为50倍。本申请实施例中,高于预设倍率阈值的变焦倍率可以称为高倍率。本申请实施例中所述的倍率也可以称为倍数。也就是说,上述变焦倍率也可以称为变焦倍数,上述预设倍率阈值可以称为预设倍数阈值,上述高倍率可以称为高倍数。
下面将结合附图对本申请实施例的实施方式进行详细描述。以上述电子设备是手机为例,介绍电子设备(如电子设备300)的硬件结构。
如图3所示,电子设备300可以包括:处理器310,外部存储器接口320,内部存储器321,通用串行总线(universal serial bus,USB)接口330,充电管理模块340,电源管理模块341,电池342,天线1,天线2,移动通信模块350,无线通信模块360,音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,传感器模块380,按键390,马达391,指示器392,摄像头393,显示屏394,以及用户标识模块(subscriber identification module,SIM)卡接口395等。
其中,上述传感器模块380可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器和骨传导传感器等传感器。
可以理解的是,本实施例示意的结构并不构成对电子设备300的具体限定。在另一些实施例中,电子设备300可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实 现。
处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以是电子设备300的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器310中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器310的等待时间,因而提高了系统的效率。在一些实施例中,处理器310可以包括一个或多个接口。
可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备300的结构限定。在另一些实施例中,电子设备300也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块340用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。充电管理模块340为电池342充电的同时,还可以通过电源管理模块341为电子设备供电。
电源管理模块341用于连接电池342,充电管理模块340与处理器310。电源管理模块341接收电池342和/或充电管理模块340的输入,为处理器310,内部存储器321,外部存储器,显示屏394,摄像头393,和无线通信模块360等供电。
电子设备300的无线通信功能可以通过天线1,天线2,移动通信模块350,无线通信模块360,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块350可以提供应用在电子设备300上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块350可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块350还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。
无线通信模块360可以提供应用在电子设备300上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(blue tooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。
在一些实施例中,电子设备300的天线1和移动通信模块350耦合,天线2和无线通 信模块360耦合,使得电子设备300可以通过无线通信技术与网络以及其他设备通信。
电子设备300通过GPU,显示屏394,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏394和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器310可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏394用于显示图像,视频等。该显示屏394包括显示面板。例如,显示屏394可以是触摸屏。
电子设备300可以通过ISP,摄像头393,视频编解码器,GPU,显示屏394以及应用处理器等实现拍摄功能。
外部存储器接口320可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备300的存储能力。外部存储卡通过外部存储器接口320与处理器310通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器321可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令,从而执行电子设备300的各种功能应用以及数据处理。例如,在本申请实施例中,处理器310可以通过执行存储在内部存储器321中的指令,内部存储器321可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备300使用过程中所创建的数据(比如音频数据,电话本等)等。
电子设备300可以通过音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
触摸传感器,也称“触控面板”。触摸传感器可以设置于显示屏394,由触摸传感器与显示屏394组成触摸屏,也称“触控屏”。触摸传感器用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏394提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器也可以设置于电子设备300的表面,与显示屏394所处的位置不同。
本申请实施例中,电子设备300可以通过触摸传感器检测到用户在触摸屏输入的触摸操作,并采集该触摸操作在触摸屏上的触控位置,以及触控时间等中的一项或多项。在一些实施例中,电子设备300可以通过触摸传感器和压力传感器结合起来,确定触摸操作在触摸屏的触控位置。
按键390包括开机键,音量键等。按键390可以是机械按键。也可以是触摸式按键。电子设备300可以接收按键输入,产生与电子设备300的用户设置以及功能控制有关的键信号输入。
马达391可以产生振动提示。马达391可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏394不同区域的触摸操作,马达391也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器392可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。SIM卡接口395用于连接SIM卡。SIM卡可以通过插入SIM卡接口395,或从SIM卡接口395拔出,实现和电子设备300的接触和分离。电子设备300可以 支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口395可以支持Nano SIM卡,Micro SIM卡,SIM卡等。
陀螺仪传感器可以是三轴陀螺仪,用于追踪电子设备300在6个方向的状态变化。加速度传感器用于检测电子设备300的运动速度、方向以及位移。本申请实施例中,电子设备300可以通过陀螺仪传感器和加速度传感器检测电子设备300的状态和位置。当电子设备300的状态和位置相比于初始位置和初始状态发生较大变化时,电子设备300可以实时在显示屏394上提醒用户及时纠正电子设备300的状态和位置。
以下实施例中的方法均可以在具有上述硬件结构的电子设备300中实现。
本申请实施例提供一种高倍率拍摄方法,该方法可以应用于上述电子设备300。以下实施例中,以电子设备300是图1所示的手机100为例,介绍本申请实施例的方法。如图4A所示,该高倍率拍摄方法可以包括S401-S406。
S401、手机100显示第一界面。该第一界面是手机100拍照的取景界面,该第一界面包括手机100的摄像头在变焦倍率为m时采集的第一预览图像,该第一预览图像包括目标对象的图像,且目标对象的图像处于第一预览图像的中心位置。
例如,手机100可以显示图4B所示的第一界面401,该第一界面401包括第一预览图像402,该第一预览图像402包括目标对象“小鸟”200的图像。以m=1为例,如图4B所示,第一界面401还包括变焦倍率标识403“1×”,表示光学倍率为1倍。
当然,m也可以取其他值。例如,如图4C所示,第一界面404包括变焦倍率标识405“10×”,表示光学倍率为10倍。以下实施例中,以m=1为例,介绍本申请实施例的方法。
在一些实施例中,手机启动相机应用所显示的取景界面中,目标对象的图像可能并不处于手机的取景框的中心位置。在这种情况下,手机可以引导用户调整手机的取景范围以使得目标对象的图像处于手机的取景框的中心位置。在该实施例中,如图4D所示,在S401之前,本申请实施例的方法还可以包括S401′和S401〃。
S401′、手机100显示第四界面。该第四界面是手机100拍照的取景界面,该第四界面包括手机100的摄像头在变焦倍率为m时采集的第五预览图像,该第五预览图像包括目标对象的图像。
其中,手机100可以响应于用户对相机应用的图标的点击操作,显示上述第四界面。该第四界面是手机100在拍照模式下的预览界面。
例如,手机100可以显示图5中的(a)所示的主界面501。该主界面501中包括多个应用的图标,如相机应用的图标502、时钟应用的图标、日历应用的图标和设置应用的图标等。响应于用户对相机应用的图标502的点击操作(如单击操作),手机100可以显示图5中的(b)所示的第四界面503。该第四界面503是手机100在拍照模式下的预览界面,该第四界面503包括第五预览图像507。
该第四界面503还包括相册键506、摄像头切换键508和拍摄键509等。该相册键506用于触发手机100显示手机100的相册。该相册键506上显示有手机100最近一次拍摄的照片。例如,如图5中的(b)所示,相册键506上显示有用户运动的照片。摄像头切换键508用于触发手机100切换摄像头,如切换前后置摄像头。拍摄键509用于触发手机100保存摄像头采集的预览图像。以m=1为例,变焦倍 率标识505用于指示手机100的摄像头的变焦倍率。如变焦倍率标识505“1×”,表示光学倍率为1倍。
一般而言,手机100启动相机应用后,手机100的摄像头的变焦倍率为1。例如,如图5中的(b)所示,第四界面503还包括变焦倍率标识505,该变焦倍率标识505用于指示摄像头的变焦倍率为“1x”,即1倍变焦。当然,m也可以取其他值。在m>1的情况下,上述第四界面可以是手机响应于变焦操作,调整摄像头的变焦倍率后,手机所显示的拍照的预览界面。
其中,手机100采集的预览图像(如第五预览图像507)中可以包括一个或多个拍摄对象的图像。例如,图5中的(b)所示的第五预览图像507中包括拍摄对象“树”504的图像和拍摄对象“小鸟”200的图像。
应理解,在低倍率场景(即手机100的摄像头的变焦倍率较低的场景)下,手机100的摄像头往往无法清楚的拍摄到远处较小的景物。例如,拍摄对象“小鸟”200距离手机100较远且拍摄对象“小鸟”200较小,如图5中的(b)所示,使得手机100采集的第五预览图像507中拍摄对象“小鸟”200(即目标对象)的图像不够清楚。
为了可以清楚的拍摄到远处的景物(即目标对象),手机100可以调整摄像头的变焦倍率。这样,可以使手机100清楚的拍摄到远处的景物。采用本申请实施例的方法,手机100可以响应于用户在拍照的预览界面选定拍摄对象(即目标对象)的操作,自动放大摄像头的变焦倍率。这样,可以避免用户手动放大变焦倍率的过程中因为手抖,使得手机100无法对准需要拍摄的小鸟200,从而无法拍摄到满意的照片。具体的,在S401′之后,本申请实施例的方法还可以包括S401〃。
S401〃、手机100响应于用户在第四界面的第二操作,在第四界面发出第二提示信息。该第二操作是用户对第四界面中目标对象的图像的选择操作。第二提示信息用于指示用户移动手机100使目标对象的图像处于取景界面的中心位置。
例如,以目标对象是图6A所示的拍摄对象“小鸟”200为例。如图6A所示,手机100可以接收用户对第五预览图像507中目标对象“小鸟”200的图像的第二操作。例如,该第二操作可以是用户对第五预览图像507中目标对象“小鸟”200的图像所在位置的单击操作或者双击操作。
响应于用户对图6A中目标对象“小鸟”200的图像所在位置的第二操作,手机100可以显示图6B中的(a)所示的第二提示信息601。该第二提示信息用于指示用户移动手机100使目标对象的图像处于取景界面的中心位置。例如,该第二提示信息601可以为“请移动手机,保证您选择的目标对象处于取景框中心”。
在另一些实施例中,上述第二提示信息还可以用于向用户提示移动手机的方位。例如,响应于用户对图6A中目标对象“小鸟”200的图像所在位置的第二操作,手机100可以显示图6B中的(b)所示的第二提示信息602,如“请向右上方移动手机,保证您选择的目标对象处于取景框中心”。
在另一些实施例中,上述第二提示信息还可以包括用于提示用户移动手机的方位的指向性图标,如方向箭头。例如,响应于用户对图6A中目标对象“小鸟”200的图像所在位置的第二操作,手机100可以显示图6B中的(c)所示的第二提示信息603,如“请按照箭头指示方向移动手机,保证您选择的目标对象处于取景框中心”和方向箭头。
需要说明的是,手机100发出第二提示信息后,用户则可能按照第二提示信息的提示移动手机。随着手机的移动,手机100的取景范围可能会发生变化。用户按照第二提示信息的提示移动手机100,在上述目标对象(如“小鸟”200)的图像处于取景界面的中心位置时,用户可以停止移动手机100。此时,手机100可以显示图4B所示的第一界面401。该第一界面401包括第一预览图像702,该第一预览图像702包括目标对象“小鸟”200的图像。并且,如图4B所示,目标对象“小鸟”200的图像处于第一预览图像702的中心位置。
在一些实施例中,手机100可以实时检测上述目标对象(如“小鸟”200)的图像在预览图像(如第一预览图像)中的位置。当目标对象的图像处于预览图像(如第一预览图像)的中心位置时,手机100可以发出第三提示信息。该第三提示信息用于提示用户:目标对象的图像已处于预览界面的中心位置,可以停止移动手机100了。例如,手机100可以显示图6C所示的第一界面604,该第一界面604包括第三提示信息605,如“目标对象‘小鸟’已处于取景框中心,请停止移动手机”。如图6C所示,目标对象“小鸟”200的图像处于第一预览图像604的中心位置。在另一些实施例中,手机100可以在预设时长内显示上述第三提示信息605。在上述预设时长截止后,手机100则可以执行S401,显示图4B所示的第一界面401。
示例性的,手机100识别目标对象的图像处于第一预览图像的中心位置的方法可以包括:手机100识别目标对象的图像是否处于手机100的取景框的预设中心区域内。其中,该预设中心区域位于手机100的取景框的中心位置。
如果目标对象的图像处于手机100的取景框的预设中心区域内,则表示目标对象的图像处于第一预览图像的中心位置。例如,如图6D中的(a)所示,预设中心区域607位于手机100在拍照模式下的取景框606的中心位置。如图6D中的(b)或者图6D中的(c)所示,目标对象“小鸟”的图像608在预设中心区域607内。如果目标对象的图像处于手机100的取景框的预设中心区域外,则表示目标对象的图像处于第一预览图像的中心位置。
应注意,目标对象的图像处于手机100的取景框的预设中心区域内,具体是指:目标对象的全部图像处于手机100的取景框的预设中心区域内。目标对象的图像处于手机100的取景框的预设中心区域外,具体是指:目标对象的部分或全部图像处于手机100的取景框的预设中心区域外。
S402、手机100响应于用户对第一界面中目标对象的图像的第一操作,手机100显示第二界面,获取并保存手机100的初始位姿信息。该第二界面包括手机100的摄像头在变焦倍率为n时采集的第二预览图像,该第二预览图像包括目标对象的图像,n>m。
其中,上述第一操作用于触发手机100调大变焦倍率,以显示包括目标对象的图像的第一预览图像。例如,上述第一操作可以是用户对第二预览图像中目标对象的图像的长按操作。
举例来说,手机100可以接收用户在图4B所示的第一界面401或者图4C所示的第一界面404输入的第一操作(如长按操作)。响应于该第一操作,手机100可以显示图8所示的第二界面801。该第二界面801包括第二预览图像802。该第二预览图像802是手机100的摄像头在变焦倍率为50时采集的,即n=50。如图8所示,第二界面801还包括变焦倍率标识803,该变焦倍率标识803用于指示摄像头的变焦倍率为“50x”,即50倍变焦。
其中,手机100的初始位姿信息可以包括手机100的初始状态信息和初始位置信息; 该初始状态信息用于指示手机100接收到上述第一操作时手机100的运动状态(简称为初始状态)。手机100的初始位置信息用于指示手机100所处的位置(简称为初始位置)。应理解,手机100接收到上述第一操作时,目标对象的图像处于取景框的中心位置。在手机100保持这种位姿(即初始位姿信息所指示的位姿)的情况下,手机100放大变焦倍率后,拍摄到完整的目标对象的可能性较高。因此,该初始状态和初始位置可以用于纠正用户调整手机100的状态和位置,以使手机100可以拍摄到完整的目标对象。
示例性的,手机100包括陀螺仪传感器和加速度传感器。在一些实施例中,手机100可以在手机100显示上述第二界面时,通过该陀螺仪传感器和加速度传感器,获取手机100的初始位姿信息。
在一些实施例中,为了避免用户误操作导致手机100显示摄像头在变焦倍率为n的情况下采集的预览图像;上述第一操作可以为用户在上述第一界面输入的按压时长大于或等于预设时长阈值的长按操作。例如,上述预设时长阈值可以为2.5秒(s)或者2s等任一时长。
在该实施例中,如果手机100接收到用户在第一界面输入的按压时长小于等于预设时长阈值的按压操作,手机100则可以不执行S402。
在另一些实施例中,手机100接收到上述第一操作后,响应于该第一操作,可以从第一预览图像中确定出目标对象的图像所在的拍摄区域(称为待拍摄区域)。例如,如图7B所示,手机100可以从第一预览图像401中确定出目标对象“小鸟”的图像所在的待拍摄区域701,即锁定待拍摄的目标对象“小鸟”。然后,手机100可以根据该待拍摄区域701将摄像头的变焦倍率调整为n,显示包括目标对象(如“小鸟”)的图像的第二预览图像。
在该实施例中,手机100可以在手机100确定待拍摄区域701(即锁定待拍摄)时,获取手机100的初始位姿信息。
示例性的,本申请实施例这里介绍S402中,手机100响应于第一操作,显示包括第二预览图像的第二界面,获取并保存手机100的初始状态信息和初始位置信息的具体方法。示例性的,如图7A所示,S402可以包括S402a-S402b。
S402a、手机100响应于第一操作,从第一预览图像中确定包括目标对象的图像的待拍摄区域,即从第一预览图像中锁定目标对象。
例如,以第一操作是图4B所示的长按操作为例。手机100可以接收用户对图4B所示的目标对象“小鸟”200的图像的长按操作。手机100可以根据触摸屏中的触摸传感器采集到的长按操作,确定用户的长按操作对应的区域(即包括目标对象的图像的待拍摄区域)。
具体的,该包括目标对象的图像的待拍摄区域可以为:以上述第一操作(如长按操作)与触摸屏接触区域的中心为矩形中心,以预设的长和宽分别为a厘米(cm)和b cm的矩形区域。例如,上述矩形可以是正方形,上述待拍摄区域可以是以上述第一操作与触摸屏接触区域的中心为正方形中心,以边长为L cm的正方形区域。即a=b=L。例如,L=2cm。
示例性的,手机100的触摸屏在识别到上述长按操作后,可以向手机100的处理器发送包括长按操作的指令和该长按操作作用于触摸屏的坐标位置信息。手机100的处理器接收到该指令和坐标位置信息后,可以获取摄像头采集的第一预览图像;然后,根据该坐标位置信息所指示的坐标位置,按照上述方式确定待拍摄区域。
例如,图7B示出图4B所示的第一预览图像401。如图7B所示,第一预览图像401 中目标对象“小鸟”200的图像所在区域701(即图7B所示的虚线框对应区域)为待拍摄区域。也就是说,手机100可以锁定该第一预览图像401中目标对象“小鸟”200的图像所在区域701为待拍摄区域。该待拍摄区域701包括目标对象“小鸟”200的图像。
在一些实施例中,手机100响应于上述第一操作,在从第一预览图像中确定包括目标对象的图像的待拍摄区域时,还需要考虑目标对象的图像的完整性。也就是说,手机100响应于第一操作确定的待拍摄区域,需要包括目标对象的完整图像。
示例性的,手机100响应于上述第一操作,可以通过图像识别技术识别出该第一操作锁定的拍摄区域中的目标对象(如小鸟或者月亮等景物)。然后,手机100可以通过图像识别技术识别第一预览图像中目标对象的完整图像。最后,手机100可以将包括目标对象的完整图像的拍摄区域确定为上述待拍摄区域。
S402b、手机100自动将变焦倍率调整为n,显示包括放大的待拍摄区域的第二界面,获取并保存手机100的初始位姿信息。
示例性的,手机100在锁定上述待拍摄区域后,可以自动调整摄像头的变焦倍率,将待拍摄区域中目标对象的图像放大,并占满手机100的显示屏(如触摸屏)或者显示屏的取景框。其中,手机100可以适配手机100的显示屏的尺寸或者显示屏的取景框的尺寸,确定上述变焦倍率n,以使得待拍摄区域中目标对象的图像占满手机100的显示屏或者显示屏的取景框。
例如,手机100锁定图7B所示的待拍摄区域701后,由于待拍摄区域701为边长2cm的正方形。对于7英寸的手机100,如果手机100的显示屏的高宽比为16:9,则手机100的长约15.5cm,宽大概8.7cm。在这种情况下,变焦倍率n=8.7/2=4.35。
在确定变焦倍率n之后,由于手机100显示屏是长方形;因此,可以以手机100的显示屏最短的宽度确定放大倍数。例如,正方形的待拍摄区域701放大4.35倍之后,宽度方向正好填充显示屏;而长度方向则自动从第一预览图像中补齐画面。
例如,以n=50为例。手机100可以显示图8所示的第二界面801。如图8所示,第二界面801包括第二预览图像802,该第二预览图像802包括目标对象“小鸟”的图像。第二界面801还包括变焦倍率标识803,该变焦倍率标识803用于指示变焦倍率为50。
在另一些实施例中,手机100可以通过图像识别技术自动识别确定包括目标对象的完整图像的待拍摄区域。在这种情况下,手机100可以先确定包括目标对象的完整图像的待拍摄区域的长X cm和宽Y cm。假设手机100的显示屏为7英寸,则变焦倍率n=Min(15.5/X,8.7/Y)。其中,Min(15.5/X,8.7/Y)表示取15.5/X和8.7/Y中的最小值。手机100确定变焦倍率n之后,可以采用待拍摄区域的长度方向或宽度方向中尺寸较小的一个方向填充显示屏;而另一方向则自动从第一预览图像中补齐画面。
S403、手机100获取手机100的实时位姿信息,该实时位姿信息用于指示手机100的实时的运动状态和位置。
应理解,在S402之后,用户手持手机100拍摄照片的过程中,可能会因为用户手部的移动,导致摄像头的取景范围发生变化,摄像头无法采集到目标对象的图像,进而导致手机100显示的预览图像不包括目标对象的图像。也就是说,目标对象的图像不能出现或者不能完整出现在手机100的预览界面中。
基于此,本申请实施例中,手机100可以通过陀螺仪传感器和加速度传感器检测手机 100的状态和位置。当手机100的状态和位置相比于初始位置和初始状态发生较大变化时,手机100可以实时在显示屏上提醒用户及时纠正手机100的状态和位置,使手机100可以采集到目标对象的完整图像,进而在预览界面显示该目标对象的完整图像。
其中,手机100的实时状态信息用于指示手机100的实时运动状态。手机100的实时位置信息用于指示手机100的实时位置。手机100包括陀螺仪传感器和加速度传感器。手机100可以通过该陀螺仪传感器和加速度传感器,实时获取手机100的状态信息(即实时状态信息)和位置信息(即实时位置信息)。例如,上述陀螺仪传感器可以是三轴陀螺仪,用于追踪手机100在6个方向的状态变化。加速度传感器用于检测手机100的运动速度、方向以及位移。
S404、手机100根据实时位姿信息与初始位姿信息,发出第一提示信息。该第一提示信息用于提示用户移动手机100,使手机100处于初始位姿信息所指示的运动状态和位置。
示例性的,假设上述初始位姿信息指示手机100的初始运动状态为初始状态W0,手机100的初始位置为初始位置S0;上述实时位姿信息指示手机100的运动状态为实时状态W1,手机100的实时位置为实时位置S1。其中,手机100可以比较实时状态W1与初始状态W0,比较实时位置S1与初始位置S0,确定手机100如何移动可以回到初始状态W0和初始位置S0。然后,手机100可以发出上述第一提示信息,提示用户移动手机100,使手机100处于初始位姿信息所指示的运动状态和位置。在一些实施例中,手机发出的第一提示信息可以为语音提示信息。在另一些实施例中,手机可以在上述第二界面显示第一提示信息。本申请实施例中,以电子设备在第二界面显示第一提示信息为例,介绍本申请实施例的方法。
例如,假设用户持手机100拍摄目标对象“小鸟”的过程中,握持手机100向右移动了。此时,手机100可以通过陀螺仪传感器和加速度传感器驾车到手机100向右移动。在这种情况下,手机100可以显示图9所示的第二界面901,该第二界面901中仅包括目标对象“小鸟”的部分图像。该第二界面901还显示第一提示信息902,如“请向右移动手机!”。
又例如,假设用户持手机100拍摄目标对象“小鸟”的过程中,握持手机100向左上方移动了。此时,手机100可以通过陀螺仪传感器和加速度传感器驾车到手机100向左上方移动。在这种情况下,手机100可以显示图10所示的第二界面1001,该第二界面1001中仅包括目标对象“小鸟”的部分图像。该第二界面1001还可以显示第一提示信息1002,如“请向右下方移动手机!”。
又例如,假设用户持手机100拍摄目标对象“小鸟”的过程中,逆时针旋转了手机100。此时,手机100可以通过陀螺仪传感器和加速度传感器驾车到手机100发生了逆时针旋转。在这种情况下,手机100可以发出用于提示用户顺时针旋转手机100的第一提示信息。
在另一些实施例中,上述第一提示信息可以通过文字和移动标识的方式,提示用户移动手机100,使手机100处于初始位姿信息所指示的运动状态和位置。
例如,手机100可以显示图11中的(a)所示的第二界面1101,该第二界面1101包括第一提示信息1102。又例如,手机100可以显示图11中的(b)所示的第二界面1103,该第二界面1103可以显示第一提示信息1104。又例如,手机100可以显示图11中的(c)所示的第二界面1105,该第二界面1105包括第一提示信息1106。其中,上述第一提示信息1102、第一提示信息1104和第一提示信息1106均包括文字“请按照键盘指示方向移动 手机”和移动图标(如方向指示箭头)。
应理解,用户按照第一提示信息的提示移动手机100后,该手机100的实时位姿(即实时状态和实时位置)可以回到初始位姿(即初始状态和初始位置)。如此,手机100便可以在取景界面显示包括摄像头在变焦倍率为n时采集的目标对象的较为完整的图像。例如,手机100可以显示图12所示的预览界面1201。
在另一些实施例中,手机100可以在手机100回到初始位姿信息所指示的运动状态和位置时,发出第四提示信息。该第四提示信息用于提示用户停止移动手机100并开始拍摄照片。例如,手机100可以发出图12所示的第四提示信息1202,如“请保持手机静止,并点击拍照快门拍摄照片”。需要说明的是,上述第四提示信息是可选的。
在一些实施例中,S404中所述的“手机100处于初始位姿信息所指示的运动状态和位置”,具体可以为:手机100的实时位姿信息所指示的运动状态与初始位姿信息所指示的运动状态的差异小于第一差异阈值;手机100的实时位姿信息所指示的位置与初始位姿信息所指示的位置的差异小于第二差异阈值。
S405、手机100响应于用户的拍照操作,显示包括第三预览图像和第四预览图像的第三界面。第三预览图像是是摄像头采集的多帧第二预览图像中图像参数最高的图像,第四预览图像是响应于拍照操作而拍摄的图像。
其中,从手机100执行S402到手机100接收到S405所述的拍照操作的过程中,手机100的摄像头可以采集多个预览图像。该第三预览图像可以是从手机100执行S402到手机100接收到S405所述的拍照操作的过程中,手机100的摄像头采集的清晰度最高、且完整度最高的预览图像。其中,第三预览图像的完整度可以为第三预览图像中包括的目标对象的图像在该目标对象的完整图像中的占比。
示例性的,在用户锁定待拍摄区域并进行放大后,可以将预览图像每隔第一预设周期进行缓存,将第一次缓存的预览图像与第二次缓存的预览图像进行比对,保留图像参数较高的预览图像;再将该清晰度高的预览图像与下一次缓存的预览图像进行比对,依然保留清晰度高的照片。以此类推,使得手机100的缓存器中一直保存最高的预览图像。
具体的,从手机100执行S402到手机100接收到S405所述的拍照操作的过程中,手机100可以按照预设周期(如第一预设周期)周期性缓存摄像头当时采集的第二预览图像。手机100在第i个第一预设周期缓存第二预览图像i。手机100在第i个第一预设周期缓存第二预览图像i后,手机可以对比第二预览图像i与第i-1个第七预览图像,得到并缓存第i个第七预览图像。该第i个第七预览图像是第二预览图像i与第i-1个第七预览图像中图像参数最高的预览图像。该图像参数包括清晰度和/或完整度。其中,预览图像的完整度可以为该预览图像中包括的目标对象的图像在该目标对象的完整图像中的占比。假设手机100接收到上述拍照操作时,手机100获取到第p个第七预览图像,该第p个第七预览图像则是上述第三预览图像。当然,手机100还可以删除图像参数较低的预览图像。其中,i为整数,i按照由小到大的顺序依次在{2,……,p}中取值,p≥2,p为整数。
其中,在i=1的情况下,上述第i个第七预览图像是手机100第1个第一预设周期获取到的第二预览图像1。
在i≥2的情况下,第i个第七预览图像是第二预览图像i与第i-1个第七预览图像中图像参数最高的预览图像。例如,上述第一预设周期的时间长度可以为0.5秒(s)或者1s 等任一时长。
例如,假设p=5,上述第一预设周期为0.5s。也就是说,从手机100执行S402开始,在第2.5s-3.0s这段时间内,手机100接收到S405所述的拍照操作。以下介绍该示例中,手机100确定第三预览图像的具体过程:
(1)手机100在第1个第一预设周期缓存第二预览图像1,即i=1。如表1所示,第1个第七预览图像是第二预览图像1。
(2)手机100在第2个第一预设周期缓存第二预览图像2,即i=2。手机100可以对比第二预览图像2与第1个第七预览图像(即第二预览图像1),得到第2个第七预览图像。由于第二预览图像2的图像参数(如完整度)高于第1个第七预览图像(即第二预览图像1)的图像参数,如表1所示,第2个第七预览图像是第二预览图像2。
(3)手机100在第3个第一预设周期缓存第二预览图像3,即i=3。手机100可以对比第二预览图像3与第2个第七预览图像(即第二预览图像2),得到第3个第七预览图像。由于第2个第七预览图像(即第二预览图像2)的图像参数(如完整度)高于第二预览图像3的图像参数,如表1所示,第3个第七预览图像是第二预览图像2。
(4)手机100在第4个第一预设周期缓存第二预览图像4,即i=4。手机100可以对比第二预览图像4与第3个第七预览图像(即第二预览图像2),得到第4个第七预览图像。由于第二预览图像4的图像参数高于第3个第七预览图像(即第二预览图像2)的图像参数(如完整度),如表1所示,第4个第七预览图像是第二预览图像4。
(5)手机100在第5个第一预设周期缓存第二预览图像5,即i=5。手机100可以对比第二预览图像5与第4个第七预览图像(即第二预览图像4),得到第5个第七预览图像。由于第4个第七预览图像(即第二预览图像4)的图像参数(如完整度)高于第二预览图像5的图像参数,如表1所示,第5个第七预览图像是第二预览图像4。
至此,第p个第七预览图像(即第5个第七预览图像,即第二预览图像4)是上述第三预览图像。
表1
i 第i-1个第七预览图像 第二预览图像i 第i个第七预览图像
i=1 第二预览图像1 第二预览图像1 第二预览图像1
i=2 第二预览图像1 第二预览图像2 第二预览图像2
i=3 第二预览图像2 第二预览图像3 第二预览图像2
i=4 第二预览图像2 第二预览图像4 第二预览图像4
i=5 第二预览图像4 第二预览图像5 第二预览图像4
在该实施例中,手机100可以一直缓存到图像参数较高的预览图像,作为第三预览图像。如此,手机100便可以在第三界面同时为用户呈现第四预览图像和图像参数最高的第三预览图像。这样,可以保证用户拍摄并选择到高质量的照片。
应理解,手机100在实时位姿信息等于或者接近于初始位姿信息,可能会接收到用户的拍照操作。例如,手机100可以接收图12所示的拍照操作,如用户对“拍照快门”的点击操作。
一般而言,响应于用户的拍照操作,手机100便可以保存摄像头实时采集的预览图像。例如,响应于图12所示的拍照操作,手机100可以显示图13所示的预览界面。相比于图 12,预览界面中的相册键由相册键506更新为相册键1302。相册键1302上显示有图12所示的预览界面中的预览图像。也就是说,手机100已保存了手机100对应的预览图像。
而本申请实施例中,手机100则不会直接保存预览图像,而是显示包括第三预览图像和第四预览图像的第三界面。由用户选择第三界面中的任一张预览图像来保存。这样,可以保证手机100能够保存用户想要的预览图像。
例如,响应于图12所示的拍照操作,手机100可以显示图14中的(a)所示的第三界面1401、图14中的(b)所示的第三界面1406或者图15所示的第三界面1501。第三界面1401、第三界面1406和第三界面1501均包括第三预览图像1403和第四预览图像1405。第三界面1401、第三界面1406和第三界面1501还用于提示用户选择想要保存的照片。例如,第三界面1401、第三界面1406和第三界面1501还包括提示信息1402,如“请选择需要保存的照片!”
需要说明的是,相比于第三界面1401,第三界面1406和第三界面1501是在手机100拍照照片的预览界面来显示上述第三预览图像1403和第四预览图像1405的。比较第三界面1406和第三界面1501可知:第三界面1406并未显示摄像头实时采集的预览图像,而第三界面1501中显示了摄像头实时采集的预览图像1502。其中,第三界面1406和第三界面1501还包括相册键506。由图14中的(b)或图15所示的相册键506可知:手机100响应于拍照操作,并未保存新的照片。
S406、手机100响应于用户对第三界面中的第三预览图像和/或第四预览图像的选择,保存用户选择的预览图像。
其中,手机100可以接收用户对第三界面中第三预览图像和第四预览图像中至少一个预览图像的选择操作。响应于用户的选择操作,手机100可以保存用户选择的预览图像。例如,如图15所示,手机100可以接收用户对第三预览图像1403的选择操作。响应于用户对图15所示的第三预览图像1403的选择操作,手机100可以显示图13所示的预览界面。
本申请实施例提供一种高倍率拍摄方法,手机100可以在高变焦倍率拍摄场景下,响应于用户的操作可以自动锁定需要高倍率拍摄的拍摄对象。然后,手机100可以采用合适的变焦倍率采集并显示该拍摄对象的预览图像(称为初始预览图像),并获取手机100的初始状态和初始位置。如此,则无需用户手动调整放大变焦倍率,可以减少用户手动操作引起的抖动。
之后,手机100可以获取该手机100的实时状态和实时位置,根据该实时状态和实时位置,提醒用户纠正手机100的位置和姿态,以便手机100可以保持在上述初始状态和初始位置或者临近初始状态和初始位置的状态。此时,手机100锁定的拍摄对象是用户想要拍摄的对象。也就是说,手机100可以在摄像头的拍摄区域偏离初始预览图像对应的拍摄区域时,提醒用户纠正手机100的位置和姿态,以便手机100可以保持在初始状态和初始位置所指示的位置和姿态,可以保证手机100能够拍摄到用户想要的拍摄对象。
最后,手机100可以响应于用户的拍照操作,将上述初始预览图像和用户手动拍摄的预览图像同时显示出来,由用户选择需要的照片来保存。如此,手机100可以按照用户的需求,拍摄到用户满意的照片。
在一些实施例中,上述变焦倍数n可以是由用户选定的变焦倍数。具体的,如图16所示,在S401之后,本申请实施例的方法还可以包括S1601-S1602,上述S402可以替换为S1603。
S1601、手机100响应于用户在第一界面的第三操作,手机100在第一界面发出第五提示信息。该第五提示信息用于指示用户选择摄像头的变焦倍率。
例如,第三操作可以是长按操作。该第三操作可以是用户对目标对象的图像的长按操作,也可以是用户对第一预览图像中任一位置的长按操作。该第三操作与第二操作可以不同,也可以相同。在该实施例中,手机100第一次接收到用户对第一预览图像的长按操作时,可以不执行S402,而是执行S1601。
例如,手机100可以显示图17A中的(a)所示的第一界面1701,该第一界面1701包括第一预览图像1702。手机100可以接收用户在第一界面1701的第三操作(如长按操作)。响应于用户对第一界面1701的第三操作,手机100可以发出图17A中的(b)所示的第五提示信息1703。该第五提示信息1703可以包括多个变焦倍率选项,如“2x”选项、“8x”选项、“10x”选项、“20x”选项、“30x”选项和“50x”选项。
S1602、手机100响应于用户对变焦倍率n的选择操作,手机100显示第六界面。该第六界面包括手机100的摄像头在变焦倍率为n时采集的第六预览图像。该第六预览图像包括目标对象的图像。
例如,以变焦倍率n为50x为例。如图17A中的(b)所示,手机100可以接收用户对“50x”选项的选择操作。响应于用户对“50x”选项的选择操作,手机100可以显示图17A中的(c)所示的第六界面1704。第六界面1704包括手机100的摄像头在变焦倍率为50x时采集的第六预览图像1705。第六预览图像1705包括目标对象“小鸟”的图像。
S1603、手机100响应于用户在第六界面的第一操作,手机100显示第二界面,获取并保存手机100的初始位置信息。该第二界面包括手机100的摄像头在变焦倍率为n时采集的第二预览图像,该第二预览图像包括目标对象的图像,n>m。
例如,手机100可以接收用户在第六界面1705的第一操作。其中,S1603的详细描述可以参考上述实施例对S402的介绍,本申请实施例这里不予赘述。
在该实施例中,手机100可以通过两段式变焦,锁定待拍摄区域。具体的,响应于用户在第一界面的第一次长按操作,手机100可以提示用户选择合适的变焦倍率。响应于用户的第二次长按操作,手机100可以以用户选择的变焦倍率放大预览图像,并锁定包括目标对象的图像的待拍摄区域。
在一些实施例中,虽然手机可以接收用户对变焦倍率的选择操作,但是用户选择的变焦倍率可能并不合适。例如,假设用户选择图17A中的(b)所示的变焦倍率60x。手机响应于用户对图17A中的(b)所示的变焦倍率60x的选择操作,可显示图17B所示的第六界面1706。第六界面1706包括第六预览图像1707。图17B所示的第六预览图像1707没有包括完整的目标对象的图像。针对这种情况,手机还需要调整变焦倍率,以使得摄像头可以采集到目标对象的完整图像。因此,上述第六界面还可以包括预设调整控件,如图17B所示的预设调整控件1708。该预设调整控件1708用于调整摄像头的变焦倍率。该预设调整控件1708还用于指示摄像头当前的变焦倍率为60x。
例如,响应于用户对预设调整控件1708的向上滑动操作,将变焦倍率由60x调整为 50x后,手机可显示图17C所示的第六界面1709。第六界面1709包括预设调整控件1710,预设调整控件1710用于调整摄像头的变焦倍率。该预设调整控件1708还用于指示摄像头当前的变焦倍率为50x。手机100可以接收用户在第六界面1709的第一操作。
在另一些实施例中,上述摄像头可以在预设角度范围内转动。示例性的,手机100可以包括摄像头的角度调节装置,该角度调节装置连接手机100的处理器。该角度调节装置可以包括用于带动摄像头在预设角度范围内转动的联动装置(如马达)。该角度调节装置可以接收来自处理器的角度调整指令,按照该角度调整指令带动摄像头在预设角度范围内转动。例如,上述预设角度范围可以为在至少两个相互垂直的方向上实现0°-180°调整的范围。在该实施例中,上述S401〃可以替换为S401 *。也就是说,本申请实施例的方法可以包括S401'、S401 *,以及S401-S406。
S401 *、手机100响应于用户在第六界面的第二操作,调整摄像头的拍摄角度,使目标对象的图像处于手机100的取景界面的中心位置。
其中,第二操作可以参考上述实施例中的介绍,这里不予赘述。在该实施例中,手机100还可以在基于物体(即目标对象)跟踪的对焦模式中,对目标对象进行对焦,调整摄像头的拍摄角度,使目标对象处于摄像头的视野范围的中心位置。如此,便可以采集到目标对象的图像处于中心位置的预览图像。
在另一些实施例中,手机100不仅可以自动调整摄像头的拍摄角度,使目标对象的图像处于手机100的取景界面的中心位置;手机100还可以自动变焦,将摄像头的变焦倍率调整为n。在该实施例中,S401〃可以替换为S401 #,S401-S402可以替换为S402'。也就是说,本申请实施例的方法可以包括S401'、S401 #、S402',以及S403-S406。
S401 #、手机100响应于用户在第六界面的第二操作,调整摄像头的拍摄角度使目标对象的图像处于手机100的取景界面的中心位置,并进行自动变焦将摄像头的变焦倍率调整为n。
其中,手机100确定变焦倍率n的方法可以参考上述实施例中的详细介绍,这里不予赘述。手机100调整摄像头的拍摄角度使目标对象的图像处于手机100的取景界面的中心位置,并进行自动变焦将摄像头的变焦倍率调整为n的具体方法,可以参考常规技术中的详细介绍,这里不予赘述。
S402'、手机100显示第二界面,获取并保存手机100的初始位姿信息。该第二界面包括手机100的摄像头在变焦倍率为n时采集的第二预览图像,该第二预览图像包括目标对象的图像。
需要说明的是,S402'的详细描述可以参考上述实施例对S402的相关介绍,本申请实施例这里不予赘述。
在该实施例中,不需要用户手动输入第一操作,手机100接收到用户对目标对象的图像的第二操作(如单击操作)后,便可以自动调整摄像头的拍摄角度使目标对象的图像处于取景界面的中心位置,并进行自动变焦将摄像头的变焦倍率调整为n。如此,手机100便可以显示S402'所述的第二界面。这样,可以减少用户操作引起的抖动,进而减少用户操作对手机100拍摄的照片的图像质量的影响。
本申请另一实施例提供一种高倍率拍摄方法,该方法可以应用于上述电子设备300。以下实施例中,以电子设备300是图1所示的手机100为例,介绍本申请实施例的方法。 如图18所示,该高倍率拍摄方法可以包括S1801-S1807。
S1801、手机100显示第一界面。该第一界面是手机100拍照的取景界面,该第一界面包括手机100的摄像头在变焦倍率为m时采集的第一预览图像,该第一预览图像包括目标对象的图像。
其中,S1801所述的第一界面相当于S401所述的第四界面,S1801的详细描述可以参考上述实施例对S401〃的相关介绍,本申请实施例这里不予赘述。
S1802、手机100响应于用户在第一界面的变焦操作,显示第二界面。该第二界面包括手机100的摄像头在变焦倍率为n时采集的第二预览图像,n>m。
示例性的,上述变焦操作用于触发手机100调整摄像头的变焦倍率,如将变焦倍率由m调整为n。例如,响应于该变焦操作,手机可以启动长焦摄像头,该长焦摄像头便可以采集图像。
可以理解,手机100中摄像头的镜头一般都是定焦镜头,焦距可调的范围很小。手机拍摄图像时,变焦可以是通过切换不同焦距的摄像头来实现的。或者,手机拍摄图像时,变焦可以是通过调整摄像头的焦距来实现的。
上述变焦操作可用于触发手机100的高倍摄像头(如长焦摄像头)采集图像。也就是说,响应于该变焦操作,手机的预览摄像头可由低倍摄像头(即焦距较小的摄像头,如主摄像头)切换为高倍摄像头(即焦距较大的摄像头,如长焦摄像头)。其中,上述变倍操作可以用于触发手机100启动长焦摄像头,并将摄像头(如长焦摄像头)的焦距由默认摄像头(如主摄像头)的1x,变倍到默认摄像头(如主摄像头)的2倍、3倍、5倍、10倍、15倍或者20倍等任一光学倍率。
本申请实施例中,以上述变焦操作触发的变焦倍率为50倍(即50x)为例,介绍本申请实施例的方法。当然,上述变焦操作触发变焦的变焦倍率也可以为10倍或者其他数据,本申请实施例对变焦倍率的具体数值不作限制。
其中,上述变焦操作可以是手机显示拍照的预览界面时,在该拍照的预览界面输入的用于控制手机的摄像头变焦的操作。
在一种应用场景中,上述目标对象的图像处于第一界面的中心位置。该这种应用场景中,上述变焦操作可以是用户在第一界面以目标对象的图像为中心输入的双指外扩操作。
示例性的,手机100可以显示图19A中的(a)所示的第一界面1901。该第一界面1901包括第一预览图像1902。第一预览图像1902包括目标对象“小鸟”200的图像,且目标对象“小鸟”200的图像处于第一预览图像1902的中心位置。
手机100可以接收用户对图19A中的(a)所示的以目标对象“小鸟”200的图像为中心的变焦操作(如双指外扩操作)。响应于该变焦操作,手机100可以显示图19A中的(b)所示的第二界面1903。该第二界面1903包括手机100的摄像头在变焦倍率为50x时采集的第二预览图像,即n=50。其中,n的值是根据变焦操作确定的。
在另一种应用场景中,上目标对象的图像可能并不处于第一界面的中心位置。例如,手机100可显示图19B中的(a)所示的第一界面1905。第一界面1905包括第一预览图像1906,该第一预览图像1906包括目标对象“小鸟”200的图像。目标对象“小鸟”200的图像并不处于第一界面1905的中心位置。如图19B中的(a)所示,手机100可以接收用户对变焦操作(如双指外扩操作);响应于该变焦操作,手机100可显示图19B中的(b)所示 的第二界面1903。该第二界面1907包括手机100的摄像头在变焦倍率为50x时采集的第二预览图像1908。由于图19B中的(a)中目标对象“小鸟”200的图像并不处于第一界面1905的中心位置;因此,响应于变焦操作所显示的第二界面1907中可能并不包括目标对象“小鸟”200的完整图像。如此,用户则可能会移动手机100以调整摄像头的取景范围,使得摄像头可以采集到目标对象的完整图像。
S1803、手机100周期性实时缓存第二预览图像;若存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域,且相同的拍摄区域中目标对象的图像的完整度大于预设完整度阈值,手机100则显示第三界面,获取并保存手机100的初始位姿信息。该第三界面包括手机100的摄像头在变焦倍率为n时采集的目标对象的图像。
例如,预设完整度阈值可以为60%、75%、70%、75%、80%或者85%等任一完整度阈值。上述初始位置信息用于指示连续的K个周期缓存的第二预设图像包括相同的拍摄区域时,手机100的运动状态和位置。
例如,如图19C中的(a)、图19C中的(b)、图19C中的(c)和图19C中的(d)所示的第二界面,这些第二界面中的第二预览图像会随着手机100的摄像头的取景范围的变化而发生变化。图19C中的(a)所示的第二预览图像1909、图19C中的(b)所示的第二预览图像1910、图19C中的(c)所示的第二预览图像1911和图19C中的(d)所示的第二预览图像1912均不同。但是,应注意的是,为了保证手机100可以采集到的用户想要拍摄的目标对象的图像,用户移动手机100时都会尽量保证目标对象的大部分图像处于手机100的取景框内。如此,则会出现连续的多个周期的第二预设图像包括相同的拍摄区域(即包括目标对象的图像的拍摄区域)。例如,图19C中的(a)所示的第二预览图像1909、图19C中的(b)所示的第二预览图像1910、图19C中的(c)所示的第二预览图像1911和图19C中的(d)所示的第二预览图像1912均包括目标对象“小鸟”的图像的大部分拍摄区域。
其中,手机100响应于上述变焦操作,可以将第二预览图像每隔预设周期(如第二预设周期)进行缓存,将第1次缓存的第二预览图像与第2次缓存的第二预览图像进行比对,判断第1次缓存的第二预览图像1与第2次缓存的第二预览图像2是否存在相同的拍摄区域(即以下实施例中所述的共同格1)。如果第1次缓存的第二预览图像与第2次缓存的第二预览图像存在相同的拍摄区域1,则判断第3次缓存的第二预览图像2与该共同格1是否存在相同的拍摄区域(即以下实施例中所述的共同格2)。以此类推,判断是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域。其中,如果第1次缓存的第二预览图像1与第2次缓存的第二预览图像2不存在相同的拍摄区域,则从第2次缓存的第二预览图像2开始,判断是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域。例如,上述第二预设周期的时间长度可以为0.4s、0.5s、0.6s或者1s等任一时长。
示例性的,手机100判断是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域的方法可以包括S1803a-S1803e:
S1803a、手机100对比第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1,判断第二预览图像j与第二预览图像j-1是否包括相同的拍摄区域(称为共同格j-1)。
其中,j为整数,j按照由小到大的顺序依次在{1,2,……,K}中取值,K为整数。示例性的,S1803a可以包括S1-S3。
S1、手机100将第j-1次缓存的第二预览图像j-1划分为Q格图像,并将第j次缓存的第二预览图像j划分为Q格图像,Q≥1,Q为整数。
示例性的,以手机100将第j次缓存的第二预览图像j划分为Q格图像为例。手机100可以按照预设矩阵将第j次缓存的第二预览图像j划分为Q格图像。例如,假设预设矩阵为3*2矩阵,则手机100可以将第二预览图像j按照3行2列的方式平均划分为6格图像。又例如,假设预设矩阵为1*2矩阵,则手机100可以将第二预览图像j按照1行2列的方式平均划分为2格图像。又例如,假设预设矩阵为2*1矩阵,则手机100可以将第二预览图像j按照2行1列的方式平均划分为2格图像。
S2、手机100获取第二预览图像j-1的Q格图像中的每格图像与第二预览图像j的Q格图像中的每格图像的图像相关系数。该图像相关系数用于表征两格图像的相似度。
其中,两格图像的图像相关系数的取值范围为[0,1]。两格图像的图像相关系数越接近于1,则表示这两格图像的相似度越高,这两格图像包括相同的拍摄区域的可能性越高。两格图像的图像相关系数越接近于0,则表示者两格图像的相似度越低,这两格图像包括相同的拍摄区域的可能性越低。
示例性的,假设Q=2,手机100执行S2可以得到表2所示的4个图像相关系数,如图像相关系数1、图像相关系数2、图像相关系数3和图像相关系数4。
例如,手机100可以对比第二预览图像j-1的第1格图像与第二预览图像j的第1格图像,得到表2所示的第二预览图像j-1的第1格图像与第二预览图像j的第1格图像的图像相关系数1。手机100可以对比第二预览图像j-1的第1格图像与第二预览图像j的第2格图像,得到表2所示的第二预览图像j-1的第1格图像与第二预览图像j的第2格图像的图像相关系数2。手机100可以对比第二预览图像j-1的第2格图像与第二预览图像j的第1格图像,得到表2所示的第二预览图像j-1的第2格图像与第二预览图像j的第1格图像的图像相关系数3。手机100可以对比第二预览图像j-1的第2格图像与第二预览图像j的第2格图像,得到表2所示的第二预览图像j-1的第2格图像与第二预览图像j的第2格图像的图像相关系数4。
表2
第二预览图像j-1 第二预览图像j 图像相关系数 是否共同格j-1
第1格图像 第1格图像 图像相关系数1(>R)
第1格图像 第2格图像 图像相关系数2(≤R)
第2格图像 第1格图像 图像相关系数3(>R)
第2格图像 第2格图像 图像相关系数4(>R)
举例来说,本申请实施例这里以手机100对比第一格图像和第二格图像,得到第一格图像与第二格图像的图像相关系数为例,介绍S2中手机100获取图像相关系数的方法。
其中,第一格图像可以是手机100分割得到的任一格图像,第二格图像可以是手机100分割得到的任一格图像。该第一格图像和第二格图像不同。具体的,手机100可以分别计算第一格图像的直方图数据和第二格图像的直方图数据;然后,手机100可以根据第一格图像的直方图数据和第二格图像的直方图数据,计算第一格图像与第二格图像的图像相关系数。
需要说明的是,第一格图像与第二格图像的图像相关系数的取值范围为[0,1]。第一 格图像与第二格图像的图像相关系数越接近于1,则表示第一格图像与第二格图像的相似度越高;第一格图像与第二格图像的图像相关系数越接近于0,则表示第一格图像与第二格图像的相似度越低。
手机100计算第一格图像的直方图数据和第二格图像的直方图数据的方法,以及根据第一格图像的直方图数据和第二格图像的直方图数据,计算第一格图像与第二格图像的图像相关系数的方法,可以参考常规技术中的相关描述,本申请实施例这里不予赘述。
S3、手机100判断第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的Q*Q个图像相关系数中是否有至少一个图像相关系数大于预设相似度阈值。
示例性的,预设相似度阈值可以在(0.5,1)中取值。例如,预设相似度阈值可以为0.7、0.6、0.8、0.75等任一数值。
其中,如果第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的Q*Q个图像相关系数中有至少一个图像相关系数大于预设相似度阈值,则表示第二预览图像j与第二预览图像j-1包括相同的拍摄区域(称为共同格j-1)。
例如,当j=2时,第二预览图像1与第二预览图像2中相同的拍摄区域可以称为共同格1,如第一共同格。例如,当j=3时,第二预览图像2与第二预览图像3中相同的拍摄区域可以称为共同格2,如第二共同格。
如果第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的Q*Q个图像相关系数均小于或等于预设相似度阈值,则表示第二预览图像j与第二预览图像j-1不包括相同的拍摄区域。
例如,表2所示的图像相关系数1、图像相关系2和图像相关系数4均大于预设相似度阈值R。表2所示的图像相关系数3小于或等于预设相似度阈值R。由表2可知,第二预览图像j-1与第二预览图像j包括相同的拍摄区域(即共同格j-1)。具体的,第二预览图像j-1与第二预览图像j包括3个共同格j-1。
具体的,在S1803a之后,如果第二预览图像j与第二预览图像j-1不包括相同的拍摄区域(即共同格j-1),手机100则可以对比第j+1次缓存的第二预览图像j+1与第j次缓存的第二预览图像j,判断第二预览图像j+1与第二预览图像j是否包括相同的拍摄区域。也就是说,手机100可以从第j次缓存的第二预览图像j开始,进行下一轮“是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域”的判断。
其中,“手机100对比第二预览图像j+1与第二预览图像j,判断第二预览图像j+1与第二预览图像j是否包括相同的拍摄区域”的方法,可以参考上述实施例对S1803a的介绍,本申请实施例这里不予赘述。
在S1803a之后,如果第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1包括相同的拍摄区域(即共同格j-1),手机100则可以执行S1803b。
S1803b、手机100对比第j+1次缓存的第二预览图像j+1与共同格j-1,判断第j+1次缓存的第二预览图像j+1与共同格j-1是否包括相同的拍摄区域(称为共同格j)。
其中,j为整数,j按照由小到大的顺序依次在{1,2,……,K}中取值,K为整数。示例性的,S1803b可以包括Si-Siii。
Si、手机100将第j+1次缓存的第二预览图像j+1划分为Q格图像,Q≥1,Q为整数。
其中,手机100将第j+1次缓存的第二预览图像j+1划分为Q格图像的方法,可以参 考上述实施例对S1的详细介绍,本申请实施例这里不予赘述。
Sii、手机100获取第二预览图像j+1的Q格图像中的每格图像与每个共同格j-1的图像相关系数。该图像相关系数用于表征两格图像的相似度。
示例性的,假设Q=2,如表2所示,第二预览图像j-1与第二预览图像j包括3个共同格j-1。如此。手机100执行Sii可以得到6个图像相关系数,如图像相关系数A、图像相关系数B、图像相关系数C、图像相关系数D、图像相关系数E、图像相关系数F。
例如,手机100可以对比第二预览图像j+1的第1格图像与第1个共同格j-1,得到表3所示的第二预览图像j+1的第1格图像与第1个共同格j-1的图像相关系数A。手机100可以对比第二预览图像j+1的第1格图像与第2个共同格j-1,得到表3所示的第二预览图像j+1的第1格图像与第2个共同格j-1的图像相关系数B。手机100可以对比第二预览图像j+1的第1格图像与第3个共同格j-1,得到表3所示的第二预览图像j+1的第1格图像与第3个共同格j-1的图像相关系数C。手机100可以对比第二预览图像j+1的第2格图像与第1个共同格j-1,得到表3所示的第二预览图像j+1的第2格图像与第1个共同格j-1的图像相关系数D。手机100可以对比第二预览图像j+1的第2格图像与第2个共同格j-1,得到表3所示的第二预览图像j+1的第2格图像与第2个共同格j-1的图像相关系数E。手机100可以对比第二预览图像j+1的第2格图像与第3个共同格j-1,得到表3所示的第二预览图像j+1的第2格图像与第3个共同格j-1的图像相关系数F。
表3
第二预览图像j+1 共同格j-1 图像相关系数 是否共同格j
第1格图像 第1个共同格j-1 图像相关系数A(>R)
第1格图像 第2个共同格j-1 图像相关系数B(≤R)
第1格图像 第3个共同格j-1 图像相关系数C(≤R)
第2格图像 第1个共同格j-1 图像相关系数D(≤R)
第2格图像 第2个共同格j-1 图像相关系数E(≤R)
第2格图像 第3个共同格j-1 图像相关系数F(>R)
Siii、手机100判断第二预览图像j+1的Q格图像与共同格j-1的图像相关系数中是否有至少一个图像相关系数大于预设相似度阈值。
其中,如果第二预览图像j+1的Q格图像与共同格j-1的图像相关系数中是否有至少一个图像相关系数大于预设相似度阈值,则表示第二预览图像j+1与共同格j-1包括相同的拍摄区域(称为共同格j)。
例如,当j=2时,第二预览图像3与共同格1中相同的拍摄区域可以称为共同格2,如第二共同格。如表3所示,2个图像相关系数大于预设相似度阈值R,存在两个第二共同格。
如果第二预览图像j-1的Q格图像与第二预览图像j的Q格图像的Q*Q个图像相关系数均小于或等于预设相似度阈值,则表示第二预览图像j与第二预览图像j-1不包括相同的拍摄区域。
具体的,在S1803b之后,如果第j+1次缓存的第二预览图像j+1与共同格j-1不包括相同的拍摄区域(即共同格j),手机100则可以对比第j+2次缓存的第二预览图像与第j+1次缓存的第二预览图像j+1,判断第j+2次缓存的第二预览图像j+2与第j+1次缓存的第二 预览图像j+1是否包括相同的拍摄区域。也就是说,手机100可以从第j+1次缓存的第二预览图像j+1开始,进行下一轮“是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域”的判断。
其中,“手机100对比第j+2次缓存的第二预览图像与第j+1次缓存的第二预览图像j+1,判断第j+2次缓存的第二预览图像j+2与第j+1次缓存的第二预览图像j+1是否包括相同的拍摄区域”的方法,可以参考上述实施例对S1803a的介绍,本申请实施例这里不予赘述。
在S1803b之后,如果第j+1次缓存的第二预览图像j+1与共同格j-1包括相同的拍摄区域(即共同格j),手机100则可以执行S1803c。
S1803c、手机100对比第j+2次缓存的第二预览图像j与共同格j,判断第j+2次缓存的第二预览图像与共同格j是否包括相同的拍摄区域(称为共同格j+1)。
具体的,在S1803c之后,如果第j+2次缓存的第二预览图像j+2与共同格j不包括相同的拍摄区域(即共同格j+1),手机100则可以对比第j+3次缓存的第二预览图像j+3与第j+2次缓存的第二预览图像j+2,判断第j+3次缓存的第二预览图像j+3与第j+2次缓存的第二预览图像j+2是否包括相同的拍摄区域。也就是说,手机100可以从第j+2次缓存的第二预览图像j+2开始,进行下一轮“是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域”的判断。
其中,“手机100对比第j+3次缓存的第二预览图像与第j+2次缓存的第二预览图像j+2,判断第j+3次缓存的第二预览图像j+3与第j+2次缓存的第二预览图像j+2是否包括相同的拍摄区域”的方法,可以参考上述实施例对S1803a的介绍,本申请实施例这里不予赘述。
在S1803c之后,如果第j+2次缓存的第二预览图像j+2与共同格j包括相同的拍摄区域(即共同格j+1),手机100则可以对比第j+3次缓存的第二预览图像j+3与共同格j+1,判断第j+3次缓存的第二预览图像j+3与共同格j+1是否包括相同的拍摄区域(称为共同格j+2)。如此循环往复,假设在连续K-1个第二预设周期缓存的第二预览图像均包括相同的拍摄区域。也就是说,如果第K-1次缓存的第二预览图像K-1与共同格K-3包括相同的拍摄区域(即共同格K-2),手机100则可以执行S1803d。
S1803d、手机100对比第K次缓存的第二预览图像K与共同格K-2,判断第K次缓存的第二预览图像与共同格K-2是否包括相同的拍摄区域(称为共同格K-1)。
具体的,在S1803d之后,如果第K次缓存的第二预览图像K与共同格K-2不包括相同的拍摄区域(即共同格K-1),手机100则可以对比第K+1次缓存的第二预览图像K+1与第K次缓存的第二预览图像K,判断第K+1次缓存的第二预览图像K+1与第K次缓存的第二预览图像K是否包括相同的拍摄区域。也就是说,手机100可以从第K次缓存的第二预览图像K开始,进行下一轮“是否存在连续的K个周期缓存的第二预设图像包括相同的拍摄区域”的判断。
其中,“手机100对比第K+1次缓存的第二预览图像K+1与第K次缓存的第二预览图像K,判断第K+1次缓存的第二预览图像K+1与第K次缓存的第二预览图像K是否包括相同的拍摄区域”的方法,可以参考上述实施例对S1803a的介绍,本申请实施例这里不予赘述。
在S1803d之后,如果第K次缓存的第二预览图像K与共同格K-2包括相同的拍摄区域(即共同格K-1),手机100则可以执行S1803e。
S1803e、手机100确定共同格K-1对应的拍摄区域为包括目标对象的图像的待拍摄区域,即从第二预览图像中锁定目标对象。
其中,S1803所示的第三界面包括放大的待拍摄区域,S1803中所述的预览图像是与上述待拍摄区域对应的预览图像。S1803中的手机100的初始位姿信息可以用于指示连续的K个周期缓存的第二预设图像包括相同的拍摄区域,且目标对象的图像的完整度大于预设完整度阈值时手机100的运动状态和位置。应理解,连续的K个周期缓存的第二预设图像包括相同的拍摄区域,且目标对象的图像的完整度大于预设完整度阈值时,手机100可以采集到的较为完整的目标区域的图像的可能性较高。因此,手机100此时的位姿信息作为初始位姿信息。手机100获取初始位姿信息的方法,可以参考上述实施例中的详细描述,本申请实施例这里不予赘述。
在一些实施例中,手机100从第二预览图像中确定包括目标对象的图像的待拍摄区域时,还需要考虑目标对象的图像的完整性。
S1804、手机100获取手机100的实时位姿信息,该实时位姿信息用于指示手机100的实时的运动状态和位置。
其中,S1804的详细描述可以参考上述实施例对S403的相关介绍,本申请实施例这里不予赘述。
S1805、手机100根据实时位姿信息与初始位姿信息,发出第一提示信息。该第一提示信息用于提示用户移动手机100,使手机100处于初始位姿信息所指示的运动状态和位置。
例如,手机100可以显示图20中的(a)所示的第三界面2001,该第三界面2001包括第一提示信息2002,如“请向左移动手机!”。其中,S1805所述的第三界面可以参考S404所述的第三界面,S1805所述的第一提示信息可以参考S404所述的第一提示信息,本申请实施例这里不予赘述。
S1806、手机100响应于用户的拍照操作,显示包括第三预览图像和第四预览图像的第四界面。第四预览图像是响应于拍照操作而拍摄的图像,第三预览图像是摄像头采集的多帧第二预览图像中图像参数最高的图像。
例如,手机100可以接收用户在图20中的(b)所示的拍照操作。响应于图20中的(b)所示的拍照操作,手机100可以显示图20中的(c)所示的第四界面2003。第四界面2003包括第四预览图像2004和第三预览图像2005。
S1807、手机100响应于用户对第四界面中的第四预览图像和/或第三预览图像的选择,保存用户选择的预览图像。
例如,手机100可以接收用户对图20中的(c)所示的第四预览图像2004和第三预览图像2005中至少一个预览图像的选择操作。
其中,S1806和S1807所述的第四预览图像相当于S405和S406所示的第四预览图像。手机100获取S1806所述的第四预览图像的方法,可以参考手机100获取S405所示的第四预览图像的方法,本申请实施例这里不予赘述。S1806和S1807所述的第三预览图像相当于S405和S406所示的第三预览图像,S1806和S1807所述的第四界面相当于S405和S406所示的第三界面。
本申请实施例提供一种高倍率拍摄方法,手机100可以响应于用户的变焦操作可以 进入高变焦倍率拍摄场景,并自动锁定需要高倍率拍摄的拍摄对象,放大显示该拍摄对象的预览图像(称为初始预览图像),并获取手机100的初始状态和初始位置。如此,则无需用户手动调整放大变焦倍率,可以减少用户手动操作引起的抖动。
之后,手机100可以获取该手机100的实时状态和实时位置,根据该实时状态和实时位置,提醒用户纠正手机100的位置和姿态,以便手机100可以保持在上述初始状态和初始位置或者临近初始状态和初始位置的状态。此时,手机100锁定的拍摄对象是用户想要拍摄的对象。也就是说,手机100可以在摄像头的拍摄区域偏离初始预览图像对应的拍摄区域时,提醒用户纠正手机100的位置和姿态,以便手机100可以保持在初始状态和初始位置所指示的位置和姿态,可以保证手机100能够拍摄到用户想要的拍摄对象。
最后,手机100可以响应于用户的拍照操作,将上述初始预览图像和用户手动拍摄的预览图像同时显示出来,由用户选择需要的照片来保存。如此,手机100可以按照用户的需求,拍摄到用户满意的照片。
本申请另一些实施例提供了一种电子设备,该电子设备可以包括:存储器、一个或多个摄像头和一个或多个处理器。
上述存储器、摄像头与处理器耦合。上述存储器中存储有计算机程序代码,该计算机程序代码包括计算机指令。当上述计算机指令被处理器执行时,使得电子设备执行如上述方法实施例中手机执行的各个功能或者步骤。该电子设备的结构可以参考图3所示的电子设备300的结构。
本申请实施例还提供一种芯片系统,如图21所示,该芯片系统2100包括至少一个处理器2101和至少一个接口电路2102。
上述处理器2101和接口电路2102可通过线路互联。例如,接口电路2102可用于从其它装置(例如电子设备的存储器)接收信号。又例如,接口电路2102可用于向其它装置(例如处理器2101)发送信号。示例性的,接口电路2102可读取存储器中存储的指令,并将该指令发送给处理器2101。当所述指令被处理器2101执行时,可使得电子设备执行上述实施例中手机210执行的各个步骤。当然,该芯片系统还可以包含其他分立器件,本申请实施例对此不作具体限定。
本申请实施例还提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在上述电子设备上运行时,使得该电子设备执行上述方法实施例中手机100执行的各个功能或者步骤。
本申请实施例还提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行上述方法实施例中手机100执行的各个功能或者步骤。例如,该计算机可以是上述手机100。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既 可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请实施例的具体实施方式,但本申请实施例的保护范围并不局限于此,任何在本申请实施例揭露的技术范围内的变化或替换,都应涵盖在本申请实施例的保护范围之内。因此,本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (19)

  1. 一种高倍率拍摄方法,其特征在于,所述方法应用于电子设备,所述电子设备包括摄像头,所述方法包括:
    所述电子设备显示第一界面,所述第一界面是所述电子设备拍照的取景界面,所述第一界面包括所述摄像头在变焦倍率为m时采集的第一预览图像,所述第一预览图像包括目标对象的图像,且所述目标对象的图像处于所述第一预览图像的中心位置;
    所述电子设备响应于用户对所述第一界面中所述目标对象的图像的第一操作,显示第二界面,获取并保存所述电子设备的初始位姿信息,所述第二界面包括所述摄像头在变焦倍率为n时采集的第二预览图像,所述第二预览图像包括所述目标对象的图像,n>m;所述初始位姿信息用于指示所述电子设备接收到所述第一操作时的运动状态和位置;
    所述电子设备获取所述电子设备的实时位姿信息,所述实时位姿信息用于指示所述电子设备实时的运动状态和位置;
    所述电子设备根据所述实时位姿信息与所述初始位姿信息,发出第一提示信息,所述第一提示信息用于提示用户移动所述电子设备,使所述电子设备处于所述初始位姿信息所指示的运动状态和位置;
    所述电子设备响应于用户的拍照操作,显示第三界面,所述第三界面包括第三预览图像和第四预览图像,所述第三预览图像是所述摄像头采集的多帧第二预览图像中图像参数最高的图像,所述图像参数包括清晰度和/或完整度,所述第四预览图像是响应于所述拍照操作而拍摄的图像;
    所述电子设备响应于用户对所述第三预览图像和/或所述第四预览图像的选择操作,保存用户选择的预览图像。
  2. 根据权利要求1所述的方法,其特征在于,在所述电子设备显示第一界面之前,所述方法还包括:
    所述电子设备显示第四界面,所述第四界面是所述电子设备拍照的取景界面,所述第四界面包括所述摄像头在变焦倍率为时采集的第五预览图像,所述第五预览图像包括所述目标对象的图像;
    所述电子设备响应于用户在所述第四界面的第二操作,在所述第四界面发出第二提示信息,所述第二操作是用户对所述目标对象的图像的选择操作,所述第二提示信息用于指示用户移动所述电子设备使所述目标对象的图像处于所述第五预览图像的中心位置。
  3. 根据权利要求1所述的方法,其特征在于,所述电子设备还包括所述摄像头的角度调节装置,所述角度调节装置用于调整所述摄像头的拍摄角度,使所述摄像头在预设角度范围内转动;
    在所述电子设备显示第一界面之前,所述方法还包括:
    所述电子设备显示第四界面,所述第四界面是所述电子设备拍照的取景界面,所述第四界面包括所述摄像头在变焦倍率为1时采集的第五预览图像,所述第五预览图像包括所述目标对象的图像;
    所述电子设备响应于用户在所述第四界面的第二操作,调整所述摄像头的拍摄角 度,使所述目标对象的图像处于所述第五预览图像的中心位置。
  4. 根据权利要求2或3所述的方法,其特征在于,在所述电子设备显示第一界面之前,所述电子设备显示第四界面之后,所述方法还包括:
    所述电子设备发出第三提示信息,所述第三提示信息用于提示用户所述目标对象的图像已处于所述第五预览图像的中心位置。
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,所述电子设备响应于用户在所述第一界面的第一操作,显示第二界面,获取并保存所述电子设备的初始位姿信息,包括:
    所述电子设备响应于所述第一操作,从所述第一预览图像中确定包括所述目标对象的图像的待拍摄区域,以从所述第一预览图像中锁定所述目标对象;
    所述电子设备自动将所述变焦倍率调整为n,显示包括放大的所述待拍摄区域的所述第二界面,获取并保存所述电子设备的所述初始位姿信息。
  6. 根据权利要求5所述的方法,其特征在于,所述待拍摄区域为以所述第一操作与所述电子设备的触摸屏的接触区域为矩形的中心,以预设的长和宽形成的矩形区域;或者,所述待拍摄区域为采集图像识别技术识别出的包括所述目标对象的矩形区域;
    所述电子设备自动将所述变焦倍率调整为n,显示包括放大的所述待拍摄区域的所述第二界面,获取并保存所述电子设备的所述初始位姿信息,包括:
    所述电子设备适配所述电子设备的触摸屏的尺寸或者触摸屏的取景框的尺寸,自动将所述变焦倍率调整为n,将所述待拍摄区域中所述目标对象的图像放大,使所述目标对象的图像占满所述电子设备的触摸屏的取景框。
  7. 根据权利要求6所述的方法,其特征在于,所述电子设备包括陀螺仪传感器和加速度传感器,所述陀螺仪传感器和所述加速度传感器用于采集所述电子设备的所述初始位姿信息和所述实时位姿信息。
  8. 根据权利要求1-7中任一项所述的方法,其特征在于,在所述电子设备根据所述实时位姿信息与所述初始位姿信息,在所述第二界面发出第一提示信息之后,所述电子设备响应于用户的拍照操作,显示第三界面之前,所述方法还包括:
    所述电子设备发出第四提示信息,所述第四提示信息用于指示所述电子设备已回到所述初始位姿信息所指示的运动状态和位置。
  9. 根据权利要求1-8中任一项所述的方法,其特征在于,所述电子设备响应于用户在所述第一界面的第一操作,显示第二界面,包括:
    所述电子设备响应于用户在所述第一界面的第三操作,发出第五提示信息,所述第五提示信息用于指示用户选择所述摄像头的变焦倍率;
    所述电子设备响应于用户对所述变焦倍率n的选择操作,显示第六界面,所述第六界面包括所述电子设备的摄像头在变焦倍率为n时采集的第六预览图像,所述第六预览图像包括所述目标对象的图像;
    所述电子设备响应于用户在所述第六界面的所述第一操作,显示所述第二界面。
  10. 根据权利要求9所述的方法,其特征在于,所述第六界面还包括预设调整控件,所述预设调整控件用于调整所述摄像头的变焦倍率,所述预设调整控件还用于指示所述摄像头当前的变焦倍率。
  11. 根据权利要求1-10中任一项所述的方法,其特征在于,所述发出第一提示信息,包括:
    所述电子设备在所述第二界面显示所述第一提示信息。
  12. 根据权利要求1-11中任一项所述的方法,其特征在于,在所述所述电子设备响应于用户的拍照操作,显示第三界面,所述第三界面包括第三预览图像和第五预览图像之前,所述方法还包括:
    所述电子设备周期性缓存所述摄像头采集的第二预览图像,直至缓存到所述摄像头采集的第p个第二预览图像,所述第二预览图像是所述第二界面和所述第三界面显示的预览图像,p≥2,p为整数;
    所述电子设备对比第i次缓存的第二预览图像i与第i-1个第七预览图像,得到并缓存第i个第七预览图像;其中,i按照由小到大的顺序依次在{1,2,……,p}中取值,i为整数;所述第i个第七预览图像是所述第二预览图像i与所述第i-1个第七预览图像中图像参数最高的预览图像;所述图像参数包括清晰度和/或完整度,所述完整度为预览图像中包括的目标对象的图像在所述目标对象的完整图像中的占比;第1个第七预览图像为第1次缓存的第二预览图像1;
    所述电子设备将第p个第七预览图像作为所述第三预览图像。
  13. 一种高倍率拍摄方法,其特征在于,所述方法应用于电子设备,所述电子设备包括摄像头,所述方法包括
    所述电子设备显示第一界面,所述第一界面是所述电子设备拍照的取景界面,所述第一界面包括所述摄像头在变焦倍率为m时采集的第一预览图像,所述第一预览图像包括目标对象的图像;
    所述电子设备响应于用户在所述第一界面的变焦操作,显示第二界面,所述第二界面包括所述摄像头在变焦倍率为n时采集的第二预览图像,n>m;所述变焦操作用于触发所述电子设备将所述摄像头的变焦倍率调整为n;
    所述电子设备周期性实时缓存所述第二预览图像;
    若存在连续的K个周期缓存的所述第二预设图像包括相同的拍摄区域,且所述相同的拍摄区域中所述目标对象的图像的完整度大于预设完整度阈值,则所述电子设备显示第三界面,且获取并保存所述电子设备的初始位姿信息;其中,所述第三界面包括所述摄像头在变焦倍率为m时采集的包括所述目标对象的图像;所述初始位姿信息用于指示连续的K个周期缓存的所述第二预设图像包括相同的拍摄区域,且所述目标对象的图像的完整度大于预设完整度阈值时所述电子设备的运动状态和位置,K≥2,K为整数;
    所述电子设备获取所述电子设备的的实时位姿信息,所述实时位姿信息用于指示所述电子设备的实时的运动状态和位置;
    所述电子设备根据所述实时位姿信息与所述初始位姿信息,发出第一提示信息,所述第一提示信息用于提示用户移动所述电子设备,使所述电子设备处于所述初始位姿信息所指示的运动状态和位置;
    所述电子设备响应于用户的拍照操作,显示包括第三预览图像和第四预览图像的第四界面,所述第四预览图像是响应于所述拍照操作而拍摄的图像,所述第三预览图 像是所述摄像头采集的多帧第二预览图像中图像参数最高的图像,所述图像参数包括清晰度和/或完整度;
    所述电子设备响应于用户对所述第四界面中的所述第三预览图像和/或所述第四预览图像的选择,保存用户选择的预览图像。
  14. 根据权利要求13所述的方法,其特征在于,所述发出第一提示信息,包括:
    所述电子设备在所述第三界面显示所述第一提示信息。
  15. 根据权利要求13或14所述的方法,其特征在于,所述若存在连续的K个周期缓存的所述第二预设图像包括相同的拍摄区域,所述电子设备则显示第三界面,包括:
    所述电子设备对比第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1,判断所述第二预览图像j与所述第二预览图像j-1是否存在共同格j-1,所述共同格j-1为所述第二预览图像j与所述第二预览图像j-1中相同的拍摄区域;其中,j为整数,j按照由小到大的顺序依次在{2,……,K}中取值;
    若所述第二预览图像j与所述第二预览图像j-1存在所述共同格j-1,所述电子设备则对比上述第j+1次缓存的第二预览图像j+1与所述共同格j-1,判断所述第j+1次缓存的第二预览图像j+1与所述共同格j-1是否存在共同格j;所述共同格j是为所述第二预览图像j+1与所述共同格j-1中相同的拍摄区域;
    若所述第j+1次缓存的第二预览图像j+1与所述共同格j-1存在所述共同格j,所述电子则对比所述第j+2次缓存的第二预览图像j+2与所述共同格j,判断第j+2次缓存的第二预览图像j+2与所述共同格j是否存在共同格j+1,所述共同格j+1为所述第二预览图像j+2与所述共同格j中相同的拍摄区域;
    如此循环执行,如果第K-1次缓存的第二预览图像K-1与共同格K-3存在共同格K-2,所述电子设备则对比第K次缓存的第二预览图像K与所述共同格K-2,判断所述第二预览图像K与所述共同格K-2是否存在共同格K-1;其中,所述共同格K-1为所述第二预览图像K与所述共同格K-2中相同的拍摄区域;
    如果所述第二预览图像K与所述共同格K-2存在所述共同格K-1,所述电子设备则将所述共同格K-1对应的拍摄区域确定为包括所述目标对象的图像的待拍摄区域,显示所述第三界面;其中,所述第三界面包括所述待拍摄区域对应的预览图像。
  16. 根据权利要求15所述的方法,其特征在于,所述电子设备对比第j次缓存的第二预览图像j与第j-1次缓存的第二预览图像j-1,判断所述第二预览图像j与所述第二预览图像j-1是否存在共同格j-1,包括:
    所述电子设备将所述第j-1次缓存的第二预览图像j-1划分为Q格图像,并将所述第j次缓存的第二预览图像j划分为Q格图像,Q≥1,Q为整数;
    所述电子设备获取所述第二预览图像j-1的Q格图像中的每格图像与所述第二预览图像j的Q格图像中的每格图像的图像相关系数;其中,所述图像相关系数用于表征两格图像的相似度,所述图像相关系数的取值范围为[0,1],所述两格图像的图像相关系数越大,则所述两格图像的相似度越高;所述两格图像的图像相关系数越小,则所述两格图像的相似度越低;
    所述电子设备判断所述第二预览图像j-1的Q格图像与所述第二预览图像j的Q格图像的多个图像相关系数中是否有至少一个图像相关系数大于预设相似度阈值;
    其中,如果所述第二预览图像j-1的Q格图像与所述第二预览图像j的Q格图像的多个图像相关系数中至少一个图像相关系数大于所述预设相似度阈值,则表示所述第二预览图像j与所述第二预览图像j-1存在所述共同格j-1;如果所述第二预览图像j-1的Q格图像与所述第二预览图像j的Q格图像的多个图像相关系数均小于或等于所述预设相似度阈值,则表示所述第二预览图像j与所述第二预览图像j-1不存在所述共同格j-1。
  17. 根据权利要求16所述的方法,其特征在于,所述电子设备获取所述第二预览图像j-1的Q格图像中的每格图像与所述第二预览图像j的Q格图像中的每格图像的图像相关系数,包括:
    所述电子设备获取第一格图像的直方图数据和第二格图像的直方图数据;其中,所述第一格图像是所述第二预览图像j-1的Q格图像中的一格图像,所述第二格图像是所述第二预览图像j的Q格图像中的一格图像;
    所述电子设备根据所述第一格图像的直方图数据和所述第二格图像的直方图数据,计算所述第一格图像与所述第二格图像的图像相关系数。
  18. 一种电子设备,其特征在于,所述电子设备包括存储器、一个或多个摄像头和一个或多个处理器;所述存储器、所述摄像头与所述处理器耦合;其中,所述摄像头用于采集图像,所述存储器中存储有计算机程序代码,所述计算机程序代码包括计算机指令,当所述计算机指令被所述处理器执行时,使得所述电子设备执行如权利要求1-17任一项所述的方法。
  19. 一种计算机可读存储介质,其特征在于,包括计算机指令,当所述计算机指令在训练平台上运行时,使得所述电子设备执行如权利要求1-17中任一项所述的方法。
PCT/CN2022/074838 2021-05-19 2022-01-28 一种高倍率拍摄方法及电子设备 WO2022242230A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/909,368 US20240196085A1 (en) 2021-05-19 2022-01-28 High-magnification photographing method and electronic device
EP22757192.4A EP4113974A4 (en) 2021-05-19 2022-01-28 HIGH MAGNIFICATION PHOTOGRAPHY METHOD AND ELECTRONIC DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110548528.2 2021-05-19
CN202110548528.2A CN113438410B (zh) 2021-05-19 2021-05-19 一种高倍率拍摄方法及电子设备

Publications (1)

Publication Number Publication Date
WO2022242230A1 true WO2022242230A1 (zh) 2022-11-24

Family

ID=77802602

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/074838 WO2022242230A1 (zh) 2021-05-19 2022-01-28 一种高倍率拍摄方法及电子设备

Country Status (4)

Country Link
US (1) US20240196085A1 (zh)
EP (1) EP4113974A4 (zh)
CN (1) CN113438410B (zh)
WO (1) WO2022242230A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113438410B (zh) * 2021-05-19 2022-06-17 荣耀终端有限公司 一种高倍率拍摄方法及电子设备
CN115103126B (zh) * 2022-07-22 2024-06-04 维沃移动通信有限公司 拍摄预览方法、装置、电子设备及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252804A (ja) * 2000-12-21 2002-09-06 Olympus Optical Co Ltd 電子カメラ
CN101702752A (zh) * 2009-11-13 2010-05-05 天津三星光电子有限公司 实现数码相机预拍功能的方法
CN106464799A (zh) * 2015-03-27 2017-02-22 华为技术有限公司 一种自动变焦的方法和装置
US20190045135A1 (en) * 2017-08-03 2019-02-07 Lg Electronics Inc. Electronic device and method for controlling of the same
CN110445978A (zh) * 2019-06-24 2019-11-12 华为技术有限公司 一种拍摄方法及设备
CN111010506A (zh) * 2019-11-15 2020-04-14 华为技术有限公司 一种拍摄方法及电子设备
CN113438410A (zh) * 2021-05-19 2021-09-24 荣耀终端有限公司 一种高倍率拍摄方法及电子设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10089534B2 (en) * 2016-12-16 2018-10-02 Adobe Systems Incorporated Extracting high quality images from a video
CN107155059A (zh) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 一种图像预览方法及终端

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252804A (ja) * 2000-12-21 2002-09-06 Olympus Optical Co Ltd 電子カメラ
CN101702752A (zh) * 2009-11-13 2010-05-05 天津三星光电子有限公司 实现数码相机预拍功能的方法
CN106464799A (zh) * 2015-03-27 2017-02-22 华为技术有限公司 一种自动变焦的方法和装置
US20190045135A1 (en) * 2017-08-03 2019-02-07 Lg Electronics Inc. Electronic device and method for controlling of the same
CN110445978A (zh) * 2019-06-24 2019-11-12 华为技术有限公司 一种拍摄方法及设备
CN111010506A (zh) * 2019-11-15 2020-04-14 华为技术有限公司 一种拍摄方法及电子设备
CN113438410A (zh) * 2021-05-19 2021-09-24 荣耀终端有限公司 一种高倍率拍摄方法及电子设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4113974A4 *

Also Published As

Publication number Publication date
CN113438410A (zh) 2021-09-24
CN113438410B (zh) 2022-06-17
EP4113974A1 (en) 2023-01-04
US20240196085A1 (en) 2024-06-13
EP4113974A4 (en) 2023-10-11

Similar Documents

Publication Publication Date Title
WO2021093793A1 (zh) 一种拍摄方法及电子设备
WO2022068537A1 (zh) 一种图像处理方法及相关装置
JP7450035B2 (ja) ビデオ撮影方法と電子装置
WO2021213477A1 (zh) 多路录像的取景方法、图形用户界面及电子设备
JP7355941B2 (ja) 長焦点シナリオにおける撮影方法および端末
KR101952684B1 (ko) 이동 단말기 및 이의 제어 방법, 이를 위한 기록 매체
WO2022242230A1 (zh) 一种高倍率拍摄方法及电子设备
KR20190014638A (ko) 전자 기기 및 전자 기기의 제어 방법
KR20150044295A (ko) 이동 단말기 및 그것의 제어 방법
KR20110055244A (ko) 디지털 촬영 장치 및 그 제어 방법 및 이를 실행하기 위한 프로그램을 저장한 기록매체
CN113596316B (zh) 拍照方法及电子设备
WO2021013147A1 (zh) 视频处理方法、装置、终端及存储介质
KR101951418B1 (ko) 이동 단말기 및 그의 오디오 줌잉방법
US20140210941A1 (en) Image capture apparatus, image capture method, and image capture program
CN116156314A (zh) 一种视频拍摄方法及电子设备
CN115484375A (zh) 拍摄方法及电子设备
CN117857920A (zh) 一种对焦方法和电子设备
CN115442509B (zh) 拍摄方法、用户界面及电子设备
WO2021185374A1 (zh) 一种拍摄图像的方法及电子设备
WO2023226634A1 (zh) 一种拍摄方法及电子设备
KR20220093246A (ko) 촬영 방법 및 전자 장치
WO2022228259A1 (zh) 一种目标追踪方法及相关装置
US11659268B2 (en) Imaging apparatus capable of automatically capturing image, control method, and recording medium
CN106993138B (zh) 时间渐变图像拍摄装置及方法
CN117479008B (zh) 一种视频处理方法、电子设备及芯片系统

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2022757192

Country of ref document: EP

Effective date: 20220829

WWE Wipo information: entry into national phase

Ref document number: 17909368

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE