WO2018053722A1 - Procédé et dispositif de capture de photo panoramique - Google Patents

Procédé et dispositif de capture de photo panoramique Download PDF

Info

Publication number
WO2018053722A1
WO2018053722A1 PCT/CN2016/099612 CN2016099612W WO2018053722A1 WO 2018053722 A1 WO2018053722 A1 WO 2018053722A1 CN 2016099612 W CN2016099612 W CN 2016099612W WO 2018053722 A1 WO2018053722 A1 WO 2018053722A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
angle
framing
mobile terminal
wide angle
Prior art date
Application number
PCT/CN2016/099612
Other languages
English (en)
Chinese (zh)
Inventor
雷振飞
王向东
孙伟
Original Assignee
北京小米移动软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京小米移动软件有限公司 filed Critical 北京小米移动软件有限公司
Priority to PCT/CN2016/099612 priority Critical patent/WO2018053722A1/fr
Priority to CN201680000893.7A priority patent/CN108141524A/zh
Publication of WO2018053722A1 publication Critical patent/WO2018053722A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present disclosure relates to the field of image capture, and in particular, to a method and apparatus for photographing a panoramic photo.
  • the panoramic shooting mode has become one of the necessary shooting modes in mobile terminals.
  • the present disclosure provides a method and apparatus for photographing a panoramic photo.
  • the technical solution is as follows:
  • a panoramic photo shooting method for a mobile terminal provided with a front camera and a rear camera, the method comprising:
  • the panoramic photo is synthesized according to the first image and the second image.
  • an angular speed sensor is disposed in the mobile terminal
  • Detecting whether the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold includes:
  • the method further includes:
  • first wide angle number is less than the second wide angle number, determining (180° - the first wide angle number) as the target rotation angle;
  • the (180° - second wide angle number) is determined as the target rotation angle.
  • the method further includes:
  • the image preview area is configured to display the first image and the second image acquired in real time, and the preview directions of the first image and the second image in different image preview areas are different;
  • the shooting progress is displayed in the image preview area according to the live view angle.
  • calculating a real-time viewing angle corresponding to each of the first image and the second image including:
  • the method further includes:
  • the prompt information is used to instruct the photographer to take a corrected photo, and the framing area corresponding to the corrected photo includes an area blocked by the photographer portrait in the panoramic photo;
  • the panoramic photo is corrected based on the corrected photo, and the corrected panoramic image does not include the portrait of the photographer.
  • a panoramic photo shooting device for a mobile terminal provided with a front camera and a rear camera, the device comprising:
  • the first acquiring module is configured to acquire a first image collected by the front camera and a second image collected by the rear camera, where the first image and the second image are collected during the rotation of the mobile terminal;
  • a detecting module configured to detect whether a sum of the framing angles of the first image and the second image reaches a preset framing angle threshold
  • a synthesizing module configured to synthesize the panoramic photo according to the first image and the second image when the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold.
  • an angular velocity sensor is disposed in the mobile terminal
  • Detection module including:
  • a first calculation submodule configured to calculate a rotation angle of the mobile terminal according to the angular velocity data collected by the angular velocity sensor
  • the detecting submodule is configured to detect whether the rotation angle reaches a target rotation angle, and the target rotation angle is determined according to a wide angle of the front camera and the rear camera;
  • the determining submodule is configured to determine that the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold when the rotation angle reaches the target rotation angle.
  • the device further includes:
  • a second acquiring module configured to acquire a first wide angle number of the front camera and a second wide angle number of the rear camera
  • a first determining module configured to determine (180° - the first wide angle number) as the target rotation angle when the first wide angle number is less than the second wide angle number;
  • the second determining module is configured to determine (180° - the second wide angle number) as the target rotation angle when the first wide angle number is greater than the second wide angle number.
  • the device further includes:
  • a third determining module configured to determine an image preview area corresponding to each of the first image and the second image, where the image preview area is used to display the first image and the second image acquired in real time, and the first image and the image in the different image preview area The preview direction of the second image is different;
  • a calculation module configured to calculate a real-time view angle corresponding to each of the first image and the second image
  • the first display module is configured to display a shooting progress in the image preview area according to the live view angle.
  • the computing module includes:
  • a second calculation sub-module configured to calculate a first live view angle corresponding to the first image according to the first wide angle number of the front camera and the real-time rotation angle
  • the third calculating submodule is configured to calculate a second live view angle corresponding to the second image according to the second wide angle number of the rear camera and the real time rotation angle.
  • the device further includes:
  • a second display module configured to display prompt information, the prompt information is used to instruct the photographer to take a repair a positive photo, the framing area corresponding to the corrected photo includes an area blocked by the photographer portrait in the panoramic photo;
  • a third obtaining module configured to obtain a corrected photo
  • the correction module is configured to correct the panoramic photo according to the corrected photo, and the corrected panoramic photo does not include the portrait of the photographer.
  • a panoramic photo taking device comprising:
  • processor a front camera and a rear camera electrically connected to the processor
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the panoramic photo is synthesized according to the first image and the second image.
  • the mobile terminal When taking a panoramic photo, the mobile terminal simultaneously enables the front camera and the rear camera, thereby acquiring the first image and the second image respectively by using the front camera and the rear camera during the rotation of the mobile terminal, and in the first image and When the sum of the framing angles of the second image reaches the panoramic angle, the first image and the second image are combined into a panoramic photo; compared to when the panoramic photo is taken only by the rear camera, the shooting angle is extremely large due to the large rotation angle of the mobile terminal It is easy to sway and affect the shooting quality of the panoramic photo.
  • the dual camera shooting and image synthesis technology can reduce the rotation angle of the mobile terminal during the shooting process, thereby improving the panoramic photo shooting efficiency and ensuring the stability of the mobile terminal during the panoramic shooting process. Sex, improve the quality of panoramic photos.
  • FIG. 1 is a schematic diagram of an implementation of a panoramic photo taken by a mobile terminal in the related art
  • FIG. 2 is a flow chart showing a method of photographing a panoramic photo provided by an exemplary embodiment
  • FIG. 3A is a flowchart showing a panoramic photo taking method provided by another exemplary embodiment
  • 3B to 3D are schematic diagrams showing an implementation of the method for photographing a panoramic photo shown in FIG. 3A;
  • 3E is a flow chart showing a process of displaying a shooting progress by the mobile terminal
  • FIG. 3F is a schematic diagram showing an interface of a panoramic photo shooting process
  • Figure 3G shows a flow chart of the panoramic photo correction process
  • 3H is a schematic diagram of an implementation of a panoramic photo correction process
  • FIG. 4 is a block diagram showing the structure of a panoramic photographing apparatus provided by an exemplary embodiment
  • FIG. 5 is a block diagram of a panoramic photo taking device according to an exemplary embodiment.
  • a “module” as referred to herein refers to a functional structure that is logically divided, and the “module” may be implemented by pure hardware or a combination of hardware and software.
  • Multiple as referred to herein means two or more. "and/or”, describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately.
  • the symbol “/” generally indicates that the contextual object is an "or" relationship.
  • Front camera The camera on the front of the mobile terminal is on the same plane as the display of the mobile terminal, and is often used for self-timer and video call.
  • Rear camera The camera on the back of the mobile terminal is on the same plane as the back cover of the mobile terminal, and is often used for photo shooting and video recording.
  • Viewing angle The framing range used to indicate the coverage of the image.
  • the larger the framing angle the larger the framing range of the image overlay.
  • the framing range covered by the image is 360° panorama.
  • Wide Angle A camera parameter that indicates the camera's lens angle of view. The higher the wide angle, The larger the lens angle of the camera, the larger the angle of view of the image captured by the camera; the lower the wide angle, the smaller the lens angle of the camera, and the smaller the angle of view of the image captured by the camera.
  • the panoramic photo shooting method provided by various embodiments of the present disclosure is used for a mobile terminal provided with a front camera and a rear camera, and the mobile terminal may be a smart phone, a tablet, an MP3 player (Moving Picture Experts Group Audio Layer III, dynamic The video specialist compresses the standard audio layer 3) and the MP4 (Moving Picture Experts Group Audio Layer IV) player and the like.
  • the mobile terminal may be a smart phone, a tablet, an MP3 player (Moving Picture Experts Group Audio Layer III, dynamic The video specialist compresses the standard audio layer 3) and the MP4 (Moving Picture Experts Group Audio Layer IV) player and the like.
  • MP3 player Moving Picture Experts Group Audio Layer III
  • the video specialist compresses the standard audio layer 3
  • MP4 Moving Picture Experts Group Audio Layer IV
  • the mobile terminal when a user uses a mobile terminal to take a panoramic photo, the mobile terminal performs image collection only through the rear camera 11 . Since the wide angle of the rear camera 11 is limited, the user needs to rotate the mobile terminal during shooting so that the rear camera achieves 360° framing during the rotation. As shown in FIG. 1, when the wide angle of the rear camera 11 is ⁇ , during the process of taking a panoramic photo, the user needs to rotate the mobile terminal from the position shown in FIG. 1(a) to the position shown in FIG. 1(b). The 360° framing of the rear camera 11 can be realized by rotating the mobile terminal 360°- ⁇ . Since the rotation angle is too large, the user takes a long time to complete the panoramic shooting, and when the mobile terminal is rotated at a large angle, the mobile terminal is inevitably shaken, resulting in poor quality of the panoramic photo.
  • the mobile terminal when the user takes a photo in the panoramic shooting mode, the mobile terminal simultaneously turns on the front camera and the rear camera, simultaneously uses the dual camera to perform framing, and synthesizes the images collected by the dual camera to obtain a panoramic photo. Therefore, the user only needs to rotate the mobile terminal to rotate a small angle to complete the shooting of the panoramic photo, thereby improving the shooting efficiency and the shooting quality of the panoramic photo.
  • the following description is made using the illustrative embodiments.
  • FIG. 2 shows a flow chart of a panoramic photo shooting method provided by an exemplary embodiment.
  • the embodiment of the present disclosure is exemplified by applying the panoramic photo shooting method to a mobile terminal.
  • the method of photographing a panoramic photo includes:
  • step 201 a first image acquired by the front camera and a second image collected by the rear camera are acquired, and the first image and the second image are collected during the rotation of the mobile terminal.
  • the mobile terminal In the panoramic shooting mode, the mobile terminal simultaneously turns on the front camera and the rear camera, and instructs the user to view the picture by rotating the mobile terminal. In the process of the user rotating the mobile terminal, the mobile terminal is Get real-time images captured by the front and rear cameras.
  • step 202 it is detected whether the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold.
  • the framing angle of the first image is the sum of the wide angle of the front camera and the rotation angle
  • the framing angle of the second image is the sum of the wide angle of the rear camera and the rotation angle
  • the first image and the second image The sum of the framing angles is (the wide angle of the front camera + the wide angle of the rear camera + 2 ⁇ rotation angle).
  • the preset viewing angle threshold is 360°
  • the preset viewing angle threshold is
  • step 203 if the sum of the framing angles of the first image and the second image reaches the preset framing angle threshold, the panoramic photo is synthesized according to the first image and the second image.
  • the mobile terminal determines to complete the 360° framing, and splicing the first image and the second image to synthesize the panoramic photo.
  • the mobile terminal when the panoramic photo is taken, the mobile terminal simultaneously enables the front camera and the rear camera, so that the front camera and the rear camera respectively acquire the first image and the rear camera during the process of rotating the mobile terminal.
  • a second image and when the sum of the framing angles of the first image and the second image reaches a panoramic angle, the first image and the second image are combined into a panoramic photo; compared to when the panoramic photo is taken only by the rear camera, due to the movement
  • the rotation angle of the terminal is large, which makes the shooting picture easy to shake and affect the shooting quality of the panoramic photo.
  • the dual camera shooting and image synthesis technology can reduce the rotation angle of the mobile terminal during shooting, thereby improving the panoramic photo shooting efficiency and ensuring the panoramic shooting process.
  • the stability of the mobile terminal improves the quality of panoramic photos.
  • the mobile terminal determines, according to the respective wide-angle parameters of the front camera and the rear camera, an angle at which the mobile terminal needs to rotate when the 360° framing is completed, and detects the real-time during the panoramic shooting process. Whether the current rotation angle reaches the angle and synthesizes the panoramic photo when the current rotation angle reaches the angle.
  • the mobile terminal determines, according to the respective wide-angle parameters of the front camera and the rear camera, an angle at which the mobile terminal needs to rotate when the 360° framing is completed, and detects the real-time during the panoramic shooting process. Whether the current rotation angle reaches the angle and synthesizes the panoramic photo when the current rotation angle reaches the angle.
  • FIG. 3A illustrates a flow chart of a panoramic photo taking method provided by another exemplary embodiment.
  • the public The embodiment is exemplified by applying the panoramic photo shooting method to a mobile terminal.
  • the method of photographing a panoramic photo includes:
  • step 301 a first wide angle number of the front camera and a second wide angle number of the rear camera are obtained.
  • the mobile terminal acquires the current first wide angle number of the front camera and the current second wide angle number of the rear camera, wherein the first wide angle number and the second wide angle number are the same or different.
  • the wide angle of the front camera and the rear camera of the mobile terminal is 60°; for example, the first wide angle of the front camera is 80°, and the second wide angle of the rear camera is 60. °.
  • step 302 if the first wide angle number is smaller than the second wide angle number, (180° - the first wide angle number) is determined as the target rotation angle.
  • the mobile terminal After obtaining the first wide angle number and the second wide angle number, the mobile terminal further determines, according to the first wide angle number and the second wide angle number, an angle of rotation (ie, a target rotation angle) that the mobile terminal needs to rotate when the 360° framing is completed.
  • an angle of rotation ie, a target rotation angle
  • the first wide angle number of the front camera 31 is ⁇
  • the second wide angle number of the rear camera 32 is ⁇
  • ⁇ when the mobile terminal rotates 180°- ⁇ clockwise, the rear camera
  • the framing angle of the first image acquired by the front camera 31 is ⁇ +(180°- ⁇ ) ⁇ 180°, that is, moving
  • the terminal rotates 180°- ⁇ the sum of the framing angles of the first image and the second image is 360°+ ⁇ - ⁇ 360°, and the mobile terminal has not completed 360° framing.
  • the mobile terminal needs to continue to rotate. .
  • the framing angle of the second image acquired by the rear camera 32 is ⁇ +(180°- ⁇ )>180°
  • the mobile terminal rotates at least (180° - the first wide angle number) to complete the 360° framing, and therefore, the mobile terminal determines (180° - the first wide angle number) Rotate the angle for the target.
  • the target rotation angle is slightly larger than (180° - the first wide angle number) to ensure that there is a movement margin during the rotation.
  • step 303 if the first wide angle number is greater than the second wide angle number, then (180° - the second wide angle The degree is determined as the target rotation angle.
  • the first wide angle number of the front camera 31 is ⁇
  • the second wide angle number of the rear camera 32 is ⁇
  • ⁇ > ⁇ when the mobile terminal rotates 180°- ⁇ clockwise,
  • the framing angle of the second image acquired by the rear camera 32 is ⁇ +(180°- ⁇ ) ⁇ 180°
  • the framing angle of the first image acquired by the front camera 31 is ⁇ +(180°- ⁇ ) ⁇ 180°
  • the sum of the viewing angles of the first image and the second image is 360°- ⁇ + ⁇ 360°
  • the mobile terminal has not completed the 360° framing, in order to complete the 360° framing, the mobile terminal Need to continue to rotate.
  • the framing angle of the first image acquired by the front camera 31 is When ⁇ +(180°- ⁇ )>180°, that is, when the mobile terminal rotates 180°- ⁇ , the sum of the viewing angles of the first image and the second image is 360°+ ⁇ - ⁇ >360°, and the mobile terminal has been completed. 360° framing.
  • the mobile terminal rotates at least (180° - the second wide angle number) to complete the 360° framing, and therefore, the mobile terminal determines (180° - the second wide angle number) Rotate the angle for the target.
  • the target rotation angle is slightly larger than (180° - the second wide angle number) to ensure that there is a movement margin during the rotation.
  • step 304 a first image acquired by the front camera and a second image collected by the rear camera are acquired, and the first image and the second image are collected during the rotation of the mobile terminal.
  • the mobile terminal displays corresponding prompt information, instructing the user to rotate the mobile terminal at a constant speed. Accordingly, the mobile terminal acquires the first image acquired by the front camera in real time and the rear camera collects in real time during the rotation process. The second image.
  • the mobile terminal when performing panoramic shooting, sets the front camera and the rear camera to the same resolution, ensuring that the acquired first image and the second image have the same resolution.
  • step 305 the rotation of the mobile terminal is calculated according to the angular velocity data collected by the angular velocity sensor. angle.
  • the mobile terminal when receiving the start shooting instruction, acquires the current rotational angular velocity through the built-in angular velocity sensor (ie, the gyro sensor), and performs an integral operation on the obtained rotational angular velocity, thereby obtaining a rotation angle of the mobile terminal.
  • the start shooting instruction is triggered when the user clicks on a predetermined shooting control/physical button.
  • step 306 it is detected whether the rotation angle reaches the target rotation angle, and the target rotation angle is determined according to the wide angle of the front camera and the rear camera.
  • the mobile terminal detects in real time whether the current rotation angle reaches the target rotation angle.
  • the mobile terminal determines that the 360° framing has been completed, and performs the following step 307; when the rotation angle does not reach the target rotation angle, the mobile terminal determines that the 360° framing has not been completed, and needs to perform further rotation, and Returning to step 304 above, until the rotation angle reaches the target rotation angle.
  • step 307 if the rotation angle reaches the target rotation angle, it is determined that the sum of the framing angles of the first image and the second image reaches the preset framing angle threshold.
  • the wide-angle parameters of the front camera and the rear camera are both 60°, and when the mobile terminal detects that the rotation angle reaches 120°, it is determined that the sum of the framing angles of the first image and the second image reaches the preset framing angle threshold (completed 360° framing); for example, the first wide-angle parameter of the front camera is 90° and the second wide-angle parameter of the rear camera is 80°, and the mobile terminal determines the first image and the first when detecting that the rotation angle reaches 100°. The sum of the framing angles of the two images reaches the preset framing angle threshold (complete 360° framing).
  • the mobile terminal when detecting that the rotation angle reaches the target rotation angle, the mobile terminal prompts the user to stop rotating the mobile terminal by a predetermined manner, where the predetermined manner includes vibration feedback, playing a preset prompt sound, displaying preset prompt information/animation, and the like.
  • step 308 if the sum of the framing angles of the first image and the second image reaches the preset framing angle threshold, the panoramic photo is synthesized according to the first image and the second image.
  • the mobile terminal identifies similar regions in the first image and the second image, and splices the first image and the second image based on the similar region, thereby synthesizing the panoramic photo.
  • Embodiments of the present disclosure do not limit the specific manner in which a panoramic photo is synthesized.
  • the rotation angle of the mobile terminal is significantly reduced.
  • the front camera and the rear camera of the mobile terminal have a wide angle of 60°, and when the panoramic photo is taken by the existing panoramic photo shooting method, the user The mobile terminal needs to be rotated by 300°, and when the panoramic photo is taken by the method provided by the present embodiment, the user only needs to rotate the mobile terminal by 120°.
  • the rotation angle of the mobile terminal is reduced, the user is more likely to remain stable during the process of rotating the mobile terminal, ensuring the stability of the viewfinder picture and improving the shooting quality of the panoramic picture.
  • the mobile terminal when the panoramic photo is taken, the mobile terminal simultaneously enables the front camera and the rear camera, so that the front camera and the rear camera respectively acquire the first image and the rear camera during the process of rotating the mobile terminal.
  • a second image and when the sum of the framing angles of the first image and the second image reaches a panoramic angle, the first image and the second image are combined into a panoramic photo; compared to when the panoramic photo is taken only by the rear camera, due to the movement
  • the rotation angle of the terminal is large, which makes the shooting picture easy to shake and affect the shooting quality of the panoramic photo.
  • the dual camera shooting and image synthesis technology can reduce the rotation angle of the mobile terminal during shooting, thereby improving the panoramic photo shooting efficiency and ensuring the panoramic shooting process.
  • the stability of the mobile terminal improves the quality of panoramic photos.
  • step 309 an image preview area corresponding to each of the first image and the second image is determined, and the image preview area is used to display the first image and the second image acquired in real time, and the first image and the second image in different image preview areas.
  • the preview direction is different.
  • the mobile terminal In the process of taking a panoramic photo, the mobile terminal provides an image preview function for displaying the captured first image and the second image in a specified image preview area, wherein the image preview corresponding to the first image and the second image The area is different.
  • the photographing interface is separated by a broken line into a left display area 33 and a right display area 34, and the left display area 33 is an image preview area of the first image, and the right display area 34 is a second image. Image preview area.
  • the mobile terminal needs to update the first image and the second image in the image preview area in real time.
  • the preview direction of the first image in the corresponding image preview area is the first direction
  • the mobile terminal updates the first image in the first direction
  • the second image is in the corresponding image preview area.
  • the preview direction is the second direction
  • the mobile terminal updates the second image in the second direction, wherein the first direction and the second direction are different.
  • the preview direction of the first image in the left display area 33 is from left to right
  • the preview direction of the second image in the right display area 34 is from right to left (ie, the first image)
  • the mobile terminal updates the first image from left to right and updates the second image from right to left during the rotation of the mobile terminal.
  • the rotation angle reaches the target rotation angle
  • the first image and the second image are stitched together.
  • step 310 a live view angle corresponding to each of the first image and the second image is calculated.
  • the mobile terminal calculates the real-time viewing angle of each of the first image and the second image in real time, and determines the current shooting progress according to the real-time viewing angle.
  • the mobile terminal calculates a first live view angle corresponding to the first image according to the first wide angle number of the front camera and the real-time rotation angle, and according to the second wide angle number and the real-time rotation angle of the rear camera Calculating a second live view angle corresponding to the second image.
  • the real-time rotation angle is calculated according to the rotational angular velocity acquired by the angular velocity sensor.
  • the front camera and the rear camera have a wide angle of 60° and a real-time rotation angle of 60°, and the live view angles of the first image and the second image are both 120°.
  • step 311 the shooting progress is displayed in the image preview area according to the live view angle.
  • the mobile terminal calculates the shooting progress according to the live view angle, and displays the shooting progress in the form of a progress bar.
  • the shooting progress (first live view angle + second live view angle) / preset view angle threshold.
  • the shooting progress is calculated according to the live view angle, and the shooting progress is displayed by the progress bar 35 in the image preview area.
  • the mobile terminal displays the collected first image and the second image in the same screen, so that the user can grasp the real-time shooting progress of the front and rear cameras.
  • the portrait may be taken into the photo.
  • the above step 308 After that, it also includes the following steps:
  • step 312 a prompt information is displayed, the prompt information is used to instruct the photographer to take a corrected photo, and the framing area corresponding to the corrected photo includes an area blocked by the photographer portrait in the panoramic photo.
  • the mobile terminal when the portrait removal function is enabled, the mobile terminal is according to the first figure. After synthesizing the panoramic photo with the second image, it is recognized whether the panoramic image includes the portrait of the photographer, and when the portrait of the photographer is included in the panoramic photo, the prompt information is displayed to prompt the user to take the corrected photo.
  • the prompt information is used to instruct the user to take a corrected photo after turning, that is, the corrected photo taken by the user includes an area of the panoramic photo that is blocked by the portrait of the photographer.
  • step 313 a corrected photo is obtained.
  • the mobile terminal acquires the corrected photo taken by the user.
  • the mobile terminal synthesizes the panoramic photo 36 including the portrait of the photographer based on the first image and the second image, and acquires the corrected photo 37 taken.
  • step 314 the panoramic photo is corrected based on the corrected photo, and the corrected panoramic image does not include the portrait of the photographer.
  • the mobile terminal performs image analysis on the panoramic photo and the corrected photo, determines an area where the photographer's portrait is located in the panoramic photo, and a correction area in the corrected photo (the area where the photographer's portrait is located corresponds to the correction area), so that the panoramic photo is The area of the photographer's portrait is replaced with the correction area to correct the panoramic photo.
  • the mobile terminal analyzes the panoramic photo 36 and the corrected photo 37, and determines the region 36a in which the portrait is located in the panoramic photo 36 and the correction region 37a in the corrected photograph 37.
  • the mobile terminal replaces the photographed portrait area 36a with the corrected area 37a, and generates a panoramic corrected photograph 38.
  • the mobile terminal instructs the user to take a corrected photo including the blocked area of the portrait of the photographer, thereby correcting the portrait of the photographer by using the corrected photo, thereby eliminating the shooting of the panoramic photo.
  • Portraits further enhance the quality of panoramic photos.
  • FIG. 4 is a block diagram showing the structure of a panoramic photographing apparatus provided by an exemplary embodiment.
  • the panoramic camera device can be implemented as a whole or a part of the mobile terminal by a dedicated hardware circuit, or a combination of hardware and software.
  • the panoramic camera includes:
  • the first obtaining module 410 is configured to acquire the first image and the rear image collected by the front camera a second image captured by the camera, the first image and the second image are collected during the rotation of the mobile terminal;
  • the detecting module 420 is configured to detect whether a sum of the framing angles of the first image and the second image reaches a preset framing angle threshold;
  • the synthesizing module 430 is configured to synthesize the panoramic photo according to the first image and the second image when the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold.
  • the mobile terminal when the panoramic photo is taken, the mobile terminal simultaneously enables the front camera and the rear camera, so that the front camera and the rear camera respectively acquire the first image and the rear camera during the process of rotating the mobile terminal.
  • a second image and when the sum of the framing angles of the first image and the second image reaches a panoramic angle, the first image and the second image are combined into a panoramic photo; compared to when the panoramic photo is taken only by the rear camera, due to the movement
  • the rotation angle of the terminal is large, which makes the shooting picture easy to shake and affect the shooting quality of the panoramic photo.
  • the dual camera shooting and image synthesis technology can reduce the rotation angle of the mobile terminal during shooting, thereby improving the panoramic photo shooting efficiency and ensuring the panoramic shooting process.
  • the stability of the mobile terminal improves the quality of panoramic photos.
  • an angular velocity sensor is disposed in the mobile terminal
  • the detecting module 420 includes:
  • a first calculation submodule configured to calculate a rotation angle of the mobile terminal according to the angular velocity data collected by the angular velocity sensor
  • the detecting submodule is configured to detect whether the rotation angle reaches a target rotation angle, and the target rotation angle is determined according to a wide angle of the front camera and the rear camera;
  • the determining submodule is configured to determine that the sum of the framing angles of the first image and the second image reaches a preset framing angle threshold when the rotation angle reaches the target rotation angle.
  • the device further includes:
  • a second acquiring module configured to acquire a first wide angle number of the front camera and a second wide angle number of the rear camera
  • a first determining module configured to determine (180° - the first wide angle number) as the target rotation angle when the first wide angle number is less than the second wide angle number;
  • the second determining module is configured to determine (180° - the second wide angle number) as the target rotation angle when the first wide angle number is greater than the second wide angle number.
  • the device further includes:
  • a third determining module configured to determine an image preview area corresponding to each of the first image and the second image
  • the image preview area is configured to display the first image and the second image acquired in real time, and the preview directions of the first image and the second image in different image preview areas are different;
  • a calculation module configured to calculate a real-time view angle corresponding to each of the first image and the second image
  • the first display module is configured to display a shooting progress in the image preview area according to the live view angle.
  • the computing module includes:
  • a second calculation sub-module configured to calculate a first live view angle corresponding to the first image according to the first wide angle number of the front camera and the real-time rotation angle
  • the third calculating submodule is configured to calculate a second live view angle corresponding to the second image according to the second wide angle number of the rear camera and the real time rotation angle.
  • the device further includes:
  • the second display module is configured to display prompt information, where the prompt information is used to instruct the photographer to take a corrected photo, and the framing area corresponding to the corrected photo includes an area blocked by the photographer portrait in the panoramic photo;
  • a third obtaining module configured to obtain a corrected photo
  • the correction module is configured to correct the panoramic photo according to the corrected photo, and the corrected panoramic photo does not include the portrait of the photographer.
  • the mobile terminal displays the collected first image and the second image in the same screen, so that the user can grasp the real-time shooting progress of the front and rear cameras.
  • the mobile terminal instructs the user to take a corrected photo including the blocked area of the portrait of the photographer, thereby correcting the portrait of the photographer by using the corrected photo, thereby eliminating the shooting of the panoramic photo.
  • Portraits further enhance the quality of panoramic photos.
  • FIG. 5 is a block diagram of a panoramic photo shooting device 500, according to an exemplary embodiment.
  • device 500 can be a smartphone, tablet, or the like.
  • apparatus 500 can include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, And a communication component 516.
  • Processing component 502 typically controls the overall operation of device 500, such as with display, telephone calls, number According to communications, camera operations and recording operations are associated with operations.
  • Processing component 502 can include one or more processors 520 to execute instructions to perform all or part of the steps of the above described methods.
  • processing component 502 can include one or more modules to facilitate interaction between component 502 and other components.
  • processing component 502 can include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.
  • Memory 504 is configured to store various types of data to support operation at device 500. Examples of such data include instructions for any application or method operating on device 500, contact data, phone book data, messages, pictures, videos, and the like.
  • the memory 504 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Electrically erasable programmable read only memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • Power component 506 provides power to various components of device 500.
  • Power component 506 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 500.
  • the multimedia component 508 includes a screen between the device 500 and the user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component 508 includes a front camera and a rear camera, wherein the front camera and the rear camera may be a fixed optical lens system or have focal length and optical zoom capability.
  • the audio component 510 is configured to output and/or input an audio signal.
  • audio component 510 includes a microphone (MIC) that is configured to receive an external audio signal when device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 504 or transmitted via communication component 516.
  • audio component 510 also includes a speaker for outputting an audio signal.
  • the I/O interface 512 provides an interface between the processing component 502 and the peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 514 includes one or more sensors for providing device 500 with various aspects of status assessment.
  • sensor assembly 514 can detect an open/closed state of device 500, a relative positioning of components, such as the display and keypad of device 500, and sensor component 514 can also detect a change in position of one component of device 500 or device 500. The presence or absence of user contact with device 500, device 500 orientation or acceleration/deceleration, and temperature variation of device 500.
  • Sensor assembly 514 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 514 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 516 is configured to facilitate wired or wireless communication between device 500 and other devices.
  • the device 500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • communication component 516 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 516 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • apparatus 500 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • non-transitory computer readable storage medium comprising instructions, such as a memory 504 comprising instructions executable by processor 520 of apparatus 500 to perform the above method.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • a non-transitory computer readable storage medium that, when executed by a processor of apparatus 500, enables apparatus 500 to perform the panoramic photo taking method described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

L'invention appartient au domaine technique de la capture d'images. L'invention concerne un procédé et un dispositif de capture de photo panoramique. Le procédé consiste à : obtenir une première image acquise par une caméra avant et une seconde image acquise par une caméra arrière, la première image et la seconde image étant acquises lors d'un processus durant lequel un terminal mobile est tourné ; déterminer si une somme d'un angle de cadrage de la première image et d'un angle de cadrage de la seconde image atteint un seuil d'angle de cadrage prédéfini ; et, si la somme de l'angle de cadrage de la première image et de l'angle de cadrage de la seconde image atteint le seuil d'angle de cadrage prédéfini, réaliser une synthèse d'image d'après la première image et la seconde image de sorte à obtenir une photo panoramique. Dans des modes de réalisation de la présente invention, en utilisant des technologies de capture de deux appareils photo et des technologies de synthèse d'image, il est possible de réduire l'angle de rotation du terminal mobile lors d'un processus de capture d'image. Cela améliore l'efficacité de capture de photo panoramique, garantit la stabilité du terminal mobile lors du processus de capture de photo panoramique, et améliore la qualité de capture d'une photo panoramique.
PCT/CN2016/099612 2016-09-21 2016-09-21 Procédé et dispositif de capture de photo panoramique WO2018053722A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2016/099612 WO2018053722A1 (fr) 2016-09-21 2016-09-21 Procédé et dispositif de capture de photo panoramique
CN201680000893.7A CN108141524A (zh) 2016-09-21 2016-09-21 全景照片拍摄方法及装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/099612 WO2018053722A1 (fr) 2016-09-21 2016-09-21 Procédé et dispositif de capture de photo panoramique

Publications (1)

Publication Number Publication Date
WO2018053722A1 true WO2018053722A1 (fr) 2018-03-29

Family

ID=61690158

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/099612 WO2018053722A1 (fr) 2016-09-21 2016-09-21 Procédé et dispositif de capture de photo panoramique

Country Status (2)

Country Link
CN (1) CN108141524A (fr)
WO (1) WO2018053722A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110175491A (zh) * 2018-11-13 2019-08-27 广东小天才科技有限公司 一种排队编号生成方法及可穿戴设备
CN110493511A (zh) * 2019-07-30 2019-11-22 维沃移动通信有限公司 一种全景图像生成方法及移动终端
CN112422827A (zh) * 2020-11-17 2021-02-26 联想(北京)有限公司 信息处理方法、装置及设备和存储介质
CN112714236A (zh) * 2019-10-24 2021-04-27 中兴通讯股份有限公司 终端及拍摄方法、存储介质、电子装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112995523B (zh) * 2021-04-30 2021-07-30 武汉特斯雷信息技术有限公司 一种在线自助业务环境检测方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577795A (zh) * 2009-06-17 2009-11-11 深圳华为通信技术有限公司 一种实现全景图像的实时预览的方法和装置
CN103795924A (zh) * 2014-02-07 2014-05-14 宇龙计算机通信科技(深圳)有限公司 全景拍照装置及方法
CN104243805A (zh) * 2013-06-20 2014-12-24 Lg电子株式会社 移动终端和控制移动终端的方法
CN104349044A (zh) * 2013-08-09 2015-02-11 联想(北京)有限公司 全景图像的拍摄方法及电子设备
US20150138314A1 (en) * 2013-11-20 2015-05-21 Google Inc. Generating Panoramic Images

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2779620B8 (fr) * 2011-11-07 2016-09-28 Sony Interactive Entertainment Inc. Dispositif de génération d'images et procédé de génération d'images
CN102645837B (zh) * 2012-04-09 2015-02-11 广东步步高电子工业有限公司 一种应用于安装有前、后摄像头的移动手持设备的全景图像拍摄和处理方法
CN107835375B (zh) * 2015-05-27 2020-03-27 Oppo广东移动通信有限公司 全景摄像的方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577795A (zh) * 2009-06-17 2009-11-11 深圳华为通信技术有限公司 一种实现全景图像的实时预览的方法和装置
CN104243805A (zh) * 2013-06-20 2014-12-24 Lg电子株式会社 移动终端和控制移动终端的方法
CN104349044A (zh) * 2013-08-09 2015-02-11 联想(北京)有限公司 全景图像的拍摄方法及电子设备
US20150138314A1 (en) * 2013-11-20 2015-05-21 Google Inc. Generating Panoramic Images
CN103795924A (zh) * 2014-02-07 2014-05-14 宇龙计算机通信科技(深圳)有限公司 全景拍照装置及方法

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110175491A (zh) * 2018-11-13 2019-08-27 广东小天才科技有限公司 一种排队编号生成方法及可穿戴设备
CN110175491B (zh) * 2018-11-13 2022-03-01 广东小天才科技有限公司 一种排队编号生成方法及可穿戴设备
CN110493511A (zh) * 2019-07-30 2019-11-22 维沃移动通信有限公司 一种全景图像生成方法及移动终端
CN110493511B (zh) * 2019-07-30 2023-05-09 维沃移动通信有限公司 一种全景图像生成方法及移动终端
CN112714236A (zh) * 2019-10-24 2021-04-27 中兴通讯股份有限公司 终端及拍摄方法、存储介质、电子装置
CN112714236B (zh) * 2019-10-24 2024-05-10 中兴通讯股份有限公司 终端及拍摄方法、存储介质、电子装置
CN112422827A (zh) * 2020-11-17 2021-02-26 联想(北京)有限公司 信息处理方法、装置及设备和存储介质

Also Published As

Publication number Publication date
CN108141524A (zh) 2018-06-08

Similar Documents

Publication Publication Date Title
KR101772177B1 (ko) 사진을 획득하기 위한 방법 및 장치
KR102194094B1 (ko) 가상과 실제 물체의 합성 방법, 장치, 프로그램 및 기록매체
CN108419016B (zh) 拍摄方法、装置及终端
WO2018000227A1 (fr) Procédé et dispositif de diffusion vidéo
WO2021047077A1 (fr) Procédé, appareil et dispositif de traitement d'images basés sur de multiples modules photographiques et support
WO2017181556A1 (fr) Procédé et dispositif de diffusion en continu en direct de jeu vidéo
WO2018035811A1 (fr) Procédé de photographie panoramique, terminal, ensemble rotatif et dispositif de photographie panoramique
WO2018053722A1 (fr) Procédé et dispositif de capture de photo panoramique
WO2016029637A1 (fr) Procédé et appareil de photographie
WO2016101481A1 (fr) Procédé et dispositif de mise au point automatique
WO2017092128A1 (fr) Procédé et dispositif pour afficher une image de prévisualisation
US11539888B2 (en) Method and apparatus for processing video data
JP6333990B2 (ja) パノラマ写真の生成方法および装置
WO2021237590A1 (fr) Procédé et appareil de collecte d'image, et dispositif et support d'enregistrement
WO2016045323A1 (fr) Procédé et dispositif de commande de présentation d'une image vidéo
WO2018133388A1 (fr) Procédé de photographie destiné à un dispositif de vol intelligent, et dispositif de vol intelligent
WO2018018508A1 (fr) Procédé et appareil de commande de lecture
CN115134505B (zh) 预览画面生成方法及装置、电子设备、存储介质
EP4161054A1 (fr) Procédé, appareil et dispositif de traitement d'informations de point d'ancrage, et support de stockage
CN105592263B (zh) 图像拍摄方法、装置及终端
US11555696B2 (en) Electronic terminal, photographing method and device, and storage medium
WO2019061118A1 (fr) Procédé et terminal de capture panoramique
WO2023225910A1 (fr) Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique
CN114943791A (zh) 动画播放方法、装置、设备及存储介质
CN107295229B (zh) 移动终端的拍照方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16916461

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16916461

Country of ref document: EP

Kind code of ref document: A1