WO2017092261A1 - 一种摄像头模组、移动终端及其拍摄图像的方法和装置 - Google Patents

一种摄像头模组、移动终端及其拍摄图像的方法和装置 Download PDF

Info

Publication number
WO2017092261A1
WO2017092261A1 PCT/CN2016/083852 CN2016083852W WO2017092261A1 WO 2017092261 A1 WO2017092261 A1 WO 2017092261A1 CN 2016083852 W CN2016083852 W CN 2016083852W WO 2017092261 A1 WO2017092261 A1 WO 2017092261A1
Authority
WO
WIPO (PCT)
Prior art keywords
lens
picture
lens component
lens assembly
video
Prior art date
Application number
PCT/CN2016/083852
Other languages
English (en)
French (fr)
Inventor
郑宇均
蓝柏林
Original Assignee
幸福在线(北京)网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 幸福在线(北京)网络技术有限公司 filed Critical 幸福在线(北京)网络技术有限公司
Publication of WO2017092261A1 publication Critical patent/WO2017092261A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets

Definitions

  • the invention relates to a camera module, a mobile terminal and a method and a device for capturing images thereof.
  • Existing smart terminals such as mobile phones and tablet computers, have cameras, which allow users to take photos and share them to the network anytime and anywhere, or use the camera to perform network video chat and other functions, which greatly enriches the user experience.
  • a typical smart terminal will include two cameras: a front camera and a rear camera.
  • the front camera and the rear camera are similar in structure, one facing the user, one facing the user, and including the lens in both the front camera and the rear camera.
  • the module and the lens module further comprise a set of lenses, but whether it is a front camera or a rear camera, the viewing angle is limited, generally between 40 degrees and 80 degrees, and the front camera and the rear camera Only one of them can be used at the same time, so the current camera cannot capture a full-view photo or video.
  • the present invention has been made in order to provide a camera module, a mobile terminal and a method and apparatus for capturing an image that overcome the above problems or at least partially solve the above problems.
  • an embodiment of the present invention provides a camera module, including: a first lens component and a second lens component;
  • the first lens assembly and the second lens assembly each include a fisheye lens, and the fish glasses
  • the head is the outermost lens of the first lens component and the second lens component
  • the first lens assembly and the second lens assembly are disposed opposite to each other and can be simultaneously opened.
  • the first lens assembly and the second lens assembly each include a lens, and the lens is a fisheye lens.
  • the first lens assembly and the second lens assembly each include at least two lenses, and the lens at the outermost end of the at least two lenses is a fisheye lens;
  • the lens on the inner side of the fisheye lens is a non-fisheye lens.
  • the camera module further includes: two filters, two image sensors for receiving images, and one flexible printed circuit board PCB;
  • Two of the image sensors are fixedly mounted under the first lens assembly and the second lens assembly, respectively;
  • Two of the filters are respectively located between the first lens assembly and the image sensor and between the second lens assembly and the image sensor;
  • the two image sensors are located on both sides of the flexible PCB and are connected to the flexible PCB.
  • an embodiment of the present invention provides a mobile terminal, where the mobile terminal includes the camera module provided by the embodiment of the present invention.
  • an embodiment of the present invention further provides a method for capturing an image by using the foregoing camera module, including:
  • the pictures or videos captured by the first lens component and the second lens component are spliced and output.
  • the above method may further include:
  • the distortion corrected picture or video is output.
  • the correcting the distortion of the picture or video captured by the first lens component or the second lens component includes:
  • determining a region of distortion in which removal is required includes:
  • the area enclosed by the four arcs and the circumference of the picture or video frame is taken as a distortion area to be removed.
  • the size of the distortion area that needs to be removed is inversely related to the size of the focal length of the fisheye lens in the first lens assembly or the second lens assembly that is activated.
  • the stretching of the picture or video frame outside the distorted area is performed to make the stretched picture or video frame a rectangle, including:
  • the embodiment of the present invention further provides an apparatus for capturing an image corresponding to the foregoing shooting method, and the apparatus includes:
  • a startup module configured to simultaneously start the first lens component and the second lens component in the camera module according to the input full-view shooting instruction
  • a splicing module configured to splicing a picture or video captured by the first lens component and the second lens component
  • An output module for outputting the stitched picture or video.
  • the apparatus for capturing an image provided by the embodiment of the present invention further includes: a correction module; wherein:
  • the startup module is further configured to start one of the first lens component and the second lens component according to the input shooting instruction of the non-full angle of view;
  • the acquiring module is further configured to acquire a picture or video captured by the first lens component or the second lens component;
  • a correction module configured to perform distortion correction on a picture or video captured by the first lens component or the second lens component
  • the output module is further configured to output the distortion corrected picture or video.
  • the correction module includes:
  • the stretching sub-module is configured to stretch the picture or video frame except the distortion area, so that the stretched picture or video frame is a rectangle.
  • the determining sub-module is specifically configured to determine an inscribed square in the circular picture or video frame; and determine each two phases in the inscribed square according to a preset arc degree Four arcs that are recessed in the center direction between adjacent vertices; a region enclosed between the four arcs and the circumference of the picture or video frame is taken as a distortion region to be removed.
  • the size of the distortion area that needs to be removed is inversely related to the size of the focal length of the fisheye lens in the first lens assembly or the second lens assembly that is activated.
  • the stretching sub-module is specifically configured to stretch a picture or a video frame other than the distorted area, so that the stretched picture or video frame has a side length equal to the arc The rectangle.
  • the camera module, the mobile terminal and the method and device for capturing the image thereof are provided in the embodiment of the present invention, and the prior art is improved.
  • the first lens component and the second lens component are arranged opposite to each other. And can be opened at the same time, the fisheye lens included in the first lens component and the second lens component is the outermost lens, so that since the fisheye lens is an extreme wide-angle lens, the viewing angle can reach 180° ⁇ 235°.
  • the method further includes: turning on only one of the first lens component or the second lens component, and then The picture or video captured by the fisheye lens in the lens assembly or the second lens assembly is subjected to distortion correction, and the distortion-corrected picture is output, so that the user can satisfy the normal shooting requirement of the user when the full-angle shooting is not required.
  • FIG. 1 is a schematic structural diagram of a camera module according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a method for capturing an image by using the camera module according to an embodiment of the present invention
  • FIG. 3 is another flowchart of a method for capturing an image by the camera module according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a distortion area that needs to be removed in a picture taken by a fisheye according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of an apparatus for capturing an image according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a calibration module according to an embodiment of the present invention.
  • the camera module provided by the embodiment of the present invention includes: a first lens component and a second lens component; wherein:
  • Each of the first lens assembly 1 and the second lens assembly 2 includes a fisheye lens 11, 21, and the fisheye lens 11, 21 is the outermost lens of the first lens assembly 1 and the second lens assembly 2;
  • the first lens assembly 1 and the second lens assembly 2 are arranged opposite each other and can be simultaneously opened.
  • the first lens assembly 1 and the second lens assembly 2 are arranged opposite to each other, wherein the first lens assembly 1 and the second lens assembly 2 may be Back-to-back arrangement (as shown in FIG. 1 ), that is, the central axes of the first lens assembly 1 and the second lens assembly 2 are on the same line or close to each other, and the first lens assembly 1 and the second lens assembly 2 may be staggered.
  • the arrangement may be determined according to the internal space arrangement of the product to which the camera module is applied.
  • the one shown in FIG. 1 is only one of the cases, which is not limited by the embodiment of the present invention.
  • the above camera module provided by the embodiment of the present invention improves the prior art, and the above camera In the head module, the first lens assembly 1 and the second lens assembly 2 are arranged opposite to each other and can be simultaneously opened, and the fisheye lenses 11, 21 included in the first lens assembly 1 and the second lens assembly 2 are the outermost ends.
  • the lens in this way, since the fisheye lens is an extreme wide-angle lens, the angle of view can reach a range of about 180° to 235°, so that when the first lens assembly 1 and the second lens assembly 2 are simultaneously opened, they are arranged opposite each other.
  • the first lens assembly 1 and the second lens assembly 2 can capture images within a 360° viewing angle through the fisheye lens 11 and 21 located inside the first lens assembly 1 and/or the second lens assembly 2, thereby realizing shooting. Full-view photos and videos.
  • both the first lens assembly and the second lens assembly include a lens, which is a fisheye lens.
  • the first lens assembly and the second lens assembly each include at least two lenses, for example, a fisheye lens, one or more non-fisheye lens (such as a standard lens, a wide-angle lens, etc.).
  • the lens at the outermost end is a fisheye lens, and accordingly, the lens on the inner side of the fisheye lens is a non-fisheye lens.
  • Non-fisheye lenses can be used in standard lenses or wide-angle lenses in the prior art. These lenses often contain multiple lenses (glass or plastic lenses), and the viewing angle is generally in the range of 45° to 150° (the specific viewing angle is related to the focal length of the lens). )Inside. In the non-fisheye lens, the angle of view is limited, and it is impossible to achieve full-angle shooting. However, when the non-fisheye lens is superimposed with the fisheye lens, the angle of view is greatly increased. Therefore, when the first lens assembly and the second are arranged opposite each other, When the lens assembly is turned on at the same time, the camera module can capture a full-view picture or video.
  • the camera module may further include: two filters 3, two image sensors 4 for receiving images, and a flexible printed circuit board (PCB) 5;
  • PCB printed circuit board
  • Two image sensors 4 are fixedly mounted under the first lens assembly 1 and the second lens assembly 2, respectively;
  • Two of the filters 3 are respectively located between the first lens assembly 1 and the image sensor 4 and between the second lens assembly 2 and the image sensor 4;
  • Two image sensors 4 are located on both sides of the flexible PCB and connected to the flexible PCB 5.
  • the first lens component and the second lens component can be simultaneously turned on.
  • the method can be implemented by, for example, controlling two image sensors to work simultaneously by software, and simultaneously collecting Light entering through the first lens assembly and the second lens assembly (controlling the shutter time to read data acquired during the shutter time), and, for example, the mechanical shutters of the first lens assembly and the second lens assembly may be controlled by software or hardware.
  • the lens assembly can be operated at the same time, and the specific implementation can refer to the prior art.
  • the embodiment of the invention further provides a mobile terminal, which is provided with the camera module provided by the embodiment of the invention.
  • the above mobile terminal provided by the embodiment of the present invention may be a smart phone, a tablet computer, a notebook computer, various wearable devices, any device with shooting requirements, and the like. This embodiment of the present invention does not limit this.
  • the user due to its freely movable feature, the user can perform full-view picture or video shooting anywhere he wants to shoot, and can also take a full view of the shooting. Sharing images or videos to other users greatly enhances the user experience with mobile devices.
  • the embodiment of the present invention further provides a method for capturing an image by using the camera module. As shown in FIG. 2, the method includes:
  • Step S21 Simultaneously start the first lens component and the second lens component in the camera module to perform shooting according to the input shooting instruction of the full angle of view;
  • Step S22 acquiring a picture or video captured by the first lens component and the second lens component, respectively;
  • step S23 the pictures or videos captured by the first lens component and the second lens component are spliced and output.
  • step S21 when the user issues a full-angle shooting instruction, for example, by pressing a preset button or button, a shooting command requesting a full viewing angle is issued, and the camera module is installed.
  • a device such as a smart phone starts the camera mode simultaneously according to the shooting instruction
  • the first lens component and the second lens component in the group since the first lens component and the second lens component are opposite to each other and the outermost lenses of the two are fisheye lenses, so that the first lens component and the second lens are simultaneously activated
  • an image of an ultra-wide viewing angle (180° to 235°) taken by the first lens assembly and the second lens assembly can be acquired.
  • step S23 after the pictures and videos captured by the first lens component and the second lens component are respectively spliced, a full-view picture or video can be obtained, and the splicing process of the picture and the video can be performed after coding, or first Complete stitching and re-encoding.
  • the method for capturing an image provided by the embodiment of the present invention, as shown in FIG. 3, may also perform the following steps:
  • Step S31 starting one of the first lens component and the second lens component according to the input shooting instruction of the non-full angle of view;
  • Step S32 acquiring a picture or video captured by the first lens component or the second lens component
  • Step S33 performing distortion correction on the picture or video captured by the first lens component or the second lens component
  • Step S34 outputting the distortion corrected picture or video.
  • the first lens component or the second lens component may be turned on according to the needs of the user.
  • the first lens component and the second lens component disposed opposite each other are a front camera and a rear camera. You can choose to open any of them by using the preset selection buttons or buttons.
  • step S32 the picture or video of the fisheye lens photographed is very sharp due to the large viewing angle of 180 to 235.
  • the fisheye lens imaging model is used to complete the coordinate transformation from the plane to the object sphere, and the spherical image is projected onto the cylinder by the arc length mapping method to complete the fisheye lens shooting. Distortion correction of the picture.
  • the following method using a fisheye lens to image a spherical coordinate model in the eye to establish a standard coordinate system, which assumes that the camera of the fisheye lens is placed at the coordinate origin, and the shooting direction is the positive direction of the OZ axis, after shooting
  • the fisheye image falls on the OXY plane and maps the spherical pixels to the target plane of view (the target plane is in the positive direction of the OZ axis, parallel to the OXY plane and the distance from the OXY plane is the spherical radius of the fisheye pure earth objective lens) Plane).
  • the picture on the plane, the picture on the target view plane is the picture or video that is finally corrected by distortion.
  • the embodiment of the present invention further provides a simpler correction method, which utilizes the feature that the fisheye lens is significantly distorted at a peripheral area of the picture (circular), which will occur first.
  • the distorted area is removed, and then the picture or video frame from which the distorted area is removed is stretched so that the stretched picture or video frame is rectangular.
  • the size of the final stretched video frame can be determined based on the number of pixels at the edge of the image before stretching.
  • Step S41 determining a circular picture taken by the fisheye lens or an inscribed square in the video frame
  • Step S42 determining four arcs that are recessed in the center direction between every two adjacent vertices in the inscribed square according to a preset arc degree;
  • Step S43 the area enclosed by the four arcs and the circumference of the picture or video frame is taken as needed. Distorted areas except.
  • the four arcs and the shaded area surrounded by the edges of the picture taken by the fisheye lens are the distortion areas that need to be removed.
  • the angle of the arc can be selected according to the focal length of the fisheye lens used.
  • the overall selection principle can refer to the imaging principle of the lens, that is, the longer the focal length of the lens, the smaller the angle of view, and the corresponding distortion region that needs to be removed.
  • the smaller the size, the smaller the arc of the arc, that is, the size of the distortion area that needs to be removed is inversely related to the focal length of the fisheye lens.
  • the arc of the four arcs is smaller than the picture taken by the fisheye lens with a viewing angle of 235°, and the arc of the four arcs is small. .
  • the picture or video frame after the distortion area is removed is stretched so that the stretched picture or video frame is a rectangle whose side length is equal to the arc (the rectangle on the right side in FIG. 5).
  • various image processing algorithms of the prior art can be used in the stretching process, for example, using various interpolation algorithms to make the stretched picture smoother and avoid distortion.
  • an embodiment of the present invention provides a device for capturing an image.
  • the principle of the device is similar to the method for capturing an image provided by the embodiment of the present invention.
  • the implementation of the method the repetition will not be repeated.
  • the apparatus for capturing an image includes:
  • the startup module 61 is configured to simultaneously start the first lens component and the second lens component in the camera module to perform shooting according to the input full-view shooting instruction;
  • the obtaining module 62 is configured to respectively acquire a picture or video captured by the first lens component and the second lens component;
  • a splicing module 63 configured to splicing pictures or videos captured by the first lens component and the second lens component;
  • the output module 64 is configured to output the stitched picture or video.
  • the apparatus provided by the embodiment of the present invention may further include: a calibration mode Block 65; where:
  • the starting module 61 is further configured to start one of the first lens component and the second lens component according to the input shooting instruction of the non-full angle of view;
  • the obtaining module 62 is further configured to acquire a picture or video captured by the first lens component or the second lens component;
  • a correction module 65 configured to perform distortion correction on a picture or video captured by the first lens component or the second lens component
  • the output module 64 is further configured to output the distortion corrected picture or video.
  • correction module 65 includes:
  • a determining sub-module 651 configured to determine, in each of the pictures or videos in the obtained first lens component or the second lens component, a distortion region that needs to be removed; the picture or the video frame is circular;
  • the stretching sub-module 653 is configured to stretch the picture or video frame except the distortion area, so that the stretched picture or video frame is a rectangle.
  • the determining submodule 651 is specifically configured to determine an inscribed square in the circular picture or video frame; and determine, according to a preset arc degree, each two adjacent vertices in the inscribed square The four arcs that are recessed toward the center of the circle; the area enclosed by the four arcs and the circumference of the picture or video frame is taken as a distortion area to be removed.
  • the size of the distortion area that needs to be removed is inversely related to the size of the focal length of the fisheye lens in the first lens assembly or the second lens assembly that is activated.
  • the stretching sub-module 653 is specifically configured to stretch a picture or a video frame other than the distortion area, so that the stretched picture or video frame is a rectangle whose side length is equal to the circular arc.
  • the camera module, the mobile terminal and the method and device for capturing the image thereof are provided in the embodiment of the present invention, and the prior art is improved.
  • the first lens component and the second lens component are arranged opposite to each other and can be Simultaneously turning on, the fisheye lens included in the first lens component and the second lens component is The outermost lens, so that since the fisheye lens is an extreme wide-angle lens, its viewing angle can reach a range of 180° to 235°, so that when the first lens assembly and the second lens assembly are simultaneously opened, they are arranged opposite each other.
  • the first lens assembly and the second lens assembly can capture images within a 360° viewing angle through a fisheye lens located inside the first lens assembly and/or the second lens assembly, thereby enabling full-view photos and videos. , to enhance the user experience.
  • the method further includes: turning on only one of the first lens component or the second lens component, and then The picture or video captured by the fisheye lens in the lens assembly or the second lens assembly is subjected to distortion correction, and the distortion-corrected picture is output, so that the user can satisfy the normal shooting requirement of the user when the full-angle shooting is not required.
  • the embodiment of the invention further provides an apparatus for capturing an image by a camera module, comprising:
  • a memory for storing processor executable commands
  • processor is configured to:
  • the pictures or videos captured by the first lens component and the second lens component are spliced and output.
  • the embodiment of the present invention further provides a non-transitory computer readable storage medium, when the instructions in the storage medium are executed by a processor of the mobile terminal, enabling the mobile terminal to perform a method for capturing an image by the camera module,
  • the method includes:
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Abstract

一种摄像头模组、移动终端及其拍摄图像的方法和装置。该摄像头模组包括:第一镜头组件和第二镜头组件;所述第一镜头组件和第二镜头组件中均包括一个鱼眼镜头,且所述鱼眼镜头为第一镜头组件和第二镜头组件中最外端的镜头;所述第一镜头组件和第二镜头组件之间相背布置且能够同时开启。通过位于在第一镜头组件和/或第二镜头组件内部的鱼眼镜头,就可以采集达到360°视角范围内的图像,实现拍摄全视角的照片和视频,提升了用户的使用体验。

Description

一种摄像头模组、移动终端及其拍摄图像的方法和装置
本申请要求在2015年12月1日提交中国专利局、申请号为2015108674702、发明名称为“一种摄像头模组、移动终端及其拍摄图像的方法和装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及一种摄像头模组、移动终端及其拍摄图像的方法和装置。
背景技术
现有的智能终端例如手机、平板电脑等都具备摄像头,让用户可以随时随地进行拍照以及分享到网络,或者使用摄像头进行网络视频聊天等功能,极大地丰富了用户的使用体验。
通常的智能终端会包括两个摄像头即:前置摄像头和后置摄像头,前置摄像头和后置摄像头结构类似,一个朝向用户,一个背向用户,在前置摄像头和后置摄像头中均包含镜头模组,镜头模组中进一步包含一组镜片,但不论是前置摄像头还是后置摄像头,其拍摄的视角都有限,一般在40度到80度之间,并且,前置摄像头和后置摄像头同一时刻只能够使用其中一个,因此,目前的摄像头无法拍摄到全视角的照片或者视频。
发明内容
鉴于上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的一种摄像头模组、移动终端及其拍摄图像的方法和装置。
第一方面,本发明实施例提供了一种摄像头模组,包括:第一镜头组件和第二镜头组件;
所述第一镜头组件和第二镜头组件中均包括一个鱼眼镜头,且所述鱼眼镜 头为第一镜头组件和第二镜头组件中最外端的镜头;
所述第一镜头组件和第二镜头组件之间相背布置且能够同时开启。
所述第一镜头组件和第二镜头组件中均包含一个镜头,所述透镜为鱼眼镜头。
在一个实施例中,所述第一镜头组件和第二镜头组件中,均包含至少两个镜头,所述至少两个镜头中位于最外端的镜头为鱼眼镜头;
所述鱼眼镜头内侧的镜头为非鱼眼镜头。
在一个实施例中,所述摄像头模组还包括:两个滤光片、两个用于承接图像的图像传感器和一个柔性印刷电路板PCB;
两个所述图像传感器分别固定安装于第一镜头组件和第二镜头组件下方;
两个所述滤光片分别位于第一镜头组件与图像传感器之间以及所述第二镜头组件与图像传感器之间;
所述两个图像传感器位于所述柔性PCB的两侧且与所述柔性PCB连接。
第二方面,本发明实施例提供了一种移动终端,该移动终端具备本发明实施例提供的上述摄像头模组。
第三方面,本发明实施例还提供了一种使用上述摄像头模组拍摄图像的方法,包括:
根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接后输出。
在一个实施例中,上述方法还可以包括:
根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
将经过畸变校正的图片或者视频输出。
在一个实施例中,所述对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正,包括:
针对第一镜头组件或者第二镜头组件拍摄得到的图片或者视频中的每个视频帧,确定其中需要去除的畸变区域;所述图片或者视频帧为圆形;
将所述确定出的畸变区域去除;
对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形。
在一个实施例中,确定其中需要去除的畸变区域,包括:
确定圆形的所述图片或者视频帧中的内接正方形;
按照预设的圆弧度数,确定所述内接正方形内每两个相邻顶点之间向所述圆心方向凹进的四条圆弧;
将所述四条圆弧与所述图片或者视频帧的圆周之间围成的区域作为需要去除的畸变区域。
在一个实施例中,所述需要去除的畸变区域的大小与所启动的第一镜头组件或者第二镜头组件中鱼眼镜头的焦距大小负相关。
在一个实施例中,所述对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形,包括:
对去除所述畸变区域的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为边长等于所述圆弧的矩形。
第四方面,本发明实施例还提供了一种与上述拍摄方法对应的拍摄图像的装置,该装置包括:
启动模块,用于根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
获取模块,用于分别获取所述第一镜头组件和第二镜头组件拍摄得到的图 片或视频;
拼接模块,用于对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接;
输出模块,用于输出拼接后的图片或视频。
在一个实施例中,本发明实施例提供的拍摄图像的装置,还包括:校正模块;其中:
所述启动模块,还用于根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
所述获取模块,还用于获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
校正模块,用于对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
所述输出模块,还用于将经过畸变校正的图片或者视频输出。
在一个实施例中,所述校正模块,包括:
确定子模块,用于针对第一镜头组件或者第二镜头组件拍摄得到的图片或者视频中的每个视频帧,确定其中需要去除的畸变区域;所述图片或者视频帧为圆形;
去除子模块,用于将所述确定出的畸变区域去除;
拉伸子模块,用于对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形。
在一个实施例中,所述确定子模块,具体用于确定圆形的所述图片或者视频帧中的内接正方形;按照预设的圆弧度数,确定所述内接正方形内每两个相邻顶点之间向所述圆心方向凹进的四条圆弧;将所述四条圆弧与所述图片或者视频帧的圆周之间围成的区域作为需要去除的畸变区域。
在一个实施例中,所述需要去除的畸变区域的大小与所启动的第一镜头组件或者第二镜头组件中鱼眼镜头的焦距大小负相关。
在一个实施例中,所述拉伸子模块,具体用于对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为边长等于所述圆弧的矩形。
本发明实施例提供的技术方案可以包括以下有益效果:
本发明实施例提供的上述摄像头模组、移动终端及其拍摄图像的方法和装置,对现有技术进行了改进,在摄像头模组中,第一镜头组件和第二镜头组件之间相背布置且可以同时开启,第一镜头组件和第二镜头组件中包含的鱼眼镜头为最外端的镜头,这样,由于鱼眼镜头是一种极端的广角镜头,其视角可达到180°~235°左右的范围,这样,当第一镜头组件和第二镜头组件同时开启时,相背布置的第一镜头组件、第二镜头组件通过位于在第一镜头组件和/或第二镜头组件内部的鱼眼镜头,就可以采集达到360°视角范围内的图像,实现拍摄全视角的照片和视频,提升了用户的使用体验。
进一步地,本发明实施例提供的摄像头模组、移动终端及其拍摄图像的方法和装置中,还可以选择性地只开启第一镜头组件或者第二镜头组件中的一个,然后,对第一镜头组件或第二镜头组件中的鱼眼镜头拍摄的图片或视频进行畸变校正,将经过畸变校正后的图片输出,使得用户在不需要进行全视角拍摄的时候也能够满足用户正常拍摄的需求。
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在所写的说明书、权利要求书、以及附图中所特别指出的结构来实现和获得。
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。
附图说明
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:
图1为本发明实施例提供的摄像头模组的结构示意图;
图2为本发明实施例提供的使用该摄像头模组拍摄图像的方法的流程图;
图3为本发明实施例提供的该摄像头模组拍摄图像的方法的另一流程图;
图4为本发明实施例提供的确定需要去除的畸变区域的流程图;
图5为本发明实施例提供的经过鱼眼拍摄的图片中需要去除的畸变区域的示意图;
图6为本发明实施例提供的拍摄图像的装置的示意图;
图7为本发明实施例提供的校正模块的示意图。
具体实施方式
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。
首先对本发明实施例提供的摄像头模组的结构进行说明。
本发明实施例提供的摄像头模组,如图1所示,包括:第一镜头组件和第二镜头组件;其中:
第一镜头组件1和第二镜头组件2中均包括一个鱼眼镜头11,21,且所述鱼眼镜头11,21为第一镜头组件1和第二镜头组件2中最外端的镜头;
所述第一镜头组件1和第二镜头组件2之间相背布置且能够同时开启。
需要说明的是,本发明实施例提供的上述摄像头模组中,第一镜头组件1和第二镜头组件2之间是相背布置的,其中第一镜头组件1和第二镜头组件2可以是背靠背布置(如图1所示),即第一镜头组件1和第二镜头组件2的中心轴在同一条线上或者相距很近,还可以是第一镜头组件1和第二镜头组件2错开布置,具体情况可以根据摄像头模组所适用的产品的内部空间布置来决定,图1所示的仅是其中一种情况而已,本发明实施例对此不做限定。
本发明实施例提供的上述摄像头模组,对现有技术进行了改进,上述摄像 头模组中,第一镜头组件1和第二镜头组件2之间相背布置且可以同时开启,第一镜头组件1和第二镜头组件2中包含的鱼眼镜头11,21为最外端的镜头,这样,由于鱼眼镜头是一种极端的广角镜头,其视角可达到180°~235°左右的范围,这样,当第一镜头组件1和第二镜头组件2同时开启时,相背布置的第一镜头组件1、第二镜头组件2通过位于在第一镜头组件1和/或第二镜头组件2内部的鱼眼镜头11,21,就可以采集达到360°视角范围内的图像,实现拍摄全视角的照片和视频。
进一步地,第一镜头组件和第二镜头组件内部结构可以有两种,一种情况是,第一镜头组件和第二镜头组件中均包含一个镜头,该透镜为鱼眼镜头。
另外一种情况是,第一镜头组件和第二镜头组件中,均包含至少两个镜头,例如可以包含一个鱼眼镜头、一个或多个非鱼眼镜头(例如标准镜头、广角镜头等等),但是在这至少两个镜头之中,位于最外端的镜头为鱼眼镜头,相应地,鱼眼镜头内侧的镜头为非鱼眼镜头。
非鱼眼镜头可以采用现有技术中的标准镜头或广角镜头等,这些镜头中往往包含多个镜片(玻璃或塑料镜片),视角一般在45°~150°的范围(具体视角大小与镜头焦距有关)内。在非鱼眼镜头自身视角有限,无法实现全视角的拍摄,但当非鱼眼镜头叠加了鱼眼镜头之后,其拍摄的视角大大增加,因此,当相背布置的第一镜头组件和第二镜头组件同时开启时,该摄像头模组就能够拍摄全视角的图片或视频。
进一步地,如图1所示,该摄像头模组还可以包括:两个滤光片3、两个用于承接图像的图像传感器4,和一个柔性印刷电路板(Printed Circuit Board,PCB)5;
两个所述图像传感器4分别固定安装于第一镜头组件1和第二镜头组件2下方;
两个所述滤光片3分别位于第一镜头组件1与图像传感器4之间以及第二镜头组件2与图像传感器4之间;
两个图像传感器4位于所述柔性PCB的两侧且与柔性PCB 5连接。
在本发明实施例提供的摄像头模组中,第一镜头组件和第二镜头组件可以同时开启,具体实现时,可以通过下述方式实现:例如通过软件方式控制两个图像传感器同时工作,同时采集通过第一镜头组件和第二镜头组件进来的光线(控制快门时间以读取该快门时间内采集的数据),又例如可以通过软件或硬件控制第一镜头组件和第二镜头组件的机械快门,实现镜头组件可以同时工作,具体的实施方式可参照现有技术。
本发明实施例还提供了一种移动终端,该移动终端具备本发明实施例提供的上述摄像头模组。
本发明实施例提供的上述移动终端,可以是智能手机、平板电脑、笔记本电脑、各种可穿戴设备以及任何有拍摄需求的设备等等。本发明实施例对此不做限定。
对于本发明实施例提供的上述移动终端来说,由于其可随意移动的特点,用户可以在其想要拍摄的任何地方,实现全视角的图片或视频的拍摄,还可以将拍摄的全视角的图片或视频共享给其他用户,极大地提升了用户对移动终端的使用体验。
相应地,基于本发明实施例提供的上述摄像头模组,本发明实施例还提供了一种使用该摄像头模组拍摄图像的方法,如图2所示,该方法包括:
步骤S21、根据输入的全视角的拍摄指令,同时启动摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
步骤S22、分别获取第一镜头组件和第二镜头组件拍摄得到的图片或视频;
步骤S23、对第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接后输出。
基于上述摄像头模组的结构,在上述步骤S21中,当用户发出了全视角的拍摄指令,例如通过触按预设的按钮或者按键,发出请求全视角的拍摄指令,安装有该摄像头模组的设备例如智能手机根据该拍摄指令,同时启动该摄像模 组中的第一镜头组件和第二镜头组件,由于第一镜头组件和第二镜头组件相背设置且两者最外侧的镜头均为鱼眼镜头,这样,同时启动第一镜头组件和第二镜头组件之后,可以获取第一镜头组件和第二镜头组件拍摄的超广视角(180°~235°)的图像。
上述步骤S23中,分别对第一镜头组件和第二镜头组件拍摄得到的图片和视频进行拼接后,可以得到全视角的图片或视频,图片和视频的拼接过程可以在编码后进行,也可以先完成拼接再编码。
进一步地,当用户不需要进行全视角拍摄时,本发明实施例提供的上述拍摄图像的方法,如图3所示,还可以执行下述步骤:
步骤S31、根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
步骤S32、获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
步骤S33、对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
步骤S34、将经过畸变校正的图片或者视频输出。
上述步骤S31中,可以根据用户的需要,开启第一镜头组件或第二镜头组件,通常,相背设置的第一镜头组件和第二镜头组件一个为前置摄像头,一个为后置摄像头,用户可以通过预设的选择按钮或者按键,选择开启其中任何一个。
在步骤S32中,拍摄的鱼眼镜头的图片或视频由于达到了180°~235°的超大视角,桶形畸变非常明显。为了向用户显示非鱼眼镜头的显示效果,需要对经过鱼眼镜头拍摄的图片或者视频进行畸变校正,将畸变的图片或视频进行“拉平”。
鱼眼镜头的校正有多种方法,例如采用鱼眼镜头成像模型,完成像平面到物球面的坐标变换,用等弧长映射方法将球面的影像投射到柱面上,从而完成鱼眼镜头拍摄的图片的畸变校正。
又例如下述方法:利用鱼眼镜头成像眼里中的球面坐标模型,建立标准坐标系,该标准坐标系是假设鱼眼镜头的摄像机放在坐标原点,拍摄方向为OZ轴正方向,拍摄后的鱼眼图像落在OXY平面上,将球面的像素映射到目标视平面上(目标视平面是在OZ轴正方向上,与OXY平面平行并与OXY平面之间的距离为鱼眼净土物镜球面半径的平面)。然后建立OXY上各像素与坐标原点之间的距离与目标视平面上对应像素与该目标视频面原点之间距离的映射,然后使用修正参数,对OXY平面上的像素进行修正,最终得到目标视平面上的图片,这个目标视平面上的图片即最终经过畸变校正后的图片或视频。
上述各方法计算量比较大,本发明实施例还提供了一种更为简易的校正方法,该方法利用鱼眼镜头发生明显畸变的位置位于在图片(圆形)外围区域的特点,先将发生畸变的区域去除,然后对去除了该畸变区域的图片或者视频帧进行拉伸,使拉伸后的图片或者视频帧为矩形。
由于用户对于非全视角拍摄的需求下,一般而言,只需要鱼眼镜头拍摄的图片中相对位于中心区域的那部分内容即可满足需求,再加上发生明显畸变的位于一般位于图片的外围区域,因此,将畸变的区域先去除后,对去除畸变区域的图片或视频帧进行拉伸,计算量相对较小,可以提高鱼眼镜头拍摄的图片畸变校正的效率。
在拉伸的过程中,根据拉伸前图片的边缘的像素的数量,可确定最终拉伸的视频帧的大小。
以一个简单的例子来说,确定需要去除的畸变区域得步骤,如图4所示,可以按照下述步骤实现:
步骤S41、确定经过鱼眼镜头拍摄的圆形的图片或者视频帧中的内接正方形;
步骤S42、按照预设的圆弧度数,确定内接正方形内每两个相邻顶点之间向圆心方向凹进的四条圆弧;
步骤S43、将四条圆弧与图片或者视频帧的圆周之间围成的区域作为需要去 除的畸变区域。
如图5所示,四条圆弧以及鱼眼镜头拍摄的图片的边缘围成的阴影区域为需要去除的畸变区域。
圆弧的角度可以根据所使用的鱼眼镜头的焦距的大小来选择,总体的选择原则可以参照透镜的成像原理,即镜头的焦距越长,其视角越小,而对应需要去除的畸变区域的大小也越小,圆弧的弧度越小,即需要去除的畸变区域的大小与鱼眼镜头的焦距大小负相关。
例如视角为180°的鱼眼镜头拍摄的图片进行畸变区域去除时,其四条圆弧的弧度,相比较视角为235°的鱼眼镜头拍摄的图片进行畸变区域去除时,四条圆弧的弧度小。
如图5所示,对去除该畸变区域后的图片或视频帧进行拉伸,使拉伸的图片或视频帧为边长等于该圆弧的矩形(图5中右侧的矩形)。
较佳地,拉伸处理过程中可使用现有技术的各种图像处理算法,例如使用各种插值算法,使得拉伸后的图片更平滑,避免失真。
基于同一发明构思,本发明实施例还提供了一种拍摄图像的装置,由于该装置所解决问题的原理与前述使用本发明实施例提供的拍摄图像的方法相似,因此该装置的实施可以参见前述方法的实施,重复之处不再赘述。
如图6所示,本发明实施例提供的拍摄图像的装置,包括:
启动模块61,用于根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
获取模块62,用于分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
拼接模块63,用于对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接;
输出模块64,用于输出拼接后的图片或视频。
进一步地,本发明实施例提供的装置,如图6所示,还可以包括:校正模 块65;其中:
相应地,启动模块61,还用于根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
获取模块62,还用于获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
校正模块65,用于对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
输出模块64,还用于将经过畸变校正的图片或者视频输出。
进一步地,上述校正模块65,如图7所示,包括:
确定子模块651,用于针对第一镜头组件或者第二镜头组件拍摄得到的图片或者视频中的每个视频帧,确定其中需要去除的畸变区域;图片或者视频帧为圆形;
去除子模块652,用于将所述确定出的畸变区域去除;
拉伸子模块653,用于对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形。
进一步地,上述确定子模块651,具体用于确定圆形的所述图片或者视频帧中的内接正方形;按照预设的圆弧度数,确定所述内接正方形内每两个相邻顶点之间向所述圆心方向凹进的四条圆弧;将所述四条圆弧与所述图片或者视频帧的圆周之间围成的区域作为需要去除的畸变区域。
进一步地,上述需要去除的畸变区域的大小与所启动的第一镜头组件或者第二镜头组件中鱼眼镜头的焦距大小负相关。
进一步地,上述拉伸子模块653,具体用于对去除畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为边长等于所述圆弧的矩形。
本发明实施例提供的上述摄像头模组、移动终端及其拍摄图像的方法和装置,对现有技术进行了改进,在摄像头模组中,第一镜头组件和第二镜头组件相背布置且可以同时开启,第一镜头组件和第二镜头组件中包含的鱼眼镜头为 最外端的镜头,这样,由于鱼眼镜头是一种极端的广角镜头,其视角可达到180°~235°左右的范围,这样,当第一镜头组件和第二镜头组件同时开启时,相背布置的第一镜头组件、第二镜头组件通过位于在第一镜头组件和/或第二镜头组件内部的鱼眼镜头,就可以采集达到360°视角范围内的图像,实现拍摄全视角的照片和视频,提升了用户的使用体验。
进一步地,本发明实施例提供的摄像头模组、移动终端及其拍摄图像的方法和装置中,还可以选择性地只开启第一镜头组件或者第二镜头组件中的一个,然后,对第一镜头组件或第二镜头组件中的鱼眼镜头拍摄的图片或视频进行畸变校正,将经过畸变校正后的图片输出,使得用户在不需要进行全视角拍摄的时候也能够满足用户正常拍摄的需求。
本发明实施例又提供了一种摄像头模组拍摄图像的装置,包括:
处理器;
用于存储处理器可执行命令的存储器;
其中,处理器被配置为:
根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接后输出。
本发明实施例还提供了一种非临时性计算机可读存储介质,当所述存储介质中的指令由移动终端的处理器执行时,使得移动终端能够执行一种摄像头模组拍摄图像的方法,所述方法包括:
根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接后输 出。
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。

Claims (17)

  1. 一种摄像头模组,其特征在于,包括:第一镜头组件和第二镜头组件;
    所述第一镜头组件和第二镜头组件中均包括一个鱼眼镜头,且所述鱼眼镜头为第一镜头组件和第二镜头组件中最外端的镜头;
    所述第一镜头组件和第二镜头组件之间相背布置且能够同时开启。
  2. 如权利要求1所述的摄像头模组,其特征在于,所述第一镜头组件和第二镜头组件中均包含一个镜头,所述透镜为鱼眼镜头。
  3. 如权利要求1所述的摄像头模组,其特征在于,所述第一镜头组件和第二镜头组件中,均包含至少两个镜头,所述至少两个镜头中位于最外端的镜头为鱼眼镜头;
    所述鱼眼镜头内侧的镜头为非鱼眼镜头。
  4. 如权利要求1-3任一项所述的摄像头模组,其特征在于,所述摄像头模组还包括:两个滤光片、两个用于承接图像的图像传感器和一个柔性印刷电路板PCB;
    两个所述图像传感器分别固定安装于第一镜头组件和第二镜头组件下方;
    两个所述滤光片分别位于第一镜头组件与图像传感器之间以及所述第二镜头组件与图像传感器之间;
    所述两个图像传感器位于所述柔性PCB的两侧且与所述柔性PCB连接。
  5. 一种移动终端,其特征在于,所述移动终端具备如权利要求1-4任一项所述的摄像头模组。
  6. 一种使用如权利要求1-4任一项所述的摄像头模组拍摄图像的方法,其特征在于,包括:
    根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
    分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
    对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接后输 出。
  7. 如权利要求6所述的方法,其特征在于,所述方法还包括:
    根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
    获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
    对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
    将经过畸变校正的图片或者视频输出。
  8. 如权利要求7所述的方法,其特征在于,所述对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正,包括:
    针对第一镜头组件或者第二镜头组件拍摄得到的图片或者视频中的每个视频帧,确定其中需要去除的畸变区域;所述图片或者视频帧为圆形;
    将所述确定出的畸变区域去除;
    对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形。
  9. 如权利要求8所述的方法,其特征在于,确定其中需要去除的畸变区域,包括:
    确定圆形的所述图片或者视频帧中的内接正方形;
    按照预设的圆弧度数,确定所述内接正方形内每两个相邻顶点之间向所述圆心方向凹进的四条圆弧;
    将所述四条圆弧与所述图片或者视频帧的圆周之间围成的区域作为需要去除的畸变区域。
  10. 如权利要求9所述的方法,其特征在于,所述需要去除的畸变区域的大小与所启动的第一镜头组件或者第二镜头组件中鱼眼镜头的焦距大小负相关。
  11. 如权利要求8或9所述的方法,其特征在于,所述对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形,包括:
    对去除所述畸变区域的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为边长等于所述圆弧的矩形。
  12. 一种拍摄图像的装置,其特征在于,包括:
    启动模块,用于根据输入的全视角的拍摄指令,同时启动所述摄像头模组中的第一镜头组件和第二镜头组件进行拍摄;
    获取模块,用于分别获取所述第一镜头组件和第二镜头组件拍摄得到的图片或视频;
    拼接模块,用于对所述第一镜头组件和第二镜头组件拍摄得到的图片或视频进行拼接;
    输出模块,用于输出拼接后的图片或视频。
  13. 如权利要求12所述的装置,其特征在于,还包括:校正模块;其中:
    所述启动模块,还用于根据输入的非全视角的拍摄指令,启动第一镜头组件和第二镜头组件中的一个;
    所述获取模块,还用于获取第一镜头组件或者第二镜头组件拍摄得到的图片或视频;
    校正模块,用于对第一镜头组件或者第二镜头组件拍摄得到的图片或视频进行畸变校正;
    所述输出模块,还用于将经过畸变校正的图片或者视频输出。
  14. 如权利要求13所述的装置,其特征在于,所述校正模块,包括:
    确定子模块,用于针对第一镜头组件或者第二镜头组件拍摄得到的图片或者视频中的每个视频帧,确定其中需要去除的畸变区域;所述图片或者视频帧为圆形;
    去除子模块,用于将所述确定出的畸变区域去除;
    拉伸子模块,用于对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为矩形。
  15. 如权利要求14所述的装置,其特征在于,所述确定子模块,具体用于 确定圆形的所述图片或者视频帧中的内接正方形;按照预设的圆弧度数,确定所述内接正方形内每两个相邻顶点之间向所述圆心方向凹进的四条圆弧;将所述四条圆弧与所述图片或者视频帧的圆周之间围成的区域作为需要去除的畸变区域。
  16. 如权利要求15所述的装置,其特征在于,所述需要去除的畸变区域的大小与所启动的第一镜头组件或者第二镜头组件中鱼眼镜头的焦距大小负相关。
  17. 如权利要求15或16所述的装置,其特征在于,所述拉伸子模块,具体用于对去除所述畸变区域之外的图片或视频帧进行拉伸,使拉伸后的图片或视频帧为边长等于所述圆弧的矩形。
PCT/CN2016/083852 2015-12-01 2016-05-29 一种摄像头模组、移动终端及其拍摄图像的方法和装置 WO2017092261A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510867470.2 2015-12-01
CN201510867470.2A CN108307090A (zh) 2015-12-01 2015-12-01 一种摄像头模组、移动终端及其拍摄图像的方法和装置

Publications (1)

Publication Number Publication Date
WO2017092261A1 true WO2017092261A1 (zh) 2017-06-08

Family

ID=58796160

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/083852 WO2017092261A1 (zh) 2015-12-01 2016-05-29 一种摄像头模组、移动终端及其拍摄图像的方法和装置

Country Status (2)

Country Link
CN (1) CN108307090A (zh)
WO (1) WO2017092261A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113596312A (zh) * 2021-08-17 2021-11-02 江西百宏光电科技有限公司 一种摄像模组及其拍摄方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110113518B (zh) * 2019-06-03 2019-11-08 北京航宇智光科技有限公司 穿戴式全空间拍摄智能设备

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045773A1 (en) * 2007-11-06 2010-02-25 Ritchey Kurtis J Panoramic adapter system and method with spherical field-of-view coverage
KR101190824B1 (ko) * 2011-12-22 2012-10-15 김동현 개인휴대통신장치 및 전자장치 카메라용 이중복합렌즈
CN104092799A (zh) * 2014-07-24 2014-10-08 广东欧珀移动通信有限公司 手机全景摄像附件以及手机
CN104835118A (zh) * 2015-06-04 2015-08-12 浙江得图网络有限公司 通过两路鱼眼摄像头采集全景图像的方法
CN105049569A (zh) * 2015-08-20 2015-11-11 擎亚国际贸易(上海)有限公司 基于手机前后摄像头的全景照片合成方法
CN204948192U (zh) * 2015-08-17 2016-01-06 苏州瀚易特信息技术股份有限公司 一种外置全景摄像附件及全景摄像装置
CN105376471A (zh) * 2015-12-21 2016-03-02 景好 一种基于移动平台的全景拍摄系统及方法
CN105554478A (zh) * 2016-02-24 2016-05-04 深圳市车米云图科技有限公司 视频监控系统及方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045773A1 (en) * 2007-11-06 2010-02-25 Ritchey Kurtis J Panoramic adapter system and method with spherical field-of-view coverage
KR101190824B1 (ko) * 2011-12-22 2012-10-15 김동현 개인휴대통신장치 및 전자장치 카메라용 이중복합렌즈
CN104092799A (zh) * 2014-07-24 2014-10-08 广东欧珀移动通信有限公司 手机全景摄像附件以及手机
CN104835118A (zh) * 2015-06-04 2015-08-12 浙江得图网络有限公司 通过两路鱼眼摄像头采集全景图像的方法
CN204948192U (zh) * 2015-08-17 2016-01-06 苏州瀚易特信息技术股份有限公司 一种外置全景摄像附件及全景摄像装置
CN105049569A (zh) * 2015-08-20 2015-11-11 擎亚国际贸易(上海)有限公司 基于手机前后摄像头的全景照片合成方法
CN105376471A (zh) * 2015-12-21 2016-03-02 景好 一种基于移动平台的全景拍摄系统及方法
CN105554478A (zh) * 2016-02-24 2016-05-04 深圳市车米云图科技有限公司 视频监控系统及方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113596312A (zh) * 2021-08-17 2021-11-02 江西百宏光电科技有限公司 一种摄像模组及其拍摄方法

Also Published As

Publication number Publication date
CN108307090A (zh) 2018-07-20

Similar Documents

Publication Publication Date Title
CN113382168B (zh) 用于存储成像数据的重叠区以产生优化拼接图像的设备及方法
TWI692967B (zh) 影像裝置
WO2018214365A1 (zh) 图像校正方法、装置、设备、系统及摄像设备和显示设备
JP6263623B2 (ja) 画像生成方法及びデュアルレンズ装置
US8872887B2 (en) Object detection and rendering for wide field of view (WFOV) image acquisition systems
WO2017107700A1 (zh) 一种实现图像配准的方法及终端
WO2017088678A1 (zh) 长曝光全景图像拍摄装置和方法
US20160301868A1 (en) Automated generation of panning shots
US9549126B2 (en) Digital photographing apparatus and control method thereof
WO2019127512A1 (zh) 拍摄设备的图像处理方法、拍摄设备及可移动平台
WO2018045596A1 (zh) 一种处理方法及移动设备
JP2019533957A (ja) 端末のための撮影方法及び端末
CN103247020A (zh) 一种基于径向特征的鱼眼图像展开方法
CN110278366B (zh) 一种全景图像虚化方法、终端及计算机可读存储介质
CN111866523B (zh) 全景视频合成方法、装置、电子设备和计算机存储介质
CN105472263B (zh) 影像撷取方法及使用此方法的影像撷取设备
US20160292842A1 (en) Method and Apparatus for Enhanced Digital Imaging
US10212341B2 (en) Mobile electronic device with multiple cameras
WO2017092261A1 (zh) 一种摄像头模组、移动终端及其拍摄图像的方法和装置
US20230033956A1 (en) Estimating depth based on iris size
US10817992B2 (en) Systems and methods to create a dynamic blur effect in visual content
Popovic et al. Design and implementation of real-time multi-sensor vision systems
CN107659786A (zh) 一种全景视频监控装置及处理方法
JP6290038B2 (ja) 電子機器、方法及びプログラム
CN103546680A (zh) 一种无变形的全方位鱼眼摄像装置及实现方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869575

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.09.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16869575

Country of ref document: EP

Kind code of ref document: A1