WO2016188269A1 - 一种图像采集设备 - Google Patents

一种图像采集设备 Download PDF

Info

Publication number
WO2016188269A1
WO2016188269A1 PCT/CN2016/079586 CN2016079586W WO2016188269A1 WO 2016188269 A1 WO2016188269 A1 WO 2016188269A1 CN 2016079586 W CN2016079586 W CN 2016079586W WO 2016188269 A1 WO2016188269 A1 WO 2016188269A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
light field
field camera
lens conversion
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/079586
Other languages
English (en)
French (fr)
Inventor
张汝民
刘迪军
苏国彬
刘鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Academy of Telecommunications Technology CATT
Original Assignee
China Academy of Telecommunications Technology CATT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Academy of Telecommunications Technology CATT filed Critical China Academy of Telecommunications Technology CATT
Publication of WO2016188269A1 publication Critical patent/WO2016188269A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/21—Combinations with auxiliary equipment, e.g. with clocks or memoranda pads

Definitions

  • the present invention relates to the field of image acquisition technologies, and in particular, to an image acquisition device.
  • the light field camera can obtain the entire four-dimensional light field in one shot, which can realize the function of taking pictures first and then focusing.
  • multiple parallax maps can be implemented, and a depth map can be obtained.
  • the light field camera sacrifices a certain spatial resolution to obtain the angular resolution, so its resolution is lower than that of the conventional imaging method, which is a defect of the light field camera.
  • 3D (3Dimensional, three-dimensional) printing technology makes the fabrication of microlens arrays unnecessary to perform complicated procedures such as mold opening, which greatly reduces the manufacturing cycle and cost of the microlens array.
  • the rapid advancement of mobile intelligent terminal technology and the high-speed processing of GPU (Graphics Processing Unit) enable real-time computing of large data images.
  • the external lens of various intelligent terminals realizes true zoom shooting after converting the lens into a standard lens.
  • the existing light field camera can realize one-shot multi-view image rendering, and the effect of focusing after photographing first is realized. Due to the precision of the imaging system and the thickness requirements of smart mobile terminals and the size of the camera sensor, it is difficult to implement a light field camera inside the mobile phone. Embedding the light field camera into the smart mobile terminal increases the cost and affects the traditional imaging function of the original smart terminal itself.
  • the prior art embeds the light field camera into the smart mobile terminal, which increases the cost and affects the traditional imaging function of the original smart terminal itself.
  • the embodiment of the invention provides an image acquisition device, which can realize an external light field camera without changing the structure of the original image acquisition device and the traditional camera function of the original device itself, thereby enabling the original image acquisition.
  • the device has the function of a light field camera.
  • An image collection device provided by the embodiment of the invention includes: a device body and an external light field camera; wherein
  • the light field camera includes a lens conversion device and a microlens array disposed on the lens conversion device, the device body including a camera and an image storage and processing module connected to the camera, the light field camera being connected through a lens conversion device The camera of the device body.
  • the image acquisition device provided by the embodiment of the present invention can realize the external light field camera without changing the structure of the original image acquisition device and the traditional imaging function of the original device itself, thereby enabling the original image acquisition device to have The function of the light field camera.
  • the device body is a smart mobile device.
  • the smart mobile device is a mobile phone or a tablet.
  • the microlens array is a square matrix composed of 16 microlenses.
  • each microlens is a circular microlens.
  • each of the circular microlenses has a diameter of 0.5 cm and a focal length of 1.6 mm.
  • the lens conversion device is a lens conversion device that converts a physical focal length of a camera of the device body to 8.4 mm.
  • the microlens array is 20 mm from the main surface of the camera.
  • FIG. 1 is a schematic structural diagram of an image collection device according to an embodiment of the present disclosure
  • FIG. 2 is a schematic flowchart of processing of an image collection device according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a microlens array according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of an external light field camera of an intelligent mobile terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of another microlens array according to an embodiment of the present invention.
  • the embodiment of the invention provides an image acquisition device, which can realize an external light field camera without changing the structure of the original image acquisition device and the traditional camera function of the original device itself, thereby enabling the original image acquisition.
  • the device has the function of a light field camera.
  • the embodiment of the present invention provides that the optical field camera is externally connected to the smart mobile terminal, and the mechanism of the original smart mobile terminal is not changed. And the traditional camera function does not affect the smart mobile terminal itself.
  • an image acquisition device includes: an apparatus body 11 and an external light field camera 10;
  • the light field camera includes a lens conversion device 102 and a microlens array 101 disposed on the lens conversion device, the device body including a camera 202 and an image storage and processing module 201 connected to the camera, the light field camera passing through the lens
  • the conversion device is connected to the camera of the device body.
  • the device body is a smart mobile device.
  • the smart mobile device is a device such as a mobile phone or a tablet computer.
  • an image acquisition device obtains an original image of a light field by one exposure of an external light field camera 10.
  • an image sequence focused at different depths and multiple viewing angles can be obtained.
  • Image sequence the calculation of the depth of the corresponding object in the scene (ie, the ranging function) can also be realized.
  • the cost is low and does not affect any function of the device body 11.
  • the external microlens array part provided by the embodiment of the invention realizes the light field on a smart device without changing the design of the smart mobile terminal through a microlens array and a standard lens conversion port. The effect of imaging.
  • a microlens array according to an embodiment of the present invention is a 5*5 microlens array 301, and d represents the side length dimension of each microlens, and each microlens is square.
  • the figure is only a schematic view of the microlens array.
  • the number, shape, and size of the microlenses included in the microlens array are not limited thereto.
  • the conversion models are also different, and different configuration conversions are specifically performed according to the parameters thereof.
  • the smart mobile terminal with a light field camera is mainly composed of a smart mobile terminal 401 (mobile phone, tablet computer, etc.) and a standard lens conversion interface ( The lens conversion device 402) and the microlens array 403 are composed. And the microlens array and the standard lens conversion interface are disposed outside the terminal camera, thereby constituting the intelligent mobile terminal with the light field camera provided by the embodiment of the present invention.
  • microlens array has only one specification, which matches the physical focal length of the camera after conversion.
  • the camera's camera parameters are: sensor 1/3.2 inch, 8.1 million pixels, lens equivalent focal length 29mm, conversion factor 6.9, physical focal length 4.2mm.
  • the physical focal length of the mobile phone camera has changed to 8.4 mm, and the equivalent focal length has become 60 mm.
  • the microlens array can be designed to match a 8.4 mm lens.
  • the microlens array in order to ensure binocular time difference in both the horizontal direction and the vertical direction, the microlens array employs 4*4 sub-lenses. Arranged in the form of a square matrix, as shown in Figure 5. Each microlens is designed with a circular lens with a diameter D of 0.5 cm and a focal length f of 1.6 mm. The diagonal matrix length D' of the composed square matrix was 3 cm. The specific mounting position of the microlens array on the lens conversion device is 20 mm away from the main surface of the mobile phone camera after the lens conversion device is mounted.
  • the scene will be 16 sub-images on the phone camera sensor, with horizontal or vertical parallax for each other. From the parallax, the depth estimation algorithm can roughly estimate the distance of the object in the scene.
  • an image acquisition device includes: an apparatus body and an external light field camera; wherein the light field camera includes a lens conversion device and a microlens array disposed on the lens conversion device,
  • the device body includes a camera and an image storage and processing module connected to the camera, and the light field camera is connected to the camera of the device body through a lens conversion device. Therefore, the image acquisition device provided by the embodiment of the present invention can realize the external light field camera without changing the structure of the original image acquisition device and the traditional imaging function of the original device itself, thereby enabling the original image acquisition device to have The function of the light field camera.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

本发明公开了一种图像采集设备，用以在不改变原来图像采集设备的结构，以及不影响原设备本身的传统摄像功能的情况下，实现外接光场相机，从而可以使得原图像采集设备具有光场相机的功能。本发明提供的一种图像采集设备，包括：设备本体和外接光场相机；其中，所述光场相机包括镜头转换装置和设置在镜头转换装置上的微透镜阵列，所述设备本体包括摄像头和与该摄像头相连的图像存储及处理模块，所述光场相机通过镜头转换装置连接所述设备本体的摄像头。

Description

一种图像采集设备
本申请要求在2015年5月22日提交中国专利局、申请号为201510267506.3、发明名称为“一种图像采集设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及图像采集技术领域，尤其涉及一种图像采集设备。
背景技术
随着科技的进步，带有照相功能的智能移动终端越来越普及，基本取代了卡片机的应用。可是，这种智能移动终端只是实现了普通数码相机的拍照功能，仍需要先对焦后拍照，一次曝光获得照片后不可做任何修改。
此外，光场相机一次拍摄可以获得整个四维光场，可以实现先拍照后聚焦的功能。另外，可以实现多视差图，并且可以获得深度图。然而，光场相机牺牲了一定的空间分辨率来获取角度分辨率，所以其分辨率相比传统的成像方式有所降低，这是光场相机的一个缺陷。
3D(3Dimensional，三维)打印技术的迅速发展，使得微透镜阵列的制作无须再进行开模等繁琐工序，大大降低了微透镜阵列的制作周期和成本。移动智能终端技术的快速进步，GPU(Graphics Processing Unit，图形处理器)的高速处理，使大数据图像的处理可以实现实时运算。各种智能终端的外接镜头，在将镜头转化为标准镜头后实现了真正意义上的可变焦拍摄。
现有的光场相机可实现一次曝光多视角图像渲染，先拍照后聚焦的效果实现。由于成像系统的精密性以及现在智能移动终端的厚度要求以及摄像传感器尺寸等的影响很难在手机内部实现光场相机。将光场相机嵌入到智能移动终端内部，增加了成本且影响了原来的智能终端本身摄像机传统成像的功能。
综上所述，现有技术中将光场相机嵌入到智能移动终端内部，增加了成本，影响了原来的智能终端本身摄像机传统成像的功能。
发明内容
本发明实施例提供了一种图像采集设备，用以在不改变原来图像采集设备的结构，以及不影响原设备本身的传统摄像功能的情况下，实现外接光场相机，从而可以使得原图像采集设备具有光场相机的功能。
本发明实施例提供的一种图像采集设备，包括：设备本体和外接光场相机；其中，
所述光场相机包括镜头转换装置和设置在镜头转换装置上的微透镜阵列，所述设备本体包括摄像头和与该摄像头相连的图像存储及处理模块，所述光场相机通过镜头转换装置连接所述设备本体的摄像头。
因此，本发明实施例提供的图像采集设备，在不改变原来图像采集设备的结构，以及不影响原设备本身的传统摄像功能的情况下，实现外接光场相机，从而可以使得原图像采集设备具有光场相机的功能。
较佳地，所述设备本体为智能移动设备。
较佳地，所述智能移动设备为手机或平板电脑。
较佳地，所述微透镜阵列为由16个微透镜组成的正方形矩阵。
较佳地，每一微透镜为圆形微透镜。
较佳地，每一圆形微透镜的直径为0.5cm，焦距为1.6mm。
较佳地，所述镜头转换装置为将所述设备本体的摄像头的物理焦距转换为8.4mm的镜头转换装置。
较佳地，所述微透镜阵列距离所述摄像头的主面20mm。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本发明的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的 不当限定。在附图中：
图1为本发明实施例提供的一种图像采集设备的结构示意图；
图2为本发明实施例提供的一种图像采集设备的处理流程示意图；
图3为本发明实施例提供的一种微透镜阵列的结构示意图；
图4为本发明实施例提供的一种智能移动终端外界光场相机的结构示意图；
图5为本发明实施例提供的另一种微透镜阵列的结构示意图。
具体实施方式
本发明实施例提供了一种图像采集设备，用以在不改变原来图像采集设备的结构，以及不影响原设备本身的传统摄像功能的情况下，实现外接光场相机，从而可以使得原图像采集设备具有光场相机的功能。
基于上面对现有的光场相机以及在智能移动终端实现光场相机的缺点分析上，本发明实施例提出，在智能移动终端上外接光场相机，并且不改变原来智能移动终端的机构，以及不影响智能移动终端本身的传统摄像功能。
参见图1，本发明实施例提供的一种图像采集设备，包括：设备本体11和外接光场相机10；其中，
所述光场相机包括镜头转换装置102和设置在镜头转换装置上的微透镜阵列101，所述设备本体包括摄像头202和与该摄像头相连的图像存储及处理模块201，所述光场相机通过镜头转换装置连接所述设备本体的摄像头。
较佳地，所述设备本体为智能移动设备。
较佳地，所述智能移动设备为手机或平板电脑等设备。
参见图2，本发明实施例提供的图像采集设备，通过外接光场相机10一次曝光获取光场原图，通过对光场原图进行渲染，可以获得聚焦在不同深度的图像序列，以及多视角图像序列。此外，还可以实现场景中相应物体的深度的计算(即测距功能)。并且，成本低，不影响设备本体11的任何功能。
本发明实施例提供的外接微透镜阵列部分，通过一个微透镜阵列和一个标准的镜头转换口，实现了在不改变智能移动终端本身设计的基础上，实现了在一种智能设备上实现光场成像的效果。
本发明实施例提供的一种微透镜阵列，如图3所示，为5*5微透镜阵列301，d表示每个微透镜的边长尺寸，每个微透镜为正方形。不过该图只是微透镜阵列的示意图，在发明中，微透镜阵列中包含的微透镜的数量、形状、尺寸不限于此。
对于本发明实施例中所述的镜头转换装置，由于不同型号的智能终端的摄像头参数不同，转换模型也不同，具体根据其参数进行不同的配置转换。
图4表示本发明带有光场相机的智能移动终端的示意图，由图4可知，带有光场相机的智能移动终端主要由智能移动终端401(手机，平板电脑等)、标准镜头转换接口(镜头转换装置402)以及微透镜阵列403组成。并且微透镜阵列及标准镜头转换接口置于终端摄像头外部，由此组成了本发明实施例提供的带有光场相机的智能移动终端。
需要说明的是，由于不同的手机或平板电脑的摄像头采用了不同的镜头焦距，所以需要针对不同的摄像头配置不同的镜头转换装置，将不同的手机镜头转换成相同的物理焦距。而微透镜阵列只有一个规格，它和摄像头转换后的物理焦距相匹配。
例如，手机的摄像头的参数为：传感器1/3.2英寸，810万像素，镜头等效焦距29mm，转换系数6.9，物理焦距4.2mm。在使用镜头转换装置后，手机摄像头的物理焦距发生了改变，变成了8.4mm，等效焦距变成了60mm。可以将微透镜阵列设计成和8.4mm的镜头相匹配。
相应地，微透镜的参数：为了保证水平方向和垂直方向都拥有双目时差，微透镜阵列采用4*4个子透镜。以正方形矩阵的形式排列，如图5所示。每一微透镜采用圆形透镜设计，直径D为0.5cm，焦距f为1.6mm。所组成的正方形矩阵的对角线长度D’为3cm。微透镜阵列在镜头转换装置上的具体的架设位置，距离安装镜头转换装置后的手机摄像头主面的距离为20mm。
此时，场景在手机摄像头传感器上将成16个子像，彼此分别具有水平或者垂直视差。从视差中，通过深度估计算法，可以粗略估算出场景中物体的距离。
综上所述，本发明实施例提供的一种图像采集设备，包括：设备本体和外接光场相机；其中，所述光场相机包括镜头转换装置和设置在镜头转换装置上的微透镜阵列，所述设备本体包括摄像头和与该摄像头相连的图像存储及处理模块，所述光场相机通过镜头转换装置连接所述设备本体的摄像头。因此，本发明实施例提供的图像采集设备，在不改变原来图像采集设备的结构，以及不影响原设备本身的传统摄像功能的情况下，实现外接光场相机，从而可以使得原图像采集设备具有光场相机的功能。
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。

Claims (8)

  1. 一种图像采集设备，其特征在于，包括：设备本体和外接光场相机；其中，
    所述光场相机包括镜头转换装置和设置在镜头转换装置上的微透镜阵列，所述设备本体包括摄像头和与该摄像头相连的图像存储及处理模块，所述光场相机通过镜头转换装置连接所述设备本体的摄像头。
  2. 根据权利要求1所述的图像采集设备，其特征在于，所述设备本体为智能移动设备。
  3. 根据权利要求2所述的图像采集设备，其特征在于，所述智能移动设备为手机或平板电脑。
  4. 根据权利要求1所述的图像采集设备，其特征在于，所述微透镜阵列为由16个微透镜组成的正方形矩阵。
  5. 根据权利要求4所述的图像采集设备，其特征在于，每一微透镜为圆形微透镜。
  6. 根据权利要求5所述的图像采集设备，其特征在于，每一圆形微透镜的直径为0.5cm，焦距为1.6mm。
  7. 根据权利要求6所述的图像采集设备，其特征在于，所述镜头转换装置为将所述设备本体的摄像头的物理焦距转换为8.4mm的镜头转换装置。
  8. 根据权利要求7所述的图像采集设备，其特征在于，所述微透镜阵列距离所述摄像头的主面20mm。
PCT/CN2016/079586 2015-05-22 2016-04-18 一种图像采集设备 Ceased WO2016188269A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510267506.3A CN106303166A (zh) 2015-05-22 2015-05-22 一种图像采集设备
CN201510267506.3 2015-05-22

Publications (1)

Publication Number Publication Date
WO2016188269A1 true WO2016188269A1 (zh) 2016-12-01

Family

ID=57393769

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/079586 Ceased WO2016188269A1 (zh) 2015-05-22 2016-04-18 一种图像采集设备

Country Status (2)

Country Link
CN (1) CN106303166A (zh)
WO (1) WO2016188269A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115250320B (zh) * 2021-04-28 2024-06-14 北京小米移动软件有限公司 图像获取方法及装置、电子设备、存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096655A (zh) * 2011-10-31 2013-05-08 深圳富泰宏精密工业有限公司 外置镜头固定结构及便携式电子装置
CN203101791U (zh) * 2012-12-26 2013-07-31 山东省科学院海洋仪器仪表研究所 红外变焦光场相机
CN103916502A (zh) * 2013-01-05 2014-07-09 昆山支付巨人信息科技有限公司 带有光场相机的移动终端
US8941722B2 (en) * 2012-01-03 2015-01-27 Sony Corporation Automatic intelligent focus control of video

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7620309B2 (en) * 2006-04-04 2009-11-17 Adobe Systems, Incorporated Plenoptic camera
CN201167353Y (zh) * 2007-12-10 2008-12-17 康佳集团股份有限公司 手机摄像装置
CN102833487B (zh) * 2012-08-08 2015-01-28 中国科学院自动化研究所 面向视觉计算的光场成像装置和方法
CN103024199A (zh) * 2012-12-28 2013-04-03 天津三星光电子有限公司 一种智能拍照手机
KR20140094395A (ko) * 2013-01-22 2014-07-30 삼성전자주식회사 복수 개의 마이크로렌즈를 사용하여 촬영하는 촬영 장치 및 그 촬영 방법
CN104580869B (zh) * 2013-10-10 2018-06-05 华为技术有限公司 一种光场相机
CN104580877B (zh) * 2013-10-29 2018-03-06 华为技术有限公司 图像获取的装置及方法
CN104506762B (zh) * 2014-12-25 2018-09-04 北京智谷睿拓技术服务有限公司 光场采集控制方法和装置、光场采集设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096655A (zh) * 2011-10-31 2013-05-08 深圳富泰宏精密工业有限公司 外置镜头固定结构及便携式电子装置
US8941722B2 (en) * 2012-01-03 2015-01-27 Sony Corporation Automatic intelligent focus control of video
CN203101791U (zh) * 2012-12-26 2013-07-31 山东省科学院海洋仪器仪表研究所 红外变焦光场相机
CN103916502A (zh) * 2013-01-05 2014-07-09 昆山支付巨人信息科技有限公司 带有光场相机的移动终端

Also Published As

Publication number Publication date
CN106303166A (zh) 2017-01-04

Similar Documents

Publication Publication Date Title
CN110036410B (zh) 用于从视图中获得距离信息的设备和方法
CN101888481B (zh) 成像设备
CN104050662B (zh) 一种用光场相机一次成像直接获取深度图的方法
CN104463949B (zh) 一种基于光场数字重聚焦的快速三维重建方法及其系统
TWI660629B (zh) 自我調整三維立體成像系統
EP3395059B1 (en) Method and apparatus for computational scheimpflug camera
CN111710001B (zh) 一种多介质条件下物像映射关系标定方法及标定装置
CN104954779B (zh) 一种集成成像三维显示中心深度平面的调节方法
KR20180037957A (ko) 저 f-수 플렌옵틱 카메라들을 위한 2-표면 마이크로렌즈 어레이를 갖는 방법들 및 장치들
CN104580869A (zh) 一种光场相机
WO2016139134A1 (en) Light field metadata
CN111340888A (zh) 一种无需白图像的光场相机检校方法及系统
CN106355621A (zh) 基于阵列图像的深度信息获取方法
WO2015192547A1 (zh) 一种基于移动终端的三维照片拍摄方法及移动终端
CN201662682U (zh) 一种立体摄像装置
EP3026629A1 (en) Method and apparatus for estimating depth of focused plenoptic data
CN108200324A (zh) 一种基于可变焦距镜头的成像系统及成像方法
TW201426018A (zh) 影像處理裝置及影像再對焦方法
CN106027861A (zh) 基于微相机阵列的光场采集装置及数据处理方法
CN204669468U (zh) 移动终端
CN108805921B (zh) 图像获取系统及方法
CN103401959A (zh) 具有3d照相功能的手机
CN110312123A (zh) 利用彩色图像和深度图像的集成成像显示内容生成方法
WO2016188269A1 (zh) 一种图像采集设备
CN101916035A (zh) 一种立体摄像装置及方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16799158

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16799158

Country of ref document: EP

Kind code of ref document: A1