WO2021102716A1 - 一种景深合成系统、相机和显微镜 - Google Patents

一种景深合成系统、相机和显微镜 Download PDF

Info

Publication number
WO2021102716A1
WO2021102716A1 PCT/CN2019/121127 CN2019121127W WO2021102716A1 WO 2021102716 A1 WO2021102716 A1 WO 2021102716A1 CN 2019121127 W CN2019121127 W CN 2019121127W WO 2021102716 A1 WO2021102716 A1 WO 2021102716A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
depth
module
unit
field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/121127
Other languages
English (en)
French (fr)
Inventor
庄堉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Sunsight Technologies Co Ltd
Original Assignee
Shenzhen Sunsight Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Sunsight Technologies Co Ltd filed Critical Shenzhen Sunsight Technologies Co Ltd
Priority to CN201980096048.8A priority Critical patent/CN113795862B/zh
Priority to PCT/CN2019/121127 priority patent/WO2021102716A1/zh
Publication of WO2021102716A1 publication Critical patent/WO2021102716A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to the technical field of image processing, in particular to a depth-of-field synthesis system, camera and microscope.
  • Traditional equipment with depth-of-field synthesis system generally has 3 independent systems, mainly optical system, imaging system, and depth-of-field synthesis algorithm system; the optical system is used to adjust the object distance of optical imaging to change the different focal planes of the object being photographed. Obtain clear images (focused images) of the subject at different heights.
  • the imaging system generally consists of a digital camera or image acquisition system, which is used to convert optical information into digital information.
  • the depth-of-field synthesis algorithm system is composed of a computer or an image processing system with powerful processing capabilities. It is used to calculate the focus of pictures with different focal planes, and then synthesize all the pictures into a clear picture.
  • the entire device is a very complex system that requires close coordination of various systems, including optical interfaces, mechanical control, image data transmission, image data processing, and so on.
  • the equipment requires that the optical system is supported by a lens that can automatically focus or controllable focus. If it does not have a driveable lens, the normal operation of the device cannot be achieved. However, most industrial application environments, or microscope application environments, use mechanical lenses that cannot be driven externally, which restricts the use of equipment with depth-of-field synthesis systems. If it is changed to a lens with driving capability, it will increase the cost of the equipment, and also increase the threshold for use, and it will not be able to be used in large quantities.
  • the present invention provides a depth of field synthesis system, camera and microscope, under the premise that the optical system is not capable of driving, such as a fixed focus or zoom ordinary lens, variable magnification microscope, stereo microscope, etc., and does not change the existing optical system In this case, it is also possible to realize the optical motion required for depth-of-field synthesis, and to collect images of different focal planes to meet the computing requirements of the back-end system.
  • a depth-of-field synthesis system including an image distance drive unit, a main control unit, a depth-of-field synthesis unit, and an image transmission unit;
  • the image distance drive unit changes the image distance with the object according to the control command of the main control unit, acquires images of different image distances of the object, and transmits them to the main control unit;
  • the main control unit processes the received image to form a data stream related to the change in image distance, selects to transmit the data stream to the depth synthesis unit, and provides valid data and depth data for the depth synthesis unit; or select Transmitting the data stream to the image transmission unit;
  • the depth-of-field synthesis unit realizes the synthesis of the image depth-of-field based on the data stream, and transmits it to the image transmission unit;
  • the image transmission unit outputs a data stream or an image synthesized by depth of field.
  • the image distance drive unit includes a sensor acquisition module, a motor drive module, and a motor limit module, the motor drive module is fixedly connected to the sensor acquisition module, and the motor limit module is fixed At the end position of the movement direction of the sensor acquisition module; the motor drive module receives the motor drive command from the main control unit, drives the sensor acquisition module to move, and adjusts the image distance; the sensor acquisition module collects data with different image distances Object image; the motor limit module monitors the position information of the sensor acquisition module and transmits it to the main control unit to generate depth information corresponding to different image distances of the object image.
  • the main control unit includes an image distance driving algorithm module, an image data preprocessing module, and an image control module;
  • the image distance drive algorithm module converts the image distance change parameter into a motor drive parameter, and sends it to the motor drive module;
  • the image data preprocessing module performs preprocessing operations on the images collected by the sensor acquisition module, and transmits them to the image control module;
  • the image control module performs parameter adjustment processing on the image after the preprocessing operation.
  • the depth-of-field synthesis unit includes a depth-of-field control module and a depth-of-field synthesis module,
  • the depth-of-field control module sets the motion interval corresponding to the depth-of-field synthesis according to the requirements of the depth-of-field synthesis; or synthesizes the corresponding motion interval according to the focus parameter by self-learning the depth-of-field; transmits the motion interval and the motion step to the image distance driving algorithm module ;
  • the depth-of-field synthesis module collects images with different depths of field, calculates the focus parameters of each pixel in these images and within a limited area, performs image synthesis according to the focus parameters, and selects the largest focus parameter among all image data at the same position and satisfies the conditions The image and depth information of the image are combined into one image until all the images are collected.
  • the image transmission unit includes one or more of an HDMI interface, a DVI interface, a USB interface, and a network interface.
  • a camera includes the depth synthesis system described above.
  • a microscope includes the depth-of-field synthesis system.
  • the beneficial effects of the present invention are: under the premise that the optical system is not capable of driving, such as fixed focus or zoom ordinary lens, variable magnification microscope, stereo microscope, etc., it can also be realized without changing the existing optical system.
  • the optical motion required for depth-of-field synthesis can collect images of different focal planes to meet the computing requirements of the back-end system.
  • Figure 1 is a schematic diagram of the principle of image imaging
  • Fig. 2 is a schematic block diagram of a depth synthesis system of the present invention.
  • the object in front of the lens is imaged behind the lens, the main plane of the lens is P; the focal point of the lens is F, F', and the corresponding focal length is f, f'; the distance from the object to the main plane is s, The distance from the image to the main plane is s'; according to the principle of Gaussian imaging, formula 1:
  • a clear real image can be obtained at the position located at s', this position is called the quasi-focus plane, if it leaves this plane, it is called the defocus plane; the object can be obtained on the quasi-focus plane
  • the clear image is a blurry image obtained on the defocused surface.
  • the lens automatically adjusts the focus module to adjust the focal position of the lens itself without changing the image distance s', and the resulting object can be clearly imaged at different s positions.
  • fixed-focus lenses and microscopes adjust the distance from the main plane P of the lens to the object without changing the focal length and image distance to obtain clear images of the object at different distances from the lens.
  • the above two traditional methods both condition the optical parameters or position of the front end to realize image acquisition of different focal planes of the object. It has a limitation in that the front end requires a motion structure to achieve the above parameter changes. Most of the lenses do not have this function, or some lenses can be customized with the above functions, but the cost is greatly increased.
  • the present invention proposes a method of changing the image distance to realize the image acquisition of different focal planes of the object by depth synthesis, move the adjusted motion structure to the back end of the optical system, and integrate it into the device of the present invention. All the shots without limitation. That is to say, the present invention obtains images of different planes of the subject by changing the image distance. Because this adjusted structure is moved into the device, all the front-end optical system is no longer limited, which can make the range of the depth-of-field synthesis system It has become more extensive.
  • the present invention proposes a depth synthesis system, including an image distance drive unit, a main control unit, a depth synthesis unit and an image transmission unit;
  • the image distance drive unit changes the image distance to the object according to the control command of the main control unit, acquires images of different image distances of the object, and transmits them to the main control unit;
  • the image distance drive unit includes a sensor acquisition module, a motor drive module, and a motor limit module.
  • the motor drive module is fixedly connected to the sensor acquisition module, and the motor limit module is fixed at the end position of the sensor acquisition module's movement direction; the motor drive module receives the main control unit
  • the motor drive command of the sensor drives the sensor acquisition module to move, such as rotation direction, stroke, etc., to adjust the image distance;
  • the sensor acquisition module collects object images with different image distances, and transmits the image data to the back-end main control unit for image processing Source data, and can also receive control signals transmitted from the main control unit for parameter adjustment;
  • the motor limit module mainly monitors whether the sensor acquisition module reaches the maximum, minimum or origin position, so that the main control unit can monitor the sensor acquisition module in real time Position, which forms the depth information of the image. If the sensor acquisition module reaches the limit position, the motor limit module sends a signal to notify the main control unit to monitor the limit position of the motor.
  • the main control unit processes the received image to form a data stream related to the change in image distance, chooses to transmit the data stream to the depth synthesis unit, and provides effective data and depth data for the depth synthesis unit; or chooses to transmit the data stream to the image Transmission unit
  • the main control unit includes an image distance driving algorithm module, an image data preprocessing module and an image control module; it realizes the preprocessing of the image data transmitted from the front end, so that it can meet the display standard picture or video, and output to the display terminal.
  • the image control module is used to adjust image parameters, such as image brightness, color gain, and image contrast.
  • the position of the sensor acquisition module is adjusted to obtain image data of different focal planes of the object being photographed, and the depth information transmitted by the motor limit module is associated with the image data captured in each frame, which is convenient The use of depth-of-field synthesis unit.
  • the image distance drive algorithm module converts the image distance change parameters into motor drive parameters, and sends them to the motor drive module;
  • the image data preprocessing module performs preprocessing operations on the images collected by the sensor acquisition module, including data decoding, data conversion, noise reduction, color restoration and other operations, so that it meets the standards of picture display or video display, and transmits it to the image control module;
  • the image control module performs parameter adjustment processing on the image after the preprocessing operation. For example, adjust the image brightness, contrast, color, color temperature, etc., so that the image can be restored to the real situation in various environments.
  • the depth-of-field synthesis unit realizes image depth-of-field synthesis based on the data stream and transmits it to the image transmission unit; the depth-of-field control module and the depth-of-field synthesis module collect images with different depths of field, and calculate the focus parameters of each pixel in these images and the limited area, according to the focus parameters Perform image synthesis, select the image and depth information with the largest focus parameter and meet the conditions among all the image data at the same position, and synthesize into one image until all the image acquisition is completed.
  • the depth-of-field control module can manually set the motion interval (start area/end area) corresponding to the depth-of-field synthesis according to the needs of the depth-of-field synthesis; or according to the focus parameters, self-learn the depth-of-field synthesis corresponding motion interval; transmit the motion interval and the motion step to Image distance drive algorithm module;
  • the depth of field synthesis module mainly collects the image data and depth information processed by the front-end image data preprocessing module, calculates the focus parameters of each pixel and small area of each frame of image, and combines these data with the result of each previous frame. For comparison, if the focus parameter of the current frame is larger than the accumulated focus parameter, and the limit condition of the area is met, the current focus parameter data is replaced with the accumulated focus parameter data, and the current depth information is also replaced with Inside the accumulated depth data. After the next frame of image comes, perform the same data processing until all the images are collected. When the sensor board moves from the start position to the end position, and all images are collected and calculated, the module will convert the accumulated data into a composite image with depth of field and transmit it to the image output unit.
  • the image transmission unit outputs a data stream or an image synthesized by depth of field.
  • the image transmission unit includes one or more of an HDMI interface, a DVI interface, a USB interface, and a network interface.
  • the video stream data output by the front end is displayed on the display through the DHMI interface or DVI interface, and the data can also be transmitted to the computer or other equipment through the USB, network and other interfaces. It is also possible to transfer the synthesized data of the depth of field to the above-mentioned equipment.
  • the present invention also provides a camera including a depth-of-field synthesis system.
  • the invention also provides a microscope including a depth-of-field synthesis system.
  • the present invention can also realize the optical system required for depth synthesis without changing the existing optical system under the premise that the optical system does not have the driveability, such as a fixed-focus or zoom ordinary lens, variable magnification microscope, stereo microscope, etc., and without changing the existing optical system Movement, collecting images of different focal planes, so that it can meet the computing needs of the back-end system.
  • the optical system does not have the driveability, such as a fixed-focus or zoom ordinary lens, variable magnification microscope, stereo microscope, etc.
  • the existing optical system Movement collecting images of different focal planes, so that it can meet the computing needs of the back-end system.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

本发明公开了一种景深合成系统，包括像距驱动单元、主控单元、景深合成单元和图像传输单元；像距驱动单元根据主控单元的控制命令，改变与物体的像距，获取物体不同像距的图像，并传输至主控单元；主控单元对接收到的图像进行处理，形成与像距变化相关的数据流，选择将数据流传输至景深合成单元，为景深合成单元提供有效数据和景深数据；或者选择将数据流传输至图像传输单元；景深合成单元基于数据流实现图像景深合成，传输至图像传输单元；图像传输单元输出数据流或景深合成后的图像。本发明不改变现有光学系统的情况下，也可以实现景深合成所需要光学运动，采集不同焦平面的图像，使其满足后端系统的计算需求。

Description

一种景深合成系统、相机和显微镜 技术领域
本发明涉及图像处理技术领域，特别是指一种景深合成系统、相机和显微镜。
背景技术
传统的具有景深合成系统的设备一般会有3个独立系统，主要有光学系统，成像系统，景深合成算法系统；光学系统是用于调整光学成像的物距达到改变被拍摄物体不同聚焦平面，以获取拍摄物体的不同高度的清晰图像(聚焦图像)。成像系统一般由一个数码相机或图像采集系统组成，用于将光学信息转换成数码信息。景深合成算法系统是由电脑或者有强大处理能力的图像处理系统组成，用于把不同焦平面的图片进行焦点计算，然后把所有图片合成一张清晰的图片。整个设备是一个相当复杂的系统，需要各个系统的紧密配合，包括光学接口，机械控制，图像数据传输，图像数据处理等等。
设备要求光学系统是具可以自动调焦或可控调焦的镜头作为支持，如果不具备可驱动的镜头是无法实现该设备的正常运作的。而大部分工业应用环境，或者显微镜应用环境里面是使用不可以使用外部驱动的机械镜头，所有使得具有景深合成系统的设备的使用受到条件的制约。如果将其改为具有驱动能力的镜头，则会提高设备的成本，同样也提高了使用门槛，无法真正的大量使用。
发明内容
本发明提出一种景深合成系统、相机和显微镜，在光学系统不具备可以驱动的前提下，如定焦或变焦的普通镜头，变倍显微镜，体视显微镜等，并且不改变现有光学系统的情况下，也可以实现景深合成所需要光学运动，采集不同焦平面的图像，使其满足后端系统的计算需求。
本发明的技术方案是这样实现的：
一种景深合成系统，包括像距驱动单元、主控单元、景深合成单元和图像传输单元；
所述像距驱动单元根据所述主控单元的控制命令，改变与物体的像距，获取物体不同像距的图像，并传输至所述主控单元；
所述主控单元对接收到的图像进行处理，形成与像距变化相关的数据流，选择将数据流传输至所述景深合成单元，为所述景深合成单元提供有效数据和景深数据；或者选择将数据流传输至所述图像传输单元；
所述景深合成单元基于数据流实现图像景深合成，传输至所述图像传输单元；
所述图像传输单元输出数据流或景深合成后的图像。
作为本发明的一个优选实施例，所述像距驱动单元包括sensor采集模块、马达驱动模块和马达限位模块，所述马达驱动模块与所述sensor采集模块固定连接，所述马达限位模块固定在所述sensor采集模块运动方向的终点位置；所述马达驱动模块接收所述主控单元的马达驱动命令，带动所述sensor采集模块运动，调整像距；所述sensor采集模块采集不同像距的物体图像；所述马达限位模块监测所述sensor采集模块的位置信息，传输至所述主控单元，生成物体图像对应不同像距的深度信息。
作为本发明的一个优选实施例，所述主控单元包括像距驱动算法模块、图像数据预处理模块和图像控制模块；
所述像距驱动算法模块将像距变化参数转换为马达驱动参数，发送至所述马达驱动模块；
所述图像数据预处理模块对所述sensor采集模块采集的图像进行预处理运算，传输至所述图像控制模块；
所述图像控制模块对预处理运算后的图像进行参数调整处理。
作为本发明的一个优选实施例，所述景深合成单元包括景深控制模块和景深合成模块，
所述景深控制模块根据景深合成的需求，设定景深合成对应的运动区间；或根据聚焦参数，自学习景深合成对应的运动区间；将运动区间和运动步进传输至所述像距驱动算法模块；
所述景深合成模块采集不同景深的图像，并计算这些图像里面各个像素点和限定区域内的聚焦参数，根据聚焦参数进行图像合成，在同个位置的所有图像数据里面选择聚焦参数最大且满足条件的图像和深度信息，合成到一张图像里面，直到所有图像采集完成。
作为本发明的一个优选实施例，所述图像传输单元包括HDMI接口、DVI接口、USB接口和网络接口中的一个或多个。
一种相机，包括所述的景深合成系统。
一种显微镜，包括所述的景深合成系统。
本发明的有益效果在于：在光学系统不具备可以驱动的前提下，如定焦或变焦的普通镜头，变倍显微镜，体视显微镜等，并且不改变现有光学系统的情况下，也可以实现景深合成所需要光学运动，采集不同焦平面的图像，使其满足后端系统的计算需求。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为图像成像的原理示意图；
图2为本发明一种景深合成系统的原理框图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是 全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
如图1所示，位于镜头前方的物体在镜头后成像，镜头的主平面为P；镜头的焦点为F，F’，对应的焦距为f，f’；物体到主平面的距离为s，而像到主平面的距离为s’；根据高斯成像的原理可以得出公式1：
Figure PCTCN2019121127-appb-000001
公式1
如果物体位于s处，那么可以在位于s’的位置上获取一个清晰的实像，这个位置称之为准焦面，如果离开这个平面则称之为离焦面；在准焦面上可以获得物体的清晰成像，在离焦面上获得的是一个模糊的成像。
在传统的相机中是通过镜头自动的调焦模块，调整镜头自身的焦点位置而不改变像距s’，而所得物体不同s位置的清晰成像。
而一般的定焦镜头和显微镜是在不改变焦距，像距的条件，调整镜头的主平面P到物体的距离而获得物体的到镜头不同距离下的的清晰成像。
以上两种传统的方式都是条件前端光学参数或位置来实现对物体的不同焦平面的图像采集，它有一个局限性，就是前端需要运动结构来实现上以上参数改变。而大部分镜头是不带这种功能的，或者有部分镜头可以定制，带有以上功能，但是大大的增加了成本。
从以上公式可以看出如果不改变镜头和物体到主平面的位置关系的条件下，调整像距s’，从而改变物距s，得到物体不同平面的清晰图片。所以本发明鉴于以上的实际情况，提出了改变像距的方法来实现景深合成对物体不同焦平面的图像采集，把调整的运动结构移到光学系统的后端，集成到本发明装置里面，适用的所有镜头，而不受限制。也就是说，本发明通过改变像距，获取被拍摄物体不同平面的图像，由于这个调整的结构移到了装置里面，所有对前端光学系统的也就不再有限制，可以使得景深合成系统的范围变的更加广泛。
如图2所示，本发明提出了一种景深合成系统，包括像距驱动单元、主控单元、景深合成单元和图像传输单元；
像距驱动单元根据主控单元的控制命令，改变与物体的像距，获取物体不同像距的图像，并传输至主控单元；
像距驱动单元包括sensor采集模块、马达驱动模块和马达限位模块，马达驱动模块与sensor采集模块固定连接，马达限位模块固定在sensor采集模块运动方向的终点位置；马达驱动模块接收主控单元的马达驱动命令，带动sensor采集模块运动，比如旋转方向，行程等，调整像距；sensor采集模块采集不同像距的物体图像，并把图像数据传输到后端的主控单元，用做图像处理的源数据，同时还可以接受主控单元传输过来控制信号，进行参数调整；马达限位模块主要是监控sensor采集模块是否达到最大，最小或者原点位置，从而使主控单元可以实时监控sensor采集模块的位置，形成图像的深度信息。如果sensor采集模块到达限位位置，则通过马达限位模块发出信号通知主控单元，实现对马达限位位置的监控。
主控单元对接收到的图像进行处理，形成与像距变化相关的数据流，选择将数据流传输至景深合成单元，为景深合成单元提供有效数据和景深数据；或者选择将数据流传输至图像传输单元；
主控单元包括像距驱动算法模块、图像数据预处理模块和图像控制模块；实现对前端传输过来的图像数据进行预处理，使其可以符合显示标准的图片或视频，并输出到显示端。同时还通过图像控制模块进行图像参数的调整，比如图像的亮度，颜色增益，图像对比度等。还会根据景深合成的需求，调整sensor采集模块的位置，获得被拍物体的不同焦平面的图像数据，并把马达限位模块传输过来的深度信息关联到每帧拍摄到的图像数据里面，便于景深合成单元的使用。
像距驱动算法模块将像距变化参数转换为马达驱动参数，发送至马达驱动模块；
图像数据预处理模块对sensor采集模块采集的图像进行预处理运算，包括数据解码，数据转换，降噪，颜色还原等运算，使其符合图片显示或视频显示的标准，传输至图像控制模块；
图像控制模块对预处理运算后的图像进行参数调整处理。比如调整图像的亮度，对比度，颜色，色温等，使图像可以还原各种环境下的真实情况。
景深合成单元基于数据流实现图像景深合成，传输至图像传输单元；景深控制模块和景深合成模块，采集不同景深的图像，并计算这些图像里面各个像 素点和限定区域内的聚焦参数，根据聚焦参数进行图像合成，在同个位置的所有图像数据里面选择聚焦参数最大且满足条件的图像和深度信息，合成到一张图像里面，直到所有图像采集完成。
景深控制模块根据景深合成的需求，可以手动设定景深合成对应的运动区间(开始区域/结束区域)；或根据聚焦参数，自学习景深合成对应的运动区间；将运动区间和运动步进传输至像距驱动算法模块；
景深合成模块主要是通过采集前端图像数据预处理模块处理完的图像数据和深度信息，计算每一帧图像的各个像素和小区域里面的聚焦参数，并把这些数据与之前每一帧累积的结果进行比较，如果当前帧的聚焦参数比累积的聚焦参数大，而且满足该区域的限制条件时，就将当前的聚焦参数数据替换到了累积的聚焦参数数据里面，同时也把当前的深度信息替换到累积的深度数据里面。下一帧图像来临后，进行同样的数据处理直到所有图像采集完成。当等到sensor板从开始位置移动到结束位置，并且所有图像都采集并计算完成后，该模块就会把累积的数据转换成一张景深合成后的图像，传输给图像输出单元。
图像传输单元输出数据流或景深合成后的图像。图像传输单元包括HDMI接口、DVI接口、USB接口和网络接口中的一个或多个。把前端输出的视频流数据通过DHMI接口或DVI接口显示到显示器上，同时也可以通过USB，网络等接口将数据传输的电脑上或其他设备上。也可以将景深合成后的数据传输到上述的设备上使用。
本发明还提出了一种相机，包括景深合成系统。
本发明还一种显微镜，包括景深合成系统。
本发明在光学系统不具备可以驱动的前提下，如定焦或变焦的普通镜头，变倍显微镜，体视显微镜等，并且不改变现有光学系统的情况下，也可以实现景深合成所需要光学运动，采集不同焦平面的图像，使其满足后端系统的计算需求。
以上仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (7)

  1. 一种景深合成系统，其特征在于：包括像距驱动单元、主控单元、景深合成单元和图像传输单元；
    所述像距驱动单元根据所述主控单元的控制命令，改变与物体的像距，获取物体不同像距的图像，并传输至所述主控单元；
    所述主控单元对接收到的图像进行处理，形成与像距变化相关的数据流，选择将数据流传输至所述景深合成单元，为所述景深合成单元提供有效数据和景深数据；或者选择将数据流传输至所述图像传输单元；
    所述景深合成单元基于数据流实现图像景深合成，传输至所述图像传输单元；
    所述图像传输单元输出数据流或景深合成后的图像。
  2. 根据权利要求1所述的一种景深合成系统，其特征在于：所述像距驱动单元包括sensor采集模块、马达驱动模块和马达限位模块，所述马达驱动模块与所述sensor采集模块固定连接，所述马达限位模块固定在所述sensor采集模块运动方向的终点位置；所述马达驱动模块接收所述主控单元的马达驱动命令，带动所述sensor采集模块运动，调整像距；所述sensor采集模块采集不同像距的物体图像；所述马达限位模块监测所述sensor采集模块的位置信息，传输至所述主控单元，生成物体图像对应不同像距的深度信息。
  3. 根据权利要求2所述的一种景深合成系统，其特征在于：所述主控单元包括像距驱动算法模块、图像数据预处理模块和图像控制模块；
    所述像距驱动算法模块将像距变化参数转换为马达驱动参数，发送至所述马达驱动模块；
    所述图像数据预处理模块对所述sensor采集模块采集的图像进行预处理运算，传输至所述图像控制模块；
    所述图像控制模块对预处理运算后的图像进行参数调整处理。
  4. 根据权利要求3所述的一种景深合成系统，其特征在于：所述景深合成单元包括景深控制模块和景深合成模块，
    所述景深控制模块根据景深合成的需求，设定景深合成对应的运动区间；或根据聚焦参数，自学习景深合成对应的运动区间；将运动区间和运动步进传输至所述像距驱动算法模块；
    所述景深合成模块采集不同景深的图像，并计算这些图像里面各个像素点和限定区域内的聚焦参数，根据聚焦参数进行图像合成，在同个位置的所有图像数据里面选择聚焦参数最大且满足条件的图像和深度信息，合成到一张图像里面，直到所有图像采集完成。
  5. 根据权利要求1-4任一项所述的一种景深合成系统，其特征在于：所述图像传输单元包括HDMI接口、DVI接口、USB接口和网络接口中的一个或多个。
  6. 一种相机，其特征在于，包括权利要求1-4任一项所述的景深合成系统。
  7. 一种显微镜，其特征在于，包括权利要求1-4任一项所述的景深合成系统。
PCT/CN2019/121127 2019-11-27 2019-11-27 一种景深合成系统、相机和显微镜 Ceased WO2021102716A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980096048.8A CN113795862B (zh) 2019-11-27 2019-11-27 一种景深合成系统、相机和显微镜
PCT/CN2019/121127 WO2021102716A1 (zh) 2019-11-27 2019-11-27 一种景深合成系统、相机和显微镜

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/121127 WO2021102716A1 (zh) 2019-11-27 2019-11-27 一种景深合成系统、相机和显微镜

Publications (1)

Publication Number Publication Date
WO2021102716A1 true WO2021102716A1 (zh) 2021-06-03

Family

ID=76129775

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/121127 Ceased WO2021102716A1 (zh) 2019-11-27 2019-11-27 一种景深合成系统、相机和显微镜

Country Status (2)

Country Link
CN (1) CN113795862B (zh)
WO (1) WO2021102716A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233440A (zh) * 2005-06-24 2008-07-30 诺基亚公司 利用滚动快门的自适应光平面形成
CN101976673A (zh) * 2010-09-29 2011-02-16 庄鸿 一种图像传感器芯片
CN102314683A (zh) * 2011-07-15 2012-01-11 清华大学 一种非平面图像传感器的计算成像方法和成像装置
CN104463817A (zh) * 2013-09-12 2015-03-25 华为终端有限公司 一种图像处理方法及装置
CN104506771A (zh) * 2014-12-18 2015-04-08 北京智谷睿拓技术服务有限公司 图像处理方法及装置
US20170094243A1 (en) * 2013-03-13 2017-03-30 Pelican Imaging Corporation Systems and Methods for Synthesizing Images from Image Data Captured by an Array Camera Using Restricted Depth of Field Depth Maps in which Depth Estimation Precision Varies
CN109803133A (zh) * 2019-03-15 2019-05-24 京东方科技集团股份有限公司 一种图像处理方法及装置、显示装置
CN209265065U (zh) * 2019-01-31 2019-08-16 周良云 一种可调节的显微镜支架

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3429755B2 (ja) * 1990-04-27 2003-07-22 株式会社日立製作所 撮像装置の被写界深度制御装置
JP2017050605A (ja) * 2015-08-31 2017-03-09 キヤノン株式会社 画像処理装置及び方法、撮像装置、プログラム
CN106210520B (zh) * 2015-11-05 2019-03-19 杭州舜立光电科技有限公司 一种自动调焦电子目镜及系统
US10270973B2 (en) * 2015-12-08 2019-04-23 Canon Kabushiki Kaisha Control device and imaging apparatus with a subject selectable mode with higher image blur correction
CN107493413A (zh) * 2017-09-01 2017-12-19 佛山科学技术学院 一种基于单透镜成像的大景深数字成像方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233440A (zh) * 2005-06-24 2008-07-30 诺基亚公司 利用滚动快门的自适应光平面形成
CN101976673A (zh) * 2010-09-29 2011-02-16 庄鸿 一种图像传感器芯片
CN102314683A (zh) * 2011-07-15 2012-01-11 清华大学 一种非平面图像传感器的计算成像方法和成像装置
US20170094243A1 (en) * 2013-03-13 2017-03-30 Pelican Imaging Corporation Systems and Methods for Synthesizing Images from Image Data Captured by an Array Camera Using Restricted Depth of Field Depth Maps in which Depth Estimation Precision Varies
CN104463817A (zh) * 2013-09-12 2015-03-25 华为终端有限公司 一种图像处理方法及装置
CN104506771A (zh) * 2014-12-18 2015-04-08 北京智谷睿拓技术服务有限公司 图像处理方法及装置
CN209265065U (zh) * 2019-01-31 2019-08-16 周良云 一种可调节的显微镜支架
CN109803133A (zh) * 2019-03-15 2019-05-24 京东方科技集团股份有限公司 一种图像处理方法及装置、显示装置

Also Published As

Publication number Publication date
CN113795862A (zh) 2021-12-14
CN113795862B (zh) 2024-06-21

Similar Documents

Publication Publication Date Title
US8466989B2 (en) Camera having image correction function, apparatus and image correction method
CN101272511B (zh) 图像深度信息和图像像素信息的获取方法及装置
US20160080657A1 (en) Image capturing device and digital zoom method
CN108462830B (zh) 摄像装置及摄像装置的控制方法
JP6996901B2 (ja) 内視鏡システム
CN105308947A (zh) 双孔径变焦数字摄影机
KR20110102695A (ko) 디지털 촬영 장치, 그 제어 방법, 및 컴퓨터 판독가능 저장매체
US20120050490A1 (en) Method and system for depth-information based auto-focusing for a monoscopic video camera
KR101038815B1 (ko) 고속 오토 포커스가 가능한 촬상 시스템
CN106506939B (zh) 一种图像采集装置及采集方法
CN201667683U (zh) 一种大变焦比自动聚焦一体化摄像机
CN112822371B (zh) 图像处理芯片、应用处理芯片、数据统计系统及方法
JP2015211302A (ja) 撮像装置、撮像システム
WO2021083082A1 (zh) 一种光路切换方法和监控模组
CN113837937A (zh) 多媒体处理芯片、电子设备图像融合方法和图像裁剪方法
CN104580895A (zh) 一种具有摄照同步工作能力的机载成像系统
JP2014135714A (ja) 立体映像信号処理装置及び立体映像撮像装置
CN107147848B (zh) 自动对焦方法及采用该方法的实时视频采集系统
CN113840075B (zh) 电子设备和基于电子设备的图像融合方法
CN113795862B (zh) 一种景深合成系统、相机和显微镜
CN209017154U (zh) 一种摄像机
JP7262940B2 (ja) 画像処理装置、撮像装置、画像処理装置の制御方法およびプログラム
JP2024077763A (ja) 制御装置、撮像装置、レンズ装置、制御方法、およびプログラム
JP6006506B2 (ja) 画像処理装置及び画像処理方法、プログラム、並びに記憶媒体
CN101867705A (zh) 一种大变焦比自动聚焦一体化摄像机

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19954461

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19954461

Country of ref document: EP

Kind code of ref document: A1