WO2020042581A1 - Focusing method and device for image acquisition apparatus - Google Patents

Focusing method and device for image acquisition apparatus Download PDF

Info

Publication number
WO2020042581A1
WO2020042581A1 PCT/CN2019/077312 CN2019077312W WO2020042581A1 WO 2020042581 A1 WO2020042581 A1 WO 2020042581A1 CN 2019077312 W CN2019077312 W CN 2019077312W WO 2020042581 A1 WO2020042581 A1 WO 2020042581A1
Authority
WO
WIPO (PCT)
Prior art keywords
image acquisition
interest
target object
point
acquisition device
Prior art date
Application number
PCT/CN2019/077312
Other languages
French (fr)
Chinese (zh)
Inventor
付阳
王云飞
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Publication of WO2020042581A1 publication Critical patent/WO2020042581A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals

Definitions

  • the present application relates to the field of computers, and in particular, to a focusing method and device of an image acquisition device.
  • An image acquisition device is a device used to capture a target object to obtain a target image, such as a camera or a video camera.
  • the obtained target image can reflect the characteristics of the target object.
  • landscapes, animals, or people can be photographed through an image acquisition device, and target-to-object feature information can be acquired through the captured images.
  • a user's face image or eye image can be obtained, and the eye gaze point can be obtained by analyzing the eye feature information.
  • the lens parameters of the image acquisition device will also be determined accordingly, resulting in a fixed depth of field of the camera.
  • the sharpness of the acquired target image will decrease, such as the acquired face
  • the sharpness of the external image or eye image is reduced, resulting in inaccurate feature information acquisition of the target object, such as inaccurate eye feature information acquisition, and thus inaccurate gaze point estimation.
  • embodiments of the present application provide a focusing method and device of an image acquisition device.
  • An embodiment of the present application provides a focusing method for an image acquisition device, where the method includes:
  • the acquiring the actual distance between the point of interest on the target object and the image acquisition device includes:
  • the actual distance between the point of interest and the image acquisition device is obtained according to the actual distance between the point of interest and the distance measuring device.
  • determining and adjusting the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device includes:
  • the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
  • the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
  • acquiring the actual distance between the point of interest and the image acquisition device includes:
  • the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
  • the point of interest on the target object is the eyes of the user
  • the acquiring the actual distance between the point of interest and the image acquisition device includes:
  • the actual distance between the eyes of the user and the image acquisition device is determined according to the spot distance or the binocular distance.
  • the image acquisition device includes a CCD camera or a CMOS camera.
  • adjusting the focus position of the image acquisition device according to the actual distance includes:
  • a focus position of the image acquisition device is adjusted by using a voice coil motor.
  • An embodiment of the present application provides a focusing device for an image acquisition device, where the device includes:
  • a distance acquisition unit configured to acquire an actual distance between a point of interest on a target object and an image acquisition device, and the image acquisition device is configured to photograph the target object;
  • the adjustment unit is configured to adjust a focus position of the image acquisition device according to the actual distance.
  • the distance obtaining unit includes:
  • a target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image
  • a first direction determining unit configured to determine a direction of an interest point on the target object with respect to the image acquisition device according to a position of the interest point in the target image
  • An orientation adjustment unit configured to determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
  • a ranging control unit configured to control the ranging device to measure an actual distance between the point of interest and the ranging device
  • the first distance acquisition subunit is configured to obtain an actual distance between the interest point and the image acquisition device according to an actual distance between the interest point and the distance measuring device.
  • the orientation adjustment unit is set as:
  • the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
  • the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
  • the distance obtaining unit includes:
  • a depth map obtaining unit configured to obtain a depth map of the target object through a depth camera
  • the distance and direction acquisition unit is configured to acquire the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
  • the second distance acquisition subunit is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera.
  • the actual distance between the point of interest on the image and the image acquisition device is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera.
  • the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
  • the point of interest on the target object is the eyes of the user
  • the distance obtaining unit includes:
  • a light source control unit configured to control a light source to illuminate the target object
  • a target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image
  • An eye feature acquisition unit configured to determine, based on the target image, a spot distance or an eye distance between eyes in the target image
  • the third distance acquisition subunit is configured to determine an actual distance between the eyes of the user and the image acquisition device according to the spot distance or the binocular distance.
  • the image acquisition device includes a CCD camera or a CMOS camera.
  • the adjustment unit is set as:
  • a focus position of the image acquisition device is adjusted by using a voice coil motor.
  • An embodiment of the present application provides a method and device for focusing an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, wherein the image acquisition device is used to shoot the target object, and according to the point of interest of the target object
  • the actual distance from the image acquisition device, the focus position of the image acquisition device is adjusted to change the depth range of the image acquisition device, so that the target object is located within the depth range of the image acquisition device, in order to obtain a clear target image, improve Accuracy of the target object's feature information acquisition.
  • FIG. 1 is a flowchart of a focusing method of an image acquisition device according to an embodiment of the present application
  • FIG. 2 is a structural block diagram of a focusing device of an image acquisition device according to an embodiment of the present application.
  • an image acquisition device can be used to shoot a target object to obtain a target image, and then obtain characteristic information of the target object from the target image.
  • an image acquisition device based on the infrared frequency band can be used to capture the eyes of the user, obtain an eye image, analyze the feature information of the eyes in the eye image, and then obtain the user's gaze point.
  • the lens parameters of the image acquisition device are also determined accordingly, resulting in a fixed depth of field of the camera.
  • the sharpness of the acquired target image will decrease, such as the obtained face
  • the sharpness of the image or eye image is reduced, resulting in inaccurate feature information acquisition of the target object, such as inaccurate eye feature information acquisition, and thus inaccurate gaze point estimation.
  • a focusing method and device of an image acquisition device are obtained by acquiring an actual distance between a point of interest of a target object and the image acquisition device, where the image acquisition device is used to shoot the target object, Adjust the focus position of the image acquisition device according to the actual distance between the interest point of the target object and the image acquisition device, so that the depth of field range of the image acquisition device is changed, so that the target object is located within the depth of field range of the image acquisition device in order to obtain
  • the clear target image improves the accuracy of the target object's feature information acquisition.
  • FIG. 1 is a flowchart of a focusing method of an image acquisition device according to an embodiment of the present application. As shown in FIG. 1, the method includes the following execution steps.
  • Step S101 Acquire the actual distance between the interest point of the target object and the image acquisition device.
  • the image acquisition device may be an infrared camera, an infrared camera, or the like, which is used to capture a user's face image and / or eye image
  • its core imaging component may be a charge coupled device (CCD) or a complementary metal oxide Semiconductor (Complementary, Metal, Oxide, Semiconductor) (CMOS).
  • CCD charge coupled device
  • CMOS complementary metal oxide Semiconductor
  • the target object may be a photographed object, and may have a point of interest on the target object.
  • the target object may be, for example, a landscape, an animal, or a person, and specifically, may be a user's face or eyes.
  • the point of interest can be determined by the user.
  • the point of interest often needs to be captured by the user. Therefore, in the image obtained, the position of the point of interest usually requires higher definition. Based on this, the interest can be obtained from the captured image.
  • Feature information for points For example, when the user needs to obtain the characteristic information of the eyes, the eyes may be used as the points of interest. Of course, the eyebrows may also be used as the points of interest.
  • a target object can be captured by an image acquisition device to obtain a target image; according to the position of the point of interest in the target image, the direction of the point of interest on the target object relative to the image acquisition device is determined; The orientation of the point of interest on the target object relative to the image acquisition device determines and adjusts the orientation of the distance measuring device; controls the distance measuring device to measure the actual distance between the point of interest on the target object and the distance measuring device; The actual distance is the actual distance between the point of interest and the image acquisition device.
  • the obtained target image may be unclear, because the position of the target object may be outside the depth of field range of the image acquisition device, and the position of the target object is beyond the image acquisition device. The further out of the depth of field range, the less clear the target image is. Since there are points of interest on the target object, there are points of interest in the target image obtained by shooting the target object.
  • the position of the point of interest in the target image determine the direction of the point of interest on the target object with respect to the image acquisition device. Specifically, it can identify the point of interest in the target image and obtain the target The direction of the point of interest relative to the optical center of the lens of the image acquisition device. According to the principle of object imaging, it can be known that the opposite direction of the point of interest in the target image with respect to the direction of the optical center of the lens of the image acquisition device is the target object. The direction of the point of interest with respect to the optical center of the lens of the image acquisition device, and the direction of the point of interest on its target object with respect to the image acquisition device.
  • the orientation of the distance measurement device may be determined and adjusted according to the relative positions of the image acquisition device and the distance measurement device.
  • the ranging device can be set on the pan / tilt, and the orientation of the ranging device can be adjusted through the pan / tilt.
  • the actual distance between the image acquisition device and the ranging device is usually small, and the direction of the interest point on the target object relative to the image acquisition device may also be used as the interest point on the target object relative to the measurement
  • the direction of the distance measuring device, and the direction of the distance measuring device is adjusted according to the direction, so that the distance measuring device faces the interest point on the target object.
  • the relative position of the distance measurement device of the image acquisition device and the target object may be used in the spatial coordinate system.
  • the orientation of the point of interest on the image acquisition device determines the direction of the point of interest on the target object relative to the distance measuring device, and adjusts the orientation of the distance measurement device according to the direction, so that the distance measuring device is facing the target object. Points of Interest.
  • a coordinate transformation matrix may be determined according to the relative positions of the image acquisition device and the ranging device, and the coordinate transformation matrix and the direction of the interest point on the target object with respect to the image acquisition device may be used to obtain the relative interest point on the target object.
  • the coordinate transformation matrix reflects a conversion relationship between a coordinate system in which the image acquisition device is located and a coordinate system in which the ranging device is located.
  • the coordinate transformation matrix may include a translation transformation matrix and / or a rotation transformation matrix.
  • the orientation of the ranging device may be a direction facing the point of interest on the target object.
  • the ranging device may be controlled to measure the actual distance between the point of interest on the target object and the ranging device.
  • the ranging device may be an infrared ranging device or an ultrasonic ranging device.
  • an infrared or ultrasonic wave may be actively transmitted through a signal transmitter of the ranging device, and the infrared or ultrasonic wave is reflected by a point of interest on the target object.
  • the signal receiver of the ranging device can receive reflected infrared or ultrasonic waves, and the testing device can calculate the actual distance between the point of interest on the target object and the ranging device according to the time of infrared or ultrasonic transmission and reception.
  • the actual distance between the point of interest on the target object and the distance measuring device After the actual distance between the point of interest on the target object and the distance measuring device is obtained, the actual distance between the point of interest on the target object and the image acquisition device can be obtained according to the actual distance between the point of interest and the testing device. In an optional embodiment, the actual distance between the image acquisition device and the ranging device is usually small. The actual distance between the point of interest on the target object and the ranging device can be used as the point of interest between the target object and the image acquisition device. Actual distance.
  • the actual distance between the image acquisition device and the ranging device is greater than or equal to the preset distance, you can also in the spatial coordinate system according to the relative positions of the image acquisition device and the ranging device, and the points of interest on the target object and The actual distance of the distance measuring device determines the actual distance between the point of interest on the target object and the image acquisition device.
  • a depth map of the target object may be obtained through a depth camera; according to the obtained depth map, the actual distance between the point of interest on the target object and the depth camera and the point of interest on the target object relative to the depth camera are obtained.
  • Direction according to the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera, the actual distance between the point of interest on the target object and the image acquisition device is obtained.
  • the depth camera may be at least one of a Time of Flight (TOF) camera, a structured light camera, and a binocular ranging camera.
  • the obtained depth map may include feature information of the target object, and may be reflected on the target object.
  • the position of the point of interest can be determined from the depth image, and the actual distance between the point of interest on the target object and the depth camera can be obtained.
  • the actual distance between feature points on the target object and the depth camera can be represented by different colors in the depth map.
  • the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera can be specifically:
  • the actual distance between the point of interest on the target object and the depth camera is taken as the actual distance between the point of interest on the target object and the image acquisition device.
  • the relative position of the image acquisition device and the depth camera and the point of interest on the target object relative to the depth camera can also be used in the spatial coordinate system.
  • the direction and the actual distance between the point of interest on the target object and the depth camera determine the actual distance between the point of interest on the target object and the image acquisition device.
  • the point of interest on the target object is the eyes of the user
  • one or more light sources can be controlled to illuminate the target object
  • the target object is captured by using an image acquisition device to obtain a target image.
  • the target image can be used to determine Binocular distance in the target image; if there are multiple light sources, these light sources will form reflection points or light spots on the corneal surface of the human eye.
  • the eye spot distance in the target image can also be determined. According to the binocular distance or between multiple light spots The distance determines the actual distance between the user's eyes and the image acquisition device.
  • the light source may be an infrared light source
  • the image acquisition device may be an infrared image sensor
  • multiple light sources may be two sets of light sources on the left and right sides of the image acquisition device.
  • mapping relationship between the spot distance or binocular distance in the target image and the actual distance can be established.
  • the mapping relationship can be, for example, a function, that is, a function between the spot distance in the target image and the actual distance, or the target image.
  • the foregoing method of determining the actual distance between the user's eyes and the image acquisition device according to the spot distance or binocular distance can be selected according to the actual situation. For example, when the target image includes two eyes, the user can be determined by binocular distance The actual distance between your eyes and the image acquisition device.
  • Step S102 Adjust the focus position of the image acquisition device according to the actual distance between the point of interest on the target object and the image acquisition device.
  • Adjust the focus position of the image acquisition device Specifically, you can adjust the lens of the image acquisition device. For example, you can use a voice coil motor (VCM) to achieve linear or limited swing angle motion. The position of the lens is adjusted to change the focus position of the image acquisition device.
  • VCM voice coil motor
  • Adjust the focus position of the image acquisition device according to the actual distance between the point of interest on the target object and the image acquisition device. Specifically, you can combine the image acquisition device with the actual distance between the point of interest on the target object and the image acquisition device. Adjust the focus position of the image acquisition device. For example, if the actual distance between the point of interest on the target object and the image acquisition device is 80 cm, and the depth of field range of the image acquisition device is 45 cm to 70 cm, the focus position of the image acquisition device can be increased. So that the depth of field range of the image acquisition device can include the actual distance between the point of interest on the target object and the image acquisition device. Specifically, by increasing the focus position of the image acquisition device, the depth of field range of the image acquisition device can be adjusted to 60 cm to 85 cm, which can include an actual distance of 80 cm.
  • An embodiment of the present application provides a method for focusing an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, wherein the image acquisition device is used for shooting the target object, and according to the interest point of the target object and the image Obtain the actual distance of the device, adjust the focus position of the image acquisition device, and change the depth of field range of the image acquisition device, so that the target object is within the depth of field range of the image acquisition device, in order to obtain a clear target image and improve the target object Accuracy of feature information acquisition.
  • the embodiment of the present application further provides a focusing device of the image acquisition device.
  • the working principle is described in detail below with reference to the accompanying drawings.
  • FIG. 2 is a structural block diagram of a focusing device of an image acquisition device according to an embodiment of the present application. As shown in FIG. 2, the device includes:
  • the distance acquiring unit 110 is configured to acquire an actual distance between a point of interest on a target object and an image acquisition device, and the image acquisition device is configured to photograph the target object;
  • the adjusting unit 120 is configured to adjust a focus position of the image acquisition device according to the actual distance.
  • the distance obtaining unit includes:
  • a target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image
  • a first direction determining unit configured to determine a direction of an interest point on the target object with respect to the image acquisition device according to a position of the interest point in the target image
  • An orientation adjustment unit configured to determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
  • a ranging control unit configured to control the ranging device to measure an actual distance between the point of interest and the ranging device
  • the first distance acquisition subunit is configured to obtain an actual distance between the interest point and the image acquisition device according to an actual distance between the interest point and the distance measuring device.
  • the orientation adjustment unit is set as:
  • the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
  • the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
  • the distance obtaining unit includes:
  • a depth map obtaining unit configured to obtain a depth map of the target object through a depth camera
  • the distance and direction acquisition unit is configured to acquire the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
  • the second distance acquisition subunit is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera.
  • the actual distance between the point of interest on the image and the image acquisition device is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera.
  • the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
  • the point of interest on the target object is the eyes of the user
  • the distance obtaining unit includes:
  • a light source control unit configured to control a light source to illuminate the target object
  • a target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image
  • An eye feature acquisition unit configured to determine, based on the target image, a spot distance or an eye distance between eyes in the target image
  • the third distance acquisition subunit is configured to determine an actual distance between the eyes of the user and the image acquisition device according to the spot distance or the binocular distance.
  • the image acquisition device includes a CCD camera or a CMOS camera.
  • the adjustment unit is set as:
  • a focus position of the image acquisition device is adjusted by using a voice coil motor.
  • An embodiment of the present application provides a focusing device for an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, where the image acquisition device is used to shoot the target object, and according to the target point of interest and the image Obtain the actual distance of the device, adjust the focus position of the image acquisition device, and change the depth of field range of the image acquisition device, so that the target object is within the depth of field range of the image acquisition device, in order to obtain a clear target image and improve the target object. Accuracy of feature information acquisition.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (ROM), or a random access memory (Random Access Memory, RAM).

Abstract

Disclosed are a focusing method and device for an image acquisition apparatus. By acquiring an actual distance between the point of interest of a target object and an image acquisition apparatus, wherein the image acquisition apparatus is used for photographing the target object, and according to the actual distance between the point of interest of the target object and the image acquisition apparatus, adjusting the focusing position of the image acquisition apparatus, the present invention enables the range of depth of field of the image acquisition apparatus to be changed, thereby enabling the target object to be located within the range of depth of field of the image acquisition apparatus so as to acquire a clear target image, and improving the accuracy of acquiring the characteristic information of the target object.

Description

一种图像获取设备的对焦方法及装置Focusing method and device of image acquisition equipment 技术领域Technical field
本申请涉及计算机领域,尤其涉及一种图像获取设备的对焦方法及装置。The present application relates to the field of computers, and in particular, to a focusing method and device of an image acquisition device.
背景技术Background technique
图像获取设备是用来拍摄目标对象获取目标图像的设备,例如照相机或摄像机等,得到的目标图像可以体现目标对象的特征。在实际应用中,可以通过图像获取设备拍摄风景、动物或人物等,通过拍摄得到的图像可以获取目标对对象的特征信息。举例来说,可以获取用户的脸部图像或眼部图像,通过分析眼睛特征信息,进而得出用户的注视点。An image acquisition device is a device used to capture a target object to obtain a target image, such as a camera or a video camera. The obtained target image can reflect the characteristics of the target object. In practical applications, landscapes, animals, or people can be photographed through an image acquisition device, and target-to-object feature information can be acquired through the captured images. For example, a user's face image or eye image can be obtained, and the eye gaze point can be obtained by analyzing the eye feature information.
然而,在图像获取设备确定后时,图像获取设备的镜头参数也会相应确定,导致相机景深固定,在目标对象的位置超出景深范围时,获取的目标图像的清晰度会降低,例如获取的脸部图像或眼部图像的清晰度降低,导致目标对象的特征信息获取不准确,例如眼睛特征信息获取不准确,从而注视点估算不准确。However, when the image acquisition device is determined, the lens parameters of the image acquisition device will also be determined accordingly, resulting in a fixed depth of field of the camera. When the position of the target object exceeds the depth of field range, the sharpness of the acquired target image will decrease, such as the acquired face The sharpness of the external image or eye image is reduced, resulting in inaccurate feature information acquisition of the target object, such as inaccurate eye feature information acquisition, and thus inaccurate gaze point estimation.
发明内容Summary of the Invention
为了解决现有技术目标图像清晰度降低导致目标对象的特征信息获取不准确的问题,本申请实施例提供了一种图像获取设备的对焦方法及装置。In order to solve the problem of inaccurate acquisition of the characteristic information of the target object caused by the decrease in the sharpness of the target image in the prior art, embodiments of the present application provide a focusing method and device of an image acquisition device.
本申请实施例提供了一种图像获取设备的对焦方法,所述方法包括:An embodiment of the present application provides a focusing method for an image acquisition device, where the method includes:
获取目标对象上的兴趣点与图像获取设备的实际距离,所述图像获取设备用于对所述目标对象进行拍摄;Acquiring an actual distance between a point of interest on a target object and an image acquisition device, where the image acquisition device is used to shoot the target object;
根据所述实际距离对所述图像获取设备的对焦位置进行调节。Adjusting a focus position of the image acquisition device according to the actual distance.
可选的,所述获取目标对象上的兴趣点与图像获取设备的实际距离,包括:Optionally, the acquiring the actual distance between the point of interest on the target object and the image acquisition device includes:
利用图像获取设备对目标对象进行拍摄,得到目标图像;Use an image acquisition device to shoot the target object to obtain a target image;
根据兴趣点在所述目标图像中的位置,确定所述目标对象上的兴趣点相对于所述图像获取设备的方向;Determining the direction of the point of interest on the target object with respect to the image acquisition device according to the position of the point of interest in the target image;
根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向;Determining and adjusting the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
控制所述测距设备测量所述兴趣点与所述测距设备的实际距离;Controlling the ranging device to measure the actual distance between the point of interest and the ranging device;
根据所述兴趣点与所述测距设备的实际距离,得到所述兴趣点与所述图像获取设备的实际距离。The actual distance between the point of interest and the image acquisition device is obtained according to the actual distance between the point of interest and the distance measuring device.
可选的,所述根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向,包括:Optionally, determining and adjusting the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device includes:
根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,以及坐标变换矩阵,确定并调整所述测距设备的朝向,所述坐标变换矩阵体现所述图像获取设备所在的坐标系与所述测距设备所在的坐标系之间的换算关系。Determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device, and a coordinate transformation matrix, the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
可选的,所述测距设备包括红外测距设备和/或超声测距设备。Optionally, the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
可选的,所述获取所述兴趣点与图像获取设备的实际距离,包括:Optionally, acquiring the actual distance between the point of interest and the image acquisition device includes:
通过深度相机获取所述目标对象的深度图;Acquiring a depth map of the target object through a depth camera;
根据所述深度图,获取所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向;Obtaining the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
根据所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向,得到所述目标对象上的兴趣点与所述图像获取设备的实际距离。Obtaining the point of interest on the target object and the image acquisition according to the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera The actual distance of the device.
可选的,所述深度相机包括:TOF相机、结构光相机和双目测距相机的至少一种。Optionally, the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
可选的,所述目标对象上的兴趣点为用户的眼睛,所述获取所述兴趣点与图像获取设备的实际距离,包括:Optionally, the point of interest on the target object is the eyes of the user, and the acquiring the actual distance between the point of interest and the image acquisition device includes:
控制光源照射所述目标对象;Controlling a light source to illuminate the target object;
利用图像获取设备对目标对象进行拍摄,得到目标图像;Use an image acquisition device to shoot the target object to obtain a target image;
通过所述目标图像确定所述目标图像中眼睛的光斑间距或双眼间距;Determining the spot distance or binocular distance of the eyes in the target image by using the target image;
根据所述光斑间距或所述双眼间距确定所述用户的眼睛与所述图像获 取设备的实际距离。The actual distance between the eyes of the user and the image acquisition device is determined according to the spot distance or the binocular distance.
可选的,所述图像获取设备包括:CCD相机或CMOS相机。Optionally, the image acquisition device includes a CCD camera or a CMOS camera.
可选的,所述根据所述实际距离对所述图像获取设备的对焦位置进行调节,包括:Optionally, adjusting the focus position of the image acquisition device according to the actual distance includes:
根据所述实际距离,利用音圈马达对所述图像获取设备的对焦位置进行调节。According to the actual distance, a focus position of the image acquisition device is adjusted by using a voice coil motor.
本申请实施例提供了一种图像获取设备的对焦装置,所述装置包括:An embodiment of the present application provides a focusing device for an image acquisition device, where the device includes:
距离获取单元,设置为获取目标对象上的兴趣点与图像获取设备的实际距离,所述图像获取设备设置为对所述目标对象进行拍摄;A distance acquisition unit configured to acquire an actual distance between a point of interest on a target object and an image acquisition device, and the image acquisition device is configured to photograph the target object;
调节单元,设置为根据所述实际距离对所述图像获取设备的对焦位置进行调节。The adjustment unit is configured to adjust a focus position of the image acquisition device according to the actual distance.
可选的,所述距离获取单元,包括:Optionally, the distance obtaining unit includes:
目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄,得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
第一方向确定单元,设置为根据兴趣点在所述目标图像中的位置,确定所述目标对象上的兴趣点相对于所述图像获取设备的方向;A first direction determining unit configured to determine a direction of an interest point on the target object with respect to the image acquisition device according to a position of the interest point in the target image;
朝向调整单元,设置为根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向;An orientation adjustment unit configured to determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
测距控制单元,设置为控制所述测距设备测量所述兴趣点与所述测距设备的实际距离;A ranging control unit configured to control the ranging device to measure an actual distance between the point of interest and the ranging device;
第一距离获取子单元,设置为根据所述兴趣点与所述测距设备的实际距离,得到所述兴趣点与所述图像获取设备的实际距离。The first distance acquisition subunit is configured to obtain an actual distance between the interest point and the image acquisition device according to an actual distance between the interest point and the distance measuring device.
可选的,所述朝向调整单元设置为:Optionally, the orientation adjustment unit is set as:
根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,以及坐标变换矩阵,确定并调整所述测距设备的朝向,所述坐标变换矩阵体现所述图像获取设备所在的坐标系与所述测距设备所在的坐标系之间的换算关系。Determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device, and a coordinate transformation matrix, the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
可选的,所述测距设备包括红外测距设备和/或超声测距设备。Optionally, the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
可选的,所述距离获取单元,包括:Optionally, the distance obtaining unit includes:
深度图获取单元,设置为通过深度相机获取所述目标对象的深度图;A depth map obtaining unit configured to obtain a depth map of the target object through a depth camera;
距离和方向获取单元,设置为根据所述深度图,获取所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向;The distance and direction acquisition unit is configured to acquire the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
第二距离获取子单元,设置为根据所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向,得到所述目标对象上的兴趣点与所述图像获取设备的实际距离。The second distance acquisition subunit is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera. The actual distance between the point of interest on the image and the image acquisition device.
可选的,所述深度相机包括:TOF相机、结构光相机和双目测距相机的至少一种。Optionally, the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
可选的,所述目标对象上的兴趣点为用户的眼睛,所述距离获取单元,包括:Optionally, the point of interest on the target object is the eyes of the user, and the distance obtaining unit includes:
光源控制单元,设置为控制光源照射所述目标对象;A light source control unit configured to control a light source to illuminate the target object;
目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄,得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
眼睛特征获取单元,设置为通过所述目标图像确定所述目标图像中眼睛的光斑间距或双眼间距;An eye feature acquisition unit, configured to determine, based on the target image, a spot distance or an eye distance between eyes in the target image;
第三距离获取子单元,设置为根据所述光斑间距或所述双眼间距确定所述用户的眼睛与所述图像获取设备的实际距离。The third distance acquisition subunit is configured to determine an actual distance between the eyes of the user and the image acquisition device according to the spot distance or the binocular distance.
可选的,所述图像获取设备包括:CCD相机或CMOS相机。Optionally, the image acquisition device includes a CCD camera or a CMOS camera.
可选的,所述调节单元设置为:Optionally, the adjustment unit is set as:
根据所述实际距离,利用音圈马达对所述图像获取设备的对焦位置进行调节。According to the actual distance, a focus position of the image acquisition device is adjusted by using a voice coil motor.
本申请实施例提供的一种图像获取设备的对焦方法及装置,通过获取目标对象的兴趣点与图像获取设备的实际距离,其中图像获取设备用于对目标对象进行拍摄,根据目标对象的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节,使图像获取设备的景深范围发生改变,从而使目标对象位于图像获取设备的景深范围之内,以便得到清晰的目标图像,提高目标对象的特征信息获取的准确性。An embodiment of the present application provides a method and device for focusing an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, wherein the image acquisition device is used to shoot the target object, and according to the point of interest of the target object The actual distance from the image acquisition device, the focus position of the image acquisition device is adjusted to change the depth range of the image acquisition device, so that the target object is located within the depth range of the image acquisition device, in order to obtain a clear target image, improve Accuracy of the target object's feature information acquisition.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请中记载的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。In order to explain the technical solutions in the embodiments of the present application or the prior art more clearly, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some of the embodiments described in this application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative labor.
图1为本申请实施例提供的一种图像获取设备的对焦方法的流程图;FIG. 1 is a flowchart of a focusing method of an image acquisition device according to an embodiment of the present application; FIG.
图2为本申请实施例提供的一种图像获取设备的对焦装置的结构框图。FIG. 2 is a structural block diagram of a focusing device of an image acquisition device according to an embodiment of the present application.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
现有技术中,可以通过图像获取设备来对目标对象进行拍摄,得到目标图像,再从目标图像中获取目标对象的特征信息。例如可以依靠基于红外频段的图像获取设备对用户的眼睛进行拍摄,得到眼睛图像,分析眼睛图像中眼睛的特征信息,进而得出用户注视点。然而,在图像获取设备确定时,图像获取设备的镜头参数也会相应确定,导致相机景深固定,在目标对象的位置超出景深范围时,获取的目标图像的清晰度会降低,例如获取的脸部图像或眼部图像的清晰度降低,导致目标对象的特征信息获取不准确,例如眼睛特征信息获取不准确,从而注视点估算不准确。In the prior art, an image acquisition device can be used to shoot a target object to obtain a target image, and then obtain characteristic information of the target object from the target image. For example, an image acquisition device based on the infrared frequency band can be used to capture the eyes of the user, obtain an eye image, analyze the feature information of the eyes in the eye image, and then obtain the user's gaze point. However, when the image acquisition device is determined, the lens parameters of the image acquisition device are also determined accordingly, resulting in a fixed depth of field of the camera. When the position of the target object exceeds the depth of field range, the sharpness of the acquired target image will decrease, such as the obtained face The sharpness of the image or eye image is reduced, resulting in inaccurate feature information acquisition of the target object, such as inaccurate eye feature information acquisition, and thus inaccurate gaze point estimation.
尤其对于高清高帧率相机,其往往受到高帧速率的限制,曝光时间较短,因此具有大光圈,同时,由于高清的需求,往往具有长焦镜头,因此,其景深相对较小,目标对象所在的位置很容易超出景深范围,获取的目标图像更容易不清楚。Especially for high-definition high-frame-rate cameras, they are often limited by high frame rates and have short exposure times, so they have large apertures. At the same time, due to the demand for high-definition, they often have telephoto lenses, so their depth of field is relatively small and the target object is The location is easily beyond the depth of field range, and the target image obtained is more easily unclear.
为了解决上述技术问题,本申请实施例提供的一种图像获取设备的对 焦方法及装置,通过获取目标对象的兴趣点与图像获取设备的实际距离,其中图像获取设备用于对目标对象进行拍摄,根据目标对象的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节,使图像获取设备的景深范围发生改变,从而使目标对象位于图像获取设备的景深范围之内,以便得到清晰的目标图像,提高目标对象的特征信息获取的准确性。In order to solve the above technical problems, a focusing method and device of an image acquisition device provided in the embodiments of the present application are obtained by acquiring an actual distance between a point of interest of a target object and the image acquisition device, where the image acquisition device is used to shoot the target object, Adjust the focus position of the image acquisition device according to the actual distance between the interest point of the target object and the image acquisition device, so that the depth of field range of the image acquisition device is changed, so that the target object is located within the depth of field range of the image acquisition device in order to obtain The clear target image improves the accuracy of the target object's feature information acquisition.
图1为本申请实施例提供的一种图像获取设备的对焦方法的流程图,如图1所示,该方法包括以下执行步骤。FIG. 1 is a flowchart of a focusing method of an image acquisition device according to an embodiment of the present application. As shown in FIG. 1, the method includes the following execution steps.
步骤S101,获取目标对象的兴趣点与图像获取设备的实际距离。Step S101: Acquire the actual distance between the interest point of the target object and the image acquisition device.
图像获取设备可以是红外照相机、红外摄像机等,用于拍摄用户的脸部图像和/或眼部图像,其核心成像部件可以是电荷耦合元件(charge coupled device,CCD),也可以是互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)。The image acquisition device may be an infrared camera, an infrared camera, or the like, which is used to capture a user's face image and / or eye image, and its core imaging component may be a charge coupled device (CCD) or a complementary metal oxide Semiconductor (Complementary, Metal, Oxide, Semiconductor) (CMOS).
目标对象可以是被拍摄的物体,在目标对象上可以具有兴趣点。目标对象例如可以是风景、动物或人物等,具体的,可以是用户的脸部或眼睛。其中,兴趣点可以由用户确定,兴趣点往往需要是用户想重点拍摄的,因此在拍摄得到的图像中,兴趣点位置通常会需要更高的清晰度,据此可以从拍摄的图像中获取兴趣点的特征信息。例如用户需要获取眼睛的特征信息时,可以将眼睛作为兴趣点,当然,也可以将眉心作为兴趣点。The target object may be a photographed object, and may have a point of interest on the target object. The target object may be, for example, a landscape, an animal, or a person, and specifically, may be a user's face or eyes. Among them, the point of interest can be determined by the user. The point of interest often needs to be captured by the user. Therefore, in the image obtained, the position of the point of interest usually requires higher definition. Based on this, the interest can be obtained from the captured image. Feature information for points. For example, when the user needs to obtain the characteristic information of the eyes, the eyes may be used as the points of interest. Of course, the eyebrows may also be used as the points of interest.
获取目标对象的兴趣点与图像获取设备的实际距离,可以有多种方式。There are various ways to obtain the actual distance between the interest point of the target object and the image acquisition device.
作为一种可能的距离获取方式,可以通过图像获取设备对目标对象进行拍摄,得到目标图像;根据兴趣点在目标图像中的位置,确定目标对象上的兴趣点相对于图像获取设备的方向;根据目标对象上的兴趣点相对于图像获取设备的方向,确定并调整测距设备的朝向;控制测距设备测量目标对象上的兴趣点与测距设备的实际距离;根据兴趣点与测距设备的实际距离,得到兴趣点与图像获取设备的实际距离。As a possible distance acquisition method, a target object can be captured by an image acquisition device to obtain a target image; according to the position of the point of interest in the target image, the direction of the point of interest on the target object relative to the image acquisition device is determined; The orientation of the point of interest on the target object relative to the image acquisition device determines and adjusts the orientation of the distance measuring device; controls the distance measuring device to measure the actual distance between the point of interest on the target object and the distance measuring device; The actual distance is the actual distance between the point of interest and the image acquisition device.
具体的,通过图像获取设备对目标对象进行拍摄,得到的目标图像可以是不清晰的,因为此时目标对象的位置可以在图像获取设备的景深范围之外,且目标对象的位置超出图像获取设备的景深范围之外越远,得到的 目标图像越不清晰。由于目标对象上具有兴趣点,因此对目标对象进行拍摄得到的目标图像中具有兴趣点。Specifically, when the target object is captured by the image acquisition device, the obtained target image may be unclear, because the position of the target object may be outside the depth of field range of the image acquisition device, and the position of the target object is beyond the image acquisition device. The further out of the depth of field range, the less clear the target image is. Since there are points of interest on the target object, there are points of interest in the target image obtained by shooting the target object.
通过兴趣点在目标图像的位置,确定目标对象上的兴趣点相对于图像获取设备的方向,可以具体为,识别目标图像中的兴趣点,通过兴趣点在目标图像中的位置,获取目标图像中的兴趣点相对于图像获取设备的镜头的光心的方向,根据物体成像原理可知,目标图像中的兴趣点相对于图像获取设备的镜头的光心的方向的反方向,即为目标对象上的兴趣点相对于图像获取设备的镜头的光心的方向,将其目标对象上的兴趣点相对于图像获取设备的方向。According to the position of the point of interest in the target image, determine the direction of the point of interest on the target object with respect to the image acquisition device. Specifically, it can identify the point of interest in the target image and obtain the target The direction of the point of interest relative to the optical center of the lens of the image acquisition device. According to the principle of object imaging, it can be known that the opposite direction of the point of interest in the target image with respect to the direction of the optical center of the lens of the image acquisition device is the target object. The direction of the point of interest with respect to the optical center of the lens of the image acquisition device, and the direction of the point of interest on its target object with respect to the image acquisition device.
在确定目标对象上的兴趣点相对于图像获取设备的方向后,可以根据图像获取设备和测距设备的相对位置,确定并调整测距设备的朝向。具体的,测距设备可以设置在云台上,通过云台调节测距设备的朝向。After determining the direction of the point of interest on the target object with respect to the image acquisition device, the orientation of the distance measurement device may be determined and adjusted according to the relative positions of the image acquisition device and the distance measurement device. Specifically, the ranging device can be set on the pan / tilt, and the orientation of the ranging device can be adjusted through the pan / tilt.
在一个可选实施例中,图像获取设备和测距设备的实际距离通常较小,则还可以将目标对象上的兴趣点相对于图像获取设备的方向,作为目标对象上的兴趣点相对于测距设备的方向,根据该方向对测距设备的朝向进行调整,使测距设备正对目标对象上的兴趣点。In an optional embodiment, the actual distance between the image acquisition device and the ranging device is usually small, and the direction of the interest point on the target object relative to the image acquisition device may also be used as the interest point on the target object relative to the measurement The direction of the distance measuring device, and the direction of the distance measuring device is adjusted according to the direction, so that the distance measuring device faces the interest point on the target object.
在一个可选实施例中,若图像获取设备的和测距设备的实际距离大于或等于预设距离,则可以在空间坐标系中,根据图像获取设备的测距设备的相对位置,以及目标对象上的兴趣点相对于图像获取设备的方向,确定目标对象上的兴趣点相对于测距设备的方向,并根据该方向对测距设备的朝向进行调整,使测距设备正对目标对象上的兴趣点。In an optional embodiment, if the actual distance between the image acquisition device and the distance measurement device is greater than or equal to the preset distance, the relative position of the distance measurement device of the image acquisition device and the target object may be used in the spatial coordinate system. The orientation of the point of interest on the image acquisition device determines the direction of the point of interest on the target object relative to the distance measuring device, and adjusts the orientation of the distance measurement device according to the direction, so that the distance measuring device is facing the target object. Points of Interest.
例如,可以根据图像获取设备和测距设备的相对位置,确定坐标变换矩阵,根据坐标变换矩阵,以及目标对象上的兴趣点相对于所述图像获取设备的方向,得到目标对象上的兴趣点相对于测距设备的方向,从而根据该方向调整测距设备的朝向,使测距设备正对目标对象上的兴趣点。其中,坐标变换矩阵体现图像获取设备所在的坐标系和测距设备所在的坐标系之间的换算关系,坐标变换矩阵可以包括平移变换矩阵和/或旋转变换矩阵等。For example, a coordinate transformation matrix may be determined according to the relative positions of the image acquisition device and the ranging device, and the coordinate transformation matrix and the direction of the interest point on the target object with respect to the image acquisition device may be used to obtain the relative interest point on the target object. According to the direction of the ranging device, so that the orientation of the ranging device is adjusted according to the direction, so that the ranging device faces the point of interest on the target object. The coordinate transformation matrix reflects a conversion relationship between a coordinate system in which the image acquisition device is located and a coordinate system in which the ranging device is located. The coordinate transformation matrix may include a translation transformation matrix and / or a rotation transformation matrix.
在调整测距设备的朝向后,测距设备的朝向可以为正对目标对象上的 兴趣点的方向,此时,可以控制测距设备测量目标对象上的兴趣点与测距设备的实际距离。其中,测距设备可以是红外测距设备或超声测距设备等,具体实施时,可以通过测距设备的信号发射器主动发射红外线或超声波,红外线或超声波经过目标对象上的兴趣点进行反射,测距设备的信号接收器可以接收反射的红外线或超声波,测试设备可以根据红外线或超声波发射的时间和接收的时间,计算目标对象上的兴趣点与测距设备之间的实际距离。After the orientation of the ranging device is adjusted, the orientation of the ranging device may be a direction facing the point of interest on the target object. At this time, the ranging device may be controlled to measure the actual distance between the point of interest on the target object and the ranging device. The ranging device may be an infrared ranging device or an ultrasonic ranging device. In specific implementation, an infrared or ultrasonic wave may be actively transmitted through a signal transmitter of the ranging device, and the infrared or ultrasonic wave is reflected by a point of interest on the target object. The signal receiver of the ranging device can receive reflected infrared or ultrasonic waves, and the testing device can calculate the actual distance between the point of interest on the target object and the ranging device according to the time of infrared or ultrasonic transmission and reception.
在得到目标对象上的兴趣点与测距设备的实际距离后,可以根据该兴趣点与测试设备的实际距离,得到目标对象上的兴趣点与图像获取设备的实际距离。在一个可选实施例中,图像获取设备和测距设备的实际距离通常较小,可以将目标对象上的兴趣点与测距设备的实际距离,作为目标对象上的兴趣点与图像获取设备的实际距离。当然,若图像获取设备的和测距设备的实际距离大于或等于预设距离,则还可以在空间坐标系中,根据图像获取设备和测距设备的相对位置,以及目标对象上的兴趣点与测距设备的实际距离,确定目标对象上的兴趣点与图像获取设备的实际距离。After the actual distance between the point of interest on the target object and the distance measuring device is obtained, the actual distance between the point of interest on the target object and the image acquisition device can be obtained according to the actual distance between the point of interest and the testing device. In an optional embodiment, the actual distance between the image acquisition device and the ranging device is usually small. The actual distance between the point of interest on the target object and the ranging device can be used as the point of interest between the target object and the image acquisition device. Actual distance. Of course, if the actual distance between the image acquisition device and the ranging device is greater than or equal to the preset distance, you can also in the spatial coordinate system according to the relative positions of the image acquisition device and the ranging device, and the points of interest on the target object and The actual distance of the distance measuring device determines the actual distance between the point of interest on the target object and the image acquisition device.
在一个可选实施例中,可以通过深度相机获取目标对象的深度图;根据获取的深度图,获取目标对象上的兴趣点与深度相机的实际距离以及目标对象上的兴趣点相对于深度相机的方向;根据目标对象上的兴趣点与深度相机的实际距离,以及目标对象上的兴趣点相对于深度相机的方向,得到目标对象上的兴趣点与图像获取设备的实际距离。In an optional embodiment, a depth map of the target object may be obtained through a depth camera; according to the obtained depth map, the actual distance between the point of interest on the target object and the depth camera and the point of interest on the target object relative to the depth camera are obtained. Direction; according to the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera, the actual distance between the point of interest on the target object and the image acquisition device is obtained.
具体的,深度相机可以是飞行时间(Time of Flight,TOF)相机、结构光相机和双目测距相机的至少一种,得到的深度图可以包括目标对象的特征信息,通过可以体现目标对象上的特征点与深度相机之间的实际距离。可以从深度图像中确定兴趣点的位置,即可获取目标对象上的兴趣点与深度相机的实际距离。例如深度图中可以通过不同的颜色表示目标对象上的特征点与深度相机的实际距离。Specifically, the depth camera may be at least one of a Time of Flight (TOF) camera, a structured light camera, and a binocular ranging camera. The obtained depth map may include feature information of the target object, and may be reflected on the target object. The actual distance between the feature point and the depth camera. The position of the point of interest can be determined from the depth image, and the actual distance between the point of interest on the target object and the depth camera can be obtained. For example, the actual distance between feature points on the target object and the depth camera can be represented by different colors in the depth map.
类似的,根据目标对象上的兴趣点与深度相机的实际距离,以及目标对象上的兴趣点相对于深度相机的方向,得到目标对象上的兴趣点与图像获取设备的实际距离,可以具体为:将目标对象上的兴趣点与深度相机的 实际距离,作为目标对象上的兴趣点与图像获取设备的实际距离。当然,若获取设备的和深度相机的实际距离大于或等于预设距离,则还可以在空间坐标系中,根据图像获取设备和深度相机的相对位置、目标对象上的兴趣点相对于深度相机的方向,以及目标对象上的兴趣点与深度相机的实际距离,确定目标对象上的兴趣点与图像获取设备的实际距离。Similarly, according to the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera, the actual distance between the point of interest on the target object and the image acquisition device can be specifically: The actual distance between the point of interest on the target object and the depth camera is taken as the actual distance between the point of interest on the target object and the image acquisition device. Of course, if the actual distance between the acquisition device and the depth camera is greater than or equal to the preset distance, the relative position of the image acquisition device and the depth camera and the point of interest on the target object relative to the depth camera can also be used in the spatial coordinate system. The direction and the actual distance between the point of interest on the target object and the depth camera determine the actual distance between the point of interest on the target object and the image acquisition device.
在一个可选实施例中,目标对象上的兴趣点为用户的眼睛,则可以控制一个或多个光源照射目标对象,利用图像获取设备对目标对象进行拍摄,得到目标图像,通过目标图像可以确定目标图像中双眼间距;若光源为多个,则这些光源将在人眼角膜表面形成反射点或光斑,此时也可确定目标图像中的眼睛的光斑间距,根据双眼间距或多个光斑之间的间距确定用户的眼睛与图像获取设备的实际距离。In an optional embodiment, the point of interest on the target object is the eyes of the user, then one or more light sources can be controlled to illuminate the target object, and the target object is captured by using an image acquisition device to obtain a target image. The target image can be used to determine Binocular distance in the target image; if there are multiple light sources, these light sources will form reflection points or light spots on the corneal surface of the human eye. At this time, the eye spot distance in the target image can also be determined. According to the binocular distance or between multiple light spots The distance determines the actual distance between the user's eyes and the image acquisition device.
其中,光源可以是红外光源,图像获取设备可以为红外图像传感器,可选的,多个光源可以为图像获取设备左右两侧的两组光源。The light source may be an infrared light source, and the image acquisition device may be an infrared image sensor. Optionally, multiple light sources may be two sets of light sources on the left and right sides of the image acquisition device.
可以理解的是,目标图像中双眼间距越小,则用户与图像获取设备之间的实际距离越大,类似的,目标图像中的同一眼睛中的光斑间距越小,则用户眼睛与图像获取设备之间的实际距离越大。根据该特性,可以建立目标图像中的光斑间距或双眼间距和实际距离之间的映射关系,映射关系例如可以是函数,即建立目标图像中的光斑间距和实际距离之间的函数,或目标图像中的双眼间距和实际距离之间的函数。通过建立完成的映射关系,可以由光斑间距或双眼间距估算用户的眼睛与图像获取设备的实际距离。It can be understood that the smaller the binocular distance in the target image, the greater the actual distance between the user and the image acquisition device. Similarly, the smaller the spot distance in the same eye in the target image, the smaller the user's eye and the image acquisition device. The greater the actual distance between them. According to this characteristic, a mapping relationship between the spot distance or binocular distance in the target image and the actual distance can be established. The mapping relationship can be, for example, a function, that is, a function between the spot distance in the target image and the actual distance, or the target image. A function between binocular distance and actual distance in. By establishing the completed mapping relationship, the actual distance between the user's eyes and the image acquisition device can be estimated from the spot spacing or binocular spacing.
可以理解的是,上述根据光斑间距或双眼间距确定用户的眼睛与图像获取设备的实际距离的方式,可以根据实际情况进行选择,例如可以在目标图像包括两个眼睛时,选择通过双眼间距确定用户的眼睛与图像获取设备的实际距离。It can be understood that the foregoing method of determining the actual distance between the user's eyes and the image acquisition device according to the spot distance or binocular distance can be selected according to the actual situation. For example, when the target image includes two eyes, the user can be determined by binocular distance The actual distance between your eyes and the image acquisition device.
步骤S102,根据目标对象上的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节。Step S102: Adjust the focus position of the image acquisition device according to the actual distance between the point of interest on the target object and the image acquisition device.
对图像获取设备的对焦位置进行调节,具体的,可以对图像获取设备的镜头进行调节,例如可以通过音圈马达(Voice Coil Motor,VCM)实现 直线型或有限摆角的运动,对图像获取设备的镜头的位置进行调节,使图像获取设备的对焦位置发生改变。Adjust the focus position of the image acquisition device. Specifically, you can adjust the lens of the image acquisition device. For example, you can use a voice coil motor (VCM) to achieve linear or limited swing angle motion. The position of the lens is adjusted to change the focus position of the image acquisition device.
根据目标对象上的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节,具体的,可以根据目标对象上的兴趣点与图像获取设备之间的实际距离,结合图像获取设备的景深范围,对图像获取设备的对焦位置进行调节。举例来说,若目标对象上的兴趣点与图像获取设备之间的实际距离为80厘米,而图像获取设备的景深范围为45厘米至70厘米,则可以将图像获取设备的对焦位置增大,以使图像获取设备的景深范围能够包括目标对象上的兴趣点与图像获取设备之间的实际距离,具体的,可以通过将图像获取设备的对焦位置增大,使图像获取设备的景深范围调节为60厘米至85厘米,从而可以包括80厘米的实际距离。Adjust the focus position of the image acquisition device according to the actual distance between the point of interest on the target object and the image acquisition device. Specifically, you can combine the image acquisition device with the actual distance between the point of interest on the target object and the image acquisition device. Adjust the focus position of the image acquisition device. For example, if the actual distance between the point of interest on the target object and the image acquisition device is 80 cm, and the depth of field range of the image acquisition device is 45 cm to 70 cm, the focus position of the image acquisition device can be increased. So that the depth of field range of the image acquisition device can include the actual distance between the point of interest on the target object and the image acquisition device. Specifically, by increasing the focus position of the image acquisition device, the depth of field range of the image acquisition device can be adjusted to 60 cm to 85 cm, which can include an actual distance of 80 cm.
本申请实施例提供的一种图像获取设备的对焦方法,通过获取目标对象的兴趣点与图像获取设备的实际距离,其中图像获取设备用于对目标对象进行拍摄,根据目标对象的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节,使图像获取设备的景深范围发生改变,从而使目标对象位于图像获取设备的景深范围之内,以便得到清晰的目标图像,提高目标对象的特征信息获取的准确性。An embodiment of the present application provides a method for focusing an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, wherein the image acquisition device is used for shooting the target object, and according to the interest point of the target object and the image Obtain the actual distance of the device, adjust the focus position of the image acquisition device, and change the depth of field range of the image acquisition device, so that the target object is within the depth of field range of the image acquisition device, in order to obtain a clear target image and improve the target object Accuracy of feature information acquisition.
基于以上实施例提供的一种图像获取设备的对焦方法,本申请实施例还提供了一种图像获取设备的对焦装置,下面结合附图来详细说明其工作原理。Based on the focusing method of the image acquisition device provided by the foregoing embodiments, the embodiment of the present application further provides a focusing device of the image acquisition device. The working principle is described in detail below with reference to the accompanying drawings.
图2为本申请实施例提供的一种图像获取设备的对焦装置的结构框图,如图2所示,该装置包括:FIG. 2 is a structural block diagram of a focusing device of an image acquisition device according to an embodiment of the present application. As shown in FIG. 2, the device includes:
距离获取单元110,设置为获取目标对象上的兴趣点与图像获取设备的实际距离,所述图像获取设备设置为对所述目标对象进行拍摄;The distance acquiring unit 110 is configured to acquire an actual distance between a point of interest on a target object and an image acquisition device, and the image acquisition device is configured to photograph the target object;
调节单元120,设置为根据所述实际距离对所述图像获取设备的对焦位置进行调节。The adjusting unit 120 is configured to adjust a focus position of the image acquisition device according to the actual distance.
可选的,所述距离获取单元,包括:Optionally, the distance obtaining unit includes:
目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄, 得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
第一方向确定单元,设置为根据兴趣点在所述目标图像中的位置,确定所述目标对象上的兴趣点相对于所述图像获取设备的方向;A first direction determining unit configured to determine a direction of an interest point on the target object with respect to the image acquisition device according to a position of the interest point in the target image;
朝向调整单元,设置为根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向;An orientation adjustment unit configured to determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
测距控制单元,设置为控制所述测距设备测量所述兴趣点与所述测距设备的实际距离;A ranging control unit configured to control the ranging device to measure an actual distance between the point of interest and the ranging device;
第一距离获取子单元,设置为根据所述兴趣点与所述测距设备的实际距离,得到所述兴趣点与所述图像获取设备的实际距离。The first distance acquisition subunit is configured to obtain an actual distance between the interest point and the image acquisition device according to an actual distance between the interest point and the distance measuring device.
可选的,所述朝向调整单元设置为:Optionally, the orientation adjustment unit is set as:
根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,以及坐标变换矩阵,确定并调整所述测距设备的朝向,所述坐标变换矩阵体现所述图像获取设备所在的坐标系与所述测距设备所在的坐标系之间的换算关系。Determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device, and a coordinate transformation matrix, the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
可选的,所述测距设备包括红外测距设备和/或超声测距设备。Optionally, the ranging device includes an infrared ranging device and / or an ultrasonic ranging device.
可选的,所述距离获取单元,包括:Optionally, the distance obtaining unit includes:
深度图获取单元,设置为通过深度相机获取所述目标对象的深度图;A depth map obtaining unit configured to obtain a depth map of the target object through a depth camera;
距离和方向获取单元,设置为根据所述深度图,获取所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向;The distance and direction acquisition unit is configured to acquire the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
第二距离获取子单元,设置为根据所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向,得到所述目标对象上的兴趣点与所述图像获取设备的实际距离。The second distance acquisition subunit is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera. The actual distance between the point of interest on the image and the image acquisition device.
可选的,所述深度相机包括:TOF相机、结构光相机和双目测距相机的至少一种。Optionally, the depth camera includes at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
可选的,所述目标对象上的兴趣点为用户的眼睛,所述距离获取单元,包括:Optionally, the point of interest on the target object is the eyes of the user, and the distance obtaining unit includes:
光源控制单元,设置为控制光源照射所述目标对象;A light source control unit configured to control a light source to illuminate the target object;
目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄, 得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
眼睛特征获取单元,设置为通过所述目标图像确定所述目标图像中眼睛的光斑间距或双眼间距;An eye feature acquisition unit, configured to determine, based on the target image, a spot distance or an eye distance between eyes in the target image;
第三距离获取子单元,设置为根据所述光斑间距或所述双眼间距确定所述用户的眼睛与所述图像获取设备的实际距离。The third distance acquisition subunit is configured to determine an actual distance between the eyes of the user and the image acquisition device according to the spot distance or the binocular distance.
可选的,所述图像获取设备包括:CCD相机或CMOS相机。Optionally, the image acquisition device includes a CCD camera or a CMOS camera.
可选的,所述调节单元设置为:Optionally, the adjustment unit is set as:
根据所述实际距离,利用音圈马达对所述图像获取设备的对焦位置进行调节。According to the actual distance, a focus position of the image acquisition device is adjusted by using a voice coil motor.
本申请实施例提供的一种图像获取设备的对焦装置,通过获取目标对象的兴趣点与图像获取设备的实际距离,其中图像获取设备用于对目标对象进行拍摄,根据目标对象的兴趣点与图像获取设备的实际距离,对图像获取设备的对焦位置进行调节,使图像获取设备的景深范围发生改变,从而使目标对象位于图像获取设备的景深范围之内,以便得到清晰的目标图像,提高目标对象的特征信息获取的准确性。An embodiment of the present application provides a focusing device for an image acquisition device, which acquires an actual distance between a point of interest of a target object and the image acquisition device, where the image acquisition device is used to shoot the target object, and according to the target point of interest and the image Obtain the actual distance of the device, adjust the focus position of the image acquisition device, and change the depth of field range of the image acquisition device, so that the target object is within the depth of field range of the image acquisition device, in order to obtain a clear target image and improve the target object. Accuracy of feature information acquisition.
当介绍本申请的各种实施例的元件时,冠词“一”、“一个”、“这个”和“所述”都意图表示有一个或多个元件。词语“包括”、“包含”和“具有”都是包括性的并意味着除了列出的元件之外,还可以有其它元件。When introducing elements of various embodiments of the present application, the articles "a," "an," "the," and "said" are intended to mean that there are one or more of the elements. The words "including," "including," and "having" are all inclusive and mean that there may be additional elements other than the listed elements.
需要说明的是,本领域普通技术人员可以理解实现上述方法实施例中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。其中,所述存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。It should be noted that a person of ordinary skill in the art can understand that the implementation of all or part of the processes in the foregoing method embodiments can be completed by using a computer program to instruct related hardware, and the program can be stored in a computer-readable storage In the medium, when the program is executed, the program may include the processes of the foregoing method embodiments. The storage medium may be a magnetic disk, an optical disc, a read-only memory (ROM), or a random access memory (Random Access Memory, RAM).
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于装置实施例而言,由于其基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。以上所 描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元及模块可以是或者也可以不是物理上分开的。另外,还可以根据实际的需要选择其中的部分或者全部单元和模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, as for the device embodiment, since it is basically similar to the method embodiment, it is described relatively simply. For the relevant part, refer to the description of the method embodiment. The device embodiments described above are only schematic, and the units and modules described as separate components may or may not be physically separated. In addition, some or all of the units and modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative efforts.
以上所述仅是本申请的具体实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本申请的保护范围。The above is only a specific implementation of the present application. It should be noted that, for those of ordinary skill in the art, without departing from the principles of the present application, several improvements and retouching can be made. These improvements and retouching also It should be regarded as the protection scope of this application.

Claims (20)

  1. 一种图像获取设备的对焦方法,所述方法包括:A focusing method of an image acquisition device, the method includes:
    获取目标对象上的兴趣点与图像获取设备的实际距离,所述图像获取设备用于对所述目标对象进行拍摄;Acquiring an actual distance between a point of interest on a target object and an image acquisition device, where the image acquisition device is used to shoot the target object;
    根据所述实际距离对所述图像获取设备的对焦位置进行调节。Adjusting a focus position of the image acquisition device according to the actual distance.
  2. 根据权利要求1所述的方法,其中,所述获取目标对象上的兴趣点与图像获取设备的实际距离,包括:The method according to claim 1, wherein the acquiring the actual distance between the point of interest on the target object and the image acquisition device comprises:
    利用图像获取设备对目标对象进行拍摄,得到目标图像;Use an image acquisition device to shoot the target object to obtain a target image;
    根据兴趣点在所述目标图像中的位置,确定所述目标对象上的兴趣点相对于所述图像获取设备的方向;Determining the direction of the point of interest on the target object with respect to the image acquisition device according to the position of the point of interest in the target image;
    根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向;Determining and adjusting the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
    控制所述测距设备测量所述兴趣点与所述测距设备的实际距离;Controlling the ranging device to measure the actual distance between the point of interest and the ranging device;
    根据所述兴趣点与所述测距设备的实际距离,得到所述兴趣点与所述图像获取设备的实际距离。The actual distance between the point of interest and the image acquisition device is obtained according to the actual distance between the point of interest and the distance measuring device.
  3. 根据权利要求2所述的方法,其中,所述根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向,包括:The method according to claim 2, wherein determining and adjusting the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device comprises:
    根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,以及坐标变换矩阵,确定并调整所述测距设备的朝向,所述坐标变换矩阵体现所述图像获取设备所在的坐标系与所述测距设备所在的坐标系之间的换算关系。Determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device, and a coordinate transformation matrix, the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
  4. 根据权利要求2所述的方法,其中,所述测距设备包括红外测距设备和/或超声测距设备。The method according to claim 2, wherein the ranging device comprises an infrared ranging device and / or an ultrasonic ranging device.
  5. 根据权利要求1所述的方法,其中,所述获取所述兴趣点与图像获取设备的实际距离,包括:The method according to claim 1, wherein the acquiring an actual distance between the point of interest and an image acquisition device comprises:
    通过深度相机获取所述目标对象的深度图;Acquiring a depth map of the target object through a depth camera;
    根据所述深度图,获取所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向;Obtaining the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
    根据所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述 目标对象上的兴趣点相对于所述深度相机的方向,得到所述目标对象上的兴趣点与所述图像获取设备的实际距离。Obtaining the point of interest on the target object and the image acquisition according to the actual distance between the point of interest on the target object and the depth camera, and the direction of the point of interest on the target object with respect to the depth camera The actual distance of the device.
  6. 根据权利要求5所述的方法,其中,所述深度相机包括:TOF相机、结构光相机和双目测距相机的至少一种。The method according to claim 5, wherein the depth camera comprises at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
  7. 根据权利要求1所述的方法,其中,所述目标对象上的兴趣点为用户的眼睛,所述获取所述兴趣点与图像获取设备的实际距离,包括:The method according to claim 1, wherein the point of interest on the target object is a user's eyes, and the acquiring the actual distance between the point of interest and an image acquisition device comprises:
    控制光源照射所述目标对象;Controlling a light source to illuminate the target object;
    利用图像获取设备对目标对象进行拍摄,得到目标图像;Use an image acquisition device to shoot the target object to obtain a target image;
    通过所述目标图像确定所述目标图像中眼睛的光斑间距或双眼间距;Determining the spot distance or binocular distance of the eyes in the target image by using the target image;
    根据所述光斑间距或所述双眼间距确定所述用户的眼睛与所述图像获取设备的实际距离。An actual distance between the eyes of the user and the image acquisition device is determined according to the spot distance or the binocular distance.
  8. 根据权利要求1-7任意一项所述的方法,其中,所述图像获取设备包括:CCD相机或CMOS相机。The method according to any one of claims 1 to 7, wherein the image acquisition device comprises: a CCD camera or a CMOS camera.
  9. 根据权利要求1-7任意一项所述的方法,其中,所述根据所述实际距离对所述图像获取设备的对焦位置进行调节,包括:The method according to any one of claims 1 to 7, wherein the adjusting a focus position of the image acquisition device according to the actual distance comprises:
    根据所述实际距离,利用音圈马达对所述图像获取设备的对焦位置进行调节。According to the actual distance, a focus position of the image acquisition device is adjusted by using a voice coil motor.
  10. 一种图像获取设备的对焦装置,所述装置包括:A focusing device of an image acquisition device, the device includes:
    距离获取单元,设置为获取目标对象上的兴趣点与图像获取设备的实际距离,所述图像获取设备设置为对所述目标对象进行拍摄;A distance acquisition unit configured to acquire an actual distance between a point of interest on a target object and an image acquisition device, and the image acquisition device is configured to photograph the target object;
    调节单元,设置为根据所述实际距离对所述图像获取设备的对焦位置进行调节。The adjustment unit is configured to adjust a focus position of the image acquisition device according to the actual distance.
  11. 根据权利要求10所述的装置,其中,所述距离获取单元,包括:The apparatus according to claim 10, wherein the distance obtaining unit comprises:
    目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄,得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
    第一方向确定单元,设置为根据兴趣点在所述目标图像中的位置,确定所述目标对象上的兴趣点相对于所述图像获取设备的方向;A first direction determining unit configured to determine a direction of an interest point on the target object with respect to the image acquisition device according to a position of the interest point in the target image;
    朝向调整单元,设置为根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,确定并调整所述测距设备的朝向;An orientation adjustment unit configured to determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device;
    测距控制单元,设置为控制所述测距设备测量所述兴趣点与所述测距设备的实际距离;A ranging control unit configured to control the ranging device to measure an actual distance between the point of interest and the ranging device;
    第一距离获取子单元,设置为根据所述兴趣点与所述测距设备的实际距离,得到所述兴趣点与所述图像获取设备的实际距离。The first distance acquisition subunit is configured to obtain an actual distance between the interest point and the image acquisition device according to an actual distance between the interest point and the distance measuring device.
  12. 根据权利要求11所述的装置,其中,所述朝向调整单元设置为:The apparatus according to claim 11, wherein the orientation adjustment unit is configured to:
    根据所述目标对象上的兴趣点相对于所述图像获取设备的方向,以及坐标变换矩阵,确定并调整所述测距设备的朝向,所述坐标变换矩阵体现所述图像获取设备所在的坐标系与所述测距设备所在的坐标系之间的换算关系。Determine and adjust the orientation of the ranging device according to the direction of the point of interest on the target object with respect to the image acquisition device, and a coordinate transformation matrix, the coordinate transformation matrix reflects the coordinate system in which the image acquisition device is located A conversion relationship with the coordinate system where the ranging device is located.
  13. 根据权利要求11所述的装置,其中,所述测距设备包括红外测距设备和/或超声测距设备。The apparatus according to claim 11, wherein the ranging device comprises an infrared ranging device and / or an ultrasonic ranging device.
  14. 根据权利要求10所述的装置,其中,所述距离获取单元,包括:The apparatus according to claim 10, wherein the distance obtaining unit comprises:
    深度图获取单元,设置为通过深度相机获取所述目标对象的深度图;A depth map obtaining unit configured to obtain a depth map of the target object through a depth camera;
    距离和方向获取单元,设置为根据所述深度图,获取所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向;The distance and direction acquisition unit is configured to acquire the actual distance between the point of interest on the target object and the depth camera and the direction of the point of interest on the target object with respect to the depth camera according to the depth map;
    第二距离获取子单元,设置为根据所述目标对象上的兴趣点与所述深度相机的实际距离,以及所述目标对象上的兴趣点相对于所述深度相机的方向,得到所述目标对象上的兴趣点与所述图像获取设备的实际距离。The second distance acquisition subunit is configured to obtain the target object according to an actual distance between the point of interest on the target object and the depth camera, and a direction of the point of interest on the target object with respect to the depth camera. The actual distance between the point of interest on the image and the image acquisition device.
  15. 根据权利要求14所述的装置,其中,所述深度相机包括:TOF相机、结构光相机和双目测距相机的至少一种。The apparatus according to claim 14, wherein the depth camera comprises at least one of a TOF camera, a structured light camera, and a binocular ranging camera.
  16. 根据权利要求10所述的装置,其中,所述目标对象上的兴趣点为用户的眼睛,所述距离获取单元,包括:The apparatus according to claim 10, wherein the point of interest on the target object is a user's eyes, and the distance obtaining unit comprises:
    光源控制单元,设置为控制光源照射所述目标对象;A light source control unit configured to control a light source to illuminate the target object;
    目标图像获取单元,设置为利用图像获取设备对目标对象进行拍摄,得到目标图像;A target image acquisition unit configured to capture a target object by using an image acquisition device to obtain a target image;
    眼睛特征获取单元,设置为通过所述目标图像确定所述目标图像中眼睛的光斑间距或双眼间距;An eye feature acquisition unit, configured to determine, based on the target image, a spot distance or an eye distance between eyes in the target image;
    第三距离获取子单元,设置为根据所述光斑间距或所述双眼间距确定 所述用户的眼睛与所述图像获取设备的实际距离。The third distance acquisition subunit is configured to determine an actual distance between the eyes of the user and the image acquisition device according to the spot distance or the binocular distance.
  17. 根据权利要求10-16任意一项所述的装置,其中,所述图像获取设备包括:CCD相机或CMOS相机。The apparatus according to any one of claims 10 to 16, wherein the image acquisition device comprises: a CCD camera or a CMOS camera.
  18. 根据权利要求10-16任意一项所述的装置,其中,所述调节单元设置为:The apparatus according to any one of claims 10 to 16, wherein the adjustment unit is configured to:
    根据所述实际距离,利用音圈马达对所述图像获取设备的对焦位置进行调节。According to the actual distance, a focus position of the image acquisition device is adjusted by using a voice coil motor.
  19. 一种存储介质,所述存储介质包括存储的程序,其中,在所述程序运行时控制所述存储介质所在设备执行权利要求1至9中任意一项所述的图像获取设备的对焦方法。A storage medium comprising a stored program, wherein when the program is run, a device where the storage medium is located is controlled to perform a focusing method of the image acquisition device according to any one of claims 1 to 9.
  20. 一种图像获取设备,包括存储器和处理器,An image acquisition device including a memory and a processor,
    所述存储器存储有计算机程序;A computer program is stored in the memory;
    所述处理器,设置为执行所述存储器中存储的计算机程序,所述计算机程序运行时执行权利要求1至9中任意一项所述的图像获取设备的对焦方法。The processor is configured to execute a computer program stored in the memory, and when the computer program runs, execute the focusing method of the image acquisition device according to any one of claims 1 to 9.
PCT/CN2019/077312 2018-08-29 2019-03-07 Focusing method and device for image acquisition apparatus WO2020042581A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810996281.9A CN108833795B (en) 2018-08-29 2018-08-29 Focusing method and device of image acquisition equipment
CN201810996281.9 2018-08-29

Publications (1)

Publication Number Publication Date
WO2020042581A1 true WO2020042581A1 (en) 2020-03-05

Family

ID=64151710

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/077312 WO2020042581A1 (en) 2018-08-29 2019-03-07 Focusing method and device for image acquisition apparatus

Country Status (2)

Country Link
CN (1) CN108833795B (en)
WO (1) WO2020042581A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833795B (en) * 2018-08-29 2020-06-19 北京七鑫易维信息技术有限公司 Focusing method and device of image acquisition equipment
CN109849788B (en) * 2018-12-29 2021-07-27 北京七鑫易维信息技术有限公司 Information providing method, device and system
CN109905599A (en) * 2019-03-18 2019-06-18 信利光电股份有限公司 A kind of human eye focusing method, device and readable storage medium storing program for executing
CN110276251B (en) * 2019-05-13 2023-07-25 联想(上海)信息技术有限公司 Image recognition method, device, equipment and storage medium
CN110225247B (en) * 2019-05-29 2021-06-15 联想(北京)有限公司 Image processing method and electronic equipment
CN112995516B (en) * 2019-05-30 2022-07-29 深圳市道通智能航空技术股份有限公司 Focusing method and device, aerial camera and unmanned aerial vehicle
CN110855891A (en) * 2019-11-26 2020-02-28 爱菲力斯(深圳)科技有限公司 Method and device for adjusting camera shooting angle based on human body posture and robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105704380A (en) * 2016-03-03 2016-06-22 上海与德通讯技术有限公司 Camera focusing method and electric device
CN105744163A (en) * 2016-02-23 2016-07-06 湖南拓视觉信息技术有限公司 Video camera and video recording method performing tracking focusing based on depth information
CN107580176A (en) * 2017-08-02 2018-01-12 努比亚技术有限公司 A kind of terminal taking control method, camera shooting terminal and computer-readable recording medium
JP2018013527A (en) * 2016-07-19 2018-01-25 キヤノン株式会社 Imaging apparatus and control method therefor
CN107920209A (en) * 2017-12-27 2018-04-17 国网通用航空有限公司 A kind of high speed camera autofocus system, method and processor, computer equipment
CN108833795A (en) * 2018-08-29 2018-11-16 北京七鑫易维信息技术有限公司 A kind of focusing method and device of image acquisition equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008052123A (en) * 2006-08-25 2008-03-06 Eastman Kodak Co Imaging apparatus
CN101154264B (en) * 2006-09-27 2011-01-26 中国科学院自动化研究所 Large field-depth iris image capturing system and method based on multiple cameras with fixed focus
JP4782725B2 (en) * 2007-05-10 2011-09-28 富士フイルム株式会社 Focusing device, method and program
JP4544282B2 (en) * 2007-09-14 2010-09-15 ソニー株式会社 Data processing apparatus, data processing method, and program
CN108200340A (en) * 2018-01-12 2018-06-22 深圳奥比中光科技有限公司 The camera arrangement and photographic method of eye sight line can be detected

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744163A (en) * 2016-02-23 2016-07-06 湖南拓视觉信息技术有限公司 Video camera and video recording method performing tracking focusing based on depth information
CN105704380A (en) * 2016-03-03 2016-06-22 上海与德通讯技术有限公司 Camera focusing method and electric device
JP2018013527A (en) * 2016-07-19 2018-01-25 キヤノン株式会社 Imaging apparatus and control method therefor
CN107580176A (en) * 2017-08-02 2018-01-12 努比亚技术有限公司 A kind of terminal taking control method, camera shooting terminal and computer-readable recording medium
CN107920209A (en) * 2017-12-27 2018-04-17 国网通用航空有限公司 A kind of high speed camera autofocus system, method and processor, computer equipment
CN108833795A (en) * 2018-08-29 2018-11-16 北京七鑫易维信息技术有限公司 A kind of focusing method and device of image acquisition equipment

Also Published As

Publication number Publication date
CN108833795B (en) 2020-06-19
CN108833795A (en) 2018-11-16

Similar Documents

Publication Publication Date Title
WO2020042581A1 (en) Focusing method and device for image acquisition apparatus
WO2019114617A1 (en) Method, device, and system for fast capturing of still frame
CN109521547B (en) Variable-step-length automatic focusing method and system
CN109451244B (en) Automatic focusing method and system based on liquid lens
WO2015184978A1 (en) Camera control method and device, and camera
KR102143456B1 (en) Depth information acquisition method and apparatus, and image collection device
JP5934929B2 (en) Image processing apparatus and image processing method
CN108076278B (en) Automatic focusing method and device and electronic equipment
WO2014153950A1 (en) Quick automatic focusing method and image acquisition device
WO2020200093A1 (en) Focusing method and device, photographing apparatus and aircraft
US9531938B2 (en) Image-capturing apparatus
WO2016119301A1 (en) Terminal, and image capturing method and device
US8698945B2 (en) Autofocus apparatus and method
US9160931B2 (en) Modifying captured image based on user viewpoint
WO2022037633A1 (en) Calibration method and apparatus for binocular camera, image correction method and apparatus for binocular camera, storage medium, terminal and intelligent device
WO2016184131A1 (en) Image photographing method and apparatus based on dual cameras and computer storage medium
TW201541141A (en) Auto-focus system for multiple lens and method thereof
WO2016197494A1 (en) Method and device for adjusting focusing area
JP7305749B2 (en) Control method and device for image acquisition device
TW201541143A (en) Auto-focus system for multiple lens and method thereof
JP7254562B2 (en) Imaging device and its control device
WO2021035704A1 (en) Focusing method and assembly for imaging apparatus, imaging apparatus and movable object
US9843715B2 (en) Photographic apparatus, stroboscopic image prediction method, and a non-transitory computer readable storage medium storing stroboscopic image prediction program
WO2013069279A1 (en) Image capturing device
TW201236448A (en) Auto-focusing camera and method for automatically focusing of the camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19853832

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19853832

Country of ref document: EP

Kind code of ref document: A1