WO2020034669A1 - 一种图像获取设备的控制方法及装置 - Google Patents

一种图像获取设备的控制方法及装置 Download PDF

Info

Publication number
WO2020034669A1
WO2020034669A1 PCT/CN2019/085961 CN2019085961W WO2020034669A1 WO 2020034669 A1 WO2020034669 A1 WO 2020034669A1 CN 2019085961 W CN2019085961 W CN 2019085961W WO 2020034669 A1 WO2020034669 A1 WO 2020034669A1
Authority
WO
WIPO (PCT)
Prior art keywords
image acquisition
acquisition device
image
inactive
active
Prior art date
Application number
PCT/CN2019/085961
Other languages
English (en)
French (fr)
Inventor
付阳
王云飞
黄通兵
Original Assignee
北京七鑫易维信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京七鑫易维信息技术有限公司 filed Critical 北京七鑫易维信息技术有限公司
Priority to JP2021507975A priority Critical patent/JP7305749B2/ja
Priority to US17/266,636 priority patent/US11853471B2/en
Priority to EP19850614.9A priority patent/EP3840360A4/en
Priority to AU2019322663A priority patent/AU2019322663B2/en
Publication of WO2020034669A1 publication Critical patent/WO2020034669A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147—Details of sensors, e.g. sensor lenses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/94—Hardware or software architectures specially adapted for image or video understanding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/144—Image acquisition using a slot moved over the image; using discrete sensing elements at predetermined points; using automatic curve following means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/16—Image acquisition using multiple overlapping images; Image stitching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H04N23/662—Transmitting camera control signals through networks, e.g. control via the Internet by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image

Definitions

  • the present application relates to the technical field of eye tracking, and in particular, to a method and device for controlling an image acquisition device.
  • Eye tracking technology refers to the technology of obtaining the target's gaze point by analyzing the eye movement of the target.
  • the mainstream technology mainly relies on the human eye image based on the infrared frequency band to analyze human eye characteristic information, and then obtain the target object gaze point.
  • multiple image acquisition devices are usually used to capture target object images, and the images captured by the multiple image acquisition devices are transmitted to the controller, so that the controller analyzes human eye feature information based on the captured target image To get the gaze point of the target object.
  • sending the images captured by multiple image acquisition devices to the controller may require a relatively large transmission bandwidth.
  • the transmission bandwidth will be limited by the specific transmission protocol, so that the actual bandwidth cannot meet the bandwidth requirements for transmitting images captured by multiple image acquisition devices.
  • At least part of the embodiments of the present application provide a method and an apparatus for controlling an image acquisition device, so as to at least partially solve the problem in the related art of sending images captured by multiple image acquisition devices to a controller at the same time, so that the actual bandwidth cannot meet the transmission requirements. Problem of bandwidth requirements for images captured by an image acquisition device.
  • a method for controlling an image acquisition device including:
  • the bandwidth required by the active image acquisition device to send the first image is greater than the bandwidth required by the inactive image acquisition device to send the second image.
  • determining an active image acquisition device and an inactive image acquisition device of the multiple image acquisition devices according to the multiple images includes:
  • the active image acquisition device and the inactive image acquisition device are determined according to the relative positions between the plurality of image acquisition devices and the target object.
  • determining an active image acquisition device and an inactive image acquisition device of the multiple image acquisition devices according to the multiple images includes:
  • An active image acquisition device is determined from the image acquisition devices to be selected; wherein, the image acquisition device to be selected is an image acquisition device other than the inactive image acquisition device among the plurality of image acquisition devices.
  • controlling the active image acquisition device to shoot the first image in the first configuration, and controlling the inactive image acquisition device to shoot the second image in the second configuration includes: At least one of the following:
  • acquiring the first image sent by the active image acquisition device and acquiring the second image sent by the inactive image acquisition device includes:
  • the method further includes:
  • the method further includes:
  • the method further includes:
  • the frequency of the second image captured by the inactive image acquisition device is accelerated.
  • the plurality of image acquisition devices include a first image acquisition device and a second image acquisition device;
  • Obtaining the position of the target object according to the multiple images includes at least one of the following:
  • a fourth image including the target object captured by the second image acquisition device is acquired, and a distance between the target object and the second image acquisition device is determined according to a feature of the fourth image.
  • determining the active image acquisition device and the inactive image acquisition device according to the relative positions between the plurality of image acquisition devices and the target object includes at least one of the following:
  • the distance between the target object and the first image acquisition device is in a first distance interval, determine that the first image acquisition device is an active image acquisition device, and determine that the second image acquisition device is an inactive image , Wherein the first distance interval is determined according to a focus position of the first image acquisition device;
  • the distance between the target object and the first image acquisition device is in a second distance interval, determine that the first image acquisition device is an inactive image acquisition device, and determine that the second image acquisition device is an active image An acquisition device, wherein the second distance interval is determined according to a focus position of the second image acquisition device.
  • the distance between any two image acquisition devices in the plurality of image acquisition devices is less than a preset distance threshold; at least two images in different focus positions exist in the plurality of image acquisition devices. Get the device.
  • a control device for an image acquisition device including:
  • a first acquisition unit configured to acquire multiple images captured by multiple image acquisition devices
  • a first determining unit configured to determine an active image acquisition device and an inactive image acquisition device of the plurality of image acquisition devices according to the plurality of images
  • a control unit configured to control the active image acquisition device to take a first image in a first configuration, and control the inactive image acquisition device to take a second image in a second configuration
  • a second acquisition unit configured to acquire the first image sent by the active image acquisition device, and acquire the second image sent by the inactive image acquisition device;
  • the bandwidth required by the active image acquisition device to send the first image is greater than the bandwidth required by the inactive image acquisition device to send the second image.
  • the first determining unit is configured to:
  • the active image acquisition device and the inactive image acquisition device are determined according to the relative positions between the plurality of image acquisition devices and the target object.
  • the first determining unit is configured to:
  • An active image acquisition device is determined from the image acquisition devices to be selected; wherein, the image acquisition device to be selected is an image acquisition device other than the inactive image acquisition device among the plurality of image acquisition devices.
  • control unit is configured to:
  • the second obtaining unit is configured to:
  • the apparatus further includes:
  • the first adjusting unit is configured to adjust at least one of the first frequency and the second frequency according to the relative positions between the plurality of image acquisition devices and the target object.
  • the apparatus further includes:
  • the second adjustment unit is configured to adjust at least one of the first frequency and the second frequency according to the sharpness of the first image.
  • the apparatus further includes:
  • a second determining unit configured to determine a change trend in the distance between the target object and the active image acquisition device according to the characteristics of several frames of images continuously captured by the active image acquisition device;
  • a judging unit configured to judge a possibility that the active image acquisition device switches to the inactive image acquisition device according to the distance change trend
  • the frequency accelerating unit is configured to accelerate the frequency at which the second image is captured by the inactive image acquisition device if the probability is greater than or equal to a preset threshold.
  • the plurality of image acquisition devices include a first image acquisition device and a second image acquisition device;
  • the first determining unit is further configured to perform at least one of the following operations:
  • a fourth image including the target object captured by the second image acquisition device is acquired, and a distance between the target object and the second image acquisition device is determined according to a feature of the fourth image.
  • the first determining unit is further configured to perform at least one of the following operations:
  • the distance between the target object and the first image acquisition device is in a first distance interval, determine that the first image acquisition device is an active image acquisition device, and determine that the second image acquisition device is an inactive image , Wherein the first distance interval is determined according to a focus position of the first image acquisition device;
  • the distance between the target object and the first image acquisition device is in a second distance interval, determine that the first image acquisition device is an inactive image acquisition device, and determine that the second image acquisition device is an active image An acquisition device, wherein the second distance interval is determined according to a focus position of the second image acquisition device.
  • the distance between any two image acquisition devices in the plurality of image acquisition devices is less than a preset distance threshold; at least two images in different focus positions exist in the plurality of image acquisition devices. Get the device.
  • a method for controlling an image acquisition device is used to acquire multiple images captured by multiple image acquisition devices; and determine an active image acquisition device and a non- An active image acquisition device; controlling the active image acquisition device to capture a first image in a first configuration, controlling the inactive image acquisition device to capture a second image in a second configuration; acquiring the first image sent by the active image acquisition device An image, and acquiring the second image sent by the inactive image acquisition device; wherein the bandwidth required by the active image acquisition device to send the first image is greater than the bandwidth required by the inactive image acquisition device to send the The required bandwidth for the second image.
  • an active image acquisition device and an inactive image acquisition device among a plurality of image acquisition devices can be determined, and the active image acquisition device is controlled to use the first configuration to shoot the first image, inactive
  • the image acquisition device adopts the second configuration to capture the second image, so that the bandwidth required by the inactive image acquisition device to send the image captured by it to the controller is relatively small, which is smaller than that when the active image acquisition device sends the image captured by it to the controller
  • the required bandwidth rather than the bandwidth required by all image acquisition devices to send the images they capture to the controller (e.g. equal to the bandwidth required by an active image acquisition device to send images it captures to the controller) Therefore, the bandwidth for transmitting images captured by the multiple image acquisition devices is saved.
  • FIG. 1 is a flowchart of a method for controlling an image acquisition device according to one embodiment of the present application.
  • FIG. 2 is a flowchart of a method for adjusting a frequency of an image captured by the image acquisition device according to an embodiment of the present application.
  • FIG. 3 is a structural block diagram of a control apparatus for an image acquisition device according to one embodiment of the present application.
  • multiple image acquisition devices are usually used to capture target object images at the same shooting frequency, and the images captured by the multiple image acquisition devices are transmitted to the controller, so that the controller is based on the captured target object images. Analyze the characteristics of human eyes to obtain the fixation point of the target object. In order to accurately analyze the fixation point of the target object, the shooting frequency of multiple image acquisition devices is generally set to be relatively high.
  • sending the images captured by multiple image acquisition devices to the controller may require a relatively large transmission bandwidth.
  • the transmission bandwidth will be limited by the specific transmission protocol, so that the actual bandwidth cannot meet the bandwidth requirements for transmitting images captured by multiple image acquisition devices.
  • the gaze point of the target object can be accurately analyzed. That is, there are one or some image acquisition devices, and the images taken by them make little contribution to the gaze point of the analysis target object. In this case, the frequency of capturing images by these image acquisition devices that have a small contribution to the gaze point of the analysis target object can be reduced, thereby saving bandwidth for transmitting images captured by the plurality of image acquisition devices.
  • one embodiment of the present application provides a method and apparatus for controlling an image acquisition device, including: acquiring a plurality of images captured by a plurality of image acquisition devices; and determining one of the plurality of image acquisition devices according to the plurality of images.
  • Active image acquisition device and inactive image acquisition device controlling the active image acquisition device to capture a first image in a first configuration, controlling the inactive image acquisition device to capture a second image in a second configuration; acquiring the active image The first image sent by the acquiring device and the second image sent by the inactive image acquiring device; wherein a bandwidth required by the active image acquiring device to send the first image is greater than the bandwidth of the non-active image acquiring device The bandwidth required by the active image acquisition device to send the second image.
  • an active image acquisition device and an inactive image acquisition device among a plurality of image acquisition devices can be determined, and the active image acquisition device can be controlled to The configuration captures the first image, and the inactive image capture device captures the second image in the second configuration, so that the bandwidth required when the inactive image capture device sends the image it captures to the controller is smaller than the bandwidth required by the active image capture device
  • the bandwidth required when the captured image is sent to the controller, rather than the bandwidth required for all image capture devices to send the captured image to the controller e.g. equal to the active image capture device sending the captured image to Bandwidth required by the controller), thereby saving bandwidth for transmitting images captured by the plurality of image acquisition devices.
  • FIG. 1 is a flowchart of a method for controlling an image acquisition device according to one embodiment of the present application. As shown in FIG. 1, the method can be applied to a telemetry eye tracking system.
  • the telemetry eye tracking system may include an image acquisition device and a controller.
  • the image acquisition device can acquire an image including a target object.
  • the controller may analyze the eye movement of the target object according to the image including the target object to obtain the target object gaze point.
  • the telemetry eye-tracking system may include multiple image acquisition devices, and the multiple image acquisition devices may shoot the same scene at an approximate angle of view. There are at least two image acquisition devices with different diagonal positions in the multiple image acquisition devices. device.
  • the method for controlling an image acquisition device provided in this embodiment may be implemented through the following steps S101-S104.
  • step S101 multiple images captured by multiple image acquisition devices are acquired.
  • the embodiments of the present application do not specifically limit the image acquisition device, and the image acquisition device may be, for example, a video camera.
  • a connection may be established between the controller and the image acquisition device through a network. Therefore, in a possible implementation manner of the embodiment of the present application, the controller may acquire the multiple image acquisition devices through the network. Captured image.
  • step S102 an active image acquisition device and an inactive image acquisition device of the plurality of image acquisition devices are determined according to the plurality of images.
  • the gaze point of the target object can be accurately analyzed.
  • the so-called active image acquisition device can be understood as an image acquisition device that greatly contributes to the gaze point of the analysis target object.
  • the so-called inactive image acquisition device can be understood as an image acquisition device that contributes little to the gaze point of the analysis target object.
  • step S102 may have multiple implementations during specific implementation. Two possible implementations are described below.
  • An active image acquisition device and an inactive image acquisition device may be determined through the following steps A-B.
  • step A the position of the target object is obtained according to the plurality of images.
  • an image acquisition device in the image acquisition system may be used to capture an image including a target object, and the image acquisition device may be a camera, a video camera, or the like. After the image acquisition device captures an image, the captured image may be sent to a controller, and the controller may analyze the eye movement of the target object to obtain the target object fixation point according to the image.
  • the distance between the target object and the image acquisition device is different, and the characteristics related to the target object in the image captured by the image acquisition device may also be different. Therefore, the position of the target object can be acquired from the images captured by the plurality of image acquisition devices.
  • a distance difference between any two image acquisition devices in the multiple image acquisition devices is less than a preset distance. Threshold; at least two image acquisition devices with different focus positions exist in the plurality of image acquisition devices.
  • the distance between any two of the plurality of image acquisition devices is less than a preset distance threshold, and it can be considered that when shooting an image containing a target object, the distance between the target object and any two image acquisition devices is The difference between them is relatively small, that is, the distance between the multiple image acquisition devices may be considered to be small. That is, it can be roughly considered that the positions where the multiple image acquisition devices are located are the same.
  • the distance between the target object and the third image acquisition device is a third distance
  • the distance between the target object and the fourth image acquisition device is a fourth distance
  • the difference between the third distance and the fourth distance is relatively small. It can be roughly considered that the third image acquisition device and the fourth acquisition device are located at the same position.
  • the preset distance threshold may be 10 cm.
  • the embodiments of the present application do not specifically limit the specific values of the focal lengths or focus positions of the multiple image acquisition devices.
  • step B determining the active image acquisition device and the inactive image acquisition device according to the relative positions between the plurality of image acquisition devices and the target object.
  • an active image acquisition device and an inactive image acquisition device of the plurality of image acquisition devices may be determined according to the relative positions.
  • a second implementation manner An active image acquisition device and an inactive image acquisition device among multiple image acquisition devices may be determined in the following manner.
  • an image acquisition device that does not include the target object in the captured image may be determined as the inactive image acquisition device, and then images from other than the inactive image acquisition device may be acquired.
  • the acquisition devices that is, the candidate image acquisition devices, an active image acquisition device is determined.
  • the embodiments of the present application do not specifically limit the specific manner of determining the active image acquisition device from the candidate image acquisition device.
  • the method described in step AB above may be used to determine from the candidate image acquisition device.
  • Active image acquisition device may be used to determine from the candidate image acquisition device.
  • step S103 controlling the active image acquisition device to capture a first image in a first configuration, and controlling the inactive image acquisition device to capture a second image in a second configuration.
  • step S104 acquiring the first image sent by the active image acquisition device, and acquiring the second image sent by the inactive image acquisition device.
  • steps S103 and S104 it should be noted that the embodiments of the present application do not specifically limit the first configuration and the second configuration, and the specific settings of the first configuration and the second configuration may be determined according to actual conditions.
  • the fixation point of the target object can be analyzed by using the image captured by the active image acquisition device.
  • the fixation of the target object can be further analyzed in combination with the image captured by the inactive image acquisition device. point. Therefore, it is possible to control the active image acquisition device to capture the first image in the first configuration and the inactive image acquisition device to capture the second image in the second configuration, so that the inactive image acquisition device needs to send the captured image to the controller.
  • the bandwidth is small and less than the bandwidth required by the active image acquisition device to send the image captured by it to the controller, instead of the bandwidth required by all image acquisition devices to send the image captured by it to the controller (e.g., equal to The bandwidth required when the active image acquisition device sends the images captured by it to the controller), thereby saving the bandwidth for transmitting the images captured by the plurality of image acquisition devices.
  • step S103 may be implemented in at least one of the following manners during specific implementation:
  • the embodiments of the present application do not specifically limit the specific values of the first frequency and the second frequency, and the specific values of the first frequency and the specific values of the second frequency may be determined according to actual conditions.
  • the first frequency may be 30 Hz
  • the second frequency may be 6 Hz.
  • the frequency of capturing images by the inactive image acquisition device is relatively low, and therefore, the bandwidth required for the inactive image to send the captured image is relatively small.
  • the embodiments of the present application do not specifically limit the specific values of the first image bit width and the second image bit width, and the specific values of the first image bit width and the second image bit width may be based on actual conditions. The situation is ok.
  • the first image bit width may be 8 bits
  • the second image bit width may be 4 bits.
  • the image bit width of the image captured by the inactive image acquisition device is relatively low, and therefore, the bandwidth required for the inactive image to send the image captured by it is relatively small.
  • the embodiments of the present application do not specifically limit the specific values of the first resolution and the second resolution, and the specific values of the first resolution and the second resolution may be determined according to actual conditions.
  • the first resolution may be 2000 * 1000
  • the second resolution may be 500 * 250.
  • the image resolution of the image captured by the inactive image acquisition device is relatively low, and therefore, the bandwidth required for the inactive image to send the image captured by it is relatively small.
  • step S104 when step S104 is specifically implemented, it may be implemented in the following manner.
  • the embodiments of the present application do not specifically limit the specific values of the first compression ratio and the second compression ratio.
  • the first compression ratio may be a relatively small value, such as 0, so
  • the second compression ratio may be a value greater than the first compression ratio, such as two. That is, when the active image acquisition device sends the image captured by it to the controller, it can compress the image with a small compression ratio or not, to provide higher image quality, so that the target object can be accurately analyzed. Gaze point. When an inactive image acquisition device sends an image captured by it to the controller, it can be compressed at a higher compression ratio to reduce the image size, thereby reducing the bandwidth required to send the image to the controller.
  • the position of the target object may change, for example, the target object moves away from the active image acquisition device. Therefore, based on the fact that the active image acquisition device captures an image at a first frequency and the inactive image acquisition device captures an image at a second frequency, the gaze point of the target object may not be accurately analyzed.
  • the first frequency and the second frequency may also be adjusted. Therefore, the image captured by the active image acquisition device and the image captured by the inactive image acquisition device can accurately analyze the gaze point of the target object.
  • At least one of the first frequency and the second frequency may be adjusted according to the relative positions between the multiple image acquisition devices and the target object.
  • the active image acquisition device corresponds to a first shooting area with a better shooting effect, and the sharpness of an image captured in the first shooting area is relatively high. Therefore, at least one of the first frequency and the second frequency is adjusted according to the relative positions between the plurality of image acquisition devices and the target object. In specific implementation, it may be determined whether the target object is within the first shooting area. If the target object is within the first shooting area, the value of the second frequency is reduced. If the object is outside the first shooting area, the value of the second frequency is increased.
  • the target object is within the first shooting area, it indicates that the fixation point of the target object can be accurately analyzed based on the image captured by the active image acquisition device.
  • the second frequency can be reduced. Value. If the target object is outside the first shooting area, it means that the image captured by the active image acquisition device may not accurately analyze the fixation point of the target object. At this time, the value of the second frequency may be increased. Therefore, the accuracy of the gaze point of the analysis target object is improved by combining the image captured by the active image acquisition device and the image captured by the inactive image acquisition device.
  • the inactive image acquisition device corresponds to a second shooting area with a better shooting effect, and the sharpness of an image captured in the second shooting area is relatively high. Therefore, at least one of the first frequency and the second frequency is adjusted according to the relative positions between the plurality of image acquisition devices and the target object. In specific implementation, it may be determined whether the target object is within the second shooting area, and if the target object is within the second shooting area, the value of the second frequency is increased, and the first The value of a frequency.
  • the fixation point of the target object can be accurately analyzed based on the image captured by the inactive image acquisition device. At this time, the target point can be reduced.
  • the value of the first frequency is correspondingly increased by the value of the second frequency.
  • At least one of the first frequency and the second frequency may be adjusted according to the sharpness of the first image.
  • the value of the second frequency may be reduced, and if the sharpness of an image captured by the active image obtaining device is less than sharpness Degree threshold, the value of the second frequency may be increased.
  • the sharpness of the image captured by the active image acquisition device is greater than or equal to the sharpness threshold, it means that the fixation point of the target object can be accurately analyzed based on the image captured by the active image acquisition device.
  • the value of the second frequency can be reduced. If the sharpness of the image captured by the active image acquisition device is less than the sharpness threshold, it means that the image captured by the active image acquisition device may not accurately analyze the fixation point of the target object.
  • the value of the second frequency thereby combining the image captured by the active image acquisition device and the image captured by the inactive image acquisition device to improve the accuracy of analyzing the gaze point of the target object.
  • the embodiment of the present application does not specifically limit the sharpness threshold, and a specific value of the sharpness threshold may be specifically determined according to an actual situation.
  • a third possible implementation manner It can be implemented through the following steps S201-S203.
  • step S201 according to the characteristics of several frames of images continuously captured by the active image acquisition device, a distance change trend between the target object and the active image acquisition device is determined.
  • the distance between the target object and the active image acquisition device when the active image acquisition device captures the frame image can be determined. Therefore, according to the characteristics of several frames of images continuously captured by the active image acquisition device, a change trend of the distance between the target object and the active image acquisition device can be determined.
  • the distance between the target object and the active image acquisition device is 45 Centimeter
  • the distance between the target object and the active image acquisition device is 50 cm
  • the active image acquisition device takes a third frame of image the target The distance between the object and the active image acquisition device is 55 centimeters, then it can be determined that the change trend of the distance between the target object and the active image acquisition device is: gradually getting farther.
  • step S202 judging the possibility that the active image acquisition device switches to the inactive image acquisition device according to the distance change trend.
  • the active image acquisition device is switched to the inactive image acquisition device mentioned in the embodiments of the present application may be that the target object can clearly take a photo after leaving the active image acquisition device. Range of possibilities.
  • the in-focus position of the active image acquisition device may be determined, and therefore, the range in which the active image acquisition device can clearly capture a photo may be determined. Therefore, the possibility that the target object leaves the range in which the active image acquisition device can clearly capture photos can be determined according to the range in which the active image acquisition device can clearly capture photos and the distance change trend.
  • the active image acquisition device can clearly capture an image including the target object, and the target object and the active image acquisition The trend of the distance between the devices is: gradually getting farther. At this time, it may be determined that the possibility of the active image acquisition device switching to the inactive image acquisition device is relatively large.
  • step S203 if the probability is greater than or equal to a preset threshold, speed up the frequency of the second image captured by the inactive image acquisition device.
  • the probability is greater than or equal to a preset threshold, it means that the fixation point of the target object may not be accurately analyzed based on the image captured by the active image acquisition device.
  • the frequency of images captured by the inactive image acquisition device may be accelerated, so that the gaze point of the target object is analyzed based on the images captured by the active image acquisition device and the images captured by the inactive image acquisition device.
  • the embodiments of the present application do not specifically limit the preset threshold, and the specific value of the preset threshold may be specifically determined according to actual situations.
  • the telemetry eye tracking system includes multiple image acquisition devices.
  • the multiple image acquisition devices include a first image acquisition device and a second image acquisition device.
  • step A the position of the target acquisition object based on the images captured by the plurality of image acquisition devices
  • step C acquiring a third image including the target object captured by the first image acquisition device, and determining a distance between the target object and the first image acquisition device according to the characteristics of the third image .
  • the distance between the target object and the first image acquisition device may be based on the interpupillary distance of the target object in the third image, the spot distance in the eyes of the target object, or the iris of the target object. Radius to reflect. Therefore, a feature related to the interpupillary distance of the target object in the third image, a feature related to the spot distance in the eyes of the target object, or a feature related to the iris radius of the target object may be extracted, thereby determining the A distance between a target object and the first image acquisition device.
  • step D acquiring a fourth image including the target object captured by the second image acquisition device, and determining a distance between the target object and the second image acquisition device according to the characteristics of the fourth image .
  • step D is similar to step C.
  • Features in the fourth image related to the interpupillary distance of the target object, or features related to the spot distance in the target object's eyes, or the iris of the target object can be extracted.
  • step B determines the plurality of image acquisition devices according to the relative positions between the plurality of image acquisition devices and the target object
  • the active image acquisition device and the inactive image acquisition device can be implemented by at least one of the following steps E and F.
  • step E if the distance between the target object and the first image acquisition device is in a first distance interval, determine that the first image acquisition device is an active image acquisition device, and determine the second image acquisition The device is an inactive image, wherein the first distance interval is determined according to a focus position of the first image acquisition device.
  • the first image acquisition device can clearly capture an image including the target object
  • the first image acquisition device is an active image acquisition device
  • the second image acquisition device is an inactive image acquisition device.
  • the range of images that can be clearly captured by the first image acquisition device is related to the focus position of the first image acquisition device. Therefore, in the embodiment of the present application, the first distance interval may be determined according A focus position of the first image acquisition device is determined.
  • step F if the distance between the target object and the first image acquisition device is in a second distance interval, determine that the first image acquisition device is an inactive image acquisition device, and determine the second image
  • the acquiring device is an active image acquiring device, wherein the second distance interval is determined according to a focus position of the second image acquiring device.
  • the second image acquisition device can clearly capture an image including the target object, At this time, it may be determined that the second image acquisition device is an active image acquisition device, and it is determined that the first image acquisition device is an inactive image.
  • the second distance interval can be determined according to The in-focus position of the second image acquisition device is determined.
  • FIG. 3 is a structural block diagram of a control device for an image acquisition device according to one embodiment of the present application.
  • the image acquisition device 300 provided in the embodiment of the present application may include a first acquisition unit 310, The first determination unit 320, the control unit 330, and the second acquisition unit 340.
  • the first obtaining unit 310 is configured to obtain multiple images captured by multiple image acquisition devices
  • a first determining unit 320 configured to determine an active image acquisition device and an inactive image acquisition device of the plurality of image acquisition devices according to the plurality of images;
  • the control unit 330 is configured to control the active image acquisition device to take a first image in a first configuration, and control the inactive image acquisition device to take a second image in a second configuration;
  • a second acquiring unit 340 configured to acquire the first image sent by the active image acquisition device, and acquire the second image sent by the inactive image acquisition device;
  • the bandwidth required by the active image acquisition device to send the first image is greater than the bandwidth required by the inactive image acquisition device to send the second image.
  • the first determining unit 320 is configured to:
  • the active image acquisition device and the inactive image acquisition device are determined according to the relative positions between the plurality of image acquisition devices and the target object.
  • the first determining unit 320 is configured to:
  • An active image acquisition device is determined from the image acquisition devices to be selected; wherein, the image acquisition device to be selected is an image acquisition device other than the inactive image acquisition device among the plurality of image acquisition devices.
  • control unit 330 is configured to:
  • the second obtaining unit 340 is configured to:
  • the apparatus 300 further includes:
  • the first adjusting unit is configured to adjust at least one of the first frequency and the second frequency according to the relative positions between the plurality of image acquisition devices and the target object.
  • the apparatus 300 further includes:
  • the second adjustment unit is configured to adjust at least one of the first frequency and the second frequency according to the sharpness of the first image.
  • the apparatus 300 further includes:
  • a second determining unit configured to determine a change trend in the distance between the target object and the active image acquisition device according to the characteristics of several frames of images continuously captured by the active image acquisition device;
  • a judging unit configured to judge a possibility that the active image acquisition device switches to the inactive image acquisition device according to the distance change trend
  • the frequency accelerating unit is configured to accelerate the frequency at which the second image is captured by the inactive image acquisition device if the probability is greater than or equal to a preset threshold.
  • the plurality of image acquisition devices include a first image acquisition device and a second image acquisition device;
  • the first determining unit is further configured to perform at least one of the following operations:
  • a fourth image including the target object captured by the second image acquisition device is acquired, and a distance between the target object and the second image acquisition device is determined according to a feature of the fourth image.
  • the first determining unit is further configured to perform at least one of the following operations:
  • the distance between the target object and the first image acquisition device is in a first distance interval, determine that the first image acquisition device is an active image acquisition device, and determine that the second image acquisition device is an inactive image , Wherein the first distance interval is determined according to a focus position of the first image acquisition device;
  • the distance between the target object and the first image acquisition device is in a second distance interval, determine that the first image acquisition device is an inactive image acquisition device, and determine that the second image acquisition device is an active image An acquisition device, wherein the second distance interval is determined according to a focus position of the second image acquisition device.
  • the distance between any two image acquisition devices in the plurality of image acquisition devices is less than a preset distance threshold; at least two image acquisition devices with different focus positions exist in the plurality of image acquisition devices.
  • the device 300 is a device corresponding to the method provided by the foregoing method embodiments, for a specific description of the device 300, reference may be made to a description part of the foregoing method embodiments, and details are not described herein again.
  • an active image acquisition device and an inactive image acquisition device among a plurality of image acquisition devices can be determined, and the active image acquisition device can be controlled to shoot in the first configuration
  • the first image and the inactive image acquisition device use the second configuration to capture the second image, so that the bandwidth required by the inactive image acquisition device to send the image it captures to the controller is relatively small, which is less than that taken by the active image acquisition device.
  • the bandwidth required when the image is sent to the controller rather than the bandwidth required when all image capture devices send images captured by the controller to the controller (for example, equal to the active image capture device sends the images captured by it to the controller) Required bandwidth), thereby saving bandwidth for transmitting images captured by the plurality of image acquisition devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Vascular Medicine (AREA)
  • Software Systems (AREA)
  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)
  • Image Analysis (AREA)

Abstract

本申请公开了一种图像获取设备的控制方法及装置，包括：获取多个图像获取设备拍摄的多个图像；根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。即，并非所有图像获取设备将图像发送给控制器所需的带宽均比较大，故节省了传输多个图像获取设备拍摄的图像的带宽。

Description

一种图像获取设备的控制方法及装置 技术领域
本申请涉及眼球追踪技术领域，特别是涉及一种图像获取设备的控制方法及装置。
背景技术
眼球追踪技术是指通过分析目标对象眼部运动得到目标对象注视点的技术。主流技术主要依靠基于红外频段的人眼图像，分析人眼特征信息，进而得出目标对象注视点。
目前，遥测眼球追踪技术中通常采用多个图像获取设备拍摄目标对象图像，将所述多个图像获取设备拍摄的图像传输给控制器，从而使得控制器基于拍摄的目标对象图像分析人眼特征信息，进而得出目标对象的注视点。
但是，将多个图像获取设备拍摄的图像均发送给控制器，可能需要比较大的传输带宽。而传输带宽会受限于具体的传输协议，从而导致实际带宽不能满足传输多个图像获取设备所拍摄的图像的带宽要求。
发明内容
本申请至少部分实施例提供了一种图像获取设备的控制方法及装置，以至少部分地解决相关技术中同时将多个图像获取设备拍摄的图像发送给控制器，从而导致实际带宽不能满足传输多个图像获取设备所拍摄的图像的带宽要求的问题。
在本申请其中一实施例中，提供一种图像获取设备的控制方法，包括：
获取多个图像获取设备拍摄的多个图像；
根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；
控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；
获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；
其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
在一个可选实施例中，根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，包括：
根据所述多个图像获取目标对象的位置；
根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
在一个可选实施例中，根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，包括：
将所述多个图像中不包括目标对象的图像获取设备，确定为所述非活跃图像获取设备；
从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
在一个可选实施例中，控制所述活跃图像获取设备采用所述第一配置拍摄所述第一图像，控制所述非活跃图像获取设备采用所述第二配置拍摄所述第二图像，包括以下至少之一：
控制所述活跃图像获取设备采用第一频率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二频率拍摄所述第二图像，其中，所述第一频率大于所述第二频率；
控制所述活跃图像获取设备采用第一图像位宽拍摄所述第一图像，控制所述非活跃图像获取设备采用第二图像位宽拍摄所述第二图像，其中，所述第一图像位宽大于所述第二图像位宽；和，
控制所述活跃图像获取设备采用第一分辨率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄所述第二图像，其中，所述第一分辨率大于所述第二分辨率。
在一个可选实施例中，获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像，包括：
获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像，其中，所述第一压缩比小于所述第二压缩比。
在一个可选实施例中，所述方法还包括：
根据所述多个图像获取设备与目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
在一个可选实施例中，所述方法还包括：
根据所述第一图像的清晰度，调节所述第一频率与所述第二频率中至少之一。
在一个可选实施例中，所述方法还包括：
根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定目标对象与所述活跃图像获取设备之间的距离变化趋势；
根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性；
若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
在一个可选实施例中，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备；
根据所述多个图像获取所述目标对象的位置，包括以下至少之一：
获取所述第一图像获取设备拍摄的包含所述目标对象的第三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距离；
和，
获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
在一个可选实施例中，根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备，包括以下至少之一：
若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备 的对焦位置确定；和，
若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
在一个可选实施例中，所述多个图像获取设备中的任意两个图像获取设备之间的距离小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
在本申请的其中一实施例中，还提供一种图像获取设备的控制装置，包括：
第一获取单元，设置为获取多个图像获取设备拍摄的多个图像；
第一确定单元，设置为根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；
控制单元，设置为控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；
第二获取单元，设置为获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；
其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
在一个可选实施例中，所述第一确定单元，设置为：
根据所述多个图像获取目标对象的位置；
根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
在一个可选实施例中，所述第一确定单元，设置为：
将所述多个图像中不包括目标对象的图像获取设备，确定为所述非活跃图像获取设备；
从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
在一个可选实施例中，所述控制单元，设置为：
控制所述活跃图像获取设备采用第一频率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二频率拍摄所述第二图像，其中，所述第一频率大于所述第二频率；
控制所述活跃图像获取设备采用第一图像位宽拍摄所述第一图像，控制所述非活跃图像获取设备采用第二图像位宽拍摄所述第二图像，其中，所述第一图像位宽大于所述第二图像位宽；和，
控制所述活跃图像获取设备采用第一分辨率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄所述第二图像；其中，所述第一分辨率大于所述第二分辨率。
在一个可选实施例中，所述第二获取单元，设置为：
获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像；其中，所述第一压缩比小于所述第二压缩比。
在一个可选实施例中，所述装置还包括：
第一调节单元，设置为根据所述多个图像获取设备与目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
在一个可选实施例中，所述装置还包括：
第二调节单元，设置为根据所述第一图像的清晰度，调节所述第一频率与所述第二频率中至少之一。
在一个可选实施例中，所述装置还包括：
第二确定单元，设置为根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定目标对象与所述活跃图像获取设备之间的距离变化趋势；
判断单元，设置为根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性；
频率加快单元，设置为若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
在一个可选实施例中，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备；
所述第一确定单元，还设置为执行以下操作中的至少之一：
获取所述第一图像获取设备拍摄的包含所述目标对象的第三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距离；
和，
获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
在一个可选实施例中，所述第一确定单元，还设置为执行以下操作中的至少之一：
若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备的对焦位置确定；和，
若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
在一个可选实施例中，所述多个图像获取设备中的任意两个图像获取设备之间的距离小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
与相关技术相比，本申请至少部分实施例具有以下优点：
通过本申请其中一实施例提供的图像获取设备的控制方法，获取多个图像获取设备拍摄的多个图像；根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二 图像所需的带宽。由此可见，利用该图像获取设备的控制方法可以确定出多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，并控制活跃图像获取设备采用第一配置拍摄第一图像，非活跃图像获取设备采用第二配置拍摄第二图像，使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，而不是所有图像获取设备将其拍摄的图像发送给控制器时所需的带宽均比较大(例如等于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽)，从而节省了传输所述多个图像获取设备拍摄的图像的带宽。
附图说明
为了更清楚地说明本申请实施例或相关技术中的技术方案，下面将对实施例或相关技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请中记载的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是根据本申请其中一实施例提供的一种图像获取设备的控制方法的流程图。
图2是根据本申请其中一实施例提供的一种调节所述图像获取设备拍摄图像的频率的方法的流程图。
图3是根据本申请其中一实施例提供的一种图像获取设备的控制装置的结构框图。
具体实施方式
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
目前，遥测眼球追踪技术中通常采用多个图像获取设备以相同的拍摄频率拍摄目标对象图像，将所述多个图像获取设备拍摄的图像传输给控制器，从而使得控制器基于拍摄的目标对象图像分析人眼特征信息，进而得出目标对象的注视点。而为了能够准确的分析出目标对象的注视点，多个图像获得 设备的拍摄频率一般设置的比较高。
但是，将多个图像获取设备拍摄的图像均发送给控制器，可能需要比较大的传输带宽。而传输带宽会受限于具体的传输协议，从而导致实际带宽不能满足传输多个图像获取设备所拍摄的图像的带宽要求。
此外，在一些场景中，使用所述多个图像获取设备中的某一个或某几个图像获取设备所拍摄的图像，就可以准确的分析出目标对象的注视点。也就是说，存在一个或者一些图像获取设备，其拍摄的图像对分析目标对象的注视点的贡献很小。对于这种情况，可以降低这些对分析目标对象的注视点的贡献很小的图像获取设备拍摄图像的频率，从而节省传输所述多个图像获取设备拍摄的图像的带宽。
鉴于此，本申请其中一实施例提供一种图像获取设备的控制方法及装置，包括：获取多个图像获取设备拍摄的多个图像；根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
由此可见，利用本申请其中一实施例提供的图像获取设备的控制方法，可以确定出多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，并控制活跃图像获取设备以第一配置拍摄第一图像，非活跃图像获取设备以第二配置拍摄第二图像，使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，而不是所有图像获取设备将其拍摄的图像发送给控制器时所需的带宽均比较大(例如等于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽)，从而节省了传输所述多个图像获取设备拍摄的图像的带宽。
下面结合附图，详细说明本申请的各种非限制性实施方式。
图1是根据本申请其中一实施例提供的一种图像获取设备的控制方法的 流程图，如图1所示，该方法可以应用于遥测式眼球追踪系统。遥测式眼球追踪系统可以包括图像获取设备和控制器。图像获取设备可以获取包括目标对象的图像。控制器可以根据所述包括目标对象的图像分析目标对象眼部运动得到目标对象注视点。
具体地，遥测式眼球追踪系统可以包含多个图像获取设备，这多个图像获取设备可以以近似的视角拍摄相同的场景，这多个图像获取设备中至少存在两个对角位置不同的图像获取设备。
该实施例提供的图像获取设备的控制方法，可以通过以下步骤S101-S104实现。
在步骤S101中：获取多个图像获取设备拍摄的多个图像。
需要说明的是，本申请实施例不具体限定所述图像获取设备，所述图像获取设备例如可以为摄像机。
在本申请实施例中，控制器和图像获取设备之间可以通过网络建立连接，因此，在本申请实施例的一种可能的实现方式中，控制器可以通过网络获取所述多个图像获取设备拍摄的图像。
在步骤S102中：根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备。
如前文所述，在一些场景中，使用所述多个图像获取设备中的某一个或某几个图像获取设备所拍摄的图像，就可以准确的分析出目标对象的注视点。
需要说明的是，所谓活跃图像获取设备，可以理解成对分析目标对象的注视点贡献大的图像获取设备。所谓非活跃图像获取设备，可以理解成对分析目标对象的注视点贡献小的图像获取设备。
需要说明的是，在本申请实施例中，步骤S102在具体实现时可以有多种实现方式，以下介绍两种可能的实现方式。
第一种实现方式：可以通过如下步骤A-B确定活跃图像获取设备和非活跃图像获取设备。
在步骤A：中根据所述多个图像获取目标对象的位置。
在本申请实施例中，所述图像获取系统中的图像获取设备可以用于拍摄包括目标对象的图像，所述图像获取设备可以为照相机、摄像机等。所述图 像获取设备拍摄图像之后，可以将拍摄的图像发送给控制器，控制器可以根据所述图像分析目标对象眼部运动得到目标对象注视点。
可以理解的是，目标对象与图像获取设备的之间的距离不同，所述图像获取设备拍摄的图像中与目标对象相关的特征也可能不同。因此，可以根据所述多个图像获取设备拍摄的图像获取目标对象的位置。
需要说明的是，本申请实施例对所述多个图像获取设备不做限定，作为一种示例，所述多个图像获取设备中的任意两个图像获取设备之间的距离差小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
所述多个图像获取设备中的任意两个图像获取设备之间的距离小于预设距离阈值，可以认为在拍摄包含目标对象的图像时，目标对象与任意两个图像获取设备之间的距离之间的差值比较小，即可以认为所述多个图像获取设备之间的距离很小。即可以粗略的认为所述多个图像获取设备所处的位置相同。例如，目标对象与第三图像获取设备之间的距离为第三距离，目标对象与第四图像获取设备之间的距离为第四距离，第三距离和第四距离之前的差值比较小，则可以粗略的认为第三图像获取设备和第四获取设备所处的位置相同。
本申请不具体限定所述预设距离阈值，作为一种示例，所述预设距离阈值可以为10厘米。
本申请实施例不具体限定所述多个图像获取设备的焦距或对焦位置的具体取值。
在步骤B中：根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
在本申请实施例中，获取多个图像获取设备与目标对象之间的相对位置之后，即可根据该相对位置确定多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备。
第二种实现方式：可以通过如下方式确定多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备。
将所述多个图像中不包括所述目标对象的图像获取设备，确定为所述非 活跃图像获取设备；从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
可以理解的是，多个图像获取设备的视场角可能不同，因此，可能存在一些图像获取设备，并不能拍摄到包含目标对象的图像，而遥测眼球追踪技术要根据目标对象的人眼特征信息，进而得出目标对象的注视点，若图像中不包含目标对象，则无法通过该不包含目标对象的图像得出目标对象的注视点。因此，在本申请实施例中，可以将拍摄的图像中不包括所述目标对象的图像获取设备，确定为所述非活跃图像获取设备，然后，从除了非活跃图像获取设备之外的其它图像获取设备即待选图像获取设备中，确定出活跃图像获取设备。
需要说明的是，本申请实施例不具体限定从待选图像获取设备中确定活跃图像获取设备的具体方式，作为一种示例，可以采用以上步骤A-B所述的方法从待选图像获取设备中确定活跃图像获取设备。
在步骤S103中：控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像。
在步骤S104中：获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像。
关于步骤S103和步骤S104，需要说明的是，本申请实施例不具体限定第一配置和第二配置，第一配置和第二配置的具体设置可以根据实际情况确定。
如前文，利用所述活跃图像获取设备拍摄的图像可以分析出目标对象的注视点，为了使得分析的目标对象的注视点更加准确，可以进一步结合非活跃图像获取设备拍摄的图像分析目标对象的注视点。因此，可以控制活跃图像获取设备采用第一配置拍摄第一图像，非活跃图像获取设备采用第二配置拍摄第二图像，使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，而不是所有图像获取设备将其拍摄的图像发送给控制器时所需的带宽均比较大(例如等于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽)，从而节省了传输所述多个图像获取设备拍摄的图像的带宽。
为了使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，在本申请实施例的一种可能的实现方式中，步骤S103在具体实现时，可以通过如下方式中至少之一来实现：
控制所述活跃图像获取设备采用第一频率拍摄第一图像，控制所述非活跃图像获取设备采用第二频率拍摄第二图像，其中，所述第一频率大于所述第二频率；
本申请实施例不具体限定所述第一频率和所述第二频率的具体取值，所述第一频率的具体取值和所述第二频率的具体取值可以根据实际情况确定。作为一种示例，所述第一频率可以为30Hz，所述第二频率可以为6Hz。
可以理解的是，非活跃图像获取设备拍摄图像的频率比较低，因此，非活跃图像发送其拍摄的图像所需的带宽比较小。
和，
控制所述活跃图像获取设备采用第一图像位宽拍摄第一图像，控制所述非活跃图像获取设备采用第二图像位宽拍摄第二图像，其中，所述第一图像位宽大于所述第二图像位宽；
需要说明的是，本申请实施例不具体限定所述第一图像位宽和第二图像位宽的具体取值，所述第一图像位宽和第二图像位宽的具体取值可以根据实际情况确定。作为一种示例，所述第一图像位宽可以为8比特，所述第二图像位宽可以为4比特。
以理解的是，非活跃图像获取设备拍摄图像的图像位宽比较低，因此，非活跃图像发送其拍摄的图像所需的带宽比较小。
和，
控制所述活跃图像获取设备采用第一分辨率拍摄第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄第二图像；其中，所述第一分辨率大于所述第二分辨率。
需要说明的是，本申请实施例不具体限定所述第一分辨率和第二分辨率的具体取值，所述第一分辨率和第二分辨率的具体取值可以根据实际情况确 定。作为一种示例，所述第一分辨率可以为2000*1000，所述第二分辨率可以为500*250。
可以理解的是，非活跃图像获取设备拍摄图像的图像分辨率比较低，因此，非活跃图像发送其拍摄的图像所需的带宽比较小。
为了使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，在本申请实施例的一种可能的实现方式中，步骤S104在具体实现时，可以通过如下方式实现。
获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像，其中，所述第一压缩比小于所述第二压缩比。
需要说明的是，本申请实施例不具体限定第一压缩比和第二压缩比的具体取值，作为一种示例，所述第一压缩比可以为一个比较小的数值，例如为0，所述第二压缩比可以为一个大于第一压缩比的值，例如为2。即活跃图像获取设备将其拍摄的图像发送给控制器时，可以以较小的压缩比对图像进行压缩，或者不进行压缩，以提供较高的图像质量，以便于准确的分析出目标对象的注视点。而非活跃图像获取设备将其拍摄的图像发送给控制器时，可以以较高压缩比进行压缩，以减小图像尺寸，从而减少将该图像发送给控制器所需的带宽。
可以理解的是，所述图像获取设备拍摄图像的过程中，目标对象的位置可能会发生改变，例如，目标对象朝着远离活跃图像获取设备的方向移动。因此，基于所述活跃图像获取设备以第一频率拍摄图像，和所述非活跃图像获取设备以第二频率拍摄图像，可能并不能准确的分析出目标对象的注视点。
因此，在本申请实施例中，还可以对所述第一频率和所述第二频率进行调节。从而使得利用所述活跃图像获取设备拍摄的图像和所述非活跃图像获取设备拍摄的图像，可以准确的分析出目标对象的注视点。
需要说明的是，对所述第一频率和所述第二频率进行调节，可以有多种 实现方式。以下将介绍三种可能的实现方式。
第一种可能的实现方式：可以根据所述多个图像获取设备与所述目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
可以理解的是，所述活跃图像获取设备对应有拍摄效果比较好的第一拍摄区域，在该第一拍摄区域内拍摄的图像的清晰度比较高。因此，根据所述多个图像获取设备与所述目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。在具体实现时，可以判断所述目标对象是否在所述第一拍摄区域内，若所述目标对象在所述第一拍摄区域内，则减小所述第二频率的数值，若所述目标对象在所述第一拍摄区域外，则增大所述第二频率的数值。
可以理解的是，目标对象在所述第一拍摄区域内，则说明基于该活跃图像获取设备拍摄的图像可以准确的分析出目标对象的注视点，此时，可以减小所述第二频率的数值。若目标对象在所述第一拍摄区域外，则说明基于该活跃图像获取设备拍摄的图像可能不可以准确的分析出目标对象的注视点，此时，可以增大所述第二频率的数值，从而结合所述活跃图像获取设备拍摄的图像和所述非活跃图像获取设备拍摄的图像，提高分析目标对象的注视点的准确性。
可以理解的是，所述非活跃图像获取设备对应有拍摄效果比较好的第二拍摄区域，在该第二拍摄区域内拍摄的图像的清晰度比较高。因此，根据所述多个图像获取设备与所述目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。在具体实现时，可以判断所述目标对象是否在所述第二拍摄区域内，若所述目标对象在所述第二拍摄区域内，则增加所述第二频率的数值，减小所述第一频率的数值。
可以理解的是，若所述目标对象在所述第二拍摄区域内，则说明基于该非活跃图像获取设备拍摄的图像可以准确的分析出目标对象的注视点，此时，可以减小所述第一频率的数值，相应的，增大所述第二频率的数值。
第二种可能的实现方式：可以根据所述第一图像的清晰度，调节所述第一频率与所述第二频率中至少之一。
具体地，若所述活跃图像获取设备拍摄的图像的清晰度大于或者等于清 晰度阈值，则可以减小所述第二频率的数值，若所述活跃图像获取设备拍摄的图像的清晰度小于清晰度阈值，则可以增加所述第二频率的数值。
可以理解的是，若所述活跃图像获取设备拍摄的图像的清晰度大于或者等于清晰度阈值，则说明基于该活跃图像获取设备拍摄的图像可以准确的分析出目标对象的注视点，此时，可以减小所述第二频率的数值。若所述活跃图像获取设备拍摄的图像的清晰度小于清晰度阈值，则说明基于该活跃图像获取设备拍摄的图像可能不可以准确的分析出目标对象的注视点，此时，可以增大所述第二频率的数值，从而结合所述活跃图像获取设备拍摄的图像和所述非活跃图像获取设备拍摄的图像，提高分析目标对象的注视点的准确性。
本申请实施例不具体限定所述清晰度阈值，所述清晰度阈值的具体数值可以根据实际情况具体确定。
第三种可能的实现方式：可以通过以下步骤S201-S203实现。
在步骤S201中：根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定所述目标对象与所述活跃图像获取设备之间的距离变化趋势。
可以理解的是，利用所述活跃图像获取设备拍摄的一帧图像的特征，可以确定出所述活跃图像获取设备拍摄该帧图像时，所述目标对象与所述活跃图像获取设备的距离。因此，根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，可以确定出所述目标对象与所述活跃图像获取设备之间的距离的变化趋势。
例如，对于所述活跃图像获取设备连续拍摄的三帧图像的特征，确定出所述活跃图像获取设备拍摄第一帧图像时，所述目标对象与所述活跃图像获取设备之间的距离为45厘米，所述活跃图像获取设备拍摄第二帧图像时，所述目标对象与所述活跃图像获取设备之间的距离为50厘米，所述活跃图像获取设备拍摄第三帧图像时，所述目标对象与所述活跃图像获取设备之间的距离为55厘米，则可以确定出所述目标对象与所述活跃图像获取设备之间的距离的变化趋势为：逐渐变远。
在步骤S202中：根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性。
需要说明的是，本申请实施例中提及的所述活跃图像获取设备切换为所 述非活跃图像获取设备的可能性，可以是所述目标对象离开所述活跃图像获取设备可以清晰拍摄照片的范围的可能性。
可以理解的是，所述活跃图像获取设备的对焦位置可以是确定的，因此，所述活跃图像获取设备可以清晰拍摄照片的范围可以是确定的。因此，可以根据所述活跃图像获取设备可以清晰拍摄照片的范围，以及所述距离变化趋势，判断所述目标对象离开所述活跃图像获取设备可以清晰拍摄照片的范围的可能性。
例如，当所述目标对象与所述活跃图像获取设备之间的距离小于等于60厘米时，所述活跃图像获取设备可以清晰拍摄包括目标对象的图像，而所述目标对象与所述活跃图像获取设备之间的距离的变化趋势为：逐渐变远。此时，可以确定所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性比较大。
在步骤S203中：若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
可以理解的是，若所述可能性大于或者等于预设阈值，则说明基于所述活跃图像获取设备拍摄的图像可能不能准确的分析出目标对象的注视点。此时，可以加快所述非活跃图像获取设备拍摄图像的频率，从而基于所述活跃图像获取设备拍摄的图像和所述非活跃图像获取设备拍摄的图像，分析目标对象的注视点。
需要说明的是，本申请实施例不具体限定所述预设阈值，所述预设阈值的具体取值可以根据实际情况具体确定。
如前文所述，所述遥测式眼球追踪系统包括多个图像获取设备，在一种可能的实现方式中，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备。对于这种情况，步骤A“所述根据所述多个图像获取设备拍摄的图像获取目标对象的位置”可以通过如下步骤C和步骤D中至少之一来实现。
在步骤C中：获取所述第一图像获取设备拍摄的包含所述目标对象的第 三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距离。
需要说明的是，所述目标对象与所述第一图像获取设备之间的距离，可以通过所述第三图像中目标对象的瞳孔间距、或者目标对象的眼睛中的光斑间距或者目标对象的虹膜半径来体现。因此，可以提取所述第三图像中与所述目标对象的瞳孔间距相关的特征、或者与目标对象的眼睛中的光斑间距相关的特征或者与目标对象的虹膜半径相关的特征，从而确定所述目标对象与所述第一图像获取设备之间的距离。
在步骤D中：获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
步骤D的具体实现方式与步骤C类似，可以提取所述第四图像中与所述目标对象的瞳孔间距相关的特征、或者与目标对象的眼睛中的光斑间距相关的特征或者与目标对象的虹膜半径相关的特征，从而确定所述目标对象与所述第二图像获取设备之间的距离。相关描述部分可以参考以上步骤A的描述，在此不再赘述。
相应的，若采用步骤C和步骤D中至少之一获取目标对象的位置，则步骤B“根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备”可以通过如下步骤E和步骤F中至少之一来实现。
在步骤E中：若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备的对焦位置确定。
需要说明的是，当所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间时，可以认为所述第一图像获取设备可以清晰的拍摄到包括目标对象的图像，此时，可以确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像获取设备。可以理解的是， 所述第一图像获取设备可以清晰拍摄的图像的范围，与所述第一图像获取设备的对焦位置相关，因此，在本申请实施例中，所述第一距离区间可以根据所述第一图像获取设备的对焦位置确定。
在步骤F中：若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
需要说明的是，当所述目标对象与所述第二图像获取设备之间的距离，处于第二距离区间时，可以认为所述第二图像获取设备可以清晰的拍摄到包括目标对象的图像，此时，可以确定所述第二图像获取设备为活跃图像获取设备，确定所述第一图像获取设备为非活跃图像。
可以理解的是，所述第二图像获取设备可以清晰拍摄的图像的范围，与所述第二图像获取设备的对焦位置相关，因此，在本申请实施例中，所述第二距离区间可以根据所述第二图像获取设备的对焦位置确定。
图3是根据本申请其中一实施例提供的一种图像获取设备的控制装置的结构框图，如图3所示，本申请实施例提供的图像获取设备300，例如可以包括第一获取单元310、第一确定单元320、控制单元330和第二获取单元340。
第一获取单元310，设置为获取多个图像获取设备拍摄的多个图像；
第一确定单元320，设置为根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；
控制单元330，设置为控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；
第二获取单元340，设置为获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；
其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
可选的，所述第一确定单元320，设置为：
根据所述多个图像获取目标对象的位置；
根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
可选的，所述第一确定单元320，设置为：
将所述多个图像中不包括所述目标对象的图像获取设备，确定为所述非活跃图像获取设备；
从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
可选的，所述控制单元330，设置为：
控制所述活跃图像获取设备采用第一频率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二频率拍摄所述第二图像，其中，所述第一频率大于所述第二频率；
控制所述活跃图像获取设备采用第一图像位宽拍摄所述第一图像，控制所述非活跃图像获取设备采用第二图像位宽拍摄所述第二图像，其中，所述第一图像位宽大于所述第二图像位宽；和，
控制所述活跃图像获取设备采用第一分辨率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄所述第二图像；其中，所述第一分辨率大于所述第二分辨率。
可选的，所述第二获取单元340，设置为：
获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像；其中，所述第一压缩比小于所述第二压缩比。
可选的，所述装置300还包括：
第一调节单元，设置为根据所述多个图像获取设备与目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
可选的，所述装置300还包括：
第二调节单元，设置为根据所述第一图像的清晰度，调节所述第一频率与所述第二频率中至少之一。
可选的，所述装置300还包括：
第二确定单元，设置为根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定目标对象与所述活跃图像获取设备之间的距离变化趋势；
判断单元，设置为根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性；
频率加快单元，设置为若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
可选的，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备；
所述第一确定单元，还设置为执行以下操作中的至少之一：
获取所述第一图像获取设备拍摄的包含所述目标对象的第三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距离；
和，
获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
可选的，所述第一确定单元，还设置为执行以下操作中的至少之一：
若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备的对焦位置确定；和，
若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
可选的，所述多个图像获取设备中的任意两个图像获取设备之间的距离小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
由于所述装置300是与以上方法实施例提供的方法对应的装置，因此，关于所述装置300的具体描述，可以参考以上方法实施例的描述部分，此处不再赘述。
由此可见，利用本申请实施例提供的图像获取设备的控制装置，可以确定出多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，并控制活跃图像获取设备采用第一配置拍摄第一图像，非活跃图像获取设备采用第二配置拍摄第二图像，使得非活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽比较小，小于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽，而不是所有图像获取设备将其拍摄的图像发送给控制器时所需的带宽均比较大(例如等于活跃图像获取设备将其拍摄的图像发送给控制器时所需的带宽)，从而节省了传输所述多个图像获取设备拍摄的图像的带宽。
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本申请的真正范围和精神由下面的权利要求指出。
应当理解的是，本申请并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制
以上所述仅为本申请的较佳实施例，并不用以限制本申请，凡在本申请的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本申请的保护范围之内。

Claims (22)

  1. 一种图像获取设备的控制方法，包括：
    获取多个图像获取设备拍摄的多个图像；
    根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；
    控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；
    获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；
    其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
  2. 根据权利要求1所述的方法，其中，根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，包括：
    根据所述多个图像获取目标对象的位置；
    根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
  3. 根据权利要求1所述的方法，其中，根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备，包括：
    将所述多个图像中不包括目标对象的图像获取设备，确定为所述非活跃图像获取设备；
    从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
  4. 根据权利要求1所述的方法，其中，控制所述活跃图像获取设备采用所述第一配置拍摄所述第一图像，控制所述非活跃图像获取设备采用所述第二配置拍摄所述第二图像，包括以下至少之一：
    控制所述活跃图像获取设备采用第一频率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二频率拍摄所述第二图像，其中，所述第一频率大于所述第二频率；
    控制所述活跃图像获取设备采用第一图像位宽拍摄所述第一图像，控制 所述非活跃图像获取设备采用第二图像位宽拍摄所述第二图像，其中，所述第一图像位宽大于所述第二图像位宽；和，
    控制所述活跃图像获取设备采用第一分辨率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄所述第二图像，其中，所述第一分辨率大于所述第二分辨率。
  5. 根据权利要求1所述的方法，其中，获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像，包括：
    获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像；其中，所述第一压缩比小于所述第二压缩比。
  6. 根据权利要求4所述的方法，其中，所述方法还包括：
    根据所述多个图像获取设备与目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
  7. 根据权利要求4所述的方法，其中，所述方法还包括：
    根据所述第一图像的清晰度，调节所述第一频率与所述第二频率中至少之一。
  8. 根据权利要求1所述的方法，其中，所述方法还包括：
    根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定目标对象与所述活跃图像获取设备之间的距离变化趋势；
    根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性；
    若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
  9. 根据权利要求2所述的方法，其中，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备；
    根据所述多个图像获取所述目标对象的位置，包括以下至少之一：
    获取所述第一图像获取设备拍摄的包含所述目标对象的第三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距 离；
    和，
    获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
  10. 根据权利要求9所述的方法，其中，根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备，包括以下至少之一：
    若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备的对焦位置确定；和，
    若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
  11. 根据权利要求1-10任意一项所述的方法，其中，所述多个图像获取设备中的任意两个图像获取设备之间的距离小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
  12. 一种图像获取设备的控制装置，包括：
    第一获取单元，设置为获取多个图像获取设备拍摄的多个图像；
    第一确定单元，设置为根据所述多个图像确定所述多个图像获取设备中的活跃图像获取设备和非活跃图像获取设备；
    控制单元，设置为控制所述活跃图像获取设备采用第一配置拍摄第一图像，控制所述非活跃图像获取设备采用第二配置拍摄第二图像；
    第二获取单元，设置为获取所述活跃图像获取设备发送的所述第一图像，以及获取所述非活跃图像获取设备发送的所述第二图像；
    其中，所述活跃图像获取设备发送所述第一图像所需的带宽，大于所述非活跃图像获取设备发送所述第二图像所需的带宽。
  13. 根据权利要求12所述的装置，其中，所述第一确定单元，设置为：
    根据所述多个图像获取目标对象的位置；
    根据所述多个图像获取设备与所述目标对象之间的相对位置确定所述活跃图像获取设备和所述非活跃图像获取设备。
  14. 根据权利要求12所述的装置，其中，所述第一确定单元，设置为：
    将所述多个图像中不包括目标对象的图像获取设备，确定为所述非活跃图像获取设备；
    从待选图像获取设备中确定活跃图像获取设备；其中，所述待选图像获取设备为所述多个图像获取设备中除了所述非活跃图像获取设备之外的其余图像获取设备。
  15. 根据权利要求12所述的装置，其中，所述控制单元，设置为：
    控制所述活跃图像获取设备采用第一频率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二频率拍摄所述第二图像，其中，所述第一频率大于所述第二频率；
    控制所述活跃图像获取设备采用第一图像位宽拍摄所述第一图像，控制所述非活跃图像获取设备采用第二图像位宽拍摄所述第二图像，其中，所述第一图像位宽大于所述第二图像位宽；和，
    控制所述活跃图像获取设备采用第一分辨率拍摄所述第一图像，控制所述非活跃图像获取设备采用第二分辨率拍摄所述第二图像；其中，所述第一分辨率大于所述第二分辨率。
  16. 根据权利要求12所述的装置，其中，所述第二获取单元，设置为：
    获取以第一压缩比压缩后得到的所述活跃图像获取设备发送的所述第一图像，以及，获取以第二压缩比压缩后得到的所述非活跃图像获取设备发送的所述第二图像；其中，所述第一压缩比小于所述第二压缩比。
  17. 根据权利要求15所述的装置，其中，所述装置还包括：
    第一调节单元，设置为根据所述多个图像获取设备与目标对象之间的相对位置，调节所述第一频率与所述第二频率中至少之一。
  18. 根据权利要求15所述的装置，其中，所述装置还包括：
    第二调节单元，设置为根据所述第一图像的清晰度，调节所述第一频率 与所述第二频率中至少之一。
  19. 根据权利要求12所述的装置，其中，所述装置还包括：
    第二确定单元，设置为根据所述活跃图像获取设备连续拍摄的若干帧图像的特征，确定目标对象与所述活跃图像获取设备之间的距离变化趋势；
    判断单元，设置为根据所述距离变化趋势判断所述活跃图像获取设备切换为所述非活跃图像获取设备的可能性；
    频率加快单元，设置为若所述可能性大于或者等于预设阈值，则加快所述非活跃图像获取设备拍摄所述第二图像的频率。
  20. 根据权利要求13所述的装置，其中，所述多个图像获取设备包括第一图像获取设备和第二图像获取设备；
    所述第一确定单元，还设置为执行以下操作中的至少之一：
    获取所述第一图像获取设备拍摄的包含所述目标对象的第三图像，根据所述第三图像的特征确定所述目标对象与所述第一图像获取设备之间的距离；
    和，
    获取所述第二图像获取设备拍摄的包含所述目标对象的第四图像，根据所述第四图像的特征确定所述目标对象与所述第二图像获取设备之间的距离。
  21. 根据权利要求20所述的装置，其中，所述第一确定单元，还设置为执行以下操作中的至少之一：
    若所述目标对象与所述第一图像获取设备之间的距离，处于第一距离区间，确定所述第一图像获取设备为活跃图像获取设备，确定所述第二图像获取设备为非活跃图像，其中，所述第一距离区间根据所述第一图像获取设备的对焦位置确定；和，
    若所述目标对象与所述第一图像获取设备之间的距离，处于第二距离区间，确定所述第一图像获取设备为非活跃图像获取设备，确定所述第二图像获取设备为活跃图像获取设备，其中，第二距离区间根据所述第二图像获取设备的对焦位置确定。
  22. 根据权利要求12-21任意一项所述的装置，其中，所述多个图像获取 设备中的任意两个图像获取设备之间的距离小于预设距离阈值；所述多个图像获取设备中至少存在两个对焦位置不同的图像获取设备。
PCT/CN2019/085961 2018-08-16 2019-05-08 一种图像获取设备的控制方法及装置 WO2020034669A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2021507975A JP7305749B2 (ja) 2018-08-16 2019-05-08 画像取得装置の制御方法及び装置
US17/266,636 US11853471B2 (en) 2018-08-16 2019-05-08 Method and apparatus for controlling image acquisition device
EP19850614.9A EP3840360A4 (en) 2018-08-16 2019-05-08 METHOD AND DEVICE FOR IMAGE ACQUISITION CONTROL
AU2019322663A AU2019322663B2 (en) 2018-08-16 2019-05-08 Method and apparatus for controlling image acquisition device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810935421.1A CN109120847B (zh) 2018-08-16 2018-08-16 一种图像获取设备的控制方法及装置
CN201810935421.1 2018-08-16

Publications (1)

Publication Number Publication Date
WO2020034669A1 true WO2020034669A1 (zh) 2020-02-20

Family

ID=64852782

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/085961 WO2020034669A1 (zh) 2018-08-16 2019-05-08 一种图像获取设备的控制方法及装置

Country Status (6)

Country Link
US (1) US11853471B2 (zh)
EP (1) EP3840360A4 (zh)
JP (1) JP7305749B2 (zh)
CN (1) CN109120847B (zh)
AU (1) AU2019322663B2 (zh)
WO (1) WO2020034669A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109120847B (zh) * 2018-08-16 2020-04-21 北京七鑫易维信息技术有限公司 一种图像获取设备的控制方法及装置
CN111831374A (zh) * 2020-06-12 2020-10-27 浪潮(北京)电子信息产业有限公司 一种bmc显示界面的远程显示方法及相关装置
US12022182B2 (en) * 2022-05-26 2024-06-25 Motorola Mobility Llc Visual feature based video effects

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714665B1 (en) * 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
CN101632090A (zh) * 2005-02-08 2010-01-20 国际商业机器公司 用于选择性图像捕获、传输和重构的系统和方法
CN103576857A (zh) * 2012-08-09 2014-02-12 托比技术股份公司 凝视跟踪系统的快速唤醒
CN104869306A (zh) * 2014-02-21 2015-08-26 托比技术股份公司 鲁棒的眼睛/视线追踪装置和方法
CN106851249A (zh) * 2017-03-30 2017-06-13 联想(北京)有限公司 图像处理方法及显示设备
CN107203270A (zh) * 2017-06-06 2017-09-26 歌尔科技有限公司 Vr图像处理方法及装置
CN109120847A (zh) * 2018-08-16 2019-01-01 北京七鑫易维信息技术有限公司 一种图像获取设备的控制方法及装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101572804B (zh) * 2009-03-30 2012-03-21 浙江大学 多摄像机智能控制方法及装置
US20100283857A1 (en) * 2009-05-05 2010-11-11 Honeywell International Inc. Event based dynamic change in video quality parameters of network cameras
US8954853B2 (en) * 2012-09-06 2015-02-10 Robotic Research, Llc Method and system for visualization enhancement for situational awareness
JP5979241B2 (ja) 2012-10-18 2016-08-24 日本電気株式会社 カメラシステム
JP2017536565A (ja) 2014-10-07 2017-12-07 ノキア テクノロジーズ オーユー ステレオ視のための広視野カメラ装置
CN104660998B (zh) * 2015-02-16 2018-08-07 阔地教育科技有限公司 一种接力跟踪方法及系统
KR102360453B1 (ko) * 2015-04-10 2022-02-09 삼성전자 주식회사 카메라 설정 방법 및 장치
CN106303390B (zh) * 2015-06-02 2020-02-21 联想(北京)有限公司 图像采集方法及其装置，图像传输方法及其装置
JP2017010120A (ja) 2015-06-17 2017-01-12 キヤノン株式会社 情報処理装置、映像処理装置、およびそれらの制御方法、ならびに映像処理システム

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714665B1 (en) * 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
CN101632090A (zh) * 2005-02-08 2010-01-20 国际商业机器公司 用于选择性图像捕获、传输和重构的系统和方法
CN103576857A (zh) * 2012-08-09 2014-02-12 托比技术股份公司 凝视跟踪系统的快速唤醒
CN104869306A (zh) * 2014-02-21 2015-08-26 托比技术股份公司 鲁棒的眼睛/视线追踪装置和方法
CN106851249A (zh) * 2017-03-30 2017-06-13 联想(北京)有限公司 图像处理方法及显示设备
CN107203270A (zh) * 2017-06-06 2017-09-26 歌尔科技有限公司 Vr图像处理方法及装置
CN109120847A (zh) * 2018-08-16 2019-01-01 北京七鑫易维信息技术有限公司 一种图像获取设备的控制方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3840360A4 *

Also Published As

Publication number Publication date
CN109120847B (zh) 2020-04-21
EP3840360A4 (en) 2022-01-05
AU2019322663B2 (en) 2022-09-22
US20210357637A1 (en) 2021-11-18
JP2021534679A (ja) 2021-12-09
JP7305749B2 (ja) 2023-07-10
CN109120847A (zh) 2019-01-01
US11853471B2 (en) 2023-12-26
AU2019322663A1 (en) 2021-04-08
EP3840360A1 (en) 2021-06-23

Similar Documents

Publication Publication Date Title
US11800213B2 (en) Advanced video conferencing systems and methods
WO2020034669A1 (zh) 一种图像获取设备的控制方法及装置
US10873666B2 (en) Camera tracking method and director device
US10904446B1 (en) Advanced video conferencing systems and methods
US20140002586A1 (en) Gaze direction adjustment for video calls and meetings
WO2020042581A1 (zh) 一种图像获取设备的对焦方法及装置
US20040008772A1 (en) Camera-integrated video recording and reproducing apparatus, and record control method thereof
US10958844B2 (en) Control apparatus and control method
US10951858B1 (en) Advanced video conferencing systems and methods
US10965908B1 (en) Advanced video conferencing systems and methods
US10447969B2 (en) Image processing device, image processing method, and picture transmission and reception system
WO2016145678A1 (zh) 一种自动曝光的方法及装置
JP2017163301A (ja) 撮像装置
US20230393651A1 (en) Method and Apparatus for Controlling Image Acquisition Device
JP2013031038A (ja) 通信装置、映像取得方法、及び映像取得プログラム
WO2022051920A1 (en) Tracking with multiple cameras
CN101409848B (zh) 视频调节的方法、系统和采集设备控制器
WO2022209478A1 (ja) 情報処理装置、情報処理方法、情報処理プログラム
CN113691720B (zh) 一种激光云台摄像机的聚焦方法、装置、存储介质及设备
KR20230149460A (ko) 감시 장치 및 방법
TW202338567A (zh) 視線追蹤控制影像的裝置及方法
JP6604256B2 (ja) 情報処理端末、情報処理方法、及びプログラム
TWI581193B (zh) Image tracking device and method
KR20150095080A (ko) 영상 데이터 전송 장치 및 방법
TW201601118A (zh) 畫面重心追蹤系統及其方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19850614

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021507975

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019850614

Country of ref document: EP

Effective date: 20210316

ENP Entry into the national phase

Ref document number: 2019322663

Country of ref document: AU

Date of ref document: 20190508

Kind code of ref document: A