WO2022054679A1 - Dispositif d'imagerie et procédé de détection de matière attachée - Google Patents

Dispositif d'imagerie et procédé de détection de matière attachée Download PDF

Info

Publication number
WO2022054679A1
WO2022054679A1 PCT/JP2021/032263 JP2021032263W WO2022054679A1 WO 2022054679 A1 WO2022054679 A1 WO 2022054679A1 JP 2021032263 W JP2021032263 W JP 2021032263W WO 2022054679 A1 WO2022054679 A1 WO 2022054679A1
Authority
WO
WIPO (PCT)
Prior art keywords
image pickup
lens
shooting
deposit
lens surface
Prior art date
Application number
PCT/JP2021/032263
Other languages
English (en)
Japanese (ja)
Inventor
拓洋 澁谷
Original Assignee
株式会社日立国際電気
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立国際電気 filed Critical 株式会社日立国際電気
Priority to JP2022547535A priority Critical patent/JPWO2022054679A1/ja
Publication of WO2022054679A1 publication Critical patent/WO2022054679A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/18—Signals indicating condition of a camera member or suitability of light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present invention relates to an image pickup device arranged so that the shooting direction can be changed.
  • the image pickup device used for a surveillance camera or the like is used in various situations as a surveillance means instead of the human eye. For example, it is mounted on a pan head and used for monitoring indoors and outdoors of buildings and rivers, and it is also mounted on automobiles and railroad vehicles and used for monitoring the inside and outside of vehicles and monitoring of operating conditions.
  • dirt such as dust may adhere to the lens surface of the image pickup apparatus, and the visibility may deteriorate.
  • This problem can be solved by cleaning the lens surface, but since many imaging devices may be used in one system, it leads to an increase in maintenance burden. Therefore, there is a demand for a mechanism for improving the efficiency of cleaning the lens surface.
  • Patent Document 1 discloses a technique for detecting the position of a dust image from a difference between an image data taken in a state of facing the sky and an image data of a fixed pattern.
  • Patent Document 2 discloses a technique of detecting the position of a dust image from the difference between the image data captured while irradiating the white LED and the image data of a fixed pattern.
  • Patent Document 1 has a problem that the weather, time zone, and installation position have a great influence on the detection of deposits because it is necessary to shoot in the sky direction. Further, in the technique of Patent Document 2, since it is necessary to irradiate a white LED, it is necessary to add hardware, and there is a problem that the device cost increases.
  • the present invention has been made in view of the above-mentioned conventional circumstances, and an object of the present invention is to provide a mechanism capable of accurately detecting deposits on the lens surface of an image pickup apparatus at low cost.
  • the image pickup apparatus is configured as follows. That is, in an image pickup device arranged so that the shooting direction can be changed, the lens is stopped down so that the lens surface is included in the depth of field, and the exposure time is lengthened so as to supplement the amount of light for the aperture. Performing a shooting control process that controls shooting while changing the direction, and a deposit detection process that detects deposits on the lens surface based on the edge component contained in the image shot under the control. It is characterized by.
  • the present invention can also be realized as the following deposit detection method. That is, it is a deposit detection method for detecting deposits on the lens surface of an image pickup apparatus arranged so as to be able to change the shooting direction.
  • the shooting control process that controls the image pickup device to shoot while changing the shooting direction while the exposure time is lengthened to compensate for the amount of light, and the edge included in the image taken by the image pickup device under the above control. It is characterized by performing a deposit detection process for detecting deposits on the lens surface based on the components.
  • the shooting control process in the shooting control process, it may be controlled to shoot while changing the shooting direction in a plurality of directions.
  • FIG. 1 shows a configuration example of the image pickup apparatus according to the first embodiment of the present invention.
  • the image pickup device 1 of FIG. 1 includes a lens 11, an image pickup element 12, a video signal processing unit 13, a lens control unit 14, an exposure control unit 15, an edge detection unit 16, a CPU (Central Processing Unit) unit 17, and a shooting control data storage unit. It is equipped with 18 and a pan head 19.
  • a lens 11 an image pickup element 12
  • a video signal processing unit 13 includes a lens 11, an image pickup element 12, a video signal processing unit 13, a lens control unit 14, an exposure control unit 15, an edge detection unit 16, a CPU (Central Processing Unit) unit 17, and a shooting control data storage unit. It is equipped with 18 and a pan head 19.
  • CPU Central Processing Unit
  • the lens 11 forms an image of incident light from the subject on the image pickup surface of the image pickup element 12.
  • the image sensor 12 photoelectrically converts the optical image of the subject imaged on the image pickup surface into an electric signal.
  • the video signal processing unit 13 performs various video signal processing (for example, gamma correction, knee correction, contour correction, color correction, etc.) on the video signal obtained by the image pickup element 12, and HD-SDI (High Definition Serial). Digital Interface HH) Generates a signal and outputs it to the outside.
  • the video signal output from the video signal processing unit 13 is not limited to HD-SDI, and any compression or encryption method may be used.
  • the lens control unit 14 controls the aperture, zoom, focus, etc. of the lens 11.
  • the exposure control unit 15 controls the exposure time of the image pickup device 12.
  • the edge detection unit 16 detects an edge component from the video signal before or after the processing by the video signal processing unit 13.
  • the pan head 19 controls the pan / tilt operation of the image pickup apparatus 1 in order to adjust the shooting direction.
  • the pan head 19 of this example can rotate the image pickup device 1 in the horizontal direction by 360 degrees, and further can rotate the image pickup device 1 in the vertical direction to an elevation angle of about 180 degrees.
  • the CPU 17 controls the operation of each part of the image pickup apparatus 1.
  • the imaging control data storage unit 18 stores imaging control data used for imaging control when detecting deposits.
  • the shooting control data is data in which the lens aperture, exposure time, and pan / tilt operation are set, and is preset.
  • the CPU unit 17 reads out the photographing control data from the photographing control data storage unit 18, and instructs the lens control unit 14, the exposure control unit 15, and the pan head 19 to control according to the set value. This makes it possible to automatically control the lens aperture, exposure time, and pan / tilt operation.
  • the lens surface in the present specification refers to the outer surface of the lens where there is a concern about adhesion of deposits, and when the lens is covered with protective glass or the like, the outer surface of such a cover.
  • Shall include.
  • the image pickup apparatus 1 starts the shooting control process and the deposit detection process under the control of the CPU unit 17 at a preset timing or a timing when the user performs a predetermined operation.
  • This timing is preferably a timing that does not interfere with the operation of the image pickup apparatus 1.
  • the lens control unit 14 narrows the aperture of the lens 11 to the limit (just before the wings close) according to the shooting control data (step S11).
  • the state becomes like a pinhole camera, and the depth of field becomes very deep, so that the deposits on the lens surface that are out of focus can be clearly seen without blurring.
  • the exposure control unit 15 makes the exposure time of the image pickup element 12 extremely longer than usual according to the shooting control data (step S12). Specifically, the exposure time is set to about several seconds to ten and several seconds. This has the effect of compensating for the amount of light reduced by the amount of the aperture of the lens 11 being stopped down and generating an afterimage when detecting deposits.
  • the pan head 19 moves the pan / tilt so that the angle of view (shooting direction) taken by the image pickup apparatus 1 changes greatly according to the shooting control data (step S13).
  • the pan / tilt is moved so that the part having a high brightness level of the subject is evenly scanned over the entire screen so that the deposits blocking the subject are clearly reflected. Is desirable. If the image pickup device is installed outdoors, it is easiest to take a picture of the daytime sky.
  • the image pickup apparatus 1 performs the deposit detection process while performing such a shooting control process.
  • the edge detection unit 16 detects the edge component in the video signal and determines whether or not the edge component is equal to or greater than the threshold value (step S14). As a result, when the edge component is equal to or higher than the threshold value, it is determined that there is an deposit on the lens surface, an alert is issued to notify the user, and then the lens aperture, exposure time, and pan / tilt position are determined. Undo (steps S15, S16). On the other hand, when the edge component is less than the threshold value, the lens aperture, the exposure time, and the pan / tilt position are restored without issuing an alert (step S16).
  • the aperture of the lens 11 is stopped down to the limit by the lens control unit 14, and the exposure time of the image pickup element 12 is extremely long by the exposure control unit 15.
  • 19 is configured to perform a shooting control process that controls shooting while changing the shooting direction, and a deposit detection process that detects deposits on the lens surface based on the edge component contained in the shot image. Has been done.
  • the shooting may be controlled so as to change the shooting direction in a plurality of directions so that the edge of the deposit can be detected more appropriately.
  • directional control for example, directional control such as drawing a circular orbit
  • the lens aperture is stopped down to the utmost limit, but the lens surface may be stopped down to the extent that it is included in the depth of field.
  • the exposure time of the image sensor is set to be extremely long (for example, from several seconds to about ten and several seconds), but the exposure time may be sufficient to supplement the amount of light corresponding to the aperture of the lens diaphragm.
  • the presence or absence of the deposit is only determined by comparing the edge component detected from the captured image with the threshold value, but even if further information such as the position and range of the deposit is obtained. good.
  • the size of the lump of edges may be calculated, and if the size is less than a predetermined value, it may be determined that it is not a deposit.
  • an alert is issued to notify the user, but the image taken after the deposit is detected is corrected for the range of the deposit. You may.
  • FIG. 4 shows an outline of the deposit detection system according to the second embodiment of the present invention.
  • the deposit detection system of this example includes a plurality of N image pickup devices 1-1 to 1-N and a deposit detection device 2.
  • the image pickup devices 1-1 to 1-N and the deposit detection device 2 are communicably connected to each other through a network line.
  • the description will be focused on the portion peculiar to the second embodiment, and the description of the same portion as that of the first embodiment will be omitted.
  • the deposit detection device 2 communicates with the nth image pickup device 1-n, which is the target of the deposit detection, to detect the deposit on the lens surface. That is, the deposit detection device 2 changes the shooting direction by the cloud stand in a state where the lens is stopped down so that the lens surface is included in the depth of field and the exposure time is lengthened so as to supplement the amount of light for the aperture. Detects deposits on the lens surface based on the shooting control process that controls the image pickup device 1-n so that the image pickup is performed while the image pickup is performed, and the edge component contained in the image captured by the image pickup device 1-n under the above control. It is configured to perform the deposit detection process.
  • the deposit detection device 2 transmits a shooting instruction signal instructing shooting under the control as described above to the image pickup device 1-n, and accordingly, the image pickup device 1-n.
  • the deposits on the lens surface of the image pickup apparatus 1-n are detected based on the edge component contained in the image transmitted from the image pickup apparatus 1-n.
  • the imaging control data used for the control may be transmitted by the deposit detection device 2 together with the imaging instruction signal, or may be stored in advance in each imaging device 1.
  • the present invention has been described above based on some embodiments, it is needless to say that the present invention is not limited to the configurations described here and can be widely applied to devices and systems having other configurations. stomach.
  • an image pickup device fixedly mounted on a moving body may be used to change the shooting direction by moving the moving body.
  • the present invention also provides, for example, a method including a technical procedure relating to the above processing, a program for executing the above processing by a processor, a storage medium for storing such a program in a computer-readable manner, and the like. Is also possible.
  • the present invention can be used for an image pickup device provided with a pan head for adjusting the shooting direction.
  • Image pickup device 2: Adhesion detection device, 11: Lens, 12: Image sensor, 13: Video signal processing unit, 14: Lens control unit, 15: Exposure control unit, 16: Edge detection unit, 17: CPU part, 18: shooting control data, 19: pan head

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention fournit de manière peu coûteuse un mécanisme apte à détecter, avec une excellente précision, toute matière attachée à une surface de lentille d'un dispositif d'imagerie. Ce dispositif d'imagerie (1) réalise : un processus de commande de photographie pour réduire l'ouverture d'une lentille (11) jusqu'à la limite maximale par une unité de commande de lentille (14) et en exerçant une commande, tandis que le temps d'exposition d'un élément d'imagerie (12) est étendu à l'extrême par une unité de commande d'exposition (15), de telle sorte que la photographie est effectuée tout en changeant la direction de photographie par une plateforme d'appareil de prise de vues (19) ; et un processus de détection de matière attachée pour détecter toute matière attachée à la surface de lentille sur la base de composantes de bord comprises dans une image photographiée.
PCT/JP2021/032263 2020-09-11 2021-09-02 Dispositif d'imagerie et procédé de détection de matière attachée WO2022054679A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022547535A JPWO2022054679A1 (fr) 2020-09-11 2021-09-02

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020152658 2020-09-11
JP2020-152658 2020-09-11

Publications (1)

Publication Number Publication Date
WO2022054679A1 true WO2022054679A1 (fr) 2022-03-17

Family

ID=80632296

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/032263 WO2022054679A1 (fr) 2020-09-11 2021-09-02 Dispositif d'imagerie et procédé de détection de matière attachée

Country Status (2)

Country Link
JP (1) JPWO2022054679A1 (fr)
WO (1) WO2022054679A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002209147A (ja) * 2001-01-12 2002-07-26 Fuji Photo Film Co Ltd ディジタル・カメラおよびその動作制御方法
JP2007159021A (ja) * 2005-12-08 2007-06-21 Matsushita Electric Ind Co Ltd カメラ装置及びワイパ制御方法
JP2011124830A (ja) * 2009-12-11 2011-06-23 Sanyo Electric Co Ltd 撮像装置および異物検出方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002209147A (ja) * 2001-01-12 2002-07-26 Fuji Photo Film Co Ltd ディジタル・カメラおよびその動作制御方法
JP2007159021A (ja) * 2005-12-08 2007-06-21 Matsushita Electric Ind Co Ltd カメラ装置及びワイパ制御方法
JP2011124830A (ja) * 2009-12-11 2011-06-23 Sanyo Electric Co Ltd 撮像装置および異物検出方法

Also Published As

Publication number Publication date
JPWO2022054679A1 (fr) 2022-03-17

Similar Documents

Publication Publication Date Title
US7639932B2 (en) Imaging apparatus
US9531938B2 (en) Image-capturing apparatus
US8264592B2 (en) Image pickup apparatus having improved contrast autofocus accuracy
JP4272863B2 (ja) カメラおよびカメラシステム
KR102130756B1 (ko) 자동 초점 조절 방법 및 자동 초점 조절 장치
US8289399B2 (en) System and method for image capture device
US8873881B2 (en) Dust detection system and digital camera
JP2007166443A (ja) 撮像装置
US20100007748A1 (en) Imaging apparatus and imaging method
JP2007288726A (ja) 撮像装置
US20070223905A1 (en) Auto-focus performance
JP6128109B2 (ja) 撮影装置、撮影方向の制御方法及びプログラム
JP2018146663A5 (fr)
US20150138430A1 (en) Image-capturing apparatus
JPH05344403A (ja) 撮像装置
JP4310309B2 (ja) 光学装置および光学装置の制御方法
KR20220023237A (ko) 이동 물체를 고속으로 추적하고 예측하여 고품질의 영상을 지속적으로 제공하는 카메라의 고속 줌과 포커싱을 위한 장치 및 이를 이용한 카메라의 고속 줌과 포커싱 방법
JP2941815B2 (ja) 撮像装置及びぶれ補正装置
JP2009188463A5 (fr)
JP2010250156A (ja) 電子カメラ
US9420161B2 (en) Image-capturing apparatus
JP6250446B2 (ja) 画像処理システム、画像処理装置、画像処理方法及びプログラム
WO2022054679A1 (fr) Dispositif d'imagerie et procédé de détection de matière attachée
JP2002365524A (ja) オートフォーカス装置及びそれを用いた撮像装置
WO2023103207A1 (fr) Système de mise au point d'imagerie pour zone de surveillance spécifiée

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21866638

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022547535

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21866638

Country of ref document: EP

Kind code of ref document: A1