US20020067422A1 - Image monitor apparatus controlling camera and illumination in order to optimize luminance of picked-up image - Google Patents

Image monitor apparatus controlling camera and illumination in order to optimize luminance of picked-up image Download PDF

Info

Publication number
US20020067422A1
US20020067422A1 US09/821,439 US82143901A US2002067422A1 US 20020067422 A1 US20020067422 A1 US 20020067422A1 US 82143901 A US82143901 A US 82143901A US 2002067422 A1 US2002067422 A1 US 2002067422A1
Authority
US
United States
Prior art keywords
image
camera
luminance
unit
illumination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/821,439
Other versions
US7202902B2 (en
Inventor
Tsuyoshi Miura
Ichiro Kagami
Noriyuki Ihara
Hiroshi Watanabe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Assigned to FUJITSU LIMITED reassignment FUJITSU LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IHARA, NORIYUKI, KAGAMI, ICHIRO, MIURA, TSUYOSHI, WATANABE, HIROSHI
Publication of US20020067422A1 publication Critical patent/US20020067422A1/en
Application granted granted Critical
Publication of US7202902B2 publication Critical patent/US7202902B2/en
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Definitions

  • the present invention relates to an image monitor apparatus which controls a camera and a lighting system.
  • the high-sensitivity camera is more susceptible to a disturbance caused in an image picked up by the high-sensitivity camera, than the cameras having normal sensitivity, where the disturbance is caused by, for example, light incident on the camera. Therefore, in order to obtain a stable image for monitoring, the disturbance must be appropriately controlled.
  • An object of the present invention is to provide an image monitor apparatus which can suppress disturbances in picked-up images, and enables high-quality image monitoring.
  • an image monitor apparatus for monitoring an image.
  • the image monitor apparatus comprises a camera, an illumination unit, and a processing unit.
  • the camera picks up an image.
  • the illumination unit includes a light emission unit and an emission control unit.
  • the light emission unit includes at least one light emitting element, and the emission control unit controls the at least one light emitting element.
  • the processing unit includes an image signal acquiring unit, a luminance examining unit, and a luminance control unit.
  • the image signal acquiring unit performs analog-to-digital conversion of the image picked up by the camera so as to generate a digitized image signal, and stores the digitized image signal.
  • the luminance examining unit examines luminance of the image represented by the digitized image signal, and determines whether or not the amount of light detected by the camera and stored in an image-pickup plane of the camera is appropriate for suppressing disturbances in the image.
  • the luminance control unit controls at least one of the camera and the illumination unit so that the amount of light becomes appropriate for suppressing disturbances in the image, when the luminance examining unit determines that the current amount of light detected by the camera and stored in the image-pickup plane is not appropriate for suppressing disturbances in the image.
  • the image monitor apparatus according to the present invention may also have one or any possible combination of the following additional features (i) to (iv).
  • the luminance control unit may make feedback control of the camera so that a shutter speed of the camera is increased within such a range that a duration in which a shutter of the camera is open is not shorter than a duration of illumination by the illumination unit, and an iris opening of the camera is maximized.
  • the luminance control unit may increase the amount of light emitted by the illumination unit, and reduce the size of the iris opening.
  • the luminance control unit may control the illumination unit so that the at least one light emitting element emits only when an image of a frame which is necessary for image processing is picked up by the camera.
  • the luminance control unit may automatically detect blooming or smearing in the image based on the luminance of the image.
  • FIG. 1 is a diagram illustrating a basic construction of an image monitor apparatus according to the present invention
  • FIG. 2 is a diagram illustrating a portion of an example of the light emission unit
  • FIG. 3 is a flow diagram illustrating an overall operation performed in an image monitor apparatus as a first embodiment of the present invention
  • FIG. 4 is a timing diagram illustrating examples of operations performed in the first embodiment of the present invention.
  • FIG. 5 is a timing diagram illustrating examples of operations performed in a second embodiment of the present invention.
  • FIG. 6 is a timing diagram illustrating examples of operations performed in a third embodiment of the present invention.
  • FIG. 7 is a flow diagram illustrating a sequence of operations for detecting blooming.
  • FIG. 8 is a diagram illustrating an example of a portion of an image which includes blooming.
  • FIG. 1 is a diagram illustrating a basic construction of an image monitor apparatus according to the present invention.
  • the image monitor apparatus 1 according to the present invention comprises a (high-sensitivity) camera 10 , an illumination unit 20 , and a processing unit 30 .
  • the camera 10 picks up an image of an object, and generates an (analog) image signal representing the image.
  • the image signal is in accordance with the NTSC or PAL standard.
  • the image signal can be in accordance with any other standard.
  • the illumination unit 20 illuminates the object, for example, in the nighttime, and comprises a light emission unit 21 and an emission control unit 22 .
  • the light emission unit 21 comprises at least one light emitting element which emits light for illumination of the object.
  • the emission control unit 22 controls the light emission by the light emission unit 21 , for example, as explained later with reference to FIG. 2.
  • the processing unit 30 controls the camera 10 and the illumination unit 20 , and processes the image signal generated by the camera 10 .
  • the processing unit 30 comprises an image signal acquiring unit 31 , a luminance examining unit 32 , a luminance control unit 33 , and an image processing unit 34 .
  • the image signal acquiring unit 31 comprises an A/D conversion unit 31 a and an image memory 31 b .
  • the A/D conversion unit 31 a receives the analog image signal from the camera 10 , and converts the analog image signal into a digitized image signal by performing A/D conversion for each field corresponding to 1/60 seconds.
  • the image memory 31 b stores the digitized image signal.
  • the image processing unit 34 reads out the image signal from the image memory 31 b , and processes the image signal. For example, the image processing unit 34 performs processing for person recognition. In this case, the image processing unit 34 sends information on the recognized person to a monitoring center, as well as the image signal.
  • the luminance examining unit 32 reads out the image signal stored in the image memory 31 b , and determines whether or not the luminance of the image represented by the image signal is appropriate for suppressing disturbances in the image picked up by the camera 10 , or preferably whether or not the luminance of the image represented by the image signal is optimum for suppressing disturbances in the image picked up by the camera 10 .
  • the luminance examining unit 32 can determine whether or not the amount of light detected by the camera 10 and stored in the image-pickup plane of the camera 10 is appropriate (or optimum).
  • the luminance control unit 33 controls at least one of the camera 10 and the illumination unit 20 so that the above amount of light becomes appropriate (or optimum) for suppressing disturbances in the image picked up by the camera 10 . Details of the operations of the luminance control unit 33 are explained later with reference to FIG. 3.
  • FIG. 2 is a diagram illustrating a portion of an example of the light emission unit 21 .
  • the light emission unit 21 illustrated in FIG. 2 comprises a plurality of light emitting elements, which are arranged in a plurality of rows. In FIG. 2, the odd-numbered rows are denoted by “A”, and the even-numbered rows are denoted by “B”.
  • the emission control unit 22 controls the light emission of the plurality of light emitting elements in the light emission unit 21 . For example, light emitting elements in the row “A” and the light emitting elements in the row “B” are alternately activated under the control of the emission control unit 22 . Alternatively, all of the light emitting elements in the light emission unit 21 may be activated concurrently.
  • the emission control unit 22 controls the light emission unit 21 so that the timing of the activation (i.e., emission) of the light emitting elements in the light emission unit 21 is synchronized with the image acquisition timing of the camera 10 .
  • FIG. 3 is a flow diagram illustrating an overall operation performed in the image monitor apparatus as the first embodiment of the present invention.
  • step S 1 the luminance control unit 33 makes an initial setting of the high-sensitivity camera 10 .
  • the shutter speed of the high-sensitivity camera 10 is set to the slowest (longest) possible value in order to efficiently utilize external illumination (such as ambient light and moonlight) when the illumination unit 20 does not emit light.
  • the iris of the high-sensitivity camera 10 is set to an auto iris setting so that the high-sensitivity camera 10 automatically picks up an optimum image under available illumination.
  • step S 2 the luminance control unit 33 makes an initial setting of the illumination unit 20 .
  • the duration of illumination (or flash duration) is set to the shortest time which can provide a sufficient amount of light for image processing, in order to lengthen the life of each light emitting element.
  • step S 3 after the above initial setting, the high-sensitivity camera 10 picks up an image.
  • the image signal acquiring unit 31 makes the A/D conversion of the picked-up image, and stores the digitized image signal in the image memory 31 b.
  • step S 4 the luminance examining unit 32 determines whether or not the luminance of the image represented by the digitized image signal stored in the image memory 31 b is appropriate for suppressing disturbances in the image. For example, as mentioned before, when a flashlight or car lighting is directed to the high-sensitivity camera 10 , an excessive amount of light is stored in the image-pickup plane of the high-sensitivity camera 10 due to the strong light, and the entire screen may be whited out, or blooming or smearing may occur.
  • the luminance examining unit 32 determines that the influence of external lighting is great, and the operation goes to step S 5 .
  • the luminance examining unit 32 determines that the luminance of the image is appropriate for the image processing, and the operation goes to step S 6 .
  • step S 5 the luminance control unit 33 resets the high-sensitivity camera 10 based on the determination made by the luminance examining unit 32 .
  • the size of the iris opening is maximized so that the illumination by the illumination unit 20 can be most efficiently utilized.
  • the shutter speed is increased, i.e., the duration in which the high-sensitivity camera 10 detects light and stores the amount of detected light for each pixel in each field is shortened.
  • step S 4 the luminance examining unit 32 determines again whether or not the luminance of the next image is appropriate for image processing.
  • the luminance control unit 33 further increases the shutter speed while maintaining the maximized iris opening. However, if the shutter speed falls below the duration of the illumination by the illumination unit 20 , the illumination by the illumination unit 20 is not effectively utilized, and the image may become dark except that an image portion produced by picking up the external lighting is bright.
  • step S 6 the image processing unit 34 performs image processing of the image signal of which the luminance is determined to be appropriate. Since the setting of the high-sensitivity camera 10 is optimized in the above feedback control as preprocessing, it is possible to obtain an appropriate image signal, and perform appropriate image processing.
  • step S 7 the luminance control unit 33 determines whether or not a predetermined time has elapsed since the time of the resetting of the high-sensitivity camera 10 .
  • the operation goes back to step S 3 .
  • the luminance control unit 33 determines that the predetermined time has elapsed, it is assumed that the disturbance (such as the car lighting directed to the high-sensitivity camera 10 ) is eliminated. Therefore, the operation goes back to step S 1 , and the initial setting of the high-sensitivity camera 10 is made again.
  • FIG. 4 is a timing diagram illustrating examples of operations performed in the first embodiment of the present invention.
  • an image pickup period is set to 1/60 seconds
  • the duration of illumination is set to 1/480 seconds
  • the intensity of the illumination is set to a value which is realized by alternately activating the light emitting elements in the rows A and B (illustrated in FIG. 2)
  • the shutter speed is 1/60 seconds
  • the iris is set to the auto iris setting.
  • the size of the iris opening is reset to FMIN, which indicates that the size of the iris opening is maximized, and the shutter speed is increased (shortened) to 1/120 seconds.
  • the other settings are the same as the initial settings.
  • the determination whether or not the influence of the external lighting is great, and the increase (shortening) of the shutter speed are repeated until the shutter speed reaches the duration of the illumination, 1/480 seconds.
  • the shutter speed is doubled, i.e., the duration in which the shutter is open is reduced by half.
  • the illumination by the illumination unit 20 is not effectively utilized, and the image may become dark except that an image portion produced by picking up the external lighting is bright. Therefore, when the shutter speed reaches the duration of the illumination, 1/480 seconds, the above feedback operations are completed, and an image picked up by the high-sensitivity camera 10 with the shutter speed of 1/480 seconds is used in the image processing.
  • the image monitor apparatus when the luminance examining unit 32 determines that the influence of the external lighting is still great even after the shutter speed is increased (shortened) to the duration of the illumination by the illumination unit 20 by the feedback control made in the first embodiment, the image monitor apparatus further makes feedback control of the intensity of the illumination by the illumination unit 20 and the size of the iris opening. That is, when the luminance examining unit 32 determines that the influence of the external lighting is great, the intensity of the illumination by the illumination unit 20 is increased, and the size of the iris opening is adjusted corresponding to the increase in the intensity of the illumination.
  • the luminance control unit 33 sends to the emission control unit 22 an instruction to increase the number of light emitting elements which are concurrently activated.
  • the emission control unit 22 controls the light emission unit 21 so as to increase the number of light emitting elements.
  • the luminance control unit 33 sends to the high-sensitivity camera 10 an instruction to reduce the size of the iris opening corresponding to the increase in the intensity of the illumination, so that contribution of the illumination by the illumination unit 20 to the light level at the high-sensitivity camera 10 is maintained equivalent to that in the first embodiment.
  • the high-sensitivity camera 10 reduces the size of the iris opening.
  • the above feedback control of the intensity of the illumination by the illumination unit 20 and the size of the iris opening is repeated until the luminance examining unit 32 determines that the influence of the external lighting is not great.
  • the image monitoring is performed. Thereafter, when a predetermined time elapses since the above feedback control is completed, it is assumed that the disturbance such as the influence of the external lighting is eliminated, and the initial setting of the high-sensitivity camera 10 and the illumination unit 20 is made again.
  • FIG. 5 is a timing diagram illustrating examples of operations performed in the second embodiment of the present invention.
  • the luminance control unit 33 controls the illumination unit 20 so as to concurrently activate the light emitting elements in both of the rows A and B, and resets the high-sensitivity camera 10 so as to reduce the size of the iris opening by half to F MIN /2.
  • the shutter speed is set to 1/480 seconds as a result of the feedback control in the first embodiment.
  • the intensity of the illumination by the illumination unit 20 and the iris opening in the high-sensitivity camera 10 are controlled, after the control of the shutter speed in the first embodiment, so as to suppress the disturbance in the image picked up by the high-sensitivity camera 10 .
  • the illumination unit 20 is controlled so as to activate the light emitting elements only when an image of a frame which is necessary for image processing is picked up.
  • FIG. 6 is a timing diagram illustrating examples of operations performed in the third embodiment of the present invention.
  • the image pickup period is 1/30 seconds
  • the illumination timing is set so that the illumination by the illumination unit 20 synchronizes with the image pickup timing.
  • the size of the iris opening is reduced by half to F MIN /2, and the light emitting elements in both of the rows A and B are concurrently activated.
  • the blooming is halation or defocus which occurs around bright areas produced in an image by picking up a very bright object such as external lighting.
  • the luminance examining unit 32 can automatically detect the blooming, and the luminance control unit 33 makes feedback control until the blooming disappears.
  • the characteristic of the blooming is that white (bright) pixels are distributed around a point corresponding to a light source, and form a bright round area, and the brightness of the pixels around the bright round area gradually decreases so that the area around the bright round area is blurred. Therefore, in order to detect the blooming, the bright area is first extracted, and it is then determined whether or not an area around the bright area is blurred. However, in the above operation of extracting the bright area, small bright areas which are considered not to affect the image processing are ignored. In addition, bright areas which are not surrounded by blurred areas are each recognized to be a bright object instead of blooming.
  • FIG. 7 is a flow diagram illustrating a sequence of operations for detecting blooming.
  • a threshold value C used for determining the above bright area and another threshold value D used for determining the above blurred area are set in advance in the image monitor apparatus 1 .
  • step S 10 the luminance examining unit 32 performs processing for binalizing all pixels of an image picked up by the high-sensitivity camera 10 by using the threshold value C. That is, pixel values equal to or greater than the threshold value C are converted to one, and pixel values smaller than the threshold value C are converted to zero.
  • step S 11 the luminance examining unit 32 performs processing for labelling the binalized image, and extracts as at least one object at least one aggregation of pixels having the value “one”, where the labelling is an operation of assigning a label (number) to each pixel of a binalized image in order to extract at least one object included in the image.
  • step S 12 the luminance examining unit 32 discards at least one object which has an area smaller than a predetermined value S, from among the at least one object extracted in step S 11 .
  • step S 13 the luminance examining unit 32 determines whether or not at least one extracted object exists after the discard in step S 12 . When yes is determined, the operation goes to step S 14 . When no is determined, the operation goes to step S 17 .
  • step S 14 the luminance examining unit 32 counts the number of pixels having a value equal to or greater than the threshold value D and smaller than the threshold value C in an area surrounding each of the at least one extracted object, where the surrounding area has a loop shape having a width of N pixels in each of the vertical and horizontal directions. Then, the luminance examining unit 32 calculates the ratio between the counted number and the total number of pixels in the surrounding area.
  • step S 15 the luminance examining unit 32 compares the ratio calculated in step S 14 with a predetermined value P(%). When the ratio calculated in step S 14 is equal to or greater than the predetermined value P, the operation goes to step S 16 . When the ratio calculated in step S 14 is smaller than the predetermined value P, the operation goes back to step S 13 .
  • step S 16 the luminance examining unit 32 recognizes the extracted object as blooming.
  • step S 17 the luminance examining unit 32 recognizes that no blooming exists in the image.
  • FIG. 8 is a diagram illustrating an example of a portion of an image which includes blooming.
  • high-luminance pixels i.e., pixels having a value equal to or greater than the threshold value C
  • middle-luminance pixels i.e., pixels having a value equal to or greater than the threshold value D and smaller than the threshold value C
  • grey circles i.e., pixels having a value equal to or greater than the threshold value D and smaller than the threshold value C
  • the other pixels including low-luminance pixels i.e., pixels having a value smaller than the threshold value D are indicated with black circles.
  • each aggregation of high-luminance pixels which are encircled by solid lines in FIG. 8, is examined.
  • the aggregation R 1 which is indicated in the upper right portion of FIG. 8, is regarded as noise, and discarded.
  • the number of the pixels in the surrounding area is twenty-eight, and twenty-five pixels among the twenty-eight pixels are middle-luminance pixels.
  • external lighting also causes a smear in an image picked up by the high-sensitivity camera 10 .
  • the smear is a vertical streak which appears above and below bright areas produced in an image by picking up a very bright object such as the external lighting.
  • the luminance examining unit 32 can automatically detect the smear, and the luminance control unit 33 makes feedback control until the smear disappears.
  • the characteristic of the smear is that white (bright) pixels are distributed above and below a point corresponding to a light source, and form a bright vertical streak. Therefore, in order to detect a smear, the sum total of luminance values of pixels on each vertical line is calculated, and it is determined whether or not a smear exists on the line, based on the sum total of the luminance values.
  • the sum total Y′ of luminance values on each vertical line is greater than a predetermined threshold value A, it is considered that a bright line exists on the vertical line, i.e., it is determined that a smear exists on the vertical line.
  • the sum total Y′ is not greater than the predetermined threshold value A, it is determined that a smear does not exist on the vertical line.
  • the above determination is made on all of the vertical lines in an image. In the case of the NTSC signals, the number of the vertical lines is 640. When all of the vertical lines in the image are determined not to include a smear, it is determined that no smear exists in the image.
  • the image monitor apparatus 1 determines whether or not the amount of light detected by the high-sensitivity camera 10 and stored in the image-pickup plane of the high-sensitivity camera 10 is appropriate (or optimum) for suppressing disturbances in the image, based on the luminance values of the image signal.
  • the amount of light is not appropriate, feedback control of at least one of the high-sensitivity camera 10 and the illumination unit 20 is made. Therefore, it is possible to suppress the influence of light from the external light source in the high-sensitivity camera 10 , and obtain a stable image by using the high-sensitivity camera 10 .
  • the duration and the intensity of illumination by the illumination unit 20 are controlled so that the light emitting elements are efficiently used, it is possible to lengthen the life of each light emitting element in the illumination unit 20 , and perform efficient image monitoring.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Exposure Control For Cameras (AREA)
  • Stroboscope Apparatuses (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

In an image monitor apparatus for monitoring an image: a camera picks up an image; an emission control unit controls at least one light emitting element; an image signal acquiring unit performs analog-to-digital conversion of the image picked up by the camera so as to generate a digitized image signal, and stores the digitized image signal; a luminance examining unit examines luminance of the image represented by the digitized image signal, and determines whether or not the amount of light detected and stored in an image-pickup plane of the camera is appropriate; and a luminance control unit controls at least one of the camera and the luminance control unit so that the amount of light stored in an image-pickup plane becomes appropriate.

Description

    BACKGROUND OF THE INVENTION
  • 1) Field of the Invention [0001]
  • The present invention relates to an image monitor apparatus which controls a camera and a lighting system. [0002]
  • 2) Description of the Related Art [0003]
  • Recently, in many image monitoring systems, a plurality of images picked up by a plurality of cameras in a plurality of locations are monitored in a monitoring center in a centralized manner. In addition, needs for monitoring or surveillance of a wide area, for example, an area including roads and railroads, are growing. Further, when the monitoring is performed in the nighttime, a high-sensitivity camera and a lighting system are required in order to monitor a dark area. [0004]
  • In the conventional image monitoring system using a high-sensitivity camera and a lighting system, when a flashlight or car lighting is directed to the high-sensitivity camera, the entire screen may be whited out (i.e., the so-called screen white-out occurs), or blooming or smearing may occur. However, if the iris opening is narrowed, the effect of the illumination by the lighting system decreases, and the image picked up by the camera becomes dark except that an image portion produced by picking up the above external lighting is bright. [0005]
  • As described above, the high-sensitivity camera is more susceptible to a disturbance caused in an image picked up by the high-sensitivity camera, than the cameras having normal sensitivity, where the disturbance is caused by, for example, light incident on the camera. Therefore, in order to obtain a stable image for monitoring, the disturbance must be appropriately controlled. [0006]
  • SUMMARY OF THE INVENTION
  • An object of the present invention is to provide an image monitor apparatus which can suppress disturbances in picked-up images, and enables high-quality image monitoring. [0007]
  • According to the present invention, there is provided an image monitor apparatus for monitoring an image. The image monitor apparatus comprises a camera, an illumination unit, and a processing unit. The camera picks up an image. The illumination unit includes a light emission unit and an emission control unit. The light emission unit includes at least one light emitting element, and the emission control unit controls the at least one light emitting element. The processing unit includes an image signal acquiring unit, a luminance examining unit, and a luminance control unit. The image signal acquiring unit performs analog-to-digital conversion of the image picked up by the camera so as to generate a digitized image signal, and stores the digitized image signal. The luminance examining unit examines luminance of the image represented by the digitized image signal, and determines whether or not the amount of light detected by the camera and stored in an image-pickup plane of the camera is appropriate for suppressing disturbances in the image. The luminance control unit controls at least one of the camera and the illumination unit so that the amount of light becomes appropriate for suppressing disturbances in the image, when the luminance examining unit determines that the current amount of light detected by the camera and stored in the image-pickup plane is not appropriate for suppressing disturbances in the image. [0008]
  • The image monitor apparatus according to the present invention may also have one or any possible combination of the following additional features (i) to (iv). [0009]
  • (i) The luminance control unit may make feedback control of the camera so that a shutter speed of the camera is increased within such a range that a duration in which a shutter of the camera is open is not shorter than a duration of illumination by the illumination unit, and an iris opening of the camera is maximized. [0010]
  • (ii) In the image monitor apparatus having the feature (i), when the amount of light cannot become appropriate for suppressing disturbances in the image even when the shutter speed of the camera is increased by the feedback control to the duration of illumination by the illumination unit, the luminance control unit may increase the amount of light emitted by the illumination unit, and reduce the size of the iris opening. [0011]
  • (iii) The luminance control unit may control the illumination unit so that the at least one light emitting element emits only when an image of a frame which is necessary for image processing is picked up by the camera. [0012]
  • (iv) The luminance control unit may automatically detect blooming or smearing in the image based on the luminance of the image. [0013]
  • According to the present invention, a stable image in which disturbance is suppressed can be obtained for monitoring. Therefore, it is possible to perform reliable, high-quality image monitoring. [0014]
  • The above and other objects, features and advantages of the present invention will become apparent from the following description when taken in conjunction with the accompanying drawings which illustrate preferred embodiment of the present invention by way of example.[0015]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In the drawings: [0016]
  • FIG. 1 is a diagram illustrating a basic construction of an image monitor apparatus according to the present invention; [0017]
  • FIG. 2 is a diagram illustrating a portion of an example of the light emission unit; [0018]
  • FIG. 3 is a flow diagram illustrating an overall operation performed in an image monitor apparatus as a first embodiment of the present invention; [0019]
  • FIG. 4 is a timing diagram illustrating examples of operations performed in the first embodiment of the present invention; [0020]
  • FIG. 5 is a timing diagram illustrating examples of operations performed in a second embodiment of the present invention; [0021]
  • FIG. 6 is a timing diagram illustrating examples of operations performed in a third embodiment of the present invention; [0022]
  • FIG. 7 is a flow diagram illustrating a sequence of operations for detecting blooming; and [0023]
  • FIG. 8 is a diagram illustrating an example of a portion of an image which includes blooming.[0024]
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Embodiments of the present invention are explained below with reference to drawings. [0025]
  • (1) Construction of Image Monitor Apparatus [0026]
  • FIG. 1 is a diagram illustrating a basic construction of an image monitor apparatus according to the present invention. As illustrated in FIG. 1, the [0027] image monitor apparatus 1 according to the present invention comprises a (high-sensitivity) camera 10, an illumination unit 20, and a processing unit 30. The camera 10 picks up an image of an object, and generates an (analog) image signal representing the image. For example, the image signal is in accordance with the NTSC or PAL standard. Alternatively, the image signal can be in accordance with any other standard. The illumination unit 20 illuminates the object, for example, in the nighttime, and comprises a light emission unit 21 and an emission control unit 22. The light emission unit 21 comprises at least one light emitting element which emits light for illumination of the object. The emission control unit 22 controls the light emission by the light emission unit 21, for example, as explained later with reference to FIG. 2.
  • The [0028] processing unit 30 controls the camera 10 and the illumination unit 20, and processes the image signal generated by the camera 10. The processing unit 30 comprises an image signal acquiring unit 31, a luminance examining unit 32, a luminance control unit 33, and an image processing unit 34. The image signal acquiring unit 31 comprises an A/D conversion unit 31 a and an image memory 31 b. The A/D conversion unit 31 a receives the analog image signal from the camera 10, and converts the analog image signal into a digitized image signal by performing A/D conversion for each field corresponding to 1/60 seconds. The image memory 31 b stores the digitized image signal. The image processing unit 34 reads out the image signal from the image memory 31 b, and processes the image signal. For example, the image processing unit 34 performs processing for person recognition. In this case, the image processing unit 34 sends information on the recognized person to a monitoring center, as well as the image signal.
  • The [0029] luminance examining unit 32 reads out the image signal stored in the image memory 31 b, and determines whether or not the luminance of the image represented by the image signal is appropriate for suppressing disturbances in the image picked up by the camera 10, or preferably whether or not the luminance of the image represented by the image signal is optimum for suppressing disturbances in the image picked up by the camera 10. Thus, the luminance examining unit 32 can determine whether or not the amount of light detected by the camera 10 and stored in the image-pickup plane of the camera 10 is appropriate (or optimum). When the luminance examining unit 32 determines that the amount of light detected and stored in an image-pickup plane is not appropriate (or optimum) for suppressing disturbances in the image picked up by the camera 10, the luminance control unit 33 controls at least one of the camera 10 and the illumination unit 20 so that the above amount of light becomes appropriate (or optimum) for suppressing disturbances in the image picked up by the camera 10. Details of the operations of the luminance control unit 33 are explained later with reference to FIG. 3.
  • FIG. 2 is a diagram illustrating a portion of an example of the [0030] light emission unit 21. The light emission unit 21 illustrated in FIG. 2 comprises a plurality of light emitting elements, which are arranged in a plurality of rows. In FIG. 2, the odd-numbered rows are denoted by “A”, and the even-numbered rows are denoted by “B”. The emission control unit 22 controls the light emission of the plurality of light emitting elements in the light emission unit 21. For example, light emitting elements in the row “A” and the light emitting elements in the row “B” are alternately activated under the control of the emission control unit 22. Alternatively, all of the light emitting elements in the light emission unit 21 may be activated concurrently. In addition, the emission control unit 22 controls the light emission unit 21 so that the timing of the activation (i.e., emission) of the light emitting elements in the light emission unit 21 is synchronized with the image acquisition timing of the camera 10.
  • (2) Overall Operation of Image Monitor Apparatus [0031]
  • FIG. 3 is a flow diagram illustrating an overall operation performed in the image monitor apparatus as the first embodiment of the present invention. [0032]
  • In step S[0033] 1, the luminance control unit 33 makes an initial setting of the high-sensitivity camera 10. Specifically, the shutter speed of the high-sensitivity camera 10 is set to the slowest (longest) possible value in order to efficiently utilize external illumination (such as ambient light and moonlight) when the illumination unit 20 does not emit light. In addition, the iris of the high-sensitivity camera 10 is set to an auto iris setting so that the high-sensitivity camera 10 automatically picks up an optimum image under available illumination.
  • In step S[0034] 2, the luminance control unit 33 makes an initial setting of the illumination unit 20. Specifically, the duration of illumination (or flash duration) is set to the shortest time which can provide a sufficient amount of light for image processing, in order to lengthen the life of each light emitting element.
  • In step S[0035] 3, after the above initial setting, the high-sensitivity camera 10 picks up an image. The image signal acquiring unit 31 makes the A/D conversion of the picked-up image, and stores the digitized image signal in the image memory 31 b.
  • In step S[0036] 4, the luminance examining unit 32 determines whether or not the luminance of the image represented by the digitized image signal stored in the image memory 31 b is appropriate for suppressing disturbances in the image. For example, as mentioned before, when a flashlight or car lighting is directed to the high-sensitivity camera 10, an excessive amount of light is stored in the image-pickup plane of the high-sensitivity camera 10 due to the strong light, and the entire screen may be whited out, or blooming or smearing may occur.
  • For example, in the case of NTSC signals, when the luminance value at coordinates (i,j) is expressed by y(i,j), and the sum total of luminance values of all pixels in an image is expressed by Y, the sum total Y of luminance values in each field of an NTSC signal is expressed as [0037] Y = i = 1 640 j = 1 240 y ( i , j ) ( 1 )
    Figure US20020067422A1-20020606-M00001
  • When the sum total Y of luminance values in a field is greater than a threshold value which is preset, it is considered that the entire screen is whited out (i.e., all pixels have very high luminance values). Therefore, in this case, the [0038] luminance examining unit 32 determines that the influence of external lighting is great, and the operation goes to step S5. When the sum total Y of luminance values in a field is smaller than the threshold value, the luminance examining unit 32 determines that the luminance of the image is appropriate for the image processing, and the operation goes to step S6.
  • In step S[0039] 5, the luminance control unit 33 resets the high-sensitivity camera 10 based on the determination made by the luminance examining unit 32. First, the size of the iris opening is maximized so that the illumination by the illumination unit 20 can be most efficiently utilized. Next, in order to reduce the influence of the external lighting, the shutter speed is increased, i.e., the duration in which the high-sensitivity camera 10 detects light and stores the amount of detected light for each pixel in each field is shortened. Thus, it becomes possible to suppress contribution of the external lighting to the amount of light detected by the high-sensitivity camera 10 and stored in the image-pickup plane, and maximize the utilization of the illumination by the illumination unit 20.
  • When the resetting operation of the high-[0040] sensitivity camera 10 is completed, the operation goes back to step S3, and the high-sensitivity camera 10 performs an operation of picking up the next image. Then, in step S4, the luminance examining unit 32 determines again whether or not the luminance of the next image is appropriate for image processing. When the luminance examining unit 32 determines that the influence of the external lighting is still great, the luminance control unit 33 further increases the shutter speed while maintaining the maximized iris opening. However, if the shutter speed falls below the duration of the illumination by the illumination unit 20, the illumination by the illumination unit 20 is not effectively utilized, and the image may become dark except that an image portion produced by picking up the external lighting is bright. Therefore, when the shutter speed reaches the duration of the illumination by the illumination unit 20, the shutter speed is maintained at the duration of the illumination by the illumination unit 20. The above feedback operations in the loop of steps S3, S4, and S5 are repeated until the luminance examining unit 32 determines that the influence of the external lighting is not great, i.e., the luminance of the image is appropriate for image processing.
  • In step S[0041] 6, the image processing unit 34 performs image processing of the image signal of which the luminance is determined to be appropriate. Since the setting of the high-sensitivity camera 10 is optimized in the above feedback control as preprocessing, it is possible to obtain an appropriate image signal, and perform appropriate image processing.
  • In step S[0042] 7, the luminance control unit 33 determines whether or not a predetermined time has elapsed since the time of the resetting of the high-sensitivity camera 10. When the predetermined time has not elapsed, or when the resetting has not been made, the operation goes back to step S3. When the luminance control unit 33 determines that the predetermined time has elapsed, it is assumed that the disturbance (such as the car lighting directed to the high-sensitivity camera 10) is eliminated. Therefore, the operation goes back to step S1, and the initial setting of the high-sensitivity camera 10 is made again.
  • (3) Timing of Luminance Control [0043]
  • FIG. 4 is a timing diagram illustrating examples of operations performed in the first embodiment of the present invention. In this example, it is assumed that only the odd-numbered fields F[0044] 1 or only the even-numbered fields F2 are used for image processing. In the initial setting, an image pickup period is set to 1/60 seconds, the duration of illumination is set to 1/480 seconds, the intensity of the illumination is set to a value which is realized by alternately activating the light emitting elements in the rows A and B (illustrated in FIG. 2), the shutter speed is 1/60 seconds, and the iris is set to the auto iris setting.
  • When the [0045] luminance examining unit 32 determines that the influence of the external lighting is great, the size of the iris opening is reset to FMIN, which indicates that the size of the iris opening is maximized, and the shutter speed is increased (shortened) to 1/120 seconds. The other settings are the same as the initial settings.
  • Thereafter, the determination whether or not the influence of the external lighting is great, and the increase (shortening) of the shutter speed are repeated until the shutter speed reaches the duration of the illumination, 1/480 seconds. In each operation of increasing the shutter speed, the shutter speed is doubled, i.e., the duration in which the shutter is open is reduced by half. However, if the shutter speed falls below the duration of the illumination by the [0046] illumination unit 20, the illumination by the illumination unit 20 is not effectively utilized, and the image may become dark except that an image portion produced by picking up the external lighting is bright. Therefore, when the shutter speed reaches the duration of the illumination, 1/480 seconds, the above feedback operations are completed, and an image picked up by the high-sensitivity camera 10 with the shutter speed of 1/480 seconds is used in the image processing.
  • As explained above, in the first embodiment of the present invention, contribution of the external lighting to the amount of light stored in the image-pickup plane can be suppressed by feedback control of the shutter speed. In addition, it is possible to maximize the utilization of the illumination by the [0047] illumination unit 20 for image monitoring.
  • (4) Second Embodiment [0048]
  • The feedback control in the second embodiment of the present invention is explained below. [0049]
  • In the second embodiment, when the [0050] luminance examining unit 32 determines that the influence of the external lighting is still great even after the shutter speed is increased (shortened) to the duration of the illumination by the illumination unit 20 by the feedback control made in the first embodiment, the image monitor apparatus further makes feedback control of the intensity of the illumination by the illumination unit 20 and the size of the iris opening. That is, when the luminance examining unit 32 determines that the influence of the external lighting is great, the intensity of the illumination by the illumination unit 20 is increased, and the size of the iris opening is adjusted corresponding to the increase in the intensity of the illumination.
  • Specifically, when the [0051] luminance examining unit 32 determines that the influence of the external lighting is great, the luminance control unit 33 sends to the emission control unit 22 an instruction to increase the number of light emitting elements which are concurrently activated. In accordance with the instruction, the emission control unit 22 controls the light emission unit 21 so as to increase the number of light emitting elements. In addition, the luminance control unit 33 sends to the high-sensitivity camera 10 an instruction to reduce the size of the iris opening corresponding to the increase in the intensity of the illumination, so that contribution of the illumination by the illumination unit 20 to the light level at the high-sensitivity camera 10 is maintained equivalent to that in the first embodiment. In accordance with the instruction, the high-sensitivity camera 10 reduces the size of the iris opening. The above feedback control of the intensity of the illumination by the illumination unit 20 and the size of the iris opening is repeated until the luminance examining unit 32 determines that the influence of the external lighting is not great. When the influence of the external lighting is eliminated by the feedback control, the image monitoring is performed. Thereafter, when a predetermined time elapses since the above feedback control is completed, it is assumed that the disturbance such as the influence of the external lighting is eliminated, and the initial setting of the high-sensitivity camera 10 and the illumination unit 20 is made again.
  • When the disturbance such as the influence of the external lighting is eliminated, the above increase in the intensity of the illumination is unnecessary. Therefore, it is possible to efficiently use the light emitting elements by initializing the high-[0052] sensitivity camera 10 and the illumination unit 20 when a predetermined time elapses since the above feedback control is completed. Thus, the life of each light emitting element can be lengthened.
  • FIG. 5 is a timing diagram illustrating examples of operations performed in the second embodiment of the present invention. [0053]
  • When the [0054] luminance examining unit 32 determines that the influence of the external lighting is still great after the feedback control in the first embodiment, the luminance control unit 33 controls the illumination unit 20 so as to concurrently activate the light emitting elements in both of the rows A and B, and resets the high-sensitivity camera 10 so as to reduce the size of the iris opening by half to FMIN/2. In the example of FIG. 5, the shutter speed is set to 1/480 seconds as a result of the feedback control in the first embodiment.
  • As explained above, in the second embodiment, the intensity of the illumination by the [0055] illumination unit 20 and the iris opening in the high-sensitivity camera 10 are controlled, after the control of the shutter speed in the first embodiment, so as to suppress the disturbance in the image picked up by the high-sensitivity camera 10.
  • (5) Third Embodiment [0056]
  • The feedback control in the third embodiment of the present invention is explained below. [0057]
  • In image monitoring, sometimes, it is not necessary to perform image processing of an image of every frame. Therefore, for example, if image processing is performed on an image of every two or three frames, illumination by the [0058] illumination unit 20 is unnecessary for the skipped frames. Therefore, in the third embodiment, the illumination unit 20 is controlled so as to activate the light emitting elements only when an image of a frame which is necessary for image processing is picked up.
  • FIG. 6 is a timing diagram illustrating examples of operations performed in the third embodiment of the present invention. In the example of FIG. 6, the image pickup period is 1/30 seconds, and the illumination timing is set so that the illumination by the [0059] illumination unit 20 synchronizes with the image pickup timing. In addition, the size of the iris opening is reduced by half to FMIN/2, and the light emitting elements in both of the rows A and B are concurrently activated.
  • (6) Automatic Recognition of Blooming [0060]
  • Automatic recognition (detection) of blooming is explained below. [0061]
  • Sometimes, external lighting causes blooming as well as the screen white-out. The blooming is halation or defocus which occurs around bright areas produced in an image by picking up a very bright object such as external lighting. The [0062] luminance examining unit 32 can automatically detect the blooming, and the luminance control unit 33 makes feedback control until the blooming disappears. The characteristic of the blooming is that white (bright) pixels are distributed around a point corresponding to a light source, and form a bright round area, and the brightness of the pixels around the bright round area gradually decreases so that the area around the bright round area is blurred. Therefore, in order to detect the blooming, the bright area is first extracted, and it is then determined whether or not an area around the bright area is blurred. However, in the above operation of extracting the bright area, small bright areas which are considered not to affect the image processing are ignored. In addition, bright areas which are not surrounded by blurred areas are each recognized to be a bright object instead of blooming.
  • FIG. 7 is a flow diagram illustrating a sequence of operations for detecting blooming. [0063]
  • A threshold value C used for determining the above bright area and another threshold value D used for determining the above blurred area are set in advance in the [0064] image monitor apparatus 1.
  • In step S[0065] 10, the luminance examining unit 32 performs processing for binalizing all pixels of an image picked up by the high-sensitivity camera 10 by using the threshold value C. That is, pixel values equal to or greater than the threshold value C are converted to one, and pixel values smaller than the threshold value C are converted to zero.
  • In step S[0066] 11, the luminance examining unit 32 performs processing for labelling the binalized image, and extracts as at least one object at least one aggregation of pixels having the value “one”, where the labelling is an operation of assigning a label (number) to each pixel of a binalized image in order to extract at least one object included in the image.
  • In step S[0067] 12, the luminance examining unit 32 discards at least one object which has an area smaller than a predetermined value S, from among the at least one object extracted in step S11.
  • In step S[0068] 13, the luminance examining unit 32 determines whether or not at least one extracted object exists after the discard in step S12. When yes is determined, the operation goes to step S14. When no is determined, the operation goes to step S17.
  • In step S[0069] 14, the luminance examining unit 32 counts the number of pixels having a value equal to or greater than the threshold value D and smaller than the threshold value C in an area surrounding each of the at least one extracted object, where the surrounding area has a loop shape having a width of N pixels in each of the vertical and horizontal directions. Then, the luminance examining unit 32 calculates the ratio between the counted number and the total number of pixels in the surrounding area.
  • In step S[0070] 15, the luminance examining unit 32 compares the ratio calculated in step S14 with a predetermined value P(%). When the ratio calculated in step S14 is equal to or greater than the predetermined value P, the operation goes to step S16. When the ratio calculated in step S14 is smaller than the predetermined value P, the operation goes back to step S13.
  • In step S[0071] 16, the luminance examining unit 32 recognizes the extracted object as blooming.
  • In step S[0072] 17, the luminance examining unit 32 recognizes that no blooming exists in the image.
  • FIG. 8 is a diagram illustrating an example of a portion of an image which includes blooming. In the example of FIG. 8, high-luminance pixels (i.e., pixels having a value equal to or greater than the threshold value C) are indicated with blank circles, middle-luminance pixels (i.e., pixels having a value equal to or greater than the threshold value D and smaller than the threshold value C) are indicated with grey circles, and the other pixels including low-luminance pixels (i.e., pixels having a value smaller than the threshold value D) are indicated with black circles. [0073]
  • First, each aggregation of high-luminance pixels, which are encircled by solid lines in FIG. 8, is examined. When the above-mentioned predetermined area S is ten (pixels), the aggregation R[0074] 1, which is indicated in the upper right portion of FIG. 8, is regarded as noise, and discarded. Next, the area surrounding the aggregation R2 and having a loop shape with a width of two pixels in each of the vertical and horizontal directions, which is encircled by dashed lines in FIG. 8, is examined. In this example, the number of the pixels in the surrounding area is twenty-eight, and twenty-five pixels among the twenty-eight pixels are middle-luminance pixels. Therefore, the ratio between the number of middle-luminance pixels and the total number of pixels in the surrounding area is obtained as (25/28)×100 =89%. Then, the obtained ratio is compared with the predetermined value P(%) in order to determine whether or not the aggregation R2 constitutes blooming. For example, when the predetermined value P is 80(%), the luminance examining unit 32 determines that the aggregation R2 constitutes blooming.
  • (7) Automatic Recognition of Smear [0075]
  • Automatic recognition (detection) of a smear is explained below. [0076]
  • Sometimes, external lighting also causes a smear in an image picked up by the high-[0077] sensitivity camera 10. The smear is a vertical streak which appears above and below bright areas produced in an image by picking up a very bright object such as the external lighting. The luminance examining unit 32 can automatically detect the smear, and the luminance control unit 33 makes feedback control until the smear disappears. The characteristic of the smear is that white (bright) pixels are distributed above and below a point corresponding to a light source, and form a bright vertical streak. Therefore, in order to detect a smear, the sum total of luminance values of pixels on each vertical line is calculated, and it is determined whether or not a smear exists on the line, based on the sum total of the luminance values.
  • For example, in the case of NTSC signals, when the luminance value at coordinates (i,j) is expressed by y(i,j), and the sum total of luminance values of all pixels on each vertical line in an image is expressed by Y′, the sum total Y′ is expressed as [0078] Y ( i ) = j = 1 240 y ( i , j ) ( 2 )
    Figure US20020067422A1-20020606-M00002
  • When the sum total Y′ of luminance values on each vertical line is greater than a predetermined threshold value A, it is considered that a bright line exists on the vertical line, i.e., it is determined that a smear exists on the vertical line. When the sum total Y′ is not greater than the predetermined threshold value A, it is determined that a smear does not exist on the vertical line. The above determination is made on all of the vertical lines in an image. In the case of the NTSC signals, the number of the vertical lines is 640. When all of the vertical lines in the image are determined not to include a smear, it is determined that no smear exists in the image. [0079]
  • (8) Advantages and Other Matters [0080]
  • (i) As explained above, the [0081] image monitor apparatus 1 according to the present invention determines whether or not the amount of light detected by the high-sensitivity camera 10 and stored in the image-pickup plane of the high-sensitivity camera 10 is appropriate (or optimum) for suppressing disturbances in the image, based on the luminance values of the image signal. When it is determined that the amount of light is not appropriate, feedback control of at least one of the high-sensitivity camera 10 and the illumination unit 20 is made. Therefore, it is possible to suppress the influence of light from the external light source in the high-sensitivity camera 10, and obtain a stable image by using the high-sensitivity camera 10. In addition, since the duration and the intensity of illumination by the illumination unit 20 are controlled so that the light emitting elements are efficiently used, it is possible to lengthen the life of each light emitting element in the illumination unit 20, and perform efficient image monitoring.
  • (ii) The foregoing is considered as illustrative only of the principle of the present invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and applications shown and described, and accordingly, all suitable modifications and equivalents may be regarded as falling within the scope of the invention in the appended claims and their equivalents. [0082]
  • (iii) All of the contents of the Japanese patent application, No.2000-311106 are incorporated into this specification by reference. [0083]

Claims (5)

What is claimed is:
1. An image monitor apparatus for monitoring an image, comprising:
a camera which picks up an image;
an illumination unit which includes,
a light emission unit having at least one light emitting element, and
an emission control unit which controls the at least one light emitting element; and
a processing unit which includes,
an image signal acquiring unit which performs analog-to-digital conversion of said image picked up by said camera so as to generate a digitized image signal, and stores the digitized image signal,
a luminance examining unit which examines luminance of the image represented by said digitized image signal, and determines whether or not an amount of light detected by said camera and stored in an image-pickup plane of the camera is appropriate, and
a luminance control unit which controls at least one of said camera and said illumination unit so that said amount of light becomes appropriate for suppressing disturbances in said image, when said luminance examining unit determines that the amount of light detected by said camera and stored in the image-pickup plane is not appropriate for suppressing disturbances in said image.
2. An image monitor apparatus according to claim 1, wherein said luminance control unit makes feedback control of said camera so that a shutter speed of said camera is increased within such a range that a duration in which a shutter of the camera is open is not shorter than a duration of illumination by the illumination unit, and an iris opening of said camera is maximized.
3. An image monitor apparatus according to claim 2, wherein when said amount of light cannot become appropriate for suppressing disturbances in the image even when said shutter speed of said camera is increased by said feedback control to said duration of illumination, said luminance control unit increases an amount of light emitted by said illumination unit, and reduces the size of the iris opening.
4. An image monitor apparatus according to claim 1, wherein said luminance control unit controls said illumination unit so that the at least one light emitting element emits light only when an image of a frame which is necessary for image processing is picked up by the camera.
5. An image monitor apparatus according to claim 1, wherein said luminance control unit automatically detects blooming or smearing in said image based on said luminance of the image.
US09/821,439 2000-10-11 2001-03-29 Image monitor apparatus controlling camera and illumination in order to optimize luminance of picked-up image Expired - Fee Related US7202902B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2000-311106 2000-10-11
JP2000311106A JP3907397B2 (en) 2000-10-11 2000-10-11 Video surveillance device

Publications (2)

Publication Number Publication Date
US20020067422A1 true US20020067422A1 (en) 2002-06-06
US7202902B2 US7202902B2 (en) 2007-04-10

Family

ID=18790930

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/821,439 Expired - Fee Related US7202902B2 (en) 2000-10-11 2001-03-29 Image monitor apparatus controlling camera and illumination in order to optimize luminance of picked-up image

Country Status (2)

Country Link
US (1) US7202902B2 (en)
JP (1) JP3907397B2 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6637893B2 (en) * 2002-03-22 2003-10-28 Accu-Sort Systems, Inc. Presentation imaging system
US20040017505A1 (en) * 2002-07-24 2004-01-29 Kazunari Yamauchi Portable device having exposure-adjustable image pick-up unit and exposure adjusting device
US20040085521A1 (en) * 2002-03-22 2004-05-06 Accu-Sort Systems, Inc. Presentation imaging system
US20040218090A1 (en) * 2003-04-30 2004-11-04 Kt & C Co., Ltd. Apparatus and method for operating day and night modes of monitoring camera by measuring brightness in no video signal interval
US20050140819A1 (en) * 2003-12-25 2005-06-30 Niles Co., Ltd. Imaging system
US20060138240A1 (en) * 2004-12-29 2006-06-29 Mehul Patel Methods and apparatus for swipe or presentation image scanning
US20080012942A1 (en) * 2003-12-25 2008-01-17 Niles Co., Ltd. Imaging System
CN100432828C (en) * 2004-08-31 2008-11-12 佳能株式会社 Image pickup apparatus equipped with light emitting device and control method thereof
GB2459506A (en) * 2008-04-26 2009-10-28 Wen-Hsiung Hsieh Surveillance Camera with Automatic Illumination
US20110115979A1 (en) * 2008-07-25 2011-05-19 Nobuaki Aoki Additional data generation system
US20110157417A1 (en) * 2009-12-30 2011-06-30 Gds Software (Shenzhen) Co.,Ltd Electronic device and light control method thereof
US8351778B2 (en) * 2011-05-18 2013-01-08 Altek Corporation Method for adjusting brightness of image
WO2012117235A3 (en) * 2011-02-28 2013-01-10 360 Vision Technology Limited Security camera assembly
WO2014065948A1 (en) * 2012-10-26 2014-05-01 Sensormatic Electronics, LLC Security camera system and method for eliminating video aberrations from excessive ir illumination
CN106534712A (en) * 2016-10-24 2017-03-22 北京旷视科技有限公司 Control method, image processing unit, light-filling and camera device
WO2018022436A1 (en) 2016-07-26 2018-02-01 BOT Home Automation, Inc. Floodlight controllers with wireless audio/video recording and communication features
TWI650020B (en) * 2017-03-16 2019-02-01 晶睿通訊股份有限公司 Brightness adjusting system and brightness adjusting method

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005150774A (en) 2002-12-27 2005-06-09 Casio Comput Co Ltd Illuminating apparatus and image pickup apparatus
JP3882793B2 (en) * 2003-07-14 2007-02-21 セイコーエプソン株式会社 Output image adjustment of image data
KR101012790B1 (en) * 2003-12-30 2011-02-08 삼성전자주식회사 Apparatus and method of converting image signal for four color display device, and display device comprising the same
JP4814616B2 (en) * 2005-10-31 2011-11-16 富士通株式会社 Pattern recognition apparatus and pattern recognition program
DE102008058671B4 (en) 2008-10-03 2011-04-07 ASTRA Gesellschaft für Asset Management mbH & Co. KG Method for controlling a video surveillance device
WO2014002398A1 (en) * 2012-06-28 2014-01-03 日本電気株式会社 Camera position/posture evaluation device, camera position/posture evaluation method, and camera position/posture evaluation program
JP5892134B2 (en) * 2013-09-20 2016-03-23 カシオ計算機株式会社 Imaging apparatus, imaging method, and program
US9898676B2 (en) * 2016-01-13 2018-02-20 I-Shou University Method for determining the level of degradation of a road marking
JP7297441B2 (en) * 2018-12-20 2023-06-26 キヤノン株式会社 ELECTRONIC DEVICE, CONTROL METHOD AND PROGRAM FOR ELECTRONIC DEVICE
JP7278764B2 (en) * 2018-12-20 2023-05-22 キヤノン株式会社 IMAGING DEVICE, ELECTRONIC DEVICE, IMAGING DEVICE CONTROL METHOD AND PROGRAM

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5223935A (en) * 1990-04-02 1993-06-29 Casio Computer Co., Ltd. Electronic camera with automatic exposure control
US5497196A (en) * 1991-03-15 1996-03-05 Sharp Kabushiki Kaisha Video camera having an adaptive automatic iris control circuit
US5671013A (en) * 1991-10-31 1997-09-23 Sony Corporation Luminance correction apparatus for image signals
US6359651B1 (en) * 1998-10-06 2002-03-19 Nikon Corporation Electronic camera using flash for exposure control
US6441856B1 (en) * 1996-07-18 2002-08-27 Sanyo Electric Co., Ltd. Digital camera, having a flash unit, which determines proper flash duration through an assessment of image luminance and, where needed, a preliminary flash emission
US6445884B1 (en) * 1995-06-22 2002-09-03 3Dv Systems, Ltd. Camera with through-the-lens lighting
US6603507B1 (en) * 1999-04-12 2003-08-05 Chung-Shan Institute Of Science And Technology Method for controlling a light source in a night vision surveillance system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07244718A (en) 1994-03-02 1995-09-19 Hamamatsu Photonics Kk Security unit

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5223935A (en) * 1990-04-02 1993-06-29 Casio Computer Co., Ltd. Electronic camera with automatic exposure control
US5497196A (en) * 1991-03-15 1996-03-05 Sharp Kabushiki Kaisha Video camera having an adaptive automatic iris control circuit
US5671013A (en) * 1991-10-31 1997-09-23 Sony Corporation Luminance correction apparatus for image signals
US6445884B1 (en) * 1995-06-22 2002-09-03 3Dv Systems, Ltd. Camera with through-the-lens lighting
US6441856B1 (en) * 1996-07-18 2002-08-27 Sanyo Electric Co., Ltd. Digital camera, having a flash unit, which determines proper flash duration through an assessment of image luminance and, where needed, a preliminary flash emission
US6359651B1 (en) * 1998-10-06 2002-03-19 Nikon Corporation Electronic camera using flash for exposure control
US6603507B1 (en) * 1999-04-12 2003-08-05 Chung-Shan Institute Of Science And Technology Method for controlling a light source in a night vision surveillance system

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6637893B2 (en) * 2002-03-22 2003-10-28 Accu-Sort Systems, Inc. Presentation imaging system
US20040085521A1 (en) * 2002-03-22 2004-05-06 Accu-Sort Systems, Inc. Presentation imaging system
US6805449B2 (en) * 2002-03-22 2004-10-19 Accu-Sort Systems, Inc. Presentation imaging system
US20040017505A1 (en) * 2002-07-24 2004-01-29 Kazunari Yamauchi Portable device having exposure-adjustable image pick-up unit and exposure adjusting device
EP1387562A3 (en) * 2002-07-24 2005-09-28 Sharp Kabushiki Kaisha Portable device having exposure-adjustable image pick-up unit and exposure adjusting device
US7414666B2 (en) 2002-07-24 2008-08-19 Sharp Kabushiki Kaisha Portable device having exposure-adjustable image pick-up unit and exposure adjusting device
US20040218090A1 (en) * 2003-04-30 2004-11-04 Kt & C Co., Ltd. Apparatus and method for operating day and night modes of monitoring camera by measuring brightness in no video signal interval
US20050140819A1 (en) * 2003-12-25 2005-06-30 Niles Co., Ltd. Imaging system
US20080012942A1 (en) * 2003-12-25 2008-01-17 Niles Co., Ltd. Imaging System
CN100432828C (en) * 2004-08-31 2008-11-12 佳能株式会社 Image pickup apparatus equipped with light emitting device and control method thereof
US20060138240A1 (en) * 2004-12-29 2006-06-29 Mehul Patel Methods and apparatus for swipe or presentation image scanning
US7367509B2 (en) * 2004-12-29 2008-05-06 Symbol Technologies, Inc. Methods and apparatus for swipe or presentation image scanning
GB2459506A (en) * 2008-04-26 2009-10-28 Wen-Hsiung Hsieh Surveillance Camera with Automatic Illumination
US20110115979A1 (en) * 2008-07-25 2011-05-19 Nobuaki Aoki Additional data generation system
US20110157417A1 (en) * 2009-12-30 2011-06-30 Gds Software (Shenzhen) Co.,Ltd Electronic device and light control method thereof
WO2012117235A3 (en) * 2011-02-28 2013-01-10 360 Vision Technology Limited Security camera assembly
US8351778B2 (en) * 2011-05-18 2013-01-08 Altek Corporation Method for adjusting brightness of image
TWI454138B (en) * 2011-05-18 2014-09-21 Altek Corp Method for adjusting brightness of image
WO2014065948A1 (en) * 2012-10-26 2014-05-01 Sensormatic Electronics, LLC Security camera system and method for eliminating video aberrations from excessive ir illumination
US9264596B2 (en) 2012-10-26 2016-02-16 Sensormatic Electronics, LLC Security camera system and method for eliminating video aberrations from excessive IR illumination
WO2018022436A1 (en) 2016-07-26 2018-02-01 BOT Home Automation, Inc. Floodlight controllers with wireless audio/video recording and communication features
EP3491627A4 (en) * 2016-07-26 2019-10-16 Amazon Technologies, Inc. Floodlight controllers with wireless audio/video recording and communication features
CN106534712A (en) * 2016-10-24 2017-03-22 北京旷视科技有限公司 Control method, image processing unit, light-filling and camera device
TWI650020B (en) * 2017-03-16 2019-02-01 晶睿通訊股份有限公司 Brightness adjusting system and brightness adjusting method

Also Published As

Publication number Publication date
US7202902B2 (en) 2007-04-10
JP3907397B2 (en) 2007-04-18
JP2002118788A (en) 2002-04-19

Similar Documents

Publication Publication Date Title
US7202902B2 (en) Image monitor apparatus controlling camera and illumination in order to optimize luminance of picked-up image
CN106791475B (en) Exposure adjustment method and the vehicle mounted imaging apparatus being applicable in
CN110536051B (en) Image pickup apparatus, control method thereof, and storage medium
CN109845242B (en) WDR imaging with LED flicker suppression
CN104702838B (en) Picture pick-up device and its control method
US20050265626A1 (en) Image processor and face detector using the same
US20040012692A1 (en) Flicker detection apparatus, a flicker correction apparatus, an image-pickup apparatus, a flicker detection program and a flicker correction program
US20080007634A1 (en) Camera, image processing method of camera and recording medium in which image processing program is recorded
US7071472B2 (en) Irradiation control device
US8885092B2 (en) Camera device, exposure control method, and program
US7486884B2 (en) Imaging device and imaging method
US7756409B2 (en) Image pickup device and image pickup method
US20110292241A1 (en) Extended flicker cancellation for auto exposure for a video camera
JP2008048251A (en) Photographing apparatus and photographing method
US20150379740A1 (en) Exposure metering based on background pixels
KR102612365B1 (en) A method for assessing ambient light during night mode image acquisition
US11019277B2 (en) LED flicker reduction for high dynamic range imaging
US20050258370A1 (en) Imaging system
US11641523B2 (en) Image capture method adapted to sparkling light sources and image sensor
JP4219201B2 (en) Imaging system
JP2004229034A (en) Day/night camera incorporating infrared illumination
JP6525723B2 (en) Imaging device, control method therefor, program, and storage medium
JP2018142887A (en) Image-taking system and image-taking device
JP7297441B2 (en) ELECTRONIC DEVICE, CONTROL METHOD AND PROGRAM FOR ELECTRONIC DEVICE
CN113452922A (en) Information processing apparatus, image pickup apparatus, information processing method, and storage medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJITSU LIMITED, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIURA, TSUYOSHI;KAGAMI, ICHIRO;IHARA, NORIYUKI;AND OTHERS;REEL/FRAME:011660/0305

Effective date: 20010313

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20150410