JP2011160026A - Imaging system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging system for imaging video and still pictures, which allows a user to select a more optimal image processing method without requiring any complicated user operation. <P>SOLUTION: The imaging system having an image sensor 53 (solid-state imaging device) which outputs light incident from an object as an imaging signal S1, has a digital signal processing circuit 10 (signal processing unit) which applies signal processing to the imaging signal S1 and generates a YC signal S2 (image signal). An external information interface 70 (information acquiring unit) is provided which acquires information for estimation for estimating an imaging scene. A CPU 20 (control unit) is provided which estimates the imaging scene using the information for estimation, and performs at least one of imaging control and signal processing control in the digital signal processing circuit 10. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging system that captures moving images and still images, and more particularly to image processing and imaging control of the imaging system.

  In an imaging system such as a digital camera, image processing such as synchronization, filtering processing, and frequency correction is often performed on a captured image (still image or moving image). In order to obtain a more preferable image output (for example, display), various methods for selecting an image processing method have been proposed. For example, multiple languages or regions are displayed on the menu screen for image adjustment, and by selecting the language or region, the initial value of the color that matches the skin color corresponding to that language or region is automatically set (For example, refer to Patent Document 1). In addition, by specifying the skin color of the subject person from the input image and substituting the skin color into an approximate expression based on statistical results performed in advance, the color component of the normal pupil from the skin color of the subject person (For example, refer to Patent Document 2), and the user can switch the image processing method with a switch (for example, refer to Patent Document 3).

JP-A-11-202844 JP2005-158033 Japanese Patent No. 3047448

  However, the preferred image quality (color reproduction, etc.) tends to differ depending on the cultural sphere, so even if a language is set as described in Patent Document 1, the region (country, etc.) in which the language is used is specified. If the cultural area is not limited, an appropriate image processing method may not be selected, and a preferable image processing result may not be obtained. For example, even when “English” is selected as the language, English-speaking users are not limited to a specific cultural zone. In order to select an image processing method more appropriately, it is necessary to display more regions on the image adjustment menu screen, and the user selects an appropriate one from the displayed menu items (regions). This is a cumbersome task. Also, as described in Patent Document 2, when the skin color of a subject person is specified from an input image, correct estimation may not be performed depending on shooting conditions (for example, illumination light color temperature). The method may not be selected. Further, as described in Patent Document 3, it is complicated for the user to switch the image processing method by a switch at the time of imaging.

  The present invention has been made paying attention to the above problem, and in an imaging system that captures moving images and still images, a more optimal image processing method can be selected without requiring a complicated operation from the photographer. The purpose is to do.

In order to solve the above problems, one embodiment of the present invention provides:
In an imaging system having a solid-state imaging device that outputs light incident from a subject as an imaging signal,
A signal processing unit that generates an image signal obtained by performing signal processing on the imaging signal;
An information acquisition unit for acquiring information for estimation for estimating the imaging scene;
A control unit that estimates the imaging scene using the estimation information, performs control of imaging according to the estimated imaging scene, and control of signal processing in the signal processing unit; and
It is provided with.

  In this configuration, the control unit estimates a captured scene based on the estimation information acquired by the information acquisition unit, and controls signal processing in the signal processing unit based on the estimation result. That is, in the present invention, the photographer does not need to select an image processing method. Moreover, since the image processing method according to the imaging scene is selected by the control unit, it is possible to obtain an image processing result that is considered preferable for the photographer.

  As described above, according to the present invention, it is possible to select a more optimal image processing method without requiring a complicated operation from the photographer.

FIG. 1 is a block diagram showing a configuration of a digital video camera according to Embodiment 1 of the present invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiments are essentially preferable examples, and are not intended to limit the scope of the present invention, its application, or its use. In the following description of each embodiment and modification, components having the same functions as those described once will be given the same reference numerals and description thereof will be omitted.

Embodiment 1 of the Invention
<Overview>
The imaging system of the present invention can be applied to any of an imaging system for moving images, an imaging system for still images, or an imaging system that captures both moving images and still images. Hereinafter, an example of a digital video camera capable of capturing moving images and still images will be described as an example of the imaging system of the present invention. The digital video camera described below performs an imaging operation and processing (signal processing) of a captured image using information (information to be described later) acquired from the outside of the digital video camera in order to estimate an imaging scene. There are a first operation mode and a second operation mode in which the imaging operation and signal processing are controlled without using the estimation information, and these operation modes can be switched.

  FIG. 1 is a block diagram showing a configuration of a digital video camera 1 according to Embodiment 1 of the present invention. As shown in the figure, the digital video camera 1 includes a digital signal processing circuit 10 (abbreviated as DSP in the figure), a CPU 20, SDRAM 30, an SD card 40, a display device 41 (abbreviated as LCD in the figure), an external information interface. 70 and an imaging module 50. Below, each component of the digital video camera 1 is demonstrated.

<Display device 41>
The display device 41 of the present embodiment is configured by a liquid crystal display, and is used for a preview of a captured image, a menu display when setting the digital video camera 1, and a so-called OSD (On Screen Display).

<Imaging Module 50>
The imaging module 50 includes a lens 51, a timing generator 52, and an image sensor 53. The lens 51 forms an image of light from the subject on the image sensor 53. The timing generator 52 generates a control signal necessary to drive the image sensor 53. The image sensor 53 is an example of a solid-state imaging device of the present invention. The image sensor 53 of this embodiment is a so-called MOS image sensor. Although illustration is omitted, the image sensor 53 includes a pixel array in which a plurality of pixels are two-dimensionally arranged. In the pixel array, each pixel performs photoelectric conversion to convert incident light from the lens 51 into electric charge. Then, the image sensor 53 performs A / D conversion on the signal of each pixel and outputs it to the digital signal processing circuit 10 as an imaging signal S1. The image sensor 53 has two operation modes. One operation mode is an operation mode in which an image (original image data) configured by pixel data obtained by digitizing a signal (analog signal) from each pixel is output as the imaging signal S1. The other operation mode is an operation mode (hereinafter referred to as pixel mixture mode) in which reduced image data composed of mixed pixel data obtained by mixing pixel data from a plurality of pixels is output as the imaging signal S1.

<SDRAM 30>
The SDRAM 30 is a recording medium used for temporarily holding a signal (data) being processed in signal processing (described later) in the digital signal processing circuit 10.

<Digital signal processing circuit 10 (DSP)>
The digital signal processing circuit 10 includes a memory controller 11, a level detection unit 12, a YC processing unit 13, a compression processing unit 14, and a digital signal processing unit 15, and processes an output (imaging signal S1) from the image sensor 53. The digital signal processing circuit 10 is an example of a signal processing unit of the present invention.

-Memory controller 11-
The memory controller 11 includes data between the level detection unit 12, the YC processing unit 13, the compression processing unit 14, and the digital signal processing unit 15 (hereinafter, these units are collectively referred to as function blocks) and the SDRAM 30. Transfer (reading or writing from the SDRAM 30). In the digital signal processing circuit 10, the imaging signal S <b> 1 is written and held in the SDRAM 30 until the imaging signals S <b> 1 corresponding to the number of pixels necessary for processing in each functional block are prepared. When the imaging signals S1 corresponding to the required number of pixels are prepared, the memory controller 11 reads the imaging signal S1 from the SDRAM 30 as necessary and outputs the imaging signal S1 to the function block that requires the imaging signal S1. In the digital video camera 1, not only the image pickup signal S 1 but also luminance signals and color signals (R, G, and B signals) obtained by being processed by the YC processing unit 13, and further, the compression processing unit 14 Code data and the like obtained by processing are also recorded in the SDRAM 30. Therefore, the memory controller 11 also reads and writes these types of data and signals.

-Level detector 12-
The level detection unit 12 detects the level of the imaging signal S1, and notifies the CPU 20 of the level of the imaging signal S1. Specifically, the level detection unit 12 calculates the level of the imaging signal S1 from the entire screen of the image sensor 53 or an average value of a part of the imaging signal S1 output from the imaging module 50, and calculates the calculation result. The CPU 20 is notified.

-YC processing unit 13-
The YC processing unit 13 is a functional block that actually performs signal processing on the imaging signal S1. Specifically, the YC processing unit 13 performs synchronization, filtering processing, frequency correction, and the like using predetermined image processing parameters, and also performs luminance signals and color difference signals (hereinafter these signals are collectively referred to as YC signal S2). Is called). The YC signal S2 is an example of the image signal of the present invention. The digital signal processing circuit 10 may be configured to handle a color signal, a level output corresponding to light incident on the image sensor 53, or the like as an image signal instead of the YC signal S2.

  In the digital video camera 1, a table (parameter table) storing a plurality of types of the parameters is prepared, and the YC processing unit 13 uses the parameters in the parameter table as a signal to the imaging signal S1 under the control of the CPU 20. Process. In the parameter table, the parameter is associated with each of a plurality of types of imaging scenes. The imaging scene in the first embodiment means a cultural area where imaging is performed, and the parameter table associates a region (cultural area) with a parameter suitable for the region. The reason why the parameter table is configured as described above is that the image quality (color reproduction, etc.) preferred by the cultural sphere tends to be different. For example, in image processing for Japan, it is often preferred to use an image in which the skin is finished in a brilliant shade (which is considered healthy in this region). However, in the United States and the like, such color reproduction is often not preferred. Therefore, for each region, a parameter for performing image processing that is preferred in the region is set in the parameter table. The parameter table may be held by the YC processing unit 13, or may be held by the CPU 20 or may be held by separately providing a non-volatile storage medium.

-Compression processing unit 14-
The compression processing unit 14 compresses the YC signal S2 (luminance signal and color difference signal) according to a predetermined format. Specifically, for example, according to the JPEG format for still images and H.264 for moving images. The amount of data is compressed according to a format such as H.264.

-Digital signal processor 15-
The digital signal processing unit 15 performs signal processing necessary for operation as a digital video camera, such as enlargement / reduction processing (so-called zoom processing) for adjusting the angle of view, flaw correction, and illumination light color temperature detection. Further, the digital signal processing unit 15 reads and writes data from and on the SD card 40 that is mounted. Further, the digital signal processing unit 15 displays an image such as a preview on the LCD 41 which is a display medium.

<SD card 40>
The SD card 40 is a recording medium that records the YC signal S2 (image signal) in a predetermined format and stores map information. In the present embodiment, an SD memory card is adopted as the SD card 40. Of course, other types of recording media can be used for the SD card 40.

<External information interface 70>
The external information interface 70 is an example of the information acquisition unit of the present invention, and acquires estimation information S4 for estimating a captured scene. In this embodiment, the external information interface 70 has a clock function and a calendar function, and outputs a date and time information (time and date) 80, and a global positioning system 81 (FIG. 1) for acquiring position information. The GPS is abbreviated as GPS), and the date and time information and the position information (hereinafter, the information input to the external information interface 70 is also referred to as external information) are obtained as the estimation information S4. These pieces of information are transmitted to the CPU 20. Note that the clock 80 has a calendar function, and outputs the current date information to the external information interface 70.

<CPU 20>
The CPU 20 is an example of a control unit of the present invention, and performs control of imaging operation and signal processing in the digital signal processing circuit 10. For example, at the time of shooting, the CPU 20 outputs a control signal necessary for the digital video camera 1 to realize an operation expected by the user to each functional block of the imaging module 50 (image sensor 53) and the digital signal processing circuit 10. . For example, the CPU 20 controls switching between output of original image data and reduced image data from the image sensor 53. Further, the CPU 20 performs initial settings of the digital signal processing circuit 10 and the imaging module 50 by turning on the power immediately after the photographer purchases the digital video camera 1. The initial setting will be described in detail later.

  In order to enable the CPU 20 to perform such an imaging operation and signal processing control, a signal for setting the release button and the operation of the digital video camera 1 (external input S3) is input to the CPU 20 from the outside. At the same time, information (estimation information S4) from the external information interface 70 is also input. The CPU 20 uses the information as appropriate to perform the control (detailed operation will be described later). In the digital video camera 1, switching between the first operation mode and the second operation mode is performed by an external input S3.

<< Operation of Digital Video Camera 1 >>
<Overview of operation>
When shooting is performed with the digital video camera 1, light from the subject enters the image sensor 53 through the lens 51 and is photoelectrically converted in the pixels on the image sensor 53. The CPU 20 controls the imaging operation such as the exposure amount control and the operation mode control of the imaging module 50 at this time. The image sensor 53 outputs the photoelectrically converted signal to the digital signal processing circuit 10 as an imaging signal S1. Further, the CPU 20 outputs a predetermined control signal to each functional block of the memory controller 11 and the digital signal processing circuit 10. As a result, the memory controller 11 writes the image signal S1 to the SDRAM 30 and reads it from the SDRAM 30 to the level detection unit 12, the YC processing unit 13, the compression processing unit 14, the digital signal processing unit 15, the SD card 40, and the LCD 41. On the other hand, signal input / output is realized. In the digital signal processing circuit 10, the YC processing unit 13 performs predetermined signal processing on the input imaging signal S <b> 1 under the control of the CPU 20, and records the YC signal S <b> 2 (image signal) as a processing result. The data is recorded on the SD card 40 mounted as a medium or displayed on the LCD 41 which is a display medium.

  Here, when the second operation mode is selected by the external input S3, the CPU 20 does not use the estimation information (external information) acquired via the external information interface 70, and is obtained from, for example, a subject. Control of the imaging operation and signal processing in the digital signal processing circuit 10 are performed according to information and user settings.

<First operation mode (image processing using external information)>
Next, image processing using external information, that is, a first operation mode, which is a feature of the digital video camera 1, will be described. In the digital video camera 1, the CPU 20 performs an initial setting when the user turns on the power immediately after purchase. Specifically, the CPU 20 records position information at the time of initial setting (initial position information) based on external information obtained from the GPS 81. Further, the CPU 20 collates the map information stored in the SD card 40 with the initial position information, selects a language appropriate for the user's (photographer) language sphere, and sets the digital video camera 1. Used for the menu language used by the user. Further, the CPU 20 selects an image processing parameter corresponding to the initial position information from the parameter table, and transmits a selection result (control signal) to the YC processing unit 13. That is, the CPU 20 estimates the photographer's cultural area (imaging scene) based on the initial position information. Further, the CPU 20 sets the photographer's local time and date / time in the clock 80 of the digital video camera 1 based on the time information obtained from the GPS 81 and the initial position information.

  After the initial setting, the photographer notifies the digital video camera 1 of shooting by pressing the shutter via the external input S3, so that the digital video camera 1 takes a still image or a moving image. At that time, the CPU 20 notifies the YC processing unit 13 of the image processing parameters selected from the initial position information. In accordance with the parameters, the YC processing unit 13 performs synchronization, filtering processing, frequency correction, and the like on the imaging signal S1 and outputs a YC signal S2 (image signal).

<< Effect in this embodiment >>
As described above, in the digital video camera 1, the parameter for image processing is selected based on the position information at the time of initial setting. That is, in the digital video camera 1, the photographer does not need to select an image processing method one by one. Since the image processing parameters selected by the CPU 20 correspond to the photographer's cultural sphere, it is possible to obtain an image processing result (YC signal S2) obtained by performing color reproduction that is considered preferable for the photographer. become. That is, according to the present embodiment, it is possible to provide an environment in which a preferable image processing result can be easily obtained without requiring a complicated operation from the photographer.

<< Modification of Embodiment 1 >>
<1> The initial position information may be stored in a nonvolatile storage medium. In this way, the initial position information can be restored when the photographer performs an unintended initial setting operation on the digital video camera 1 due to an erroneous operation. By protecting the initial position information in this way, it is possible to prevent selection of an incorrect image processing parameter, and the signal processing by the YC processing unit 13 results in an unfavorable image processing result. It becomes possible to avoid that.

  <2> A mechanism for manually setting the initial position information may be provided separately. This makes it possible for the photographer to reset the correct initial position information even when, for example, the initial position information set when the power is turned on is damaged at a remote location. Furthermore, an image that has been subjected to image processing preferable for the viewer by intentionally presenting the shooting result to viewers in other cultural areas and intentionally using the viewer's location information as initial location information. Can be presented.

  Further, in addition to the initial position information, a plurality of pieces of position information can be stored. When performing image processing, only necessary types of parameters for image processing corresponding to the position information stored in the YC processing unit 13 are used. Two or more types of image signals that have been notified and processed with different parameters may be stored. In this way, when there are a plurality of viewers other than the photographer, it is possible to provide a preferable image processing result (image signal) to each viewer. In addition, when two or more types of image processing results to be stored are, for example, still images, a file format that can handle a plurality of still images as a single file, such as a known multi-picture format (a standard proposed by CIPA). It may be put together.

  Also, instead of storing two or more types of image processing results, for example, one type of data with sufficiently high bit accuracy of the image data is stored, and the desired position information is obtained when the image is reproduced or moved. The processing may be performed again with the corresponding image processing parameter. Alternatively, the image data may be stored as raw data, the initial position information may be used as additional information, and the viewer may notify the device used for viewing, and image processing may be performed during playback. . This makes it possible to reduce the data size of the image stored in the digital video camera 1, so that a storage medium (for example, the SD card 40) for storing the image data can be used effectively. It becomes possible to do.

  <3> Instead of recording the map information on the SD card 40, a separate ROM or the like may be prepared in the digital video camera 1, and the map information may be recorded there. When the map information is recorded in the digital video camera 1, the map information may have rough accuracy. By doing so, the internal memory size to be used can be reduced and the increase in cost can be reduced. Further, even when the map information is stored in the SD card 40, the map information may be rough in order to reduce the storage capacity used.

  Further, the map information may be stored in both the digital video camera 1 and the SD card 40 which is an external recording medium. In such a case, rough digital map information is stored in the digital video camera 1, and the SD card 40, which is an external recording medium, stores a detailed map of the area that the photographer assumes in advance. If the information is stored, it is possible to reduce the storage capacity consumed by the map information while ensuring the accuracy of the necessary map information.

  <4> For example, when there are a plurality of language zones (a plurality of official languages) as in Canada, a plurality of languages may be selected. Further, in the case of being located in the middle of a plurality of language areas, it may be possible to select from a combination of languages of a plurality of language areas. This makes it possible to provide an environment that is easier for the photographer to use. In addition, an icon that can be intuitively determined without depending on the language is displayed on the OSD before language selection is performed, for example, an hourglass is displayed until initial setting such as acquisition of position information is completed. Thus, it becomes possible to reduce the photographer's stress due to the waiting time.

  <5> In the parameter table, patterns of all assumed regions may be held, or the parameters may be held discretely with respect to the reference position, so The parameters for image processing may be calculated from the position information and information on the reference positions of the parameters that are discretely held. For example, weighted addition according to the distance is suitable from the viewpoint of calculation cost and mounting. The reference positions may be held at regular intervals with respect to the map information, may be held only in areas with a large population, or may be held at intervals according to the density of the population.

<< Embodiment 2 of the Invention >>
Next, a digital video camera according to Embodiment 2 of the present invention will be described. The digital video camera according to the second embodiment has the first and second operation modes similarly to the digital video camera 1 according to the first embodiment. In the first operation mode, the digital video camera uses the external information in the digital video camera. This is different from the digital video camera 1 of the first embodiment in that imaging control is performed. Specifically, the digital video camera of the present embodiment estimates the type of artificial light source when it is estimated that an artificial light source is used for imaging, and controls imaging based on the estimation result. In this embodiment, the basic function for shooting is the same as that of the digital video camera of the first embodiment, so only the difference from the digital video camera 1 of the first embodiment will be described below.

  In the first operation mode, the CPU 20 of the present embodiment estimates the light source at the time of imaging, and based on the estimation result, the light emission of the strobe (auxiliary light emitting device), the exposure time, and the opening amount of the aperture of the lens 51 (aperture) Value), the operation mode of the image sensor 53, ISO sensitivity, and the like. The CPU 20 estimates the type of light source as follows. For example, in a situation where the GPS 81 cannot communicate with a positioning satellite indoors, position information cannot be obtained from the GPS 81. In such a case, it can be estimated that the photographer is present at a position such as indoors where the artificial light source is the dominant illumination light rather than the natural light. Artificial light sources tend to be biased by type, so if you know the shooting position, you can estimate the type of artificial light source more accurately and quickly than the method of estimating artificial light sources by measuring illumination light. become. Specifically, the CPU 20 of the present embodiment stores position information and date / time information at a predetermined interval, and at the time of imaging using the stored information, current position information and date / time information. Estimate the type of light source.

  For example, it is estimated that the GPS 81 cannot communicate with the positioning satellite and the photographer is present indoors or in a position where the artificial light source is the dominant illumination light rather than the natural light. If possible, the CPU 20 compares the time information immediately before the link with the positioning satellite is lost in the GPS 81 with the time information when the shooting is actually performed. As a result of the comparison, when the interval between the two pieces of time information is sufficiently wide, the CPU 20 measures the illumination light using the image sensor 53 or a device for measuring the illumination light color temperature, which is a known technique. If the interval between the two pieces of time information is sufficiently narrow, it can be estimated that the position immediately before the link with the positioning satellite is lost and the current position of the photographer are not far apart. Therefore, the CPU 20 performs light source estimation using position information immediately before the link with the positioning satellite is lost, together with light source estimation based on the imaging signal. In the light source estimation based on the imaging signal, for example, an achromatic portion of the subject is estimated, and image processing parameters are calculated so that the portion estimated to be an achromatic color becomes an achromatic color. In the light source estimation using the immediately preceding position information, the image processing parameters are calculated by performing the light source estimation based on the usage tendency of the artificial illumination in the area (position information). And when it image | photographed in the area | region which has the special color in the kind of artificial lighting used, the result of the light source estimation using the last positional information is preferentially employ | adopted. Specifically, signal processing is performed using image processing parameters weighted closer to the result of light source estimation using the immediately preceding position information. For example, it may be difficult to determine whether the subject is a red subject photographed under a fluorescent lamp or an achromatic subject photographed under an incandescent bulb, but it is difficult to determine the light source based on the image signal. A more preferable image signal can be obtained by weighting the light source estimation using the immediately preceding position information while performing the above. For example, if it is estimated that shooting was performed in an area with many incandescent bulbs (for example, the United States, etc.), the result of light source estimation using the immediately preceding position information is preferentially adopted, and the incandescent bulb is the light source. presume. Similarly, when it is estimated that shooting was performed in an area where electrification has not progressed, a light source such as a candle or a leak of natural light is estimated. As described above, in the present embodiment, it is possible to accurately and quickly obtain the light source estimation result.

  If the link with the positioning satellite is not lost, it can be estimated that the photographer is outdoors. In this case, the illumination light color temperature for natural light can be estimated by using time information at the time of photographing. For example, the illumination light is estimated according to the time zone such as sunrise, daytime, and sunset. If the time is clearly later than sunset, strobe light emission is recommended, the shutter speed is controlled to extend the exposure time of the image sensor 53, the aperture of the lens 51 is adjusted, A high-sensitivity shooting is performed by mixing and reading out the pixels of the image sensor 53, or a photographer can obtain a preferable shooting result by displaying on the LCD 41 with the OSD so as to increase the ISO sensitivity and notifying the photographer. To assist in controlling the exposure amount.

<< Effect in this embodiment >>
As described above, in the present embodiment, it is possible to efficiently estimate the type of artificial light source and the state of natural light at the time of shooting based on position information and date / time information. That is, in the digital video camera of this embodiment, more optimal imaging control is performed in various imaging scenes (in this example, the type of artificial light source and the state of natural light at the time of shooting). Therefore, according to the present embodiment, it is possible to provide an environment for easily obtaining a preferable image processing result without requiring a complicated operation from the photographer.

<< Modification of Embodiment 2 >>
<1> In the second embodiment, there are two estimation methods (estimation by region and image) depending on the interval between two pieces of time information: time information immediately before the link with the positioning satellite is lost and time information actually taken. (Estimation (measurement)) using the sensor 53 or the like is switched. However, estimation may be performed by both methods, and estimation may be performed by weighting each estimation result according to the two time intervals.

  <2> When it is estimated that the light source is a fluorescent lamp, the frequency of the commercial power source may be estimated in order to perform flicker correction. For example, if it is estimated from the position information whether the commercial power source is a 50 Hz zone or a 60 Hz zone, the exposure time of the image sensor 53 is controlled for the 50 Hz zone or the control for the 60 Hz zone. It becomes possible to switch easily.

  <3> The CPU 20 may control the digital video camera according to the distance between the position information immediately before the link with the positioning satellite is lost and the position information with which the link with the positioning satellite can be established again. . For example, if the two distances are sufficiently far apart and movement using an aircraft is estimated, the photoelectric conversion unit of the image sensor 53 (due to the influence of α rays due to the presence of a digital video camera at a high altitude. Pixel) may be destroyed. In view of this, it is possible to detect and register the defective pixel of the image sensor 53 at the time when the link with the positioning satellite is established again, and to correct the defective pixel at the time of image processing at the time of photographing.

<< Embodiment 3 of the Invention >>
Next, a digital video camera according to Embodiment 3 will be described. The digital video camera according to the third embodiment is different from the digital video camera 1 according to the first embodiment in that the digital video camera according to the third embodiment has no means for acquiring position information obtained by positioning such as GPS81. Note that the first and second operation modes are provided in the same manner as the digital video camera 1 of the first embodiment, and the basic functions for performing shooting are the same as those of the digital video camera of the first embodiment. Below, it demonstrates focusing on the difference with the digital video camera 1. FIG.

  In the present embodiment, the GPS 81 is not connected to the external information interface 70, but instead, information read from a recognition tag mounted on a battery (not shown) of the digital video camera is communicated. Yes. The CPU 20 acquires the information of the recognition tag via the external information interface 70 and sets the initial position information. The identification tag mounted on the battery is pre-embedded with information on the area where the battery is sold, in addition to the identification information of the battery solid, and when the photographer wears (replaces) the battery at the time of shooting, the battery The external information interface 70 acquires information on the area where the product is sold and notifies the CPU 20 of the information. In the first operation mode, the CPU 20 selects an image processing parameter corresponding to the corresponding area from the parameter table and notifies the YC processing unit 13 of the image processing parameter, and the YC processing unit 13 is based on the parameter. Perform image processing.

<< Effect in this embodiment >>
As described above, in this embodiment, there is no means for updating the position information at the time of shooting in real time, but it is possible to obtain a processing result preferable for the photographer based on the information of the recognition tag provided in the battery. become. That is, according to the present embodiment, it is possible to provide an environment in which a preferable image processing result can be easily obtained without costing positioning and without requiring a complicated operation from the photographer.

<< Modification of Embodiment 3 >>
<1> In addition to the identification tag attached to the battery, for example, when an information tag is provided on an external light source such as a lens or a flash, which are various devices connected to the digital video camera, The position information may be acquired using the information of the information tag. Further, when a plurality of areas are detected, the largest number may be used as position information at the time of initial setting. Furthermore, the information may be acquired from a personal computer or the like instead of a device directly connected at the time of shooting.

  <2> The position information is acquired at the time of initial setting, and the current shooting position is estimated by a commercial power source connected when the battery is charged (for example, when an external power source is connected to the digital video camera). It may be. In this case, the information of the battery recognition tag is provided with a storage area that is updated each time it is charged, and the type of commercial power source to be connected is determined, and this information is updated each time it is charged. Write to the storage area. Then, when the battery is connected to the digital video camera, the external information interface 70 notifies the CPU 20 of information from the storage area that is updated each time the battery is charged together with the position information at the time of initial setting. deep. Further, the CPU 20 estimates position information from the commercial power source, selects a parameter for image processing that is preferable for the photographer from the estimated position information, and notifies the YC processing unit 13 of the selected parameter as a control signal. Note that the CPU 20 may be configured to estimate shooting conditions such as illumination of a subject based on information obtained from a storage area that is updated each time the battery is charged.

<< Embodiment 4 of the Invention >>
Next, a digital video camera according to Embodiment 4 will be described. The digital video camera of the fourth embodiment is different from the digital video camera 1 of the first embodiment in that the digital video camera is incorporated as part of the function of the mobile phone. Similarly to the digital video camera 1 of the first embodiment, the digital video camera of the present embodiment also has the first and second operation modes, and the functions for performing shooting are the same as those of the digital video camera 1, and therefore the following differences will be described. Only the explanation will be given.

  In the present embodiment, the external information interface 70 is inputted with information that the mobile phone communicates with the base station. In general, information indicating a position is included in information communicated with a base station. The CPU 20 of this embodiment confirms the photographer's position information through the external information interface 70. For example, the position information at the time of shooting is acquired using the position information of the base station notified from the base station indoors. In particular, when communication with the base is realized by an indoor repeater or the like, the operation of the digital video camera is switched to the processing for indoor shooting as shown in the second embodiment.

<< Effect in this embodiment >>
As described above, in this embodiment, position information can be obtained without providing a means for detecting position information in the digital video camera, and a processing result preferable for the photographer can be obtained. That is, according to the present embodiment, it is possible to provide an environment in which a preferable image processing result can be easily obtained without costing positioning and without requiring a complicated operation from the photographer.

<< Modification of Embodiment 4 >>
<1> If the information obtained from the mobile phone is from an indoor repeater, the installed facility may be identifiable, so the light source frequently used in the facility is used as the illumination light of the subject. May be estimated. Further, if it is in a facility, the CPU 20 may perform control so that photographing cannot be performed in a specific area, or the compression rate when the compression processing unit 14 compresses image data is extremely increased. In this way, it is possible to intentionally obtain a photographing result that makes it difficult for the subject to be recognized. Moreover, the form which controls the light emission control of an external light-emitting device and the volume of a shutter sound in the specific area in a facility may be sufficient.

  <2> Further, imaging control and signal processing control may be performed using information obtained by connecting to the Internet via the base station. For example, when it can be estimated that a certain subject can be photographed, the information may be displayed on the LCD 41 as an OSD, or the photographing timing may be notified. In particular, when the timing at which a subject is ready for shooting is known in advance, not only shooting timing notification but also shooting at that timing or periodic shooting from a certain period before that timing It is also possible to take a picture or to take a picture by recognizing the subject. When controlling the degree of focus of the lens 51 in accordance with the recognition of the subject, only a result of detection of the high-frequency component obtained from the imaging signal S1, or a rough result obtained from the photographer's position and the rough position of the subject. The focal length of the lens 51 may be controlled by combining the distance and the detection result. By doing so, the focal length of the lens 51 can be quickly and accurately performed.

  <3> When shooting a still image, the shooting interval is often large. Therefore, it is possible to take a video and video, and the photographer extracts a desired frame from the video data of the shooting result. Alternatively, a still image with improved resolution may be obtained using moving image data before and after a desired frame of moving image data. Furthermore, not only the shooting timing but also a mode in which image processing is performed by notifying the digital video camera of shooting parameters when other shooting is performed in advance through communication with the base station. By doing so, it is possible to obtain a more preferable shooting result even if the photographer does not have high technology or knowledge regarding shooting.

  <4> Also, the information communicated from the base station is combined with the information of the clock 80 for acquiring the date and time information and the GPS 81 for acquiring the position information to control the imaging of the digital video camera. May be. For example, when the weather information is notified through the base station, the light source of the subject may be estimated based on the notified weather information such as clear sky, cloudy weather, and rainy weather. In particular, when the shooting location can be estimated as a summer beach, a snowy mountain in winter, etc. from position information, time information, date information (calendar function of the clock 80), weather information, etc., the amount of light incident on the image sensor 53 is reduced. It may be a form that adjusts the control. Further, if the temperature information is greatly different from the temperature information when the scratch is registered in the image sensor 53 based on the temperature information obtained from the weather information or the like, the scratch information of the image sensor 53 is registered again. You may keep it. By doing so, it becomes possible to deal with scratches, noise degradation, and the like of the image sensor 53 that become prominent at high temperatures. Further, the intensity of noise reduction image processing for noise reduction (specifically, setting of image processing parameters) provided in the YC processing unit 13 may be changed according to temperature information. Good.

  <5> Also, by setting the shooting location in the digital video camera in advance, when the photographer is located at the shooting location, shooting may be started automatically, or as a reminder to the photographer. You may make it notify that it is a point of imaging | photography. Furthermore, in combination with pre-registered shooting location and information such as weather forecasts, lenses and optical filters, which are equipment necessary for shooting to obtain more favorable shooting results, are provided to the photographer in advance. It may be in the form of notification.

  <6> In addition, a gyro (not shown) used for optical camera shake correction may be combined with position information and time information. For example, when shooting the sky, the angle of view is cleared by the gyro. It is possible to determine whether the subject is facing or shooting a ground subject such as a person. In addition, if the time and position are known, it is possible to determine whether the sunset, blue sky, or night sky. For example, image processing that retains the red color of the sunset or the blue color of the blue sky in image processing, for example. It may be realized. For example, when shooting the night sky, information such as a constellation may be notified to the photographer from information notified from the base station, or the exposure method of the digital video camera may be switched to long exposure. In particular, when the exposure method is switched to long exposure, accumulation of dark current components and scratches on the image sensor 53 become prominent. Therefore, data for correcting the scratches on the image sensor 53 is generated, and the image It may be in the form used for processing. Specifically, the data for correcting the dark current component and the flaws of the image sensor 53 can be taken for a long time with the shutter closed to correct the dark current component before or after the long exposure shooting. It is advisable to obtain and generate the data you have done. Moreover, you may estimate whether the imaging | photography object is a tree, the ratio for which an artificial building accounts, etc.

<< Embodiment 5 of the Invention >>
Next, a digital video camera according to Embodiment 5 will be described. The digital video camera of the present embodiment is different in position information acquisition timing from the above-described embodiments and modifications. However, the digital video camera according to the present embodiment also has the first and second operation modes like the digital video camera 1 according to the first embodiment, and the basic functions for performing shooting are the same as those of the digital video camera 1 and the like. . In other words, in the first operation mode, the CPU 20 performs operation control of the digital video camera in addition to image processing parameter setting based on information obtained from the external information interface 70. Specifically, the external information interface 70 is connected to a clock 80 for acquiring date / time information and a GPS 81 for acquiring position information, and the date / time information and position information are communicated to the CPU 20. . Further, like the digital video camera of the fourth embodiment, it has means for communicating with the base station, and the external information interface 70 is notified of information communicated with the base station. In the first operation mode, the CPU 20 performs parameter setting and operation control for image processing using information communicated with the base station. That is, the CPU 20 generates a control signal so that the digital video camera performs an operation corresponding to information obtained by communication with the base station.

  Next, position information acquisition timing, which is a feature of the present embodiment, will be described. In the present embodiment, the external information interface 70 acquires position information at the time of shooting not at the timing of pressing the shutter at the time of shooting but at the timing set by the photographer in advance. Positioning means such as GPS81 have a complicated calculation for measuring the actual position. Therefore, GPS81 mounted on the digital video camera has its information in real time for energy saving operation for performance deficiency and battery remaining protection. The case where it is difficult to acquire is assumed. Therefore, in the present embodiment, the external information interface 70 periodically acquires position information at a timing preset by the photographer and notifies the CPU 20 of the position information, and the CPU 20 periodically acquires the external information in the first operation mode. Based on the position information notified from the interface 70, image processing and operation control are performed.

<< Effect in this embodiment >>
As described above, according to the present embodiment, the position information at the time of shooting is not updated in real time, so that it is possible to reduce battery consumption. Also, image processing and operation control based on position information can be performed even when positioning cannot be performed in real time at the time of shooting due to insufficient performance of the GPS 81.

<< Modification of Embodiment 5 >>
The position information acquisition cycle may be constant. For example, the frequency of shooting is counted, and when the number of shooting times per unit time exceeds a predetermined number, the cycle of acquiring position information is shortened. When the number of photographings per unit time is less than a predetermined number, the period for acquiring the position information may be extended up to the period preset by the photographer.

Embodiment 6 of the Invention
Next, a digital video camera according to Embodiment 6 will be described. The digital video camera of Embodiment 6 differs from the above-described embodiments and modification examples in the position information acquisition timing at the time of shooting. Note that the digital video camera of the present embodiment also has the first and second operation modes like the digital video camera 1 of the first embodiment, and the basic functions for performing shooting are the digital video camera of the first embodiment and the like. It is the same. Also in this embodiment, in the first operation mode, the CPU 20 performs operation control of the digital video camera in addition to image processing parameter setting based on information obtained from the external information interface 70. Further, like the digital video camera of the fourth embodiment, it has means for communicating with a predetermined base station, and performs image processing parameter setting and operation control using information communicated with the base station. Specifically, also in this embodiment, the external information interface 70 is connected to a clock 80 for acquiring date / time information and a GPS 81 for acquiring position information. Communicating with the CPU 20. Further, the external information interface 70 is notified of information communicated with the base station, and the CPU 20 generates a control signal so that the digital video camera performs an operation corresponding to the information obtained by communication with the base station. .

  Next, position information acquisition timing, which is a feature of the present embodiment, will be described. In the present embodiment, acquisition of position information at the time of shooting is performed not when the shutter is pressed at the time of shooting but when the result shot by the digital video camera is played back. Specifically, the CPU 20 performs optimal color reproduction, γ correction, and the like of the reproduced image according to the reproduction location (for example, outdoors or indoors) notified from the external information interface 70. For example, if there is a light source with strong redness in the environment at the time of reproduction, if nothing is taken care of, the reproduced image will be viewed in a reddish state, so that preferable color reproduction is performed I can't say that. In such a case, the viewer will feel uncomfortable with the reproduced image. Therefore, at the time of reproduction, the CPU 20 communicates a control signal for instructing the digital signal processing circuit 10 to change the image processing parameter so as to reproduce an image that weakens red.

<< Effect in this embodiment >>
As described above, in the present embodiment, the parameter for image processing corresponding to the reproduction location is selected when the image is reproduced. Therefore, the digital video camera according to the present embodiment can realize more preferable color reproduction. That is, in the present embodiment, it is possible to perform optimal color reproduction of a reproduced image according to the photographing environment without requiring a complicated operation even during reproduction or delivery of a photographing result.

<< Modification of Embodiment 6 >>
<1> Note that, even during playback, the shooting function of the digital video camera may be driven to capture captured image data in the playback environment, and may be used as an aid for determining the state of illumination light in the playback environment. Good.

  <2> When reproducing a result captured by another imaging apparatus, a color space profile (for example, AdobeRGB or sRGB) for color reproduction of the other imaging apparatus is notified to the CPU 20 in advance. It is preferable that In this case, the CPU 20 may perform more preferable color reproduction by combining the determination of the illumination light situation in the reproduction environment obtained from the position information at the time of reproduction based on the profile.

  <3> When a display device (external display device) other than the LCD 41 is connected during playback, a color space profile (for example, AdobeRGB or sRGB) for color reproduction of the external display device is notified. Is preferred.

  <4> The position information may be acquired when moving or copying the imaging data recorded in the digital video camera to another recording medium. This is because when the captured data is transferred to a third party observer, the captured data can be moved or copied so that the captured result can be reproduced as a more preferable color reproduction for the third party observer. The image is processed again based on the position information at the time. It is also possible to add a conversion table for color conversion, a color space profile, or the like to the data to be moved (or copied) without performing image processing again.

  INDUSTRIAL APPLICABILITY The present invention has an effect that it is possible to select a more optimal image processing method without requiring a complicated operation from a photographer, and is useful as an imaging system that captures moving images and still images. .

1 Digital video camera (imaging system)
10 Digital signal processing circuit (signal processing unit)
20 CPU (control unit)
53 Image sensor (Solid-state imaging device)
70 External information interface (information acquisition unit)
80 Clock 81 GPS (Global Positioning System)
S1 imaging signal S2 YC signal (image signal)
S4 Information for estimation

Claims (8)

In an imaging system having a solid-state imaging device that outputs light incident from a subject as an imaging signal,
A signal processing unit that generates an image signal obtained by performing signal processing on the imaging signal;
An information acquisition unit for acquiring information for estimation for estimating the imaging scene;
With
An imaging system, wherein the imaging scene is estimated using the estimation information, and at least one of imaging control and signal processing control in the signal processing unit is performed according to the estimated imaging scene. The imaging system of claim 1.
A controller that analyzes the estimation information and generates a control signal for controlling the operation of the signal processor;
The image processing apparatus, wherein the signal processing unit selects the image processing method according to the control signal. The imaging system according to claim 1 or 2,
The estimation system is at least one of position information, date / time information, weather information, and temperature information. The imaging system according to claim 1 or 2,
The control unit includes an imaging power source, a time when the estimation information is notified from the outside of the imaging system, a predetermined periodic interval, a time when the power supplied to the imaging system is replaced, and an external power source for the imaging system. The estimation information is reflected in the imaging system at at least one of the timing when the image data is connected, the time when the imaging data is reproduced, and the time when the imaging data is moved outside the imaging system. Imaging system. The imaging system according to claim 1 or 2,
The imaging control includes a driving method of the solid-state imaging device, detection of defective pixels on the solid-state imaging device, correction of the defective pixels, exposure amount, ISO sensitivity, shutter speed, lens aperture value, and light emission of the auxiliary light emitting device. Lens focusing, dark current level estimation, dark current component correction, illumination light color temperature estimation, illumination light color temperature correction, parameter image signal generation processing for image processing used by the signal processing unit The imaging is characterized by at least one of a parameter, a parameter for noise reduction of the image signal, shooting timing, number of shooting, subject recognition, saving of imaging data, and compression rate when saving imaging data system. The imaging system according to claim 1 or 2,
The imaging system is characterized in that the image signal is at least one of a luminance signal, a color difference signal, a color signal, and a level output corresponding to light incident on the solid-state imaging device. In any one imaging system in Claim 1-6,
The control unit includes a first operation mode in which the control is performed using the estimation information, and a second operation mode in which the control is performed without using the estimation information. And the second operation mode can be switched. The imaging system according to any one of claims 1 to 7,
The information acquisition unit obtains the estimation information from at least one of a global positioning system, a clock, a calendar, the Internet, and a communication destination base station.

Images