JP2012156884A - Control device and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control device which remotely controls an imaging device and reduces a load on dust removal by effectively confirming effect of the dust removal by combination of a plurality of images only from an image file by using the plurality of pieces of dust correction data which are separately recorded in the image during photographing.SOLUTION: In a camera adding first dust correction data as information when a photographed image is photographed in the imaging device holding dust correction data detected by photographing white paper as first dust position information, remaining dust position information is acquired by scanning again the image after dust is removed from the image by the first dust correction data in PC as second dust correction data. When the second dust correction data is input to the camera, the first and second dust correction data are added to the image.

Description

  The present invention relates to a technique for suppressing image quality deterioration due to foreign matter adhering to the surface of an optical low-pass filter or the like in an imaging apparatus using an imaging element such as a CCD or CMOS sensor.

  2. Description of the Related Art In recent years, many image pickup apparatuses that generate image signals using an image pickup device such as a CCD and record the data as data, such as digital cameras and digital video cameras, have come into circulation. In a digital camera, a photosensitive film that has been used as a conventional recording medium is no longer necessary, and instead of this, a data image is recorded on a data recording medium such as a semiconductor memory card or a hard disk device. Since these data recording media can be written and erased any number of times unlike films, the cost for consumables can be reduced, which is very convenient.

  Usually, a digital camera is equipped with an LCD (Liquid Crystal Display) monitor device capable of displaying captured images at any time and a detachable mass storage device.

  Using a digital camera equipped with these two devices not only eliminates the need for a film as a recording medium that has been used as a consumable item in the past, but also allows the captured image to be displayed on the LCD monitor device and immediately confirmed on the spot. . Therefore, unsatisfactory image data can be erased on the spot or re-photographed as needed, and the efficiency of photography is dramatically increased compared to film cameras using film. I can say.

  Due to such convenience and technological innovations such as an increase in the number of pixels in the image sensor, the range of use of digital cameras has been expanded. In recent years, there are many digital cameras capable of exchanging lenses, such as single-lens reflex cameras.

  However, in a digital camera, foreign matter such as dust or dust is present on the surface of an image sensor protective glass, an optical filter or the like disposed on the imaging optical axis in front of the image sensor or on an optical system (hereinafter collectively referred to as an image sensor optical system component). (Hereafter, simply dust) may adhere. When dust adheres to the image sensor optical system component in this way, there is a problem that the quality of the photographed image is deteriorated, for example, light is blocked by the dust and the portion is not photographed.

  Therefore, the photographer must always pay attention to the adhesion of dust to the image sensor optical system parts, and has spent a lot of labor on checking and cleaning the dust. In particular, since the image sensor is disposed at a relatively deep location inside the camera, it is not easy to clean or check for dust.

  In addition, with interchangeable lens digital cameras, not only dust can be easily infiltrated by attaching and detaching the lens, but many of the interchangeable lens digital cameras have a focal plane shutter immediately in front of the image sensor. Garbage easily adheres to the top.

  Such dust usually adheres not to the surface of the image sensor, but also to protective glass and optical filters, so the image formation state depends on the aperture value of the photographic lens and the distance from the photographic lens pupil to the imaging surface. Is different. That is, if the aperture is close to the open value, the image is blurred, and even if small dust is attached, there is almost no effect. However, if the aperture value is increased, the image is clearly formed and the image is affected.

  Therefore, there is a method to make dust inconspicuous by taking a picture of a white wall etc. with the lens aperture closed and preparing an image showing only dust on the image sensor in combination with a normal shot image. It is known (see Patent Document 1). However, with this method, it is necessary to always be aware of the association between the image captured for dust detection and the actual captured image group associated therewith, which is cumbersome.

  Therefore, it is conceivable to capture a dust position by photographing a white wall or the like and hold it on a digital camera, and attach a list of dust positions and sizes to image data at the time of normal photographing. For example, by using a separately prepared image processing apparatus, the dust position on the photographed data is analyzed from the attached dust position, and the analyzed area is interpolated with surrounding pixels, thereby making it less noticeable.

  However, it is difficult to make all the dust reflected on the image inconspicuous by such processing. This is because when the position of dust is acquired by photographing a white wall or the like with a digital camera, the acquisition of the position of dust may fail due to the influence of peripheral dimming. In this case, since the dust is not registered in the list of dust positions and sizes, the dust cannot be made inconspicuous in the analysis and interpolation processing using the image processing apparatus described above.

  As described above, the dust that has not been registered in the dust list cannot be made inconspicuous in the image processing using the dust list as described above. Therefore, a method is known in which such dust is inconspicuous when the user designates the position of the dust on the photographed image with his / her hand and performs a repair process or the like (see Patent Document 2). According to this, it is possible to additionally register a list of dust positions and sizes as file information or information in the camera. However, when there are a plurality of photographed images, the user uses a list to perform repair processing on all images, so it is necessary to always apply a file, and the user load There is a problem that becomes large. Further, a similar problem occurs when a list is held as information in the camera.

JP 2004-222231 A JP 2008-244867 A

  The present invention has been made in view of the above-described problems, and the object thereof is a control device that remotely controls an imaging device, even when dust adheres to protective glass, a filter, or the like disposed in front of the imaging device. It is to be able to efficiently suppress the influence on the photographed image.

  In order to solve the above-described problems, a control device according to the present invention is an imaging device that holds dust correction data detected by shooting a blank sheet as first dust position information, and at the time of shooting a captured image. In the camera to which the first dust correction data is added as information, as the second dust correction data, the PC removes dust from the image with the first dust correction data, and then scans the image again, and the remaining dust positions When the information is acquired and the second dust correction data is input to the camera, the first and second dust correction data are added to the image.

  According to the present invention, even when dust adheres to protective glass, a filter, or the like disposed in front of the image sensor, it is possible to efficiently suppress the influence on the captured image.

It is a figure which shows an example of the control system which concerns on Embodiment 1 to 3 of this invention. It is a block diagram which shows an example of schematic structure of the control system which concerns on Embodiment 1 to 3 of this invention. 6 is a flowchart illustrating an example of processing performed by the imaging device according to the first to third embodiments of the present invention. 6 is a flowchart illustrating an example of processing performed by the imaging device according to the first to third embodiments of the present invention. 6 is a flowchart illustrating an example of processing performed by the imaging device according to the first to third embodiments of the present invention. It is a figure which shows an example of the dust correction data (400) which concerns on Embodiments 1-3 of this invention, and additional dust correction data (400). It is a figure which shows an example of the dust correction data (410) which concerns on Embodiments 1-3 of this invention, and additional dust correction data (410). It is a flowchart which shows an example of the process performed with the control apparatus which concerns on Embodiment 1 to 3 of this invention. It is a flowchart which shows an example of the process performed with the control apparatus which concerns on Embodiment 1 to 3 of this invention. It is a flowchart which shows an example of the process performed with the control apparatus which concerns on Embodiment 1 to 3 of this invention. It is a figure which shows an example of the camera control screen (500) which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the camera control screen (500) which concerns on Embodiment 3 of this invention. It is a figure which shows an example of the transmission command (700) which concerns on Embodiment 1 to 3 of this invention. It is a flowchart which shows an example of the registration process of the additional dust correction data (400) performed with the control apparatus which concerns on Embodiments 1-3 of this invention, and an imaging device. It is a flowchart which shows an example of the registration process of the additional dust correction data (400) performed with the control apparatus which concerns on Embodiments 1-3 of this invention, and an imaging device. It is a flowchart which shows an example of the registration process of the additional dust correction data (400) performed with the control apparatus which concerns on Embodiments 1-3 of this invention, and an imaging device.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[Example 1]
FIG. 1 is a diagram illustrating an example of a schematic configuration of a remote control system according to Embodiment 1 of the present invention. FIG. 2 is a block diagram illustrating an example of a remote control system according to the first embodiment of the present invention.

  The communication system according to the first embodiment includes a control device (100), an interface (300), and an imaging device (200) as shown in FIGS. The control device (100) and the imaging device (200) are connected via an interface (300). As an example of the interface (300), a USB (Universal Serial Bus) connection cable is used. Hereinafter, the connection cable will be described as “USB cable”.

  Next, an example of the configuration of the PC (100) will be described.

  As shown in FIG. 2, the PC (100) includes a CPU (Central Processing Unit) (101), a memory (102), a communication unit (104), a display unit (105), and an operation unit (106).

  The display unit (105) includes a display such as a liquid crystal display. The display unit (105) can display video data supplied from at least one of the memory (102) and the communication unit (104). The display unit (105) can also display a menu screen that is a graphical user interface stored in the memory (102). The menu screen is a PC control screen for controlling the PC (100), a PC setting screen for changing settings of the PC (100), or a camera control screen (500) for controlling the imaging device (200). Etc.

  When these menu screens are displayed on the display unit (105), the CPU (201) superimposes and displays a mouse cursor (arrow-shaped icon) (600) on the menu screen.

  The display unit (105) displays the video data supplied from the communication unit (104) in a predetermined area of the camera control screen (500) supplied from the CPU (101). The camera control screen (500) will be described later.

  The operation unit (106) is a user interface for operating the PC (100). The operation unit (106) includes a mouse (106a), a pointing device such as a tablet, a trackball, and a keyboard (106b) as operation means for operating the PC (100). When the user operates these pointing devices, the mouse cursor (600) superimposed on the menu screen can be operated on the menu screen.

  On the menu screen, the mouse cursor (600) moves on the menu screen according to the position information of the pointing device, and when the pointing device is pressed, the mouse cursor (600) performs processing according to the detected area. .

  Next, an example of the configuration of the imaging device (200) will be described.

  As shown in FIG. 2, the imaging apparatus (200) includes a CPU (201), a memory (202), a recording unit (203), a communication unit (204), an image processing unit (205), a display unit (206), an operation Part (207) and an imaging part (208).

  The imaging device (200) has operation modes such as a shooting mode, a reproduction mode, a dust detection mode, and a dust correction data registration mode. When the operation mode of the imaging apparatus (200) is the shooting mode, the imaging apparatus (200) can shoot a subject and records the captured video (either a moving image or a still image) on a recording medium. be able to. When the operation mode of the imaging device (200) is the playback mode, the video (either a moving image or a still image) selected by the user can be played from the recording medium. When the operation mode of the imaging apparatus (200) is the dust detection mode, the imaging apparatus (200) captures a still image, detects dust correction data (400) from the image, and stores dust correction data (400) in the memory (202). 400). When the operation mode of the imaging apparatus (200) is the dust correction data registration mode, the imaging apparatus (200) acquires the dust correction data (400) transferred from the PC (100) via the USB cable (300). The additional dust correction data (400) is recorded in the memory (202).

  The dust correction data (400) and the additional dust correction data (400) will be described later with reference to FIGS. 4 (a) and 4 (b).

  The information stored in the memory (202) includes a computer program for controlling the imaging device (200), predetermined image data and icons displayed on the display unit (206), dust correction data (400), and additional dust correction data. (400) etc.

  When the operation mode of the imaging apparatus (200) is the shooting mode, the imaging unit (208) captures a subject and generates video data from the optical image of the subject. At this time, if dust correction data (400) and additional dust correction data (400) are recorded in the memory (202), dust correction data (400) and additional dust correction data (400) are stored in the MakerNote of the video data. Record. The video data generated by the imaging unit (208) is supplied to the communication unit (204), the image processing unit (205), and the display unit (206). Audio data generated by a microphone unit (not shown) is also supplied to the recording unit (203) and the communication unit (204).

  Further, when the operation mode of the imaging device (200) is the shooting mode, the recording unit (203) generates video data that has been subjected to various image processing by the image processing unit (205) and a microphone unit (not shown). The recorded audio data can be recorded on a recording medium. At this time, if dust correction data (400) and additional dust correction data (400) are recorded in the memory (202), dust correction data (400) and additional dust correction data (400) are stored in the MakerNote of the video data. Record.

  In addition, when the operation mode of the imaging apparatus (200) is the reproduction mode, the recording unit (203) can reproduce the video data and audio data selected by the user from the recording medium. The video data reproduced from the recording medium is supplied to the display unit (206) and the communication unit (204). On the other hand, the audio data reproduced from the recording medium is supplied to the communication unit (204) and a speaker unit (not shown).

  The display unit (206) is configured by a liquid crystal display or the like. When the operation mode of the imaging device (200) is the shooting mode, the display unit (206) displays the video data generated by the imaging unit (208). When the operation mode of the imaging apparatus (200) is the reproduction mode, the display unit (206) displays the video data reproduced from the recording medium by the recording unit (203).

  The operation unit (207) is a user interface for operating the imaging device (200), and includes a plurality of buttons for operating the imaging device (200). An instruction from the user is input to the CPU (201) via the operation unit (207). Each button in the operation unit (207) includes a switch, a touch panel, and the like.

  The operation unit (207) includes a shutter button, a power button, a start / stop button, a mode change button, a menu button, a cross button, a SET button, and the like.

  The shutter button has two states, S1 in which the shutter button is half-pressed and S2 in which the shutter button is fully pressed. When the operation mode of the imaging device (200) is the shooting mode, the CPU (201) instructs the imaging unit (208) to start a series of shooting processing operations when the shutter button is in the state of S2 when the shutter button is pressed. To do. An imaging process performed by the imaging unit (208) when the shutter button is in the state of S2 will be described later.

  The start / stop button is a button for instructing the CPU (201) to start or pause recording of video data generated by the imaging unit (208) on a recording medium. The mode change button is a button for instructing the CPU (201) to change the operation mode of the imaging apparatus (200) to any one of a shooting mode, a reproduction mode, a dust detection mode, a dust correction data registration mode, and the like.

  The menu button is a button for instructing the CPU (201) to display or hide the menu screen of the imaging apparatus (200). The menu screen of the imaging apparatus (200) includes a menu screen for controlling the imaging apparatus (200) and a menu screen for changing settings of the imaging apparatus (200). These menu screens are stored in the memory (202).

  The operation unit (207) includes a play button, a stop button, a pause button, a fast forward button, a rewind button, and the like. These buttons instruct the CPU (201) to execute play (play), stop (stop), pause (pauSe), fast forward (fast forward), and rewind (rewind) of the video data recorded on the recording medium. It is a button to do.

  Next, the photographing process will be described.

  The photographing process is a process performed by a normal camera when the shutter button of the image pickup apparatus (200) is fully pressed to enter the state of S2.

  In this processing, analog data output from the image sensor is converted into digital data by the A / D converter, and then compressed by the image processor (205), and the image data is written to the recording unit (203). At this time, during normal shooting, the dust correction data (400) and additional dust correction data (400) shown in FIG. 5 are associated with the image data together with the camera setting values at the time of shooting, and the image data is written to the recording unit (203). . At the time of dust detection, the dust shown in FIG. 5 is detected from the image data obtained by photographing, and is written in the memory (202) as dust correction data (400).

  Next, processing performed by the imaging apparatus (200) according to the first embodiment will be described with reference to FIGS. 1, 2, and 3A. FIG. 3 is a flowchart illustrating an example of imaging processing performed by the imaging apparatus (200) according to the first embodiment.

  3 is performed when the PC (100) and the imaging device (200) are connected via the USB cable (300), and the PC (100) and the imaging device (200) are in a power-on state. It is a process to be executed. The process shown in the flowchart of FIG. 3 is controlled by the CPU (201) executing a computer program stored in the memory (202).

  In step S101, when the operation mode of the imaging apparatus (200) is set to the shooting mode by the operation unit (207), the CPU (201) causes the communication unit (204) to generate an operation mode signal indicating the shooting mode, and the USB (USB). An instruction is sent to the communication unit (104) of the PC (100) via the cable (300). In this case, the flowchart proceeds from step S101 to step S102.

  In step S102, the CPU (201) determines whether or not the communication unit (204) has received a shooting preparation command. When the CPU (201) determines that the shooting preparation command has been received, the CPU (201) sets a shooting preparation flag in the memory (202). In this case, the flowchart proceeds from step S102 to step S103. When the CPU (201) determines that the photographing preparation command has not been received, the flowchart returns from step S102 to step S102.

  In step S103, the CPU (201) instructs the imaging unit (208) to execute shooting preparation processing. When the shooting preparation process is performed, the flowchart proceeds from step S103 to step S104.

  In step S104, the CPU (201) determines whether or not the communication unit (204) has received a shooting command from the PC (100). When the CPU (201) determines that the communication unit (204) has received the shooting command, the CPU (201) sets a shooting flag in the memory (202). In this case, the flowchart proceeds from step S104 to step S105. When the CPU (201) determines that the communication unit (204) has not received the shooting command, the CPU (201) resets the shooting preparation flag in the memory (202). In this case, the flowchart returns from step S104 to step S102.

In step S <b> 105, the CPU (201) instructs the imaging unit (208) to execute shooting processing. If dust correction data (400) or additional dust correction data (400) is recorded in the memory (202), the dust correction data (400) and additional dust correction data shown in FIG. (400) is associated with the image data, and the image data is written in the recording unit (203).
When the photographing process is performed, the CPU (201) resets the photographing preparation flag and the photographing flag in the memory (202). In this case, the flowchart proceeds from step S105 to step S106.

  In step S106, after the photographing process is completed, the CPU (201) instructs the communication unit (204) to generate a preparation completion signal indicating that the preparation for transmission of the image data is completed and to transmit it to the PC (100). Put out. After the preparation completion signal is transmitted to the PC (100), the CPU (201) reads the image data from the recording unit (203), and instructs the communication unit to transmit the read image data to the PC. In this case, the process of the imaging device (200) performed in this flowchart is completed.

  Next, processing performed by the imaging apparatus (200) according to the first embodiment will be described with reference to FIGS. 1, 2, and 3B. FIG. 3 is a flowchart illustrating an example of dust detection processing performed by the imaging apparatus (200) according to the first embodiment.

  In step S107, when the operation mode of the imaging apparatus (200) is set to the dust detection mode by the operation unit (207), the CPU (201) causes the communication unit (204) to generate an operation mode signal indicating the dust detection mode. Instruct to transmit to the communication unit (104) of the PC (100) via the USB cable (300). In this case, the flowchart proceeds from step S107 to step S104.

  In step S104, the CPU (201) determines whether or not the communication unit (204) has received a shooting command from the PC (100). When the CPU (201) determines that the communication unit (204) has received the shooting command, the CPU (201) sets a shooting flag in the memory (202). In this case, the flowchart proceeds from step S104 to step S108.

  In step S <b> 108, after the dust acquisition process is completed, the CPU (201) instructs the communication unit (204) to generate a dust acquisition completion signal indicating that the dust acquisition process has been completed and to transmit it to the PC (100). Put out. In this case, the process of the imaging device (200) performed in this flowchart is completed.

  Next, the dust acquisition process performed in step S108 will be described. This dust detection process is a process for detecting the position, size, etc. of the shadow of dust attached to the surface of an optical member (not shown) disposed in front of an image sensor (not shown) that is reflected in the image. The dust detection process is performed by capturing a dust detection image. When performing dust detection processing, a camera is installed with a photographing optical axis of a lens (not shown) directed to a surface having a uniform color, such as an emission surface of a surface light source device or a white wall, and preparation for dust detection is performed. In the present embodiment, the dust detection image is an image having a uniform color. After the preparation is completed, for example, when the start of dust detection processing is instructed from the operation unit (207), the CPU 201 first sets the aperture. The image formation state of dust near the image sensor changes depending on the aperture value of the lens, and the position changes depending on the pupil position of the lens. Therefore, in the dust correction data (400), in addition to the dust position and size, it is necessary to hold the aperture value at the time of detection and the pupil position of the lens. Here, the pupil position refers to the distance from the imaging plane (focal plane) of the exit pupil. However, if it is determined in advance that the same aperture value is always used even when different lenses are used at the stage of creating the dust correction data (400), it is necessary to always hold the aperture value in the dust correction data (400). There is no.

  In step S111, an aperture value of a photographing lens (not shown) is designated. Here, for example, F22 is designated. In this case, the flowchart proceeds from step S111 to step S112.

  In step S112, the CPU 201 causes the lens control circuit (not shown) to perform aperture blade control of the shooting lens (not shown), and sets the aperture to the aperture value specified in step S111. In this case, the flowchart proceeds from step S112 to step S113.

  In step S113, the focus position is set to infinity. In this case, the flowchart proceeds from step S113 to step S114.

  In step S114, when the aperture value and focus position of the photographing lens are set, photographing in the dust detection mode is executed. The captured image data is stored in the memory 202. In this case, the flowchart proceeds from step S114 to step S115.

  In step S115, when shooting is completed, data corresponding to each pixel of the shot image stored in the memory 202 is called to the image processing unit 207. In this case, the flowchart proceeds from step S115 to step S116.

  In step S <b> 116, the image processing unit 205 performs a dust area acquisition process, and acquires the position and size of a pixel where a dust area (dust shadow) exists. In this case, the flowchart proceeds from step S116 to step S117. The dust area acquisition process is equivalent to the description in (Dust acquisition routine) in Document 2.

  In step S117, the position and size of the pixel in which the dust region acquired in step S116 exists are registered in the memory 202. Here, in step S117, the position of the defective pixel from the time of manufacture recorded in advance in the pixel defect position memory is compared with the position of the read pixel data to confirm whether the pixel is defective. Only the area determined not to be due to a pixel defect may be registered in the memory 202. An example of the data format of the dust correction data (400) stored in the memory 202 is shown in FIG. As shown in FIG. 4A, the dust correction data (400) stores information on the position and size of dust at the time of shooting a dust detection image. The dust correction data (400) is added to the image together with the shooting information of the image data during normal shooting, and is used in dust removal processing and interpolation processing. This is the same as the description of the dust removal processing and (dust removal processing) in Document 2. The interpolation process is the same as that described in (Interpolation routine) in Document 2. Specifically, the number of detected dust areas (integer value) is stored in the storage area, and subsequently, individual specific dust area parameters are repeatedly stored by the number of dust areas. The parameter of the dust region is a set of three numerical values: the radius of the dust region (for example, 2 bytes), the center x coordinate (for example, 2 bytes) in the effective image region, and the center y coordinate (for example, 2 bytes). When the dust correction data size is limited due to the size of the memory 202, the data is stored with priority from the top of the dust area. This is because the dust areas are sorted in order of conspicuous dust in the dust area acquisition routine in step S117. Here, as shown in FIG. 4B, the data format of the dust correction data (400) includes an actual aperture value at the time of detection image shooting as lens information at the time of detection image shooting. (F value) and the lens pupil position at that time may be stored.

  Next, processing performed by the imaging apparatus (200) according to the first embodiment will be described with reference to FIGS. 1, 2, and 3C. FIG. 3 is a flowchart illustrating an example of dust correction data registration processing performed by the imaging apparatus (200) according to the first embodiment.

  When the operation mode of the imaging apparatus (200) is set to the dust correction data registration mode in the operation unit (207) in step S109, the CPU (201) indicates the dust correction data registration mode to the communication unit (204). A signal is generated and an instruction is sent to the communication unit (104) of the PC (100) via the USB cable (300). In this case, the flowchart proceeds from step S109 to step S110.

  In step S110, the CPU (201) determines whether the communication unit (204) has received a dust correction data registration command from the PC (100). When the CPU (201) determines that the communication unit (204) has received the dust correction data registration command, the CPU (201) sets a dust correction data registration flag in the memory (202). In this case, the flowchart proceeds from step S110 to step S111.

  In step S111, after the registration process of the additional dust correction data (400) is completed, the CPU (201) notifies the communication unit (204) of the dust correction data (400) indicating that the registration process of the additional dust correction data (400) is completed. 400), a registration completion signal is generated and an instruction is sent to the PC (100). In this case, the process of the imaging device (200) performed in this flowchart is completed.

  Next, processing performed by the PC (100) according to the first embodiment will be described with reference to FIGS. 1, 2, and 5A. FIG. 5A is a flowchart illustrating an example of a photographing process performed by the PC (100) according to the first embodiment. In the process shown in the flowchart of FIG. 5A, the PC (100) and the imaging device (200) are connected via the USB cable (300), and the PC (100) and the imaging device (200) are in a power-on state. This process is executed at a certain time. The process shown in the flowchart of FIG. 5A is controlled by the CPU (101) executing a computer program stored in the memory (102).

  When the communication unit (104) receives an operation mode signal indicating the shooting mode from the imaging device (200), the CPU (101) sets the operation mode flag to “shooting mode” in the memory (102).

  Thereafter, the CPU (101) reads the camera control screen (500) from the memory (102) and displays it on the display unit (105).

  Similarly, when the communication unit (104) receives an operation mode signal indicating the dust detection mode from the imaging device (200), the CPU (101) sets the operation mode flag to “dust detection mode” in the memory (102). To do.

  Similarly, when the communication unit (104) receives an operation mode signal indicating the dust correction data registration mode from the imaging device (200), the CPU (101) sets the operation mode flag in the memory (102) to “register dust correction data”. Set to "Mode".

  In step S201, the CPU (101) determines whether or not the mouse cursor (600) is detected on the area of the shooting button (502) as the first determination means. In this case, the flowchart proceeds from step S201 to step S203. When the CPU (101) does not detect the mouse cursor (600) on the area of the shooting button (502), the flowchart returns from step S201 to step S201.

  In step S203, the CPU (101) determines whether or not the mouse cursor (600) is hovered over the area of the shooting button (502) as the first determination means. When the CPU (101) determines that the mouse cursor (600) has been detected on the area of the shooting button (502), the process proceeds from step S203 to step S204. When the CPU (101) does not detect the mouse cursor (600) on the area of the shooting button (502), the flowchart returns from step S203 to step S201.

  In step S204, the CPU (101) determines whether or not the button of the mouse (106a) of the operation unit (106) for operating the mouse cursor (600) is clicked as the second determination means. When the CPU (101) determines that the mouse (106a) button has been clicked, the process proceeds from step S204 to step S205. If the CPU (101) does not determine that the mouse (106a) button has been clicked, the process returns from step S204 to step S203.

  In step S205, when the mouse (106a) is clicked by the CPU (101) when the mouse cursor (600) is on the area of the shooting button (502), the CPU (101) serves as the second instruction means. The communication unit (104) generates a shooting command and transmits it to the imaging device (200). Here, in the flowchart, the process proceeds from step S205 to step S206. After executing step S205, the photographing process is executed in step S105 of the flowchart of FIG. 3A, image data transmission is executed in step S106, and the image data is sent to the PC (100).

  In step S206, the CPU (101) causes the display unit (105) to display the image data sent from the imaging device (200). Here, this flowchart ends.

  Thus, when the mouse cursor (600) is moved over the area of the shooting button (502) by operating the mouse (106a), the PC (100) instructs the imaging apparatus (200) to perform shooting preparation processing. Thereafter, when the mouse cursor (600) is on the area of the shooting button (502) where the mouse is over, when the mouse (106a) is clicked, the PC (100) instructs the imaging device (200) to perform a shooting process. Furthermore, the image data sent from the imaging device (200) to the PC (100) is displayed.

  Next, processing performed by the PC (100) according to the first embodiment will be described with reference to FIGS. 1, 2, and 5B. FIG. 5B is a flowchart illustrating an example of dust detection processing performed by the PC (100) according to the first embodiment.

  In step S201, the CPU (101) determines whether or not the mouse cursor (600) is detected on the area of the shooting button (502) as the first determination means. In this case, the flowchart proceeds from step S201 to step S203. When the CPU (101) does not detect the mouse cursor (600) on the area of the shooting button (502), the flowchart returns from step S201 to step S201.

  In step S203, the CPU (101) determines whether or not the mouse cursor (600) is hovered over the area of the shooting button (502) as the first determination means. When the CPU (101) determines that the mouse cursor (600) has been detected on the area of the shooting button (502), the process proceeds from step S203 to step S204. When the CPU (101) does not detect the mouse cursor (600) on the area of the shooting button (502), the flowchart returns from step S203 to step S201.

  In step S204, the CPU (101) determines whether or not the button of the mouse (106a) of the operation unit (106) for operating the mouse cursor (600) is clicked as the second determination means. When the CPU (101) determines that the mouse (106a) button has been clicked, the process proceeds from step S204 to step S205. If the CPU (101) does not determine that the mouse (106a) button has been clicked, the process returns from step S204 to step S203.

  In step S205, when the mouse (106a) is clicked by the CPU (101) when the mouse cursor (600) is on the area of the shooting button (502), the CPU (101) serves as the second instruction means. The communication unit (104) generates a dust detection command and transmits it to the imaging device (200). Here, this flowchart ends.

  After executing step S205, dust detection processing is executed in step S108 in the flowchart of FIG. 3B, and dust correction data (400) is recorded in the memory (202).

  In this way, when the mouse cursor (600) is on the area of the shooting button (502) where the mouse is over, when the mouse (106a) is clicked, the PC (100) performs dust detection processing on the imaging device (200). Instruct.

  Next, processing performed by the PC (100) according to the first embodiment will be described with reference to FIGS. 1, 2, and 5C. FIG. 5C is a flowchart illustrating an example of dust correction data registration processing performed by the PC (100) according to the first embodiment.

  Here, description will be made only on the flow of registering additional dust correction information in the camera by designating dust on the view area (501), but a specific operation flow will be described later. This will be described in the camera control screen (500) which is an example of the menu screen shown in FIG.

  In step S207, the CPU (101) determines whether or not the mouse cursor (600) is detected on the view area (501) as the first determination means. In this case, the flowchart proceeds from step S207 to step S204. If the mouse cursor (600) is not detected on the view area (501) by the CPU (101), the flowchart returns from step S207 to step S207.

  In step S204, the CPU (101) determines whether or not the button of the mouse (106a) of the operation unit (106) for operating the mouse cursor (600) is clicked as the second determination means. When the CPU (101) determines that the mouse (106a) button has been clicked, the process proceeds from step S204 to step S208. When the CPU (101) does not determine that the button of the mouse (106a) has been clicked, the flowchart returns from step S204 to step S204.

  In step S205, when the mouse (106a) is clicked by the CPU (101) when the mouse cursor (600) is on the area of the shooting button (502), the CPU (101) serves as the second instruction means. The communication unit (104) generates a dust detection command and transmits it to the imaging device (200). Here, this flowchart ends.

  After execution of step S205, dust correction data registration processing is executed in step S111 of the flowchart of FIG. 3C, and additional dust correction data (400) is recorded in the memory (202).

  As described above, when the mouse cursor (600) is on the view area (501) where the mouse is over, when the mouse (106a) is clicked, the PC (100) registers dust correction data in the imaging device (200). Instruct processing.

  In the first embodiment, the subject to be photographed is confirmed through a finder (not shown), and the image pickup apparatus (200) is remotely controlled. The image pickup apparatus (200) may be remotely controlled while confirming the above.

  FIG. 6A shows a camera control screen (500), which is an example of a menu screen, and is configured on a window system that is standardly adopted by the OS of a personal computer.

  Further, the camera control screen (500) has an image editing function, and can perform dust removal processing and interpolation processing. The dust removal process is equivalent to the description of (dust removal process) in Patent Document 2. The interpolation processing is equivalent to the description of (Interpolation routine) in Patent Document 2.

  The camera control screen (500) is a window for remote control of the camera, and includes a view area (501) for displaying video data, a shooting button (502), a parameter area (503), a dust removal image display button (504), and an addition. There are a dust removal image display button (505), a whole dust removal image display button (506), a radius slider (507), and the like.

  The view area (501) displays live view video continuously received by the communication unit (104) from the imaging device (200), still images received by the shooting operation, moving images received by the playback operation, and still images. it's shown.

  The shooting button (502) performs shooting processing in two states: S1 in which the shutter button is half-pressed and S2 in which the shutter button is fully pressed. When the mouse cursor (600) is moved onto the shooting button (502) and the operation mode of the imaging device (200) is the normal shooting mode, start of shooting preparation processing from the PC (100) to the imaging device (200). Instruct. When the mouse cursor (600) is clicked on the shooting button (502) and the operation mode of the imaging device (200) is the normal shooting mode, a series of operations from the PC (100) to the imaging device (200) is performed. Instructs the start of shooting processing operation.

  In the parameter area (503), the shooting mode and the like are displayed. These values are included in auxiliary data received from the imaging device (200). The parameter area (503) may display auxiliary data other than this. When the value on the parameter area (503) is changed by the operation, the CPU (101) causes the communication unit (104) to generate an auxiliary data setting command (700) and causes the imaging device (200) to Send. Thereby, the parameters of the imaging apparatus are changed.

  The CPU (101) controls the communication unit (104) to display data received from the imaging device (200) in the view area (501) and the parameter area (503), respectively.

  The dust removal image display button (504) uses the dust correction data (400) associated with the image data in the digital camera body when the mouse cursor (600) is pressed on the button area, and the specified coordinates are used. Dust removal processing is executed, and the processed image is displayed in the view area (501).

  The additional dust removal image display button (505) uses the additional dust correction data (400) associated with the image data in the main body of the digital camera when the mouse cursor (600) is pressed on the button area, to the designated coordinates. The dust removal process is executed for the image, and the processed image is displayed in the view area (501).

  The entire dust removal image display button (506) is pressed by pressing the mouse cursor (600) on the button area, so that dust correction data (400) associated with image data on the digital camera body and additional dust correction data (400) are displayed. , The dust removal process is executed for the designated coordinates, and the processed image is displayed in the view area (501).

  A radius slider (507) is a slider for designating an application range of interpolation processing. The radius is changed by moving the slider with the mouse cursor (600).

  Further, based on the operation of the mouse cursor (600) in the view area (501) and the radius specified by the radius slider (505), the display image is interpolated. Further, the CPU (101) causes the communication unit (104) to generate a command (700) for registering additional dust correction data and transmits it to the imaging device (200), thereby adding the coordinates and radius of the dust region in the camera. Register as dust correction data (400).

  FIG. 7 illustrates the command (700).

  The command (700) includes a transmission command (710) for controlling the camera and supplementary data (720). For example, when registering auxiliary data, an auxiliary data registration command is set as a transmission command (710), and when registering additional dust correction data (400), additional dust is generated as a transmission command (710). The registration command for the correction data (400) is set, and the coordinates and radius of the dust region are set as supplementary data (720).

  In the dust removal process in the image editing function, dust that has not been registered in the dust correction data (400) cannot be removed. Therefore, here, a method for registering dust data not registered in the dust correction data (400) as additional dust correction data (400) in the camera will be described.

  In the present embodiment, after the dust removal process is executed, the dust information that could not be corrected by the dust removal process is registered as additional dust correction data (400). In this process, when the dust area that could not be corrected by the dust removal process is manually specified and interpolated by specifying the dust area, information on the dust area is registered as additional dust correction data (400). is there.

  Here, step S208 of the flowchart described in FIG. 5C will be described.

  FIG. 8 is a flowchart showing details of step S208 in the flowchart showing an example of the dust correction data registration process performed by the PC (100) according to the first embodiment.

  In step S210, manual interpolation processing is executed for dust that could not be corrected by dust removal processing using dust correction data (400). When transitioning to manual interpolation processing, the CPU (101) waits for an instruction from the mouse (106a) by the user. The user looks at the view area (501), searches for a dust area that has not been processed by the dust removal process using the dust correction data (400), and if found, as described above, the view area (501). The dust region is designated by inputting the coordinates and size from the operation of the mouse cursor (600) and the radius slider (505). If there are a plurality of dust areas that have not been processed in the dust removal process using the dust correction data (400), this is repeated. The CPU (101) performs an interpolation process on the area that has received an instruction from the user. In this case, the flowchart proceeds from step S210 to step S211.

  In step S211, it is determined whether the interprocess has been successful. If successful, the process proceeds to step S306. If unsuccessful, the process ends. Specifically, the above-described dust region determination is performed on the dust region designated by the user, and if it is not determined as a dust region, it is treated as a failure. In this case, the flowchart proceeds from step S211 to step S212.

  In step S212, dust correction parameters are acquired. The dust correction parameters mentioned here are the dust region coordinates and the radius of the dust region designated by the user by operating the mouse cursor (600) in the view region (501) and the radius slider (505). In this case, the flowchart proceeds from step S212 to step S213.

  In step S213, an additional dust correction data registration command (700) is created from the dust region coordinates and dust region radius in step S212. In this case, the flowchart proceeds from step S213 to step S214.

  In step S214, an additional dust correction data registration command (700) is transmitted to the imaging device (200), whereby dust correction data registration processing is executed in step S111 of the flowchart of FIG. ) To record additional dust correction data (400). If there are a plurality of dust areas designated by the user, steps S210 to S214 may be repeated by that number.

  In this way, unregistered dust can be registered in the additional dust correction data (400).

  As a result, at the time of subsequent shooting, the dust correction data (400) and the additional dust correction data (400) are additionally recorded in the MakerNote area, which is the header area of the image file, so that the dust removal image display is displayed. By pressing the button (502), the dust removal effect by the dust correction data (400) can be confirmed. Further, by pressing the additional dust removal image display button (503), the dust removal effect by the additional dust correction data (400) can be confirmed. Furthermore, the dust removal effect by the dust correction data (400) and the additional dust correction data (400) can be confirmed by pressing the entire dust removal image display button (504).

  In this embodiment, dust information is additionally registered in the dust correction data (400) only when manual dust removal processing is successful. However, the method is not limited to manual dust removal processing, and other methods may be used as long as an instruction for specifying the dust position and registering additional dust correction data (400) can be given.

  Further, when registering additional dust correction data (400) by specifying the position of dust by manual dust removal processing or the like, it is determined whether or not the dust information is already registered in dust correction data (400). Then, the registration process may be performed. This determination is performed, for example, by comparing all entries in the dust correction data (400) with information on the additionally designated dust region.

  If there are a plurality of dust areas designated by the user, steps S210 to S214 are repeated by that number, but each time additional dust correction information is registered, a command is transmitted to the camera. Instead of this, a plurality of additional dust correction information may be collected and executed by a single communication command to the camera.

[Example 2]
In the first embodiment, a view area (501) for one screen is displayed as a view area, a dust removal image display button (504), an additional dust removal image display button (505), and an entire dust removal image display button (506). By pressing, the dust removal effect by the dust correction data (400) and the additional dust correction data (400) was confirmed.

The camera control screen (500) as an example of the menu screen in the second embodiment will be described with reference to FIG. 6B. The view area is the view area 1 (511), the view area 2 (512), and the view area 3 (513). ), Display 4 screens as in view area 4 (514),
An image after dust removal processing using dust correction data (400) associated with the image data on the digital camera body obtained by pressing the dust removal image display button (504) is displayed in the view area 2 (512). ,
View region 3 (513) displays an image after dust removal processing using additional dust correction data (400) associated with the image data in the digital camera body, which is obtained by pressing the additional dust removal image display button (505). And
After the dust removal processing using the dust correction data (400) associated with the image data on the digital camera body and the additional dust correction data (400) obtained by pressing the additional dust removal image display button (505). The image may be displayed in the view area 4 (514).

  Accordingly, the dust removal image display button (502), the additional dust removal image display button (503), and the entire dust removal image display button (504) are pressed, and the dust correction data (400) and the additional dust correction data (400) are used. Rather than confirming the dust removal effect, all images that can be confirmed by pressing each button are displayed in the view area 1 (511), view area 2 (512), view area 3 (513), and view area 4 (514). Will be able to.

[Example 3]
In the first and second embodiments, when the additional dust correction data (400) is registered, the camera is registered regardless of the amount of dust.

  However, when the amount of dust exceeds an allowable range, it may be better to display an alert and prompt the user to clean the image sensor.

  A flowchart illustrating an example of the dust correction data registration process according to the third embodiment will be described with reference to FIG.

To explain only the parts different from the first and second embodiments,
In step S212, dust correction parameters are acquired. The dust correction parameters referred to here are the operation of the mouse cursor (600) in the view area (501), the coordinates of the dust area designated by the radius slider (505), the radius of the dust area, and the header area of the image file. Dust correction data (400) and additional dust correction data (400) included in the MakerNote area. In this case, the flowchart proceeds from step S212 to step S220.

  In step S220, it is determined whether the amount of dust (number, area, etc.) of the dust correction parameter has exceeded the threshold value. If it is determined that the threshold has been exceeded, the process proceeds to step S221. Advances to step S213.

  In step S221, an alert is displayed. In this case, this flowchart ends.

  A flowchart illustrating an example of dust correction data registration processing according to the third embodiment will be described with reference to FIG.

To explain only the parts different from the first and second embodiments,
In step S212, dust correction parameters are acquired. The dust correction parameters referred to here are the operation of the mouse cursor (600) in the view area (501), the coordinates of the dust area designated by the radius slider (505), the radius of the dust area, and the header area of the image file. Dust correction data (400) and additional dust correction data (400) included in the MakerNote area. In this case, the flowchart proceeds from step S212 to step S220.

  In step S220, it is determined whether the amount of dust (number, area, etc.) of the dust correction parameter has exceeded the threshold value. If it is determined that the threshold has been exceeded, the process proceeds to step S221. Advances to step S213.

  In step S221, an alert is displayed. In this flowchart, the process proceeds from step S221 to step S213.

  As a result, when the user additionally registers dust, if the amount of dust exceeds the allowable range, an alert is displayed and the user is prompted to perform procedures such as cleaning the image sensor. Will be able to.

100 control device 101 CPU
102 memory 103 ROM
104 Communication Unit 105 Display Unit 106 Operation Unit 106a Mouse 106b Keyboard 200 Imaging Device 201 CPU
202 Memory 203 Recording Unit 204 Communication Unit 205 Image Processing Unit 206 Display Unit 207 Operation Unit 208 Imaging Unit 300 USB Cable 400 Dust Correction Data 410 Dust Correction Data 500 Camera Control Screen 501 View Area 502 Shooting Button 503 Parameter Area 504 Dust Removal Button 505 Additional dust removal button 506 Whole dust removal button 507 Radius slider 511 View area 1
512 View area 2
513 view area 3
514 view area 4
600 Mouse cursor 700 Command 710 Send command 720 Supplementary data

Claims (7)

A control device (100) for remotely controlling the imaging device (200),
Display control means (105) for controlling the image transmitted from the imaging device (200) to be displayed on the camera control screen (500);
First determining means (101) for determining whether or not a predetermined area displayed on the camera control screen (500) and a mouse cursor (600) operated using the pointing device (106a) overlap. When,
First instruction means (101) for transmitting a command (700) to the imaging apparatus (200) to cause the imaging apparatus to perform imaging preparation processing when the predetermined area and the mouse cursor (600) overlap; ,
Second determining means (101) for determining whether or not the pointing device (106a) is clicked when the predetermined area and the mouse cursor (600) overlap;
Second instruction means (101) for transmitting a command (700) to the imaging apparatus (200) to cause the imaging apparatus (200) to perform the imaging process when the pointing device (106a) is clicked;
A control device comprising: In addition to the control device,
In an imaging apparatus that holds dust correction data (400) detected by shooting a blank sheet as first dust position information (400),
In the camera to which the first dust correction data (400) is added as information at the time of taking a photographed image,
As the second dust correction data (400), after removing dust from the image with the first dust correction data (400) on the PC, the image is scanned again to obtain the remaining dust position information.
The control apparatus according to claim 1, wherein when the second dust correction data (400) is input to the camera, the first and second dust correction data (400) are added to the image. In addition to the control device,
3. The image processing apparatus according to claim 2, further comprising: a view area (501) in which the effect of removing dust from the image can be confirmed by the first dust position information (400) and the second dust correction data (400). Control device. In addition to the control device,
A view area (511), a view area (512), a view area (513), and a view area where the effect of removing dust from the image can be confirmed by the first dust position information (400) and the second dust correction data (400). The control device according to claim 2, wherein each of the control devices has (514). In addition to the control device,
5. An alert is displayed when a dust parameter in the first dust position information (400) and the second dust correction data (400) exceeds a threshold value. The control device according to any one of the above. In addition to the control device,
The control apparatus according to claim 5, wherein the parameter of dust is a number. In addition to the control device,
The control apparatus according to claim 5, wherein the parameter of dust is an area.