JP5476930B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to an image pickup apparatus and an image pickup method, and is capable of simultaneously displaying image data currently acquired and image data acquired in the past, and storing past image data as an image file. The present invention relates to an imaging apparatus and an imaging method capable of performing the above.

When taking an image while moving using an imaging device typified by a digital camera, a photo opportunity may be missed. This can also occur when shooting a moving subject.
The digital camera can display a subject image on a display device included in the imaging device main body if the power is turned on in the pre-shooting process. In other words, even before a predetermined operation is performed on the shutter button and image file recording processing is performed, the image data relating to the subject image is acquired by the subject acquired through the imaging unit included in the imaging device. After being generated from light and subjected to predetermined image processing, display processing is performed.
That is, in the conventional imaging device, since the predetermined image processing is performed on the image data related to the subject image even before the shutter button is operated, the image data is temporarily captured. It is stored in the device.

  However, since the recording and storage processing of the image data is performed after performing operations related to shooting, even if the subject crosses the front of the imaging lens at a high speed, the subject can be traced back. The image could not be confirmed.

  On the other hand, a lens unit including a photographing lens, an image sensor, and a CPU (central processing unit) that performs predetermined image processing, a CPU that performs predetermined image processing, and a recording unit that records image data are provided. 2. Description of the Related Art An imaging device that includes a main unit that can be freely connected is known.

  In such an imaging apparatus, since various data needs to be exchanged between the CPU mounted on the lens unit and the main body unit, there is one configured to perform using a general-purpose serial port (for example, Patent Documents). 1).

  The image pickup apparatus described in Patent Document 1 includes a control serial driver capable of bi-directional communication and one-way communication from a lens unit to a main unit for data transfer between a lens unit and a CPU included in the main unit. However, when transmitting captured image data from the lens unit to the main unit, a thinned image is created from the image data and the thinned image is transmitted to the main unit. ing.

In order to perform display on the main unit using the thinned image as described above, it is necessary to preliminarily define the format of the image data. When generating the thinned image, conversion processing to a single image format defined in advance. Need to be done.
When the image format is restricted as described above, there is a problem that the data size (image size) of the image data is also restricted.
In addition, since image data to be transmitted / received is a thinned image, there arises a problem that image quality is deteriorated.

  Also, in order to make it easy to capture a moving subject quickly, the subject image is continuously stored in the volatile memory at a fixed time interval while the shutter button is pressed, and when the shutter button is released, There is known an imaging apparatus that records subject images accumulated so far as image data.

  Such an imaging device can generate an image file by selecting from continuously recorded subject images. However, the subject image while only displaying a through image without pressing the shutter button is used. It cannot be recorded.

  Therefore, it is more convenient for the user if the captured image data can be displayed at the same time while performing the so-called through image display, but the image transmitted from the lens unit to the main unit like a conventional imaging device. If the data is compressed into a predetermined format, the main unit needs to simultaneously perform decoding processing for display and image processing for recording.

  Further, it is convenient if the image data displayed as the through image data can be paused and viewed. In addition, you can check the subject image that you missed by going back to an arbitrary time. While the live view image data and the image data taken in the past are being displayed at the same time, It is convenient to be able to record and save as a file.

In order to perform the image processing as described above, it is necessary to simultaneously perform a plurality of different image processes in parallel. In order to perform such processing, it is necessary to use an image processing apparatus corresponding to the number of processes to be performed simultaneously. However, when a large number of image processing apparatuses are installed, the manufacturing cost of the imaging apparatus itself increases.
In addition, even with an imaging device in which an image processing device is mounted on each of the lens unit and the main unit, there is still an imaging device that can simultaneously display the plurality of image data by performing the image processing as described above. unknown.

  The present invention has been made in view of the above problems, and can display currently acquired image data and previously acquired image data at the same time, and save the past image data as an image file. It is an object to provide an imaging apparatus and an imaging method capable of performing the above.

The present invention is an imaging apparatus including a lens unit and a main body unit that is detachable from the lens unit, and the lens unit images an optical lens and subject light transmitted through the optical lens. An imaging device, an image processing device that periodically generates image data from the output of the imaging device, a storage device that stores the generated image data, and periodic image data that the image processing device periodically generates and the stored image data stored in the storage device and a communication interface to be transmitted to the main unit, the main unit has a said periodic image data and the stored image data transmitted from the lens unit a communication interface for receiving, combining image and the periodic image data and the stored image data received from the lens unit And a display device for displaying the data, in a state where the synthetic image data on the display device is being displayed, when the image pickup operation signal for instructing the image pickup operation is sent from the main unit to the lens unit, the The main feature is that the main unit stops updating the display of the composite image data displayed on the display device .

In the invention, it is preferable that the main unit includes a recording device that records only the periodic image data as an image file among the periodic image data and the accumulated image data received from the lens unit .

In the invention, it is preferable that the main unit includes a recording device that records only the accumulated image data as an image file among the periodic image data and the accumulated image data received from the lens unit .

Further, the present invention is characterized in that the main unit includes means for synthesizing the periodic image data received from the lens unit and the accumulated image data to generate the synthesized image data .

The present invention is also an image pickup apparatus having a lens unit and a main body unit that is detachable from the lens unit, and the lens unit picks up an optical lens and subject light transmitted through the optical lens. An image sensor that periodically generates image data from the output of the image sensor, a storage device that accumulates the generated image data, and a periodic image that the image processor periodically generates A communication interface for transmitting composite image data obtained by combining data and stored image data stored in the storage device to the main body unit, and the main body unit transmits the composite image data transmitted from the lens unit. And a display device for displaying the received composite image data. The composite image data displayed on the display device when the imaging operation signal instructing the imaging operation is transmitted from the main unit to the lens unit in a state where the composite image data is displayed. The updating of the display is stopped .

The present invention also relates to an imaging method by an imaging apparatus having a lens unit and a lens unit and a detachable body unit, wherein the lens unit includes an optical lens and subject light transmitted through the optical lens. An image pickup device that picks up images, an image processing device that periodically generates image data from the output of the image pickup device, a storage device that stores the generated image data, and a cycle that the image processing device periodically generates specific image data and the stored image data stored in the storage device and a communication interface to be transmitted to the main unit, the main unit is the periodic image data and the stored image is transmitted from the lens unit a communication interface for receiving data, to display the composite image data with the periodic image data and the stored image data And a display device, the lens unit, and the periodic image data and the stored image data to perform the steps, to be sent to the main unit, the main unit is, the periodic image data and the stored image the combined image data with the data to perform a table Shimesuru steps, on the display device, in a state where the synthetic image data is displayed on the display device, an imaging operation signal instructing the imaging operation from the main unit When transmitted to the lens unit, the main body unit executes a step of stopping the updating of the display of the composite image data displayed on the display device .

The present invention is characterized in that the main unit is of the periodic image data and the stored image data received from the lens unit, to step, the execution of recording only the periodic image data as an image file And

The present invention includes the feature that the main unit is of the periodic image data and the stored image data received from the lens unit, to step, the execution of recording only the stored image data as an image file To do.

According to the present invention , the main unit executes a step of generating the composite image data by combining the periodic image data received from the lens unit and the accumulated image data .

The present invention also relates to an imaging method by an imaging apparatus having a lens unit and a lens unit and a detachable body unit, wherein the lens unit includes an optical lens and subject light transmitted through the optical lens. An image pickup device that picks up images, an image processing device that periodically generates image data from the output of the image pickup device, a storage device that stores the generated image data, and a cycle that the image processing device periodically generates A communication interface that transmits combined image data of the target image data and the stored image data stored in the storage device to the main body unit, and the main body unit receives the combined image data transmitted from the lens unit. A communication interface for receiving, and a display device for displaying the composite image data. Transmitting the synthesized image data to the main body unit, the main body unit executing the step of displaying the synthesized image data on the display device, and the synthesized image data being displayed on the display device. When the imaging operation signal for instructing the imaging operation is transmitted from the main unit to the lens unit, the main unit stops updating the display of the composite image data displayed on the display device. Performing the step .

  According to the present invention, it is possible to simultaneously display periodic image data that is a current through image while displaying image data that is accumulated in a lens unit that is a past through image. As a result, the current subject image can be confirmed without missing.

  In addition, according to the present invention, the current subject image included in the periodic image data is displayed by simultaneously displaying the accumulated image data and the periodic image data, and performing a predetermined operation while confirming the past subject image. Will be able to shoot.

  Further, according to the present invention, the stored image data and the periodic image data can be displayed at the same time, and the stored image data can be stored as an image file by performing a predetermined operation while confirming the past subject image. As a result, even a past subject image can be taken.

  According to the present invention, the subject image is accumulated in the lens unit as accumulated image data, and can be read out and confirmed by a predetermined operation. Even after the confirmation, the accumulated image data is stored as an image file. Since it can be stored, it is possible to shoot without missing the subject even when the user is not conscious of the shooting action.

1 is an external perspective view showing an example of an imaging apparatus according to the present invention. It is a block diagram which shows the example of the hardware constitutions of the lens unit and main body unit which comprise the imaging device which concerns on this invention. It is a block diagram which shows another example of the said lens unit. It is a block diagram which shows another example of the said lens unit. It is a functional block diagram which shows the example of a function structure of the imaging device which concerns on this invention. It is a sequence diagram which shows the example of the process in the imaging method using the said imaging device. It is a sequence diagram which shows another example of the process in the said imaging method. It is a sequence diagram which shows another example of the process in the said imaging method. It is an image figure which shows the example of a display of the to-be-photographed image in the imaging method which concerns on this invention. It is an image figure which shows another example of the display of the to-be-photographed image in the imaging method which concerns on this invention. It is an image figure which shows another example of the display of the to-be-photographed image in the imaging method which concerns on this invention. It is a sequence diagram which shows another example of the process in the imaging method which concerns on this invention. It is a sequence diagram which shows another example of the process in the imaging method which concerns on this invention. It is a sequence diagram which shows another example of the process in the imaging method which concerns on this invention.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of an imaging apparatus and an imaging method using the apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is an external perspective view showing an example of a lens constituting an imaging apparatus according to the present invention and a main body that is detachable from the lens.
In FIG. 1, reference numeral 1 denotes a lens unit, reference numeral 2 denotes a main unit, and reference numeral 3 denotes an imaging device that is integrated with the lens unit 1 attached to the main unit 2.

  There are various types of lens units 1 depending on an imaging lens and an imaging element provided in the lens unit 1, and a user can select the lens unit 1 appropriately and attach it to the main unit 2. For example, by attaching the lens unit 1a (FIG. 1A) equipped with a single focus lens or the lens unit 1b equipped with a zoom lens (FIG. 1B) to the main unit 2, respectively. It becomes possible to perform imaging taking advantage of the characteristics of these imaging lenses.

  Next, an example of a hardware configuration of the lens unit according to the present invention and a main body unit that is detachably connected to the lens unit and constitutes the imaging device according to the present invention will be described with reference to the block diagrams of FIGS. explain.

As shown in FIG. 2, by joining the connector 116 on the lens unit 1 side and the connector 201 on the main unit 2 side, each unit is electrically connected to each other, and the imaging device 3 is configured.
In FIG. 2, the lens unit 100 includes a lens group 107 including a focus lens, an image sensor 108 that converts a subject image received through the lens group 107 from an optical signal to an electrical signal, and outputs the image. An AFE (analog front end) 109 that converts an output signal (analog image signal) into a digital image signal and performs signal amplification, processing for converting the converted digital image signal from RGB to YUV data, and converted YUV And a CPU 103 that generates image data by performing predetermined image processing such as processing for compressing and encoding data in JPEG or MPEG format or processing for generating RAW data. The CPU 103 is a so-called image processing engine on the lens unit side.

The lens unit 100 includes an inter-unit interface that is electrically connected to the main unit 200.
The inter-unit interface provided in the lens unit 100 includes a joint connector 116 coupled to the joint connector 201 on the main unit side, a control signal interface between the main unit 200 indicated by reference numeral 121, a serial signal interface indicated by reference numeral 122, and a reference numeral 123. , An SDIO signal interface indicated by reference numeral 124, an input interface for a release switch signal indicated by reference numeral 126, and an image signal transmission interface 125 indicated by a one-way interface.

In addition, the lens unit 100 includes a motor driver 111 that controls a motor 110 used for extending and storing the lens barrel of the lens group 107. The motor driver 111 is controlled by a control signal received from the main unit 200 via the interface 121.
With this mechanism, depending on the type of interchangeable lens, it is possible to perform various operation controls such as storing the lens barrel when the power of the imaging device 3 is turned off, and performing a magnification operation by pressing a button (not shown) .

  The lens unit 100 also detects a DC-DC converter 101 that generates various types of power necessary for the operation of the lens unit 100 from the power 120 supplied from the main body unit, and the power 120 supplied from the main body unit 200 to detect DC. A sub-microcomputer 102 that controls the DC converter 101;

  The lens unit 100 also includes a detection circuit 113 that detects a teleconverter lens and a wide converter lens that can be mounted outside the lens unit 100.

The lens unit 100 includes a gyro sensor 106 that detects the tilt of the imaging device 3, an acceleration sensor 112 that detects acceleration applied to the imaging device 3, a lens group based on the tilt detected by the gyro sensor 106 and the acceleration detected by the acceleration sensor 112. A coil 105 for driving 107 and a hall element 104 for detecting the driving amount of the coil 105 are provided.
The gyro sensor 106, the acceleration sensor 112, the coil 105, and the hall element 104 can exhibit a camera shake prevention function.

Software for performing image processing and the like in the lens unit 100 is stored in a flash ROM 114 (hereinafter referred to as “ROM 114”).
The lens unit 100 also includes a DDR-SDRAM 115 (hereinafter referred to as “RAM 115”) that functions as a ring buffer that stores image data generated in the CPU 103 via the image sensor 108. The RAM 115 also functions as a work area for the above software.

In FIG. 2, the main unit 200 includes an inter-unit interface that is electrically connected to the lens unit 100.
The interface between the units on the 200 side between the body side units includes a joint connector 201 coupled to the joint connector 116 on the lens side unit side, an interface for control signals with the lens unit 100 indicated by reference numeral 221, an interface for a serial signal indicated by reference numeral 222, An interface used for bidirectional communication indicated by reference numeral 223, an SDIO signal interface indicated by reference numeral 224, an output interface of a release switch signal indicated by reference numeral 224, and an image signal receiving port 225 which is a one-way interface.

  The main unit 2 also converts the image data received from the lens unit 1 through the image signal receiving port 224, which is a one-way interface, into YUV data, and compresses the converted YUV data in JPEG or MPEG format. The CPU 208 appropriately performs predetermined image processing such as encoding processing, compression-encoded data decompression processing, or RAW data generation processing. A CPU 208 is an image processing engine on the main unit side.

  In addition, the main unit 200 includes a release switch 211 that starts a shooting operation of the imaging device 3 by a predetermined operation, an operation switch 206 that includes a cross key used for various settings such as an operation mode of the imaging device 3, and an operation The input of the switch 206 is detected to perform predetermined setting processing, etc., the power supplied from the lithium ion battery 204 is controlled using the DC-DC converter 203, and the power is supplied to the lens unit 100. And a sub-microcomputer 205 that controls a power switch 202 that is a switch for this purpose.

  Software for performing image processing and operation control processing in the main unit 200 is stored in a flash ROM 219 (hereinafter referred to as “ROM 219”). The main unit 200 also includes a DDR-SDRAM 220 (hereinafter referred to as “RAM 220”) that functions as a work area used for image processing and the like.

  The main unit 200 also includes an audio codec 216, a microphone 218 that inputs an audio signal to the audio codec 216, a speaker 217 that outputs sound from the audio codec 216, a USB interface connector 214, and an AV output connector 213. An output interface 212 for HDMI signals, an SD memory 215 that is a removable storage means for storing captured image files, and a strobe 207 that also serves as a connection circuit when an external strobe is attached to the main unit 200, It has an LCD 210 and an EVF 209 which are display means for displaying the subject image in the monitoring operation during the focusing operation by operating the switch 211 and displaying the captured image data when performing the photographing operation.

FIG. 3 is a functional block diagram showing another example of a lens unit that constitutes the imaging apparatus according to the present invention. In FIG. 3, the lens unit 300 has substantially the same configuration as the lens unit 100 shown in FIG. The lens unit 300 includes a zoom lens in the lens group 307, and has a configuration difference from the lens unit 100 in that it includes a zoom motor 310 for moving the zoom lens. The lens unit 300 is configured to cause the focus lens and the zoom lens provided in the lens group 307 to perform predetermined operations by operating a zoom switch provided in the main body unit 200 (not shown).
In FIG. 3, an image signal transmission interface constituted by a one-way interface is omitted.

FIG. 4 is a functional block diagram showing still another example of the lens unit constituting the imaging device according to the present invention. In FIG. 4, the lens unit 400 includes a large image sensor 408, and has a configuration corresponding to the Hall element 104, the coil 105, and the gyro sensor 106 that performs a camera shake prevention operation. There are differences in configuration.
In FIG. 4, an image signal transmission interface constituted by a one-way interface is omitted.

  Next, an example of an imaging method using the imaging apparatus according to the present invention will be described with reference to the drawings. The imaging method described below includes software stored in the ROMs 114, 314, and 414 included in the lens units 100, 300, and 400 described above, and various types of software that the lens units 100, 200, and 300 and the main unit 200 have. It is executed by hardware resources. Each means in the functional block diagram shown in FIG. 5 is a functional block realized by cooperation of the hardware with the software.

  In FIG. 5, the lens unit 10 performs imaging processing of a subject image using hardware resources including the lens group 107, the imaging element 108, and the AFE 109 included in the lens unit 100 by software stored in the RAM 114. Means 11, image processing means 12 for executing predetermined image processing and operation control of the imaging apparatus using CPU 103, storage means 13 operating as a ring buffer using a storage area of ROM 114 or RAM 115, joint connector 116 and the bidirectional interface 123, the first interface 14 that performs bidirectional communication between the main body unit 200 and the lens unit 100, and the lens unit 1 using the joint connector 116 and the one-way interface 125. 0 and the second interface 15 is a one-way interface for executing transmission of the image data to the main unit 200, comprising a

  The first interface 14 includes a CPU 208, a joint connector 201, and a bidirectional interface 223 on the lens unit 200 side, and the second interface 15 includes a CPU 208, a joint connector 201, and a one-way interface 225 on the lens unit 200 side. Yes.

  On the other hand, the main unit 20 includes an image processing unit 21 that performs predetermined image processing and operation control of the imaging apparatus using the CPU 208, and temporary storage unit that uses the RAM 115 to perform information processing by software stored in the RAM 220. A storage means 22 composed of an SD memory for storing image data received from the lens unit 10 as an image file, a display means 23 for displaying image data and the like using a liquid crystal display (LCD) 210, and an operation The switch 206, the sub-microcomputer 205, and the operation means 24 that senses the user's operation using the release switch 211 are provided.

Next, an embodiment of the imaging method according to the present invention will be described with reference to the functional block diagram of FIG. 5 and the sequence diagram of FIG.
The present embodiment is an example of an imaging method according to through image display control. Here, the through image refers to image data that is repeatedly displayed on the display device included in the main unit until the imaging operation is performed after the imaging apparatus according to the present invention is turned on.

In FIG. 6, each processing step is expressed as S101, S102, S103. Further, the output destination (notification destination) of the information generated (or processed) in each processing step is represented by using an arrow.
First, when the power button of the main unit 20 is operated and the power is turned on, or after the power is turned on and the setting related to the operation of the imaging device 3 is changed by the operation of the operation unit 24 The sub CPU 205 (FIG. 3) detects an operation on the operation unit 24 (S101), and the image processing unit 21 generates setting information on the operation. The generated setting information is transmitted to the lens unit 10 via the first interface 14 (S102).

  The setting information is information including information such as the display performance of the display means 23, the displayable data format, and the image size. In other words, the information group includes information on the display device included in the main unit 20.

  Based on the received setting information, the image processing unit 12 generates image data from the imaging data periodically output by the imaging unit 11 (S103). The periodically generated image data is transmitted to the main unit 20 and displayed on the display unit 23, whereby a through image is displayed. Further, the image data generated in the above is temporarily stored and accumulated in the storage means 13 which is a ring buffer (S104).

In the description of the present specification, the through image data that is continuously displayed without being stored and is displayed on the main unit 20 is referred to as “current through image data”, and is image data that has been stored once and is read later. The image data transmitted to the main unit and displayed is referred to as “past through image data”.
Further, the image data constituting the current through image data is denoted as periodic image data, and the image data constituting the past through image data is denoted as accumulated image data.

Here, the detailed processing flow in the processing step S103 will be described. The subject image acquired by the imaging unit 11 via the imaging lens is converted into RGB digital image data by the image processing unit 12. Image data in YUV format is generated from the RGB image data, and transmitted to the main unit in the next processing step S105. The image data transmitted here is periodic image data.
The image data in the YUV format is converted into a compressed image data format such as JPEG format or MPEG format by the image processing means 12 and then stored in the storage means 13 in processing step S104. The image data stored here is stored image data.

In the processing step S104, the image data is accumulated in the storage means 13, and at the same time, the periodic image data is transmitted to the main unit 20 via the second interface 15 (S105).
The image processing means 21 of the main unit 20 performs a data format conversion process on the received periodic image data based on the setting information of the display means 23, converts the data to a size suitable for display (S106), Display is performed using the display means 23 (S107).
As described above, according to the imaging apparatus according to the present embodiment, the generated through image data is transmitted to the main body unit 20 and stored in the storage unit 13 included in the lens unit 10, thereby having a characteristic through described later. An image display process and an imaging method can be realized.

Here, in the image pickup apparatus according to the present embodiment, when the setting “not to perform through image display” is set in advance, the processing flow is as shown in the sequence diagram of FIG. In FIG. 7, each processing step is expressed as S201, S202, S203.
Similarly to FIG. 6, the output (notification) destination of the information generated (processed) in each processing step is indicated by using an arrow.

After the power is turned on, if setting for turning off the live view display is performed by operating the operation unit 24, the sub CPU 205 (FIG. 3) detects this setting operation (S201), and the image processing unit 21 performs the setting operation. Predetermined setting information is generated and transmitted to the lens unit 10 via the first interface 14 (S202).
Based on the received setting information, the image processing unit 12 generates image data from the imaging data periodically output by the imaging unit 11 (S203), and the generated image data is stored in the storage unit 13 that is a ring buffer. Temporarily accumulate (S204). However, the process of transmitting periodic image data to the main unit 20 is not performed based on the setting information.

  Next, an embodiment in which periodic image data and accumulated image data are simultaneously displayed in the imaging method according to the present invention will be described with reference to the drawings. The present embodiment is an example of a flow of processing for simultaneously displaying a current through image and a past through image. In FIG. 8, each processing step is represented as S301, S302, S303,. Further, the output (notification) destination of the information generated (output) in each processing step is represented by using an arrow.

When the periodic image data transmission process and the accumulated image data accumulation process in the first embodiment are being performed, an operation for instructing the display of past through images is performed by the operation unit 24 provided in the main unit 20. The sub CPU 205 (FIG. 3) detects the operation (S301), and the image processing means 21 generates operation information related to the operation and transmits it to the lens unit 10 via the first interface 14 (S302). .
Here, “an operation for instructing the display of a past live view” is a means for displaying past live view such as display (playback), frame advance display, rewind display, fast forward display or pause of past live view. 23 is an operation for enabling visual recognition.
Therefore, the operation information generated by the operation refers to an information group for notifying the lens unit 10 of the various operations described above.

The image processing unit 12 starts predetermined processing based on the received operation information. First, the through image accumulation processing performed so far is stopped (S303).
Next, stored image data is read (S304). Since the stored image data has been converted into a compressed format such as JPEG format, a process of decoding this into YUV data is performed (S305).

Next, the image processing unit 12 generates image data from the imaging data periodically output by the imaging unit 11 (S306), and an image to be synthesized with the decoded accumulated image data and the periodic image data. Processing is performed to generate composite image data (S307). The generated composite image data is transmitted to the main unit 20 via the second interface 15 (S308).
Note that the process of reading and decoding the accumulated image data (S304, S305) and the process of generating the periodic image data (S306) may be reversed in order, and after the periodic image data is generated, the accumulation is performed. You may perform the process which reads and decodes image data.

  The image processing means 21 of the main unit 20 converts the received composite image data into a size suitable for display based on the setting information of the display means 23 (S309), and outputs it to the display means 23 (S310). As a result, the current through image can be displayed while the past through image can be displayed at the same time.

An example of the synthesized image data displayed on the display means 23 by the above processing will be described with reference to FIGS. FIG. 9 shows an example in which the stored image data is decoded and can be displayed, and shows how the subject 91 is moving as time elapses from FIG. 9A to FIG. 9E.
FIG. 10 is an example of periodic image data that is current through image data. FIG. 11 shows an example of image data obtained by synthesizing the accumulated image data shown in FIG. 9 and the periodic image data shown in FIG. In FIG. 11, the subject 91 displayed in the accumulated image data and the subject 92 displayed in the periodic image data are combined and displayed on the same screen display.
For example, as shown in FIG. 11A, a past through image may be imposed on the current through image and displayed in a small size on the lower left of the display means 23, or as shown in FIG. A past through image may be imposed on the through image and displayed at the center of the display means 23.
The display ratio of the current through image and the past through image may be switched and displayed. These display changes are realized by a predetermined operation using the operation means 24.

  As described above, according to the imaging apparatus according to the present embodiment, the periodic image data based on the imaging data periodically output from the imaging unit 11 and the past through image data accumulated in the storage unit 13 in advance. Since the accumulated image data can be synthesized and displayed, optimal imaging processing can be performed without missing a photo opportunity while confirming past through images.

Next, another example of the imaging method according to the present invention will be described with reference to the functional block diagram of FIG. 5 and the sequence diagram of FIG.
The sequence diagram illustrated in FIG. 12 illustrates the flow of still image shooting processing in the imaging method according to the present embodiment.

  In FIG. 12, each processing step is expressed as S401, S402, S403. Further, the output (notification) destination of the information generated (processed) in each processing step is represented by using an arrow.

  This embodiment is executed when a predetermined imaging operation is performed on the operation unit 24 when the combined image data obtained by combining the periodic image data and the accumulated image data is displayed on the display unit 23 as a through image. It is an example of the process performed.

When composite image data is displayed on the display means 23, when a predetermined imaging operation for instructing an imaging operation is performed and an operation signal is input via the operation means 24, the first interface which is a bidirectional interface 14 to that effect is notified to the image processing means 12 (S401).
The predetermined imaging operation is, for example, an operation of depressing the release switch 211 for a predetermined time or more.

  In addition, although not shown in the figure, a predetermined imaging operation is performed by directly inputting a signal from the release switch 211 (FIG. 3) via the release switch interface 226 (FIG. 3) (without passing through the first interface) to the lens unit. The ten image processing means 12 can also be notified.

  The image processing means 12 that has received the release operation notification obtains the subject image from the imaging means 11 and generates image data while continuing to transmit the stored image data as it is (S402). The data format of the image data generated here is the YUV format or the RGB format, and is determined by setting the imaging mode set in advance.

  The generated image data is transmitted to the main unit 20 via the first interface 14 which is a bidirectional interface (S403). The image data generated in the normal still image capturing process is transmitted to the main unit 20 via the second interface 15 that is a one-way interface. In this embodiment, the second interface 15 transmits the through image data. Therefore, the image file is transmitted through the first interface 14.

The above processing is performed in a state where the through image is displayed on the display unit 23 in advance.
When an imaging operation signal is transmitted through the first interface 14 while a through image is displayed, the displayed through image data may be darkened or distorted. Therefore, when the operation information for imaging is transmitted, the main unit 20 temporarily stops the update of the live view image data, and the live view data is not updated depending on the live view data received during that time. The display is controlled so that the live view image data is updated again after waiting for a timing at which normal display can be performed without any disturbance.

  Next, in the main unit 20, an interrupt for notifying completion of storage of image data in the RAM 200 is generated from the DMA controller included in the image processing means 21, and the reception processing of the image data transmitted from the lens unit 10 is completed ( S404).

  The image processing means 21 of the main unit 20 is not shown when the received image data is YUV data and image processing such as color correction and brightness correction is performed in the image processing means 12 of the lens unit 10. The image is compressed into a JPEG format by a JPEG encoder and stored as an image file in a nonvolatile memory such as the SD memory 215 constituting the storage unit 22 (S405).

  Further, the image processing means 21 of the main unit 20 is provided when the received image data is not subjected to image processing such as color correction or brightness correction, and when further image processing or correction is necessary, color correction or After performing image processing such as brightness correction, the image is compressed into a JPEG format by a JPEG encoder (not shown) and stored as an image file in a non-volatile memory such as the SD memory 215 constituting the storage unit 22 (S405).

  Further, when the received image data is RAW data, the image processing means 21 of the main unit 20 performs an arbitrary RAW format after performing image processing such as color correction and luminance correction or without performing the image processing. And is stored as an image file in a non-volatile memory such as the SD memory 215 constituting the storage means 22 (S405).

  In addition, when the received image data is RAW data, the image processing means 21 of the main unit 20 performs image processing such as color correction and luminance correction, and then converts the data into YUV data as necessary, which is not shown. The image is compressed in the JPEG format by the JPEG encoder and stored as an image file in a nonvolatile memory such as the SD memory 215 constituting the storage unit 22 (S405).

  Further, the image processing means 21 of the main body unit 20 converts the received image data into RAW file format when the received image data is RAW data and image processing such as color correction and luminance correction is performed. An image file is stored in a non-volatile memory such as the SD memory 215 constituting the storage means 22 (S405).

  Further, the image processing means 21 of the main unit 20 converts the received image data into RAW data and performs image processing such as color correction and luminance correction, or converts the data into YUV data or is composed of RGB. The raw data is compressed in the JPEG format by a JPEG encoder (not shown) and stored as an image file in a nonvolatile memory such as the SD memory 215 constituting the storage unit 22 (S405).

  In addition, the image processing means 21 of the main body unit 20 can use metadata (for example, EXIF format) as necessary when the received image data is irreversible data such as JPEG format or reversible data such as bitmap format or TIFF format. TAG, etc.) is added and converted into an arbitrary file format, and then stored as an image file in a non-volatile memory such as the SD memory 215 constituting the storage means 22 (S405).

  As described above, according to the present embodiment, when a predetermined imaging operation is performed while displaying a through image obtained by synthesizing a current through image and a past through image, an image is displayed via a bidirectional interface. By transmitting the data to the main unit 20, it is possible to perform the imaging process in parallel with the transmission process of the through image data, and it is possible to perform the flexible imaging without missing a photo opportunity.

  Further, according to the imaging apparatus according to the present embodiment, the format of the image data transmitted from the lens unit 10 to the main unit 20 can be any format according to the processing performance on the main unit 20 side.

  Next, another embodiment of the imaging method using the imaging apparatus according to the present invention will be described with reference to the drawings. The present embodiment is an example of another process related to the still image capturing control shown in the third embodiment. In FIG. 13, each processing step is expressed as S501, S502, S503. Further, the output (notification) destination of the information generated (output) in each processing step is represented by using an arrow.

This embodiment is executed when a predetermined imaging operation is performed on the operation unit 24 when the combined image data obtained by combining the periodic image data and the accumulated image data is displayed on the display unit 23 as a through image. It is an example of the process performed.
When composite image data is displayed on the display unit 23, when a predetermined imaging operation for instructing an imaging operation is performed and an operation signal is input from the operation unit 24, the first interface 14 that is a bidirectional interface is displayed. Accordingly, the fact is notified to the image processing means 12 of the lens unit 10 (S501, S502).
The predetermined imaging operation is, for example, an operation of depressing the release switch 211 for a predetermined time or more.

Here, “an operation to display a past live view” means that past live view is displayed (playback), frame advance display, rewind display, fast forward display, pause, etc. 23 is an operation for displaying in a visible manner.
Therefore, the operation information generated by the operation is information for notifying the lens unit 10 of the various operations described above.

The image processing unit 12 starts predetermined processing based on the received operation information. First, the through image accumulation processing that has been performed is stopped (S503).
Next, the past through image stored in the storage unit 13 is read, and the accumulated image data is block-transferred to the main unit 20 via the first interface 14 (S504). Here, block transfer refers to a process of transmitting stored image data to the main unit 20 in a compressed format.
The image processing means 21 of the main unit 20 performs a decoding process on the received stored image data. (S505).

Next, the image processing means 12 generates image data from the imaging data periodically output by the imaging means 11 (S506), and the generated image data is transmitted to the main unit 20 via the second interface 15. (S507).
Next, the image processing means 21 performs a process of synthesizing the through image data relating to the decoded accumulated image data and the through image data relating to the periodic image data received from the lens unit 20 via the second interface. This is performed (S508).

  Next, the image processing means 21 outputs the combined through image data to the display means 23 (S509). This makes it possible to display the currently acquired image data displayed periodically and the through image data acquired in the past at the same time.

  The imaging apparatus according to the present embodiment can display accumulated image data at the same time while displaying periodic image data by a predetermined operation using the operation unit 24. Since various display controls such as stop and frame return can be performed, even if the subject is missed, the subject image can be confirmed retroactively.

  Next, another embodiment of the imaging method using the imaging apparatus according to the present invention will be described with reference to the drawings. The present embodiment is still another example of processing for simultaneously displaying a current through image and a past through image. In FIG. 14, each processing step is expressed as S601, S602, S603. Further, the output (notification) destination of the information generated (output) in each processing step is represented by using an arrow.

  When the periodic image data and the accumulated image data are transmitted from the lens unit 10 to the main unit 20 and are combined and displayed on the display unit 23 of the main unit 20 at the same time, the operation unit 24 included in the main unit 20 is provided. When the predetermined imaging signal is input by the sub CPU 205 (FIG. 3), the sub CPU 205 (FIG. 3) detects the operation (S601), and the operation information is notified to the image processing means 12 via the first interface 14 which is a bidirectional interface. (S602).

When the lens unit 10 receives the operation information, the lens unit 10 stops the through image accumulation processing that has been performed so far (S603), and stores the accumulated image data read from the storage unit 13 at that time as a “through image display stop frame”. ”To generate an image file based on this frame (S604). The generated image file is transmitted to the main unit 20 via the first interface (S605).
The image processing means 21 stores the received image file in the storage means 22 (S606).

  As described above, the imaging apparatus according to the present embodiment can perform display control such as playback, pause, frame rewind, and rewind of past through images by the operation unit 24, and can be performed during the pause. Since the composite image data of the past live image and the current live image can be recorded, even if the subject is missed, the subject image can be confirmed retroactively by performing a predetermined operation. It can be recorded as an image file.

100 Lens unit 200 Main unit 103 CPU
107 Lens group 114 Flash ROM
115 DDR-SDRAM
116 Connector 123 Bidirectional Interface 125 Unidirectional Interface 201 Connector 223 Bidirectional Interface 225 Unidirectional Interface 208 CPU

JP 2007-110314 A

Claims (10)

An imaging apparatus having a lens unit, and the lens unit and a detachable main body unit,
The lens unit
An optical lens,
An image sensor for imaging subject light transmitted through the optical lens;
An image processing device that periodically generates image data from the output of the imaging device;
A storage device for storing the generated image data;
The stored image data by the image processing apparatus is stored in the periodic image data and the storage device for periodically generating and a communication interface to be transmitted to the main unit,
The main unit is
A communication interface for receiving the periodic image data and the accumulated image data transmitted from the lens unit;
And a display device for displaying the synthesized image data of the periodic image data and the stored image data received from the lens unit,
When the imaging operation signal instructing the imaging operation is transmitted from the main body unit to the lens unit while the composite image data is displayed on the display device, the main body unit is displayed on the display device. Stop updating the display of the composite image data,
An imaging apparatus characterized by that . The main unit is
The imaging apparatus according to claim 1, further comprising: a recording device that records only the periodic image data as an image file among the periodic image data and the accumulated image data received from the lens unit . The main unit is
2. The imaging apparatus according to claim 1, further comprising a recording device that records only the accumulated image data as an image file among the periodic image data and the accumulated image data received from the lens unit . The main unit is
The imaging apparatus according to any one of claims 1 to 3, further comprising a unit that synthesizes the periodic image data received from the lens unit and the accumulated image data to generate the synthesized image data . An imaging apparatus having a lens unit, and the lens unit and a detachable main body unit,
The lens unit
An optical lens,
An image sensor for imaging subject light transmitted through the optical lens;
An image processing device that periodically generates image data from the output of the imaging device;
A storage device for storing the generated image data;
A communication interface that transmits, to the main unit, synthesized image data obtained by synthesizing periodic image data periodically generated by the image processing device and accumulated image data accumulated in the accumulation device;
The main unit is
A communication interface for receiving the composite image data transmitted from the lens unit;
A display device for displaying the received composite image data,
When the imaging operation signal instructing the imaging operation is transmitted from the main body unit to the lens unit while the composite image data is displayed on the display device, the main body unit is displayed on the display device. Stop updating the display of the composite image data,
An imaging apparatus characterized by that. An imaging method using an imaging device having a lens unit, and a lens unit and a detachable body unit,
The lens unit includes an optical lens, an image sensor that captures subject light transmitted through the optical lens, an image processing device that periodically generates image data from the output of the image sensor, and the generated image data. comprising a storage device for storing, a communication interface for transmitting and storing image data by the image processing apparatus is stored in the periodic image data and the storage device for periodically generated in the main unit, and
The main unit includes a communication interface that receives the periodic image data and the accumulated image data transmitted from the lens unit, and a display device that displays composite image data of the periodic image data and the accumulated image data. And comprising
The lens unit,
Transmitting the periodic image data and the stored image data to the main unit ;
Run
The main unit is
Table Shimesuru steps on the display unit the combined image data with the periodic image data and the stored image data,
The execution,
When an imaging operation signal instructing an imaging operation is transmitted from the main unit to the lens unit while the composite image data is displayed on the display device, the main unit is displayed on the display device. Stopping updating the display of the composite image data,
The imaging method characterized by performing. The main unit is
Of the periodic image data received from the lens unit and the accumulated image data , recording only the periodic image data as an image file,
Imaging method according to claim 6, characterized in that the run. The main unit is
Of the periodic image data received from the lens unit and the accumulated image data , recording only the accumulated image data as an image file,
Imaging method according to claim 6, characterized in that the run. The main unit is
Combining the periodic image data received from the lens unit and the accumulated image data to generate the composite image data;
The imaging method according to claim 6, wherein the imaging method is executed. An imaging method using an imaging device having a lens unit, and a lens unit and a detachable body unit,
The lens unit includes an optical lens, an image sensor that captures subject light transmitted through the optical lens, an image processing device that periodically generates image data from the output of the image sensor, and the generated image data. An accumulation device that accumulates; and a communication interface that transmits, to the main unit, composite image data of periodic image data periodically generated by the image processing device and accumulated image data accumulated in the accumulation device,
The main body unit includes a communication interface that receives the composite image data transmitted from the lens unit, and a display device that displays the composite image data.
The lens unit is
Transmitting the composite image data to the main unit;
Run
The main unit is
Displaying the composite image data on the display device;
Run
When an imaging operation signal instructing an imaging operation is transmitted from the main unit to the lens unit while the composite image data is displayed on the display device, the main unit is displayed on the display device. Stopping updating the display of the composite image data,
The imaging method characterized by performing.

Images