JP5269639B2 - Imaging apparatus and communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device capable of performing reproduction display on which photographer's intention to take a still picture is reflected, and a communication system including the imaging device. <P>SOLUTION: The imaging device includes an imaging unit which generates image data by collecting light from a predetermined visual field area and photoelectrically converting the collected light, a display unit which displays an image corresponding to the image data generated by the imaging unit, an input unit which receives a signal including a release signal instructing photography by the imaging unit, an operation decision unit which determines operations performed on the imaging device, a converted image generation unit which generates a converted image by subjecting a photographed image photographed by the imaging unit to predetermined conversion based upon an operation performed before the release signal is input by the input unit among the operations decided by the operation decision unit, and a control unit which controls the display unit to display the photographed image and the converted image, generated by the converted image generation unit based upon the photographed image, successively in predetermined order. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to an imaging apparatus that captures an image and generates electronic image data of the image, and a communication system including the imaging apparatus.

  In recent years, in an imaging device such as a digital camera that captures an image and generates electronic image data, the captured image is played back by another device, or image data is transmitted and received by communicating with another device. Has come to be done. Examples of devices that can communicate with the imaging device include devices that include a display unit having a larger screen than the liquid crystal panel of the imaging device, such as a television, a projector, a personal computer, and a digital photo frame. If an image captured by the imaging device is displayed with such a device, the image can be viewed and enjoyed by a large number of people.

  When viewing and enjoying an image with a large number of people, simply replaying the image may be monotonous. Therefore, there is a demand for a method for reproducing and displaying images that is more entertaining and that everyone can see and enjoy.

  Under such circumstances, with regard to moving images, there is a technology for estimating the operation by the photographer by detecting the movement of the image for each frame, and extracting and displaying important frames reflecting the intention of the photographer to shoot. It is disclosed (see, for example, Patent Document 1).

JP 2004-88352 A

  By the way, as in the case of the moving image described above, it is conceivable to perform reproduction reflecting the photographer's intention of shooting in the case of a still image. Here, as a method of reproducing a still image reflecting the photographer's intention of photographing, it is conceivable to perform reproduction so that the user can re-experience the operation contents performed before photographing. However, in the conventional imaging apparatus, there is no known technique for performing reproduction display that allows the photographer to relive the operation content before photographing.

  The present invention has been made in view of the above, and is a reproduction display that reflects the intention of photographing when the photographer shoots a still image and allows the photographer to re-experience the operation contents before photographing. An object of the present invention is to provide an imaging apparatus capable of performing the above and a communication system including the imaging apparatus.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention is an imaging apparatus that captures an image and generates electronic image data of the image, and emits light from a predetermined visual field region. An imaging unit that generates image data by photoelectrically converting the collected light, a display unit that displays an image corresponding to the image data generated by the imaging unit, and imaging in the imaging unit. An input unit that receives an input of a signal including a release signal to be instructed, an operation determination unit that determines an operation to be performed on the imaging apparatus, and the release signal by the input unit among operations determined by the operation determination unit A converted image generation unit that generates a converted image obtained by performing predetermined conversion on the captured image captured by the imaging unit based on an operation performed before the image is input, and based on the captured image and the captured image In A control unit for controlling the serial converted image generating unit to continuously display a predetermined order the converted image generated on the display unit, characterized by comprising a.

  The imaging device according to the present invention further includes a communication unit that communicates information including image data with a display device that displays information including an image in the above invention, and the control unit includes the communication unit On the other hand, control is performed to continuously transmit the captured image and the converted image generated using the captured image to the display device in the same order as the display order on the display unit.

  Moreover, the imaging device according to the present invention is characterized in that, in the above-mentioned invention, the control unit performs control to make the display time of the converted image shorter than the display time of the captured image.

  Moreover, the imaging device according to the present invention is characterized in that, in the above invention, the converted image has a data amount smaller than that of the captured image.

  In the imaging device according to the present invention as set forth in the invention described above, the operation is zooming, exposure correction, or panning.

  In the image pickup apparatus according to the present invention, in the above invention, when the operation is zooming, the converted image generation unit enlarges or reduces the captured image at a plurality of magnifications according to a zoom speed. The control unit generates a converted image, and the control unit controls the display unit to display the plurality of converted images in order of decreasing magnification or decreasing magnification from the captured image after displaying the captured image. It is characterized by performing.

  Moreover, in the imaging device according to the present invention, in the above invention, when the operation is exposure correction, the converted image generation unit performs a plurality of different corrected images by performing a plurality of different exposure corrections on the captured image. And the control unit controls the display unit to display the plurality of converted images in the order in which the converted image generation unit generates them.

  In the imaging device according to the present invention, in the above invention, when the operation is panning, the converted image generation unit changes in a direction opposite to a direction of movement of the imaging device before photographing in the photographed image. A plurality of converted images are generated by setting a plurality of small regions to be enlarged and enlarging the images of the plurality of set small regions to the same area as the captured image.

  In the imaging device according to the present invention, in the above invention, the control unit displays the plurality of converted images in accordance with the movement of the imaging device before photographing on the display unit before displaying the photographed image. The display is controlled to be displayed.

  An imaging apparatus according to the present invention is an imaging apparatus that is capable of communicating with a display device that displays information including an image, captures the image, and generates electronic image data of the image, and has a predetermined field of view. An imaging unit that collects light from a region and photoelectrically converts the collected light to generate image data, a display unit that displays an image corresponding to the image data generated by the imaging unit, and the imaging unit An input unit that receives input of a signal including a release signal instructing shooting in the camera, an operation determination unit that determines an operation to be performed on the imaging device, and the captured image captured by the imaging unit Control for associating operation information related to an operation performed between a shooting operation corresponding to the shooting operation and a shooting operation immediately before the shooting operation, and performing control to transmit the associated captured image and operation information to the display device Characterized by comprising a and.

  In addition, a communication system according to the present invention includes an imaging device that captures an image and generates electronic image data of the image, and a display device that can communicate with the imaging device and displays information including the image. The imaging apparatus includes: an imaging unit that collects light from a predetermined visual field region and generates image data by photoelectrically converting the collected light; and an image generated by the imaging unit A display unit that displays an image corresponding to the data, an input unit that receives an input of a signal including a release signal instructing shooting in the imaging unit, and an operation determination unit that determines an operation performed on the imaging device The operation information relating to the operation performed between the shooting operation corresponding to the captured image and the shooting operation immediately before the shooting operation is associated with the captured image captured by the imaging unit, and the associated imaging is performed. A control unit that performs control to transmit an image and operation information to the display device, the display device based on the captured image transmitted from the imaging device and the operation information associated with the captured image A converted image generation unit that generates a converted image obtained by performing a predetermined conversion on the captured image, and the converted image generated by the converted image generation unit based on the captured image and the captured image on the display unit in a predetermined order And a display control unit that performs control for continuous display.

  According to the present invention, based on an operation performed before the release signal is input by the input unit among the operations determined by the operation determination unit, a converted image obtained by performing a predetermined conversion on the captured image is generated, and The related photographed image and the converted image are continuously displayed in a predetermined order, so that the photographer's intention of photographing when photographing a still image is reflected and the photographer can relive the operation before photographing. Possible reproduction display can be performed.

  The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 1 of the present invention. An imaging apparatus 1 shown in FIG. 1 collects light from a subject included in a predetermined field of view and generates digital image data from an image signal obtained by photoelectrically converting the collected light. 2, an image processing unit 3 that performs image processing on the image data generated by the imaging unit 2, a display unit 4 that displays an image corresponding to the image data processed by the image processing unit 3, and a release signal An input unit 5 that receives an input of an operation signal or the like of the imaging device 1 including a sensor, a sensor unit 6 that detects the state of the field of view of the imaging unit 2 including brightness, and a clock 7 having a shooting date determination function and a timer function. An operation determination unit 8 that determines an operation to be performed on the imaging apparatus 1, a communication unit 9 that transmits and receives information using a predetermined communication method with an external device, and an image captured by the imaging unit 2. Various information including image data A storage unit 10 for storing to a control unit 11 for controlling the operation of the imaging apparatus 1 according to the operation signal input from the detection result and the input unit 5 of the sensor unit 6, the.

  The imaging unit 2 includes one or a plurality of lenses, and includes an optical system that collects light from a subject existing in a predetermined visual field area, a diaphragm that adjusts the amount of incident light collected by the optical system, and a release. An image sensor such as a CCD (Charge Coupled Device) that receives the light that has passed through the shutter and the shutter, and operates according to the signal, and converts it into an electrical signal, and an analog signal output from the image sensor is amplified and white balanced And a signal processing circuit that generates digital image data by performing A / D conversion after performing signal processing such as the above.

  The image processing unit 3 generates a converted image obtained by performing a predetermined conversion on the photographed image based on an operation performed before the release signal is input by the input unit 5 among the operations determined by the operation determining unit 8. A converted image generation unit 31 is included. Since the converted image generated by the converted image generation unit 31 is an auxiliary image for obtaining a visual effect at the time of reproduction, it is more preferable that the data amount is smaller than the captured image.

  The display unit 4 is realized by using a display panel made of liquid crystal, organic EL, or the like, and appropriately displays operation information of the imaging apparatus 1 and information related to photographing in addition to image data.

  The input unit 5 switches a power button of the imaging apparatus 1, a release button for inputting a release signal for giving an imaging instruction, a button for adjusting zoom and exposure at the time of shooting, and various operation modes that can be set by the imaging apparatus 1. A mode switching button for performing, a control button including instructions for reproducing and editing image data, and the like. Further, a touch panel may be stacked on the display unit 4 as the input unit 5 so that the user can input an operation signal on the display unit 4.

  The sensor unit 6 includes an acceleration sensor and / or angular velocity sensor that detects the movement of the imaging device 1, a position sensor that receives information sent from a GPS (Global Positioning System) and detects the position of the imaging device 1. .

  The communication unit 9 performs wireless communication such as wireless LAN (Local Area Network) or infrared communication with the display device 201 that displays an image. Note that communication between the communication unit 9 and the display device 201 may be realized by wire.

  The storage unit 10 relates to an image data storage unit 101 that stores image data of an image shot by the imaging unit 2 and processed by the image processing unit 3, and an operation performed on the imaging device 1 before shooting. The operation information storage unit 102 that stores the operation information, the associated information storage unit 103 that stores the captured image captured by the imaging unit 2 in association with the operation information related to the operation performed before the imaging, and the imaging apparatus 1 execute. And a program storage unit 104 that stores various programs. The storage unit 10 is realized using a semiconductor memory such as a flash memory or a DRAM fixedly provided inside the imaging apparatus 1. The storage unit 10 may function as a recording medium interface that records information on a computer-readable recording medium such as a memory card mounted from the outside while reading information recorded on the recording medium. Good.

  The control unit 11 is realized using an MPU (Micro Processing Unit) or the like, and is connected to each component of the imaging apparatus 1 via a bus line.

  FIG. 2 is a diagram illustrating types of main modes that can be set by the imaging apparatus 1 having the above configuration. The imaging apparatus 1 can set at least a shooting mode for shooting an image and a playback mode for playing back various image data stored in the storage unit 10.

  Among these, in the shooting mode, a normal shooting mode and a special shooting mode can be set. The special shooting mode is a mode in which an image captured by the imaging unit 2 during an operation such as zooming, exposure correction, or panning performed before shooting is stored and associated with the operation information.

  On the other hand, in the playback mode, three types of modes, a normal playback mode, an image transmission mode, and a slide show mode, can be set. The normal reproduction mode is a mode in which an image selected by the input unit 5 among images stored in the image data storage unit 101 is reproduced and displayed on the display unit 4. The image transmission mode is a mode in which image data of an image reproduced and displayed on the display unit 4 is transmitted to the display device 201. The slide show mode is a mode in which a plurality of images are displayed on the display unit 4 automatically and continuously in a predetermined order and image data corresponding to these images is transmitted to the display device 201.

  The display device 201 that communicates with the imaging device 1 and displays an image included in the image data transmitted from the imaging device 1 can be realized using any of a television, a projector, a personal computer, and a digital photo frame. The display device 201 includes display switching means for switching between displaying an image based on the image data transmitted from the imaging device 1 and displaying an image based on other functions.

  FIG. 3 is a diagram illustrating a situation where processing characteristic of the imaging apparatus 1 is performed. In FIG. 3, it is assumed that the photographer gradually zooms up using the imaging device 1 and photographs the whole body of the deer B. In this case, when playing back the captured image, the viewer can view the fact that the photographer has zoomed up in some way, as well as displaying the actual captured image. Can relive the mood of the photographer when shooting. In the first embodiment, when the imaging apparatus 1 is set to the special shooting mode, an operation by the photographer before shooting is determined, and this operation information is stored. Thereafter, when the imaging apparatus 1 is set to the slide show mode and reproduces the captured image, the captured image is displayed and an image corresponding to the content of the operation before capturing the captured image is generated and displayed.

  4 is a diagram illustrating a display example of a reproduced image on the display unit 4 and the display device 201 when the photographer performs a zoom-up operation before photographing in the imaging device 1 set to the slide show mode. It is a figure which shows the example of a display in the case of reproducing | regenerating the picked-up image image | photographed on the condition shown in. In FIG. 4, an image 301 that is a captured image is first displayed on the display unit 4. The images 302 and 303 displayed thereafter are converted images obtained by gradually enlarging the center portion of the image 301. In this case, the display time of the images 302 and 303 is set shorter than the display time of the image 301. Thus, by generating the images 302 and 303 obtained by enlarging the image 301 as converted images and sequentially displaying them after the image 301 is displayed, it is possible to display an outline of the operation at the time of photographing by the photographer. As a result, the viewer of the image can appreciate the image while being immersed in the photographer's mood rather than when the image is simply reproduced and displayed. Although the case where the photographer performed a zoom-up operation before shooting is described here, when the photographer performs a zoom-down operation before shooting, the reduced images are sequentially displayed in the center of the screen. You may make it display.

  FIG. 5 is a diagram illustrating a display example of a reproduced image on the display unit 4 and the display device 201 when the photographer performs shooting after performing an exposure correction operation in a state where the imaging device 1 is set to the special shooting mode. In the case illustrated in FIG. 5, images 304 to 306 indicate a case where the exposure correction is displayed so as to gradually change from plus to minus. Of the three images 304 to 306, for example, when the image 306 is a captured image, the other images 304 and 305 are converted images generated by performing exposure correction from the image 306. In this case, if the image 306 is displayed longer than the other images 304 and 305, the viewer of the slide show can accurately recognize which is the captured image. In addition, by displaying a plurality of images with different exposures, it is possible to clearly display all the locations in the screen by any one of a series of images.

  FIG. 6 shows a display example of the reproduced image on the display unit 4 and the display device 201 when the photographer takes a panning by panning operation with the imaging device 1 set to the special imaging mode. Of the four images shown in FIG. 6, the captured image is the image 310 that is displayed last. FIG. 7 is a diagram showing an outline of the panning operation when the image 310 is captured. As shown in FIG. 7, the photographer pans the imaging device 1 leftward in the horizontal direction in accordance with the movement of the horse H. The imaging device 1 can detect the movement of the main body based on the detection result of the sensor unit 6. When this movement satisfies a predetermined condition, the imaging apparatus 1 recognizes that a panning operation has been performed, and records the operation content in the operation information storage unit 102.

  In FIG. 6, three images 307 to 309 displayed in front of the image 310 are converted images generated by cutting out and enlarging different portions from the image 310 in accordance with the movement of the imaging device 1. According to the display using such images 307 to 309, the viewer can visually recognize the outline of the panning operation when the image 310 is photographed by expressing the running feeling of the horse H. Also in this case, if the display time of the image 310 that is a captured image is set longer than the display time of the other images 307 to 309, the viewer can accurately recognize that the image 310 is a captured image. Although the case where the panning operation in the horizontal direction is performed has been described here, the same display can be performed in the case of the panning operation in the vertical direction (tilting operation). Moreover, you may make it display between conversion images instead of displaying a picked-up image last.

  Under normal settings, most controls, such as exposure and focus, are performed automatically, so the photographer wants to shoot elaborate images when switching to manual operation. It can be assumed that this is the case. Therefore, by generating a converted image corresponding to the manual operation as described above and displaying it continuously with the photographed image, it is possible to perform reproduction display that clearly reflects the photographer's intention.

  FIG. 8 is a flowchart illustrating an outline of processing when the imaging apparatus 1 is set to the shooting mode or the playback mode. First, a case where the shooting mode is set will be described (step S1: shooting mode).

  When the normal shooting mode is set among the shooting modes (step S2: normal shooting mode), the display unit 4 displays an image (through image) captured by the imaging unit 2 (step S3). Thereafter, when a release signal is input by the input unit 5 (step S4: Yes), the imaging unit 2 performs shooting (step S5). Thereafter, the imaging apparatus 1 records the image data of the image subjected to the image processing by the image processing unit 3 in the image data storage unit 101 (step S6). When no release signal is input by the input unit 5 (step S4: No), the imaging device 1 proceeds to step S7 described later.

  In step S <b> 7, when a signal for ending photographing is input by the input unit 5 (step S <b> 7: Yes), the imaging device 1 ends a series of processes. On the other hand, in step S7, when a signal for ending photographing is not input by the input unit 5 (step S7: No), the imaging device 1 returns to step S1.

  Next, a case where the imaging device 1 is set to the special shooting mode will be described (step S2: special shooting mode). After the display unit 4 displays the through image (step S8), when there is an operation other than the release on the imaging device 1 (step S9: Yes), the imaging device 1 writes the operation information to the operation information storage unit 102. (Step S10). Thereafter, when a release signal is input by the input unit 5 (step S11: Yes), the imaging unit 2 performs a shooting operation (step S12). Thereafter, the imaging apparatus 1 records the captured image in the association information storage unit 103 in association with the operation information (step S13), and proceeds to step S7. If there is no operation other than the release in step S9 (step S9: No), the imaging device 1 proceeds to step S11. When no release signal is input by the input unit 5 in step S11 (step S11: No), the imaging device 1 proceeds to step S7.

  Next, the case where the imaging device 1 is set to the reproduction mode (step S14: Yes) will be described. When the imaging device 1 is set to the slide show mode (step S14: Yes), the imaging device 1 displays the slide show image selected by the user on the display unit 4 as a slide show, and the communication unit 9 displays the image on the display device 201. It transmits sequentially (step S15). Thereafter, when a signal for ending reproduction is input by the input unit 5 (step S16: Yes), the imaging device 1 ends a series of processes. On the other hand, when the signal to end reproduction is not input by the input unit 5 (step S16: No), the imaging device 1 returns to step S1.

  When the imaging device 1 is not set to the slide show mode (step S14: No) and is set to the image transmission mode (step S17: Yes), the imaging device 1 displays the image selected by the user on the display unit 4. And is transmitted to the display device 201 by the communication unit 9 (step S18). The display device 201 displays an image received from the imaging device 1. Hereinafter, it is assumed that the images transmitted to the display device 201 are sequentially displayed on the display device 201.

  Thereafter, when a deletion instruction is input by the input unit 5 (step S19: Yes), the imaging device 1 deletes the image data of the image displayed on the display unit 4 from the image data storage unit 101 (step S20). Proceed to step S16. On the other hand, when a deletion instruction is not input by the input unit 5 (step S19: No), the process proceeds to step S16.

  When the imaging device 1 is not set to the slide show mode (step S14: No) and is not set to the image transmission mode (step S17: No), the imaging device 1 is set to the normal playback mode. The image selected by the photographer is displayed on the display unit 4 (step S21), and the process proceeds to step S19.

FIG. 9 is a flowchart showing details of the slide show image display and transmission processing in step S15 of FIG. First, when there is no operation related to the photographed image selected and reproduced by the user (step S31: No), the imaging device 1 displays the photographed image on the display unit 4 and transmits it to the display device 201 by the communication unit 9. (Step S32). Thereafter, when the predetermined time t ₀ has elapsed (step S33: Yes), if there is a photographed image to be displayed next (step S34: Yes), the imaging apparatus 1 returns to step S31, but should be displayed next. If there is no photographed image (step S34: No), the imaging apparatus 1 returns to the main routine shown in FIG. 8 and proceeds to step S16. When the time t ₀ has not elapsed in step S33 (step S33: No), the imaging device 1 repeats step S33.

  Next, a case where there is an operation related to a captured image selected and reproduced by the user (step S31: Yes) will be described. In this case, the imaging apparatus 1 reads operation information related to the captured image to be reproduced from the associated information storage unit 103 (step S35).

When the operation information read from the associated information storage unit 103 is zooming (step S36: Yes), the operation determination unit 8 performs zooming speed determination (step S37), and the converted image generation unit 31 is based on the determination result. The display time t ₁ of the converted image generated by and the total number p of converted images to be generated by the converted image generation unit 31 are set (step S38). Here, for example, the operation determination unit 8 sets the display time t ₁ to be shorter as the zooming speed increases.

Thereafter, the control unit 11 displays the captured image on the display unit 4 and transmits it to the display device 201 via the communication unit 9 (step S39). When the time t ₀ has elapsed after the display unit 4 starts displaying the captured image in step S39 (step S40: Yes), the imaging device 1 proceeds to step S41. On the other hand, when the time t ₀ has not elapsed since the display unit 4 started displaying the captured image (step S40: No), the imaging device 1 repeats step S40.

  Subsequently, the control unit 11 sets a parameter m for counting the number of repetitions to zero (step S41), and sets a value (m + 1) obtained by increasing the parameter m by 1 as a new parameter m (step S42).

Thereafter, the converted image generating section 31, after enlarged or reduced at a predetermined magnification to generate a transformed image P _m by cutting out a predetermined area (step S43). Thereafter, the control unit 11 displays the converted image _Pm on the display unit 4 and transmits the converted image Pm to the display device 201 via the communication unit 9 (step S44).

If the display time t ₁ has elapsed after the display unit 4 starts displaying the converted image P _m in step S44 (step S45: Yes), the imaging is performed if the parameter m is equal to the total number p of converted images (step S46: Yes). The apparatus 1 proceeds to step S34. On the other hand, if the parameter m is not equal to the total number p of converted images in step S46 (step S46: No), the imaging device 1 returns to step S42. If the display time t ₁ has not elapsed since the display unit 4 started to display the converted image P _m (step S45: No), the imaging device 1 repeats step S45.

  In this way, the display shown in FIG. 4 is realized by performing the processing when the operation information related to the captured image relates to zooming.

When the operation information read from the associated information storage unit 103 is not zooming (step S36: No) and exposure correction is performed (step S47: Yes), the converted image generation unit 31 applies exposure correction ΔS ₁ ( > 0) to generate a converted image Q ₁ subjected to (step S48). Thereafter, the control unit 11, via the communication unit 9 transmits to the display device 201 along with displaying the converted image Q ₁ on the display unit 4 (step S49).

  Subsequently, the control unit 11 sets a parameter m for counting the number of repetitions to zero (step S50), and sets a value (m + 1) obtained by increasing the parameter m by 1 as a new parameter m (step S51).

Thereafter, the converted image generating section 31 generates the converted image Q _{m + 1} by performing exposure correction -ΔS ₂ (<0) in the transformed image Q _m (step S52). It is assumed that ΔS ₁ > ΔS ₂ (> 0) and ΔS ₁ is a multiple of ΔS ₂ . Under these conditions, the converted image includes the exposure correction total ΔS from the captured image of zero and includes substantially the same image as the captured image.

After step S52, the control unit 11 displays the converted image Q _{m + 1} on the display unit 4 and transmits it to the display device 201 via the communication unit 9 (step S53).

In the following step S54, when the exposure correction sum ΔS of the converted image Q _{m + 1} generated in step S52 is zero (step S54: Yes), the display unit 4 displays the converted image Q _{m + 1} for the time t _0. To do. That is, if the time t ₀ has elapsed since the display unit 4 started to display the converted image Q _{m + 1} (step S55: Yes), the imaging apparatus 1 proceeds to step S57 described later, while the display unit 4 performs conversion. If the time t ₀ has not elapsed since the start of displaying the image Q _{m + 1} (step S55: No), the imaging device 1 repeats step S55.

On the other hand, if the total exposure correction ΔS of the converted image Q _{m + 1} is not zero in step S54 (step S54: No), the display unit 4 displays the converted image Q _{m + 1} for the time t ₂ (<t ₀ ). To do. That is, if the time t ₂ has elapsed since the display unit 4 started to display the converted image Q _{m + 1} (step S56: Yes), the imaging apparatus 1 proceeds to step S57 described later, while the display unit 4 performs conversion. If the time t ₂ has not elapsed since the start of displaying the image Q _{m + 1} (step S56: No), the imaging device 1 repeats step S56.

In step S57, when the total amount ΔS of exposure correction from the captured image of the converted image Q _{m + 1} is larger than a predetermined lower limit value −q (q> 0) (step S57: Yes), the imaging device 1 goes to step S51. Return. On the other hand, when the exposure correction total ΔS from the captured image of the converted image Q _{m + 1} is −q or less (step S57: No), the imaging apparatus 1 proceeds to step S34.

  In this way, the display shown in FIG. 5 is realized by performing the processing when the operation information stored in the association information storage unit 103 relates to exposure correction.

If the operation information read from the associated information storage unit 103 is not zooming (step S36: No) and is not exposure correction (step S47: No), the operation information relates to panning. In this case, the control unit 11, based on the direction of motion of the imaging apparatus 1 operation determining unit 8 determines, sets a small region D ₁ to D _r to be extracted as a converted image (step S58). FIG. 10 is a diagram illustrating an example of setting a small area when the display illustrated in FIG. 6 is performed. FIG. 10 shows a case where _three small areas D _{1 to} D ₃ are set, that is, the total number r of small areas is 3. These three small areas D _{1 to} D ₃ are in the order of D ₁ , D ₂ , D ₃ in the direction of movement of the image pickup apparatus 1 before shooting in the image 310 that is the shot image (horizontal left direction: FIG. 7). (See right).

  Subsequently, the control unit 11 sets a parameter m for counting the number of repetitions to zero (step S59), and sets a value (m + 1) obtained by increasing the parameter m by 1 as a new parameter m (step S60).

Thereafter, the converted image generating section 31 generates the converted image R _m by enlarging cut out small region D _m of the photographic image in the same area as the captured image (step S61). FIG. 11 is a diagram schematically illustrating a situation in which the converted image generation unit 31 generates an image 307 corresponding to the converted image R ₁ from the small area D ₁ of the image 310 that is a captured image.

Subsequently, the control unit 11 to transmit to the display device 201 via the communication unit 9 causes the display on the display unit 4 the converted image R _m (step S62).

When a predetermined time t ₃ (<t ₀ ) has elapsed since the display unit 4 started displaying the converted image R _m in step S62 (step S63: Yes), if the parameter m is equal to the total number r of small regions (step S63). S64: Yes), the control unit 11 displays the captured image on the display unit 4 and transmits it to the display device 201 via the communication unit 9 (step S65). On the other hand, if the parameter m is not equal to the total number r of small regions in step S64 (step S64: No), the imaging device 1 returns to step S60. If the predetermined time t ₃ (<t ₀ ) has not elapsed since the display unit 4 started displaying the converted image R _m (step S63: No), the imaging device 1 repeats step S63.

When the time t ₀ has elapsed after the display unit 4 starts displaying the captured image in step S65 (step S66: Yes), the imaging apparatus 1 proceeds to step S34. On the other hand, when the time t ₀ has not elapsed since the display unit 4 started displaying the captured image (step S66: No), the imaging device 1 repeats step S66.

  In this way, the display shown in FIG. 6 is realized by performing the processing when the operation information stored in the association information storage unit 103 is related to panning.

  According to the first embodiment of the present invention described above, predetermined conversion into a photographed image is performed based on an operation performed before the release signal is input by the input unit 5 among the operations determined by the operation determination unit 8. In order to generate a converted image that has been subjected to, and to continuously display the captured image and the converted image that are related to each other in a predetermined order, the photographer performs reproduction display that reflects the intention of shooting when shooting a still image Is possible. As a result, the viewer can relive the operation of the photographer and can view the reproduced image with a feeling close to the feeling the photographer felt at the time of shooting.

  Further, according to the first embodiment, since the image can be displayed on the display device 201 by transmitting the image data to the display device 201 having a larger screen than the display unit 4, the image can be displayed as a large number of people. It becomes possible to enjoy watching.

  In the first embodiment, the imaging apparatus 1 reproduces and displays an image shot in the special shooting mode as shown in FIGS. 4 to 6 only when the slide show mode is set. The same display may be performed in other playback modes.

  In the first embodiment, the imaging device 1 transmits image data regardless of the presence or absence of the display device 201 when the image transmission mode or the slide show mode is set. It is also possible to adopt a configuration in which image data is transmitted only when communication with an external device such as the display device 201 is established before image data is transmitted.

(Embodiment 2)
The second embodiment of the present invention is characterized in that the display device generates a converted image. For this reason, the imaging device transmits the captured image and the operation information associated with each other to the display device when the slide show mode is set.

  FIG. 12 is a block diagram showing a configuration of a communication system according to the second embodiment. A communication system 1000 shown in the figure includes an imaging device 21 and a display device 401 that can communicate with each other.

  The imaging device 21 includes an imaging unit 2, an image processing unit 22, a display unit 4, an input unit 5, a sensor unit 6, a clock 7, an operation determination unit 8, a communication unit 9, a storage unit 10, and a control unit 11. Unlike the image processing unit 3 described above, the image processing unit 22 does not have a function of generating a converted image.

  The display device 401 includes a communication unit 402 that transmits and receives various types of information including image information to and from the imaging device 21, an input unit 403 that receives input of various types of information including operation instructions, and image data received from the outside. An image processing unit 404 that performs image processing on an image to be processed, a display unit 405 that displays an image processed by the image processing unit 404, and a storage unit 406 that stores various types of information including image data received from the outside. And a display control unit 407 for controlling the operation of the display device 401.

  The image processing unit 404 includes a converted image generation unit 441 that generates a converted image obtained by performing predetermined conversion on the captured image based on the captured image and operation information received from the imaging device 21.

  The display unit 405 is realized using liquid crystal, organic EL, or the like. If the display unit 405 has a large screen, it is suitable for viewing an image with a large number of people.

  The storage unit 406 includes an association information storage unit 461 that stores a captured image and operation information received from the imaging device 21 and associated with each other, and a program storage unit 462 that stores various programs executed by the display device 201. Have.

  The display control unit 407 is realized using an MPU or the like, and is connected to each component of the display device 401 via a bus line.

  The display device 401 having the above configuration can be realized by using, for example, any one of a television, a projector, a personal computer, and a digital photo frame. In this case, the display device 401 may be provided with display switching means for switching between displaying an image based on the image data sent from the imaging device 21 and displaying an image based on other functions.

  FIG. 13 is a flowchart illustrating an outline of processing when the imaging device 21 is set to the shooting mode or the playback mode. In the flowchart shown in FIG. 13, the processes in steps S101 to S114 and S116 to S120 except for step S115 are the same as the processes in steps S1 to S14 and S16 to S20 in the flowchart shown in FIG.

  In step S115, the communication unit 9 sequentially transmits slide show images to the display device 401 (step S115). Note that the display unit 4 does not display a slide show image.

  The details of the slide show image transmission process in step S115 will be described below with reference to the flowchart of FIG. When there is no operation related to the captured image selected and reproduced by the user (step S131: No), the communication unit 9 transmits the captured image to the display device 401 (step S132). Thereafter, if there is a captured image to be transmitted next (step S133: Yes), the imaging device 21 returns to step S131, while if there is no captured image to be transmitted next (step S133: No), the imaging device 21 The process returns to the main routine shown in FIG. 13 and proceeds to step S116.

  On the other hand, when there is an operation related to the captured image selected and reproduced by the user (step S131: Yes), the communication unit 9 transmits the captured image and the operation information associated with each other to the display device 401 (step S134). Thereafter, the imaging device 21 proceeds to step S133.

  FIG. 15 is a flowchart illustrating details of processing performed by the display device 401 based on a captured image and operation information received from the imaging device 21. As a premise for performing the following processing, it is assumed that the display device 401 has established communication with the imaging device 21.

  First, when the captured image to be reproduced by the communication unit 402 and the operation information associated with the captured image are not received (step S141: No), if the predetermined time has elapsed (step S142: Yes), the display device 401 An error signal is transmitted to the imaging device 21 via the communication unit 402 (step S143), and an error is displayed on the display unit 405 (step S144). When the predetermined time has not elapsed in step S142 (step S142: No), the display device 401 returns to step S141.

  Thereafter, when a signal to end the slide show is input by the input unit 403 (step S145: Yes), the display device 401 ends a series of processes. On the other hand, when the signal to end the slide show is not input by the input unit 403 (step S145: No), the display device 401 returns to step S141.

  Next, a case where a captured image reproduced by the communication unit 402 and operation information associated with the captured image are received (step S141: Yes) will be described. The processing of steps S146 to S176 performed subsequently in this case sequentially corresponds to the processing of steps S36 to S66 shown in FIG. However, since FIG. 15 shows the processing of the display device 401, various images are not transmitted in steps S149, S154, S159, S163, S172, and S175.

  According to the second embodiment of the present invention described above, the imaging device 21 captures operation information of operations performed before the release signal is input by the input unit 5 among the operations determined by the operation determination unit 8. The display device 401 generates a converted image obtained by performing predetermined conversion on the captured image based on the received captured image and operation information, and the generated converted image and captured image are stored in a predetermined manner. Since the images are continuously displayed in order, it is possible to perform reproduction display reflecting the intention of shooting when the photographer takes a still image. As a result, the viewer can relive the operation of the photographer and can view the reproduced image with a feeling close to the feeling the photographer felt at the time of shooting.

  Further, according to the second embodiment, since the imaging device 21 does not need to generate a converted image, the amount of data transmitted to the display device 401 can be reduced, and data can be transmitted more quickly. it can.

  Further, according to the second embodiment, since the display device 401 reproduces an image including a converted image, it is suitable for viewing the reproduced image with a large number of people like a party.

(Appendix)
A communication unit that performs communication of information including image data with an imaging device that captures an image and generates electronic image data of the image;
A display unit for displaying an image corresponding to the image data received from the imaging device;
A converted image generating unit that generates a converted image obtained by performing a predetermined conversion on the captured image based on the captured image received by the communication unit from the imaging apparatus and operation information associated with the captured image;
A display control unit that performs control to continuously display the captured image and the converted image generated by the converted image generation unit based on the captured image in a predetermined order on the display unit;
A display device comprising:

(Other embodiments)
The best mode for carrying out the present invention has been described in detail so far, but the present invention should not be limited only by the above-described two embodiments. FIG. 16 is a flowchart showing an outline of processing when an imaging apparatus according to another embodiment of the present invention is set to a shooting mode or a playback mode. In FIG. 16, the same processes as those in the flowchart of FIG. 8 are denoted by the same step numbers as in FIG. In the flowchart shown in FIG. 16, the processing when an image deletion instruction is issued when the image transmission mode or the normal reproduction mode is set is different from the flowchart of FIG. Specifically, when a deletion instruction is input by the input unit in step S19 (step S19: Yes), the image processing unit resizes the image to a small capacity (step S22). Specifically, the image data is reduced to about 5% of the original image. Thereafter, the imaging apparatus records the compressed image in association with the associated information storage unit in association with the previous and subsequent captured images (step S23), deletes the original image (step S24), and then proceeds to step S16.

  As described above, when the deletion instruction is input in the case of the image transmission mode or the normal playback mode, the image to be deleted is resized and stored, and when the slide show mode is set, the converted image is stored. It may be used as a part.

  In addition, although the case where the deletion instruction is input when the image transmission mode or the normal playback mode is set has been described here, for example, a configuration in which the photographer can delete immediately after shooting in the normal shooting mode In this case, the image deleted immediately after shooting is resized and stored, then linked to the image that was shot and saved, and used as part of the converted image when played back in slideshow mode. May be.

  In the present invention, operations other than those described above can be included as operations to be determined by the operation determination unit.

It is a block diagram which shows the structure of the imaging device which concerns on Embodiment 1 of this invention. It is a figure which shows the kind of main mode which can be set with the imaging device which concerns on Embodiment 1 of this invention. It is a figure explaining the condition which performs the process characteristic of the imaging device which concerns on Embodiment 1 of this invention. Example of displaying an image when the imaging apparatus according to Embodiment 1 of the present invention reproduces and displays an image shot with the special shooting mode set (when a zooming operation is performed before shooting) FIG. An example of displaying an image when the image capturing apparatus according to Embodiment 1 of the present invention reproduces and displays an image shot in a state where the special shooting mode is set (set an exposure correction operation before shooting) FIG. Example of displaying an image captured by the imaging apparatus according to Embodiment 1 of the present invention while the special imaging mode is set and displayed while being set to the slide show mode (a panning operation is performed before shooting) FIG. It is a figure which shows the outline | summary of panning operation using the imaging device which concerns on Embodiment 1 of this invention. 6 is a flowchart illustrating an outline of processing when the imaging apparatus according to Embodiment 1 of the present invention is set to a shooting mode or a playback mode. 6 is a flowchart showing details of a slide show image display and transmission process when the imaging apparatus according to Embodiment 1 of the present invention is set in a slide show mode. It is a figure which shows typically the example of a setting of the small area | region at the time of performing the display shown in FIG. It is a figure which shows typically the condition where a conversion image production | generation part produces | generates a conversion image. It is a block diagram which shows the structure of the communication system which concerns on Embodiment 2 of this invention. It is a flowchart which shows the outline | summary of a process in case the imaging device which concerns on Embodiment 2 of this invention is set to imaging | photography mode or reproduction | regeneration mode. 12 is a flowchart illustrating details of a slide show image transmission process when the imaging apparatus according to the second embodiment of the present invention is set to a slide show mode. 10 is a flowchart illustrating details of processing performed by a display device based on a captured image and operation information received from an imaging device in a communication system according to Embodiment 2 of the present invention. It is a flowchart which shows the outline | summary of a process in case the imaging device which concerns on another embodiment of this invention is set to imaging | photography mode or reproduction | regeneration mode.

DESCRIPTION OF SYMBOLS 1,21 Imaging device 2 Imaging part 3, 22, 404 Image processing part 4, 405 Display part 5, 403 Input part 6 Sensor part 7 Clock 8 Operation determination part 9, 402 Communication part 10, 406 Storage part 11 Control part 31, 441 Conversion image generation unit 101 Image data storage unit 102 Operation information storage unit 103, 461 Associated information storage unit 104, 462 Program storage unit 201, 401 Display device 301-310 Image 407 Display control unit 1000 Communication system B Deer H Horse D ₁ ~D ₃ small area

Claims (10)

An imaging device that captures an image and generates electronic image data of the image,
An imaging unit that collects light from a predetermined field of view and generates image data by photoelectrically converting the collected light; and
A display unit for displaying an image corresponding to the image data generated by the imaging unit;
An operation determination unit that determines an operation performed on the imaging device;
An image processing unit for generating an image reflecting the operation determined by the operation determination unit before taking a still image;
A control unit that causes the display unit to perform display using the image generated by the image processing unit and the captured image captured by the imaging unit;
An imaging apparatus comprising: The controller is
The imaging apparatus according to claim 1 , wherein when the captured image is reproduced, the image generated by the image processing unit is reproduced in a shorter time than the captured image . The imaging apparatus according to claim 1 , wherein the operation is a manual operation . The image processing unit
The imaging apparatus according to claim 1 , further comprising: a converted image generation unit configured to generate a converted image obtained by performing a predetermined conversion on the captured image as the image reflecting the operation . The converted image generation unit
When the operation is panning, a plurality of small areas that change in a direction opposite to the direction of movement of the imaging device before photographing are set in the photographed image, and the images of the set plurality of small areas are photographed. The imaging apparatus according to claim 4 , wherein a plurality of converted images are generated by enlarging each to an area equal to the image. The converted image generation unit
When the operation is zooming, a plurality of converted images are generated by enlarging or reducing the captured image at a plurality of magnifications according to a zoom speed,
The controller is
Relative to the display unit, the after displaying the captured image, according to claim 4, characterized in that the control to display the plurality of converted images in order sequentially or reduction ratio magnification is small is large from the captured image Imaging device. The converted image generation unit
When the operation is exposure correction, a plurality of converted images are generated by performing a plurality of different exposure corrections on the captured image,
The controller is
The imaging apparatus according to claim 4 , wherein the display unit is controlled to display the plurality of converted images in an order generated by the converted image generation unit. A communication unit that communicates information including image data with a display device that displays information including an image;
The controller is
8. The control according to claim 4, wherein the communication unit is controlled to transmit the captured image and the converted image generated using the captured image to the display device. 9 . Imaging device. An imaging device that captures an image and generates electronic image data of the image,
An imaging unit that collects light from a predetermined field of view and generates image data by photoelectrically converting the collected light; and
An operation determination unit that determines an operation performed on the imaging device;
A communication unit that communicates information including image data with a display device that displays information including an image;
Operation information related to the operation performed between the shooting operation corresponding to the captured image and the shooting operation immediately before the shooting operation is associated with the captured image captured by the imaging unit, and the associated captured image And a control unit that performs control to transmit operation information to the display device;
An imaging apparatus comprising: A communication system comprising: an imaging device that captures an image and generates electronic image data of the image; and a display device that is communicable with the imaging device and displays information including the image,
The imaging device
An imaging unit that collects light from a predetermined field of view and generates image data by photoelectrically converting the collected light; and
An operation determination unit that determines an operation performed on the imaging device;
Operation information related to the operation performed between the shooting operation corresponding to the captured image and the shooting operation immediately before the shooting operation is associated with the captured image captured by the imaging unit, and the associated captured image And a control unit that performs control to transmit operation information to the display device;
Prepared,
The display device
An image processing unit that generates an image reflecting the operation based on a captured image transmitted from the imaging device and operation information associated with the captured image;
A display control unit for performing display using an image generated by the image processing unit and a captured image captured by the imaging unit;
A communication system comprising:

Images