JP2016103841A - Imaging apparatus and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of obtaining a plurality of images desired by a suer by one photographing operation and an imaging method.SOLUTION: The imaging apparatus includes an imaging part which images a subject and generates the image data of the subject, a display part which can display information including an image, an image processing part which performs a plurality of types of processing different from each other to one image data and synthesizes a plurality of image data each having the plurality of types of processing with a set layout, and a display control part which allows the display part to display a synthetic image synthesized by the image processing part.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus and an imaging method for imaging a subject and generating image data of the subject.

  2. Description of the Related Art Conventionally, in an imaging device that captures a subject and generates image data of the subject, a plurality of guide images based on a plurality of guide image data corresponding to a series of sample images are obtained when a series of pattern photographing is performed on an object. A technique for simultaneously displaying on a screen is known (see, for example, Patent Document 1). According to this technique, since a plurality of guide images are simultaneously displayed on the screen, it is easy to set a shooting procedure, and it is possible to efficiently capture a plurality of images.

JP 2004-215157 A

  By the way, when an art effect that produces a visual effect by combining a plurality of image processes is provided to a photographed image, there is a demand for comparing images provided with a plurality of different art effects side by side. .

  However, since the above-described prior art is based on the premise that a plurality of images are captured with respect to one subject, a plurality of images desired by the user cannot be obtained by a single capturing operation.

  The present invention has been made in view of the above, and an object thereof is to provide an imaging apparatus and an imaging method capable of obtaining a plurality of images desired by a user by one imaging operation.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that captures an image of a subject and generates image data of the subject, and performs image processing on the image data generated by the imaging unit. An image processing unit that performs image processing, a display unit that can display an image corresponding to image data that has been subjected to image processing by the image processing unit, and a plurality of images that the image processing unit has performed a plurality of different image processes. A display control unit that makes one image selected from the main image a main image and collectively displays an image other than the main image on the display unit as a sub-image that can be distinguished from the main image; It is characterized by.

  In the above invention, the imaging device according to the present invention includes a touch panel that is provided so as to overlap the display unit and receives an input of a signal according to a contact position from the outside, and the display control unit is provided on the touch panel from the outside. The image corresponding to the contact position is the main image.

  The imaging apparatus according to the present invention is characterized in that, in the above invention, the display control unit causes the display unit to display the main image and the sub-image divided into individual regions.

  In the imaging device according to the present invention, in the above invention, the display control unit causes the display unit to display the main image larger than the sub-image.

  In the imaging device according to the present invention, in the above invention, the display control unit causes the display unit to display the main image larger than the sub image, and to display the sub image superimposed on the main image. It is characterized by that.

  The image pickup apparatus according to the present invention is characterized in that, in the above invention, the image processing unit performs special effect processing that causes a visual effect by combining a plurality of image processings on the image data. .

  In the imaging device according to the present invention, in the above invention, the imaging unit generates image data continuously at a predetermined time interval, and the display control unit temporally sets the display unit on the basis of the main image. The image data generated at the imaging timing before and after is set as the sub-image, and the main image and the sub-image are displayed side by side with the passage of time.

  According to the present invention, one image selected from a plurality of images each subjected to a plurality of different image processes by the image processing unit is set as a main image, and an image other than the main image is set as the main image. Since the sub-images that can be identified are collectively displayed on the display unit, a plurality of images desired by the user can be obtained by one photographing operation.

FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 1 of the present invention. FIG. 2 is a diagram showing an outline of art effect image processing performed by the art effect image processing unit. FIG. 3 is a diagram illustrating a display example of a composite image generated by the image composition unit. FIG. 4 is a diagram illustrating another display example (second example) of the composite image generated by the image composition unit. FIG. 5 is a diagram illustrating another display example (third example) of the composite image generated by the image composition unit. FIG. 6 is a diagram illustrating another display example (fourth example) of the composite image generated by the image composition unit. FIG. 7 is a diagram illustrating a configuration on the back side of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 8 is a flowchart showing an outline of processing performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 9 is a diagram showing an outline of the layout change process performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 10 is a diagram showing an overview of the image processing change process performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 11 is a diagram showing an outline of the cutout range changing process performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 12 is a diagram specifically illustrating a process when no touch input is made at the periphery of the display screen of the display unit of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 13 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to Embodiment 2 of the present invention. FIG. 14 is a diagram specifically illustrating processing when a touch input is made inside the display screen of the display unit of the imaging apparatus according to Embodiment 2 of the present invention. FIG. 15 is a diagram illustrating another example of the layout change process. FIG. 16 is a diagram illustrating a display example in the case where the sub-image is divided and displayed, and the magnification is changed. FIG. 17 is a diagram illustrating a display example when the divided sub-images are irregularly arranged. FIG. 18 is a diagram illustrating a display example when a plurality of subjects included in one image are divided to generate a sub-image. FIG. 19 is a diagram illustrating a display example when generating a sub-image for displaying a plurality of persons included in one image for each person.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 1 of the present invention. An imaging apparatus 1 shown in the figure includes a main body unit 2, a lens unit 3 that is detachable from the main body unit 2, and a movable monitor unit 4 that is movably connected to the main body unit 2. An accessory 5 can be detachably attached to the main body 2 of the imaging device 1.

  The main body 2 includes a shutter 10, a shutter driving unit 11, an image sensor 12, an image sensor driving unit 13, a signal processing unit 14, an A / D conversion unit 15, an image processing unit 16, and an input unit 17. An eyepiece display unit 18, an eye sensor 19, a rotation determination unit 20, a temporary recording unit 21, a recording unit 22, a main body communication unit 23, a second communication unit 24, and a control unit 25. .

  The shutter 10 sets the state of the image sensor 12 to an exposure state or a light shielding state. The shutter drive unit 11 is configured using a stepping motor or the like, and drives the shutter 10 in accordance with an instruction signal input from the control unit 25.

The imaging device 12 is configured using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like that receives the light collected by the lens unit 3 and converts it into an electrical signal. The imaging element 12 has at least a part of the function of an imaging unit that images a subject and generates image data of the subject h.
The image sensor drive unit 13 causes the signal processing unit 14 to output image data (analog signal) from the image sensor 12 at a predetermined timing. In this sense, the image sensor driving unit 13 functions as an electronic shutter.

  The signal processing unit 14 performs analog processing such as noise reduction processing and gain increase processing on the analog signal input from the image sensor 12 and outputs the analog signal to the A / D conversion unit 15.

  The A / D conversion unit 15 generates digital image data by performing A / D conversion on the analog signal input from the signal processing unit 14 and outputs the digital image data to the control unit 25.

  The image processing unit 16 performs predetermined image processing on the image data generated by the image sensor 12. The image processing unit 16 includes a basic image processing unit 161, an art effect image processing unit 162, and an image composition unit 163.

  The basic image processing unit 161 performs basic image processing including optical black subtraction processing, white balance (WB) adjustment processing, color matrix calculation processing, gamma correction processing, color reproduction processing, and edge enhancement processing on image data. . In addition, the basic image processing unit 161 performs finish effect processing for reproducing a natural image based on preset image processing parameters to generate finish effect image data. Here, the parameters of each image processing are values of contrast, sharpness, saturation, white balance, and gradation.

  The art effect image processing unit 162 performs art effect image processing for generating a visual effect by combining a plurality of image processings on one image data, thereby processing image data (hereinafter referred to as “art effect image data”). Generated).

  FIG. 2 is a diagram showing an outline of art effect image processing performed by the art effect image processing unit 162. In Fig. 2, as the art effect image processing, Fantastic Focus, Fantastic Focus + Starlight, Fantastic Focus + White Edge, Pop Art, Pop Art + Starlight, Pop Art + Pinhole, Pop Art + White Edge, Toy Photo, Rough Monochrome Ten types of diorama are described. Hereinafter, the art effect image processing will be described.

Fantastic focus is a process that gives a soft focus effect in which the entire image is subjected to a blurring process and synthesized at a certain ratio with the image before blurring. Fantastic focus is a tone curve process that brightens the intermediate brightness, leaving the details of the subject in a soft tone and creating an image with a beautiful and fantastic atmosphere as if wrapped in a happy light. Image or produce. The fantastic focus is realized by combining image processing such as tone curve processing, blur processing, alpha blend processing, and image composition processing.
Fantastic focus + starlight is a process of applying a cross filter effect that draws a cross pattern to a high-luminance portion in an image in addition to the fantastic focus.
Fantastic focus + white edge is a process in which, in addition to the phantom focus, an effect of gradually becoming whiter is given from the center of the image to the periphery. Such a whiteness effect can be obtained by changing the pixel value so that the peripheral portion becomes whiter as the distance from the center of the image increases.

Pop art is a process that emphasizes colors colorfully and expresses a bright and fun atmosphere. Pop art is realized by, for example, combining saturation enhancement processing and contrast enhancement processing. The overall effect is high contrast and high saturation.
Pop art + starlight is a process of applying pop art and starlight in layers. In this case, the effect of applying a cross filter to a colorful image can be obtained.
In addition to pop art, pop art + pinhole is a process of applying toy photo (pinhole) that darkens the periphery of an image by shading and gives an effect of looking through a hole. Details of the toy photo will be described later.
Pop art + white edge is a process in which pop art and white edge are overlapped.

  Toy photo is a process in which the brightness is reduced (darker) as the distance from the center of the image increases, and the effect is as if looking into a different space from a hole. Toy photo is realized by combining image processing such as low-pass filter processing, white balance processing, contrast processing, hue / saturation processing, and shading processing that multiplies the luminance signal by a smaller coefficient toward the periphery (toy photo). For details of photo and shading, see, for example, Japanese Patent Application Laid-Open No. 2010-74244.

  Rough monochrome is a process of expressing the strength and roughness of a monochrome image by adding high contrast and grainy noise of the film. Rough monochrome is realized by combining, for example, edge enhancement processing, level correction optimization processing, noise pattern superimposition processing, synthesis processing, contrast processing, and the like (for details of rough monochrome, for example, Japanese Patent Application Laid-Open No. 2010-62836). See the publication). Among these, the noise pattern superimposing process (noise adding process) is a process of adding a noise pattern image created in advance to the original image. The noise pattern image may be generated based on, for example, a random number generated.

  Diorama is a process that creates a high-contrast, high-saturation image on the screen by creating an atmosphere that looks like a miniature model or toy by blurring the periphery of the image. The diorama is realized by combining, for example, hue / saturation processing, contrast processing, peripheral blur processing, synthesis processing, and the like. Among these, the peripheral blur processing performs low-pass filter processing while changing the low-pass coefficient according to the position of the image so that the degree of blurring in the peripheral portion increases according to the distance from the center of the image. Note that as the peripheral blur processing, only the upper and lower sides of the image or only the left and right sides of the image may be blurred.

  The image composition unit 163 synthesizes a plurality of art effect images obtained by the art effect image processing unit 162 performing a plurality of different art effect image processes. FIG. 3 is a diagram illustrating a display example of a composite image generated by the image composition unit 163. A composite image 101 shown in the figure is an image obtained by combining four sub-images 102 to 105. The sub-images 102 to 104 are generated by performing three different art effect image processes on the same image data. The sub-image 105 is an image (captured image) that has not been subjected to art effect image processing. FIG. 3 schematically shows the art effect. The point schematically showing the art effect is the same for all the drawings described below.

  FIG. 4 is a diagram illustrating another display example (second example) of the composite image generated by the image composition unit 163. A composite image 111 shown in the figure is an image obtained by combining one main image 113 and two sub-images 112 and 114. The main image 113 occupies the right half area of the composite image 111. The sub-images 112 and 114 have a size obtained by equally dividing the left half area of the composite image 111 in the vertical direction and are smaller than the main image 113.

  FIG. 5 is a diagram illustrating another display example (third example) of the composite image generated by the image composition unit 163. A composite image 121 shown in the figure is an image obtained by combining four sub-images 122 to 125. The sub-images 122 to 125 are vertically long images having the same size. The sub-images 122 to 124 are respectively generated by performing three different art effect image processes on the same image data. The sub-image 125 is an image that has not been subjected to art effect image processing.

  FIG. 6 is a diagram illustrating another display example (fourth example) of the composite image generated by the image composition unit 163. The composite image 131 shown in the figure has a mode in which three sub-images 133 to 135 are superimposed on one main image 132 having the same size as the screen. The main image 132 and the sub images 133 and 134 are respectively generated by performing three different art effect image processes on the same image data. The sub-image 135 is an image that has not been subjected to art effect image processing. Note that the display positions of the sub-images 133 to 135 can be changed as appropriate.

  Next, the configuration of the imaging device 1 will be described. The input unit 17 is a release button for receiving an input of a shooting signal at the time of still image shooting, a mode switching button for receiving an input of a switching instruction signal for instructing mode switching of the imaging apparatus 1, and a signal for instructing start and end of moving image shooting. This is realized by using a user interface for operation signal input including a moving image button or the like for receiving input.

The eyepiece display unit 18 is an electronic viewfinder (EVF). The eyepiece display unit 18 can display the composite images 101, 111, 121, and 131 shown in FIGS.
The eye sensor 19 is provided in the vicinity of the eyepiece display unit 18 and detects whether or not a human eye is near the eyepiece display unit 18.
The rotation determination unit 20 determines whether or not the monitor unit 4 is separated from the main body unit 2 by rotation.

  The temporary recording unit 21 temporarily records image data input from the A / D conversion unit 15, image data after image processing input from the image processing unit 16, and information being processed by the imaging apparatus 1. The temporary recording unit 21 is configured using a volatile memory.

  The recording unit 22 is configured using a non-volatile memory, and includes an image data recording unit 221, an art effect information recording unit 222, a layout information recording unit 223, and a program recording unit 224.

The image data recording unit 221 records image data including image data generated by the image sensor 12. The art effect information recording unit 222 records image processing combination information in each art effect image processing performed by the art effect image processing unit 162.
The layout information recording unit 223 records the layout information (for example, see FIGS. 3 to 6) of the composite image generated by the image composition unit 163.
The program recording unit 224 records various programs for operating the imaging apparatus 1, imaging programs, various data used during execution of the programs, various parameters necessary for image processing operations by the image processing unit 16, and the like. .

  Note that the function of the recording unit 22 can be realized by applying a computer-readable storage medium such as a memory card mounted from the outside.

  The main body communication unit 23 is a communication interface for performing communication with the lens unit 3 attached to the main body unit 2. The main body communication unit 23 also includes an electrical contact with the lens unit 3.

  The second communication unit 24 is an interface for performing communication with the accessory 5 attached to the main body unit 2. The second communication unit 24 also includes an electrical contact with the accessory 5. Here, the accessory 5 includes an accessory communication unit 51 that is a communication interface with the main body unit 2. As the accessory 5, for example, an electronic flash that projects auxiliary light can be cited.

  The control unit 25 is configured using a CPU (Central Processing Unit) or the like. The control unit 25 includes a face detection unit 251 that detects a human face included in the captured image, a touch detection unit 252 that detects a touch position according to a signal received from the touch panel 42 included in the monitor unit 4 described below, The image processing control unit 253 controls the operation of the image processing unit 16, and the display control unit 254 controls the display mode of the display unit 41 included in the eyepiece display unit 18 and the monitor unit 4. The display control unit 254 sets a single image selected from a plurality of images to which the image processing unit 16 has performed a plurality of different image processes, as a main image, and displays an image other than the main image as the main image. As a sub-image that can be discriminated from the display unit 41 of the monitor unit.

  Based on the image data recorded by the image data recording unit 221, the control unit 25 sets exposure conditions when performing still image shooting or moving image shooting (AE processing), and automatically adjusts the focus of the imaging apparatus 1 (AF processing). )I do. The control unit 25 performs overall control of the operation of the imaging device 1 by transmitting control signals and various data to each unit configuring the imaging device 1 via the bus.

  The control unit 25 performs control to start the shooting operation when a shooting operation start signal (operation signal) is input from the input unit 17. Here, the photographing operation means that the signal processing unit 14, the A / D conversion unit 15, and the image processing unit 16 are predetermined for the image data output from the imaging device 12 by driving the shutter driving unit 11 and the imaging device driving unit 13. This is the operation to perform the process. The image data thus processed is compressed according to a predetermined format and recorded in the recording unit 22 under the control of the control unit 25. Here, examples of the predetermined format include a JPEG (Joint Photographic Experts Group) system, a Motion JPEG system, and an MP4 (H.264) system.

  The main body 2 having the above configuration transmits and receives data to and from an external device via a voice input / output unit, an auxiliary light emitting unit that emits auxiliary light (flash) to the subject, and a predetermined communication network. A communication unit or the like may be further provided.

  Next, the configuration of the lens unit 3 will be described. The lens unit 3 includes an optical system 31, a lens driving unit 32, a diaphragm 33, a diaphragm driving unit 34, a lens operation unit 35, a lens recording unit 36, a lens communication unit 37, a lens control unit 38, Is provided.

  The optical system 31 is configured using one or a plurality of lenses. The optical system 31 collects light from a predetermined visual field region. The optical system 31 has an optical zoom function for changing the angle of view and a focus function for changing the focus.

  The lens driving unit 32 is configured using a DC motor, a stepping motor, or the like, and changes the focus position, the angle of view, and the like of the optical system 31 by moving the lens of the optical system 31 on the optical axis L.

The diaphragm 33 adjusts the exposure by limiting the amount of incident light collected by the optical system 31.
The aperture drive unit 34 is configured using a stepping motor or the like, and drives the aperture 33.

  The lens operation unit 35 is, for example, a ring provided around the lens barrel of the lens unit 3, and instructs to input an operation signal for starting the optical zoom operation in the lens unit 3 or to adjust the focus position in the lens unit 3. An instruction signal input is received. The lens operation unit 35 may be a push switch or the like.

  The lens recording unit 36 includes a lens characteristic information recording unit 361 that records information on the optical characteristics of the optical system 31. The lens recording unit 36 records a control program and various parameters for determining the position and movement of the optical system 31.

  The lens communication unit 37 is a communication interface for communicating with the main body communication unit 23 of the main body 2 when the lens unit 3 is attached to the main body 2. The lens communication unit 37 includes an electrical contact with the main body unit 2.

  The lens control unit 38 is configured using a CPU (Central Processing Unit) or the like. The lens control unit 38 controls the operation of the lens unit 3 in accordance with an operation signal from the lens operation unit 35 or an instruction signal from the main body unit 2. The lens control unit 38 cooperates with the main body unit 2 by transmitting and receiving lens communication signals to and from the control unit 25 of the main body unit 2 at a predetermined cycle. Specifically, the lens control unit 38 drives the lens driving unit 32 in accordance with the operation signal of the lens operation unit 35 included in the lens communication signal to adjust the focus of the lens unit 3 and change the zoom. The drive unit 34 is driven to change the aperture value. When the lens unit 3 is mounted on the main body unit 2, the lens control unit 38 transmits lens characteristic information, focus position information, focal length, unique information for identifying the lens unit 3, and the like to the main body unit 2.

  Next, the configuration of the monitor unit 4 will be described. The monitor unit 4 includes a display unit 41 and a touch panel 42. The display unit 41 and the touch panel 42 are electrically connected to the main body unit 2.

  The display unit 41 has a configuration capable of displaying an image corresponding to the image data, and is configured using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The image display method in the display unit 41 includes a rec view display that displays image data immediately after shooting for a predetermined time (for example, 3 seconds), a reproduction display that reproduces image data recorded by the recording unit 22, and the image sensor 12. Examples include live view display (live view display) that sequentially displays live view images corresponding to continuously generated image data in time series. In addition, the display unit 41 appropriately displays operation information of the imaging device 1 and information related to shooting. The display unit 41 can display composite images 101, 111, 121, and 131 shown in FIGS.

  The touch panel 42 is provided on the display screen of the display unit 41 so as to receive an input of a signal corresponding to the contact position from the outside. As a method of the touch panel 42, any method such as a resistive film method, a capacitance method, and an optical method can be applied.

  FIG. 7 is a diagram illustrating a configuration on the back side of the imaging device 1, and is a diagram illustrating a manner of movement of the monitor unit 4 with respect to the main body unit 2. The monitor unit 4 has a hinge and a connecting arm, and is connected to the main body unit 2 via a tilt mechanism 6 that changes the tilt angle of the display screen 41 with respect to the main body unit 2. In the case shown in FIG. 7A, the display screen of the display unit 41 is in a state parallel to the back surface of the main body unit 2. On the other hand, in the case illustrated in FIG. 7B, the display screen of the display unit 41 is inclined with respect to the back surface of the main body unit 2. Although FIG. 7B illustrates a case where the display screen of the display unit 41 is tilted upward in the figure, the display screen of the display unit 41 can be tilted downward in the figure.

  The imaging apparatus 1 having the above configuration can set a shooting mode for shooting and a playback mode for playing back images. Among these, in the shooting mode, it is possible to set a multi-image shooting mode in which a plurality of images obtained by adding a plurality of different image processes to one image are simultaneously displayed in a desired layout. When the imaging device 1 is set to the multi-image shooting mode, the display unit 41 or the eyepiece display unit 18 displays a composite image in one of the display modes of FIGS. Thereafter, when the user performs shooting with a release button or the like, the imaging apparatus 1 captures an image in a mode displayed on the display unit 41 or the eyepiece display unit 18 as a captured image and records the image in the recording unit 22.

  Next, an outline of processing performed by the imaging apparatus 1 will be described with reference to a flowchart shown in FIG.

  First, the case where the imaging device 1 is set to the shooting mode (step S101: shooting mode) will be described. In this case, when the lens is exchanged (step S102: Yes), the imaging device 1 performs lens communication (step S103). On the other hand, when the lens is not exchanged in the shooting mode (step S102: No), the imaging device 1 acquires an image, starts displaying a through image, and stores the acquired image in the primary recording unit 21. Temporary recording is performed (step S104).

  Subsequently, a case where the imaging device 1 is set to the multi-image shooting mode (step S105: Yes) will be described. In this case, when a signal for setting a layout is input from the input unit 17 (step S106: Yes), the image processing control unit 253 transmits layout setting information to the image processing unit 16 (step S107). In step S106, when a signal for setting a layout is not input from the input unit 17 (step S106: No), the imaging apparatus 1 proceeds to step S108 described later.

  In step S108, the image composition unit 163 composes images according to the set layout and generates a composite image (step S108).

  Thereafter, the display control unit 254 displays the composite image on the display unit 41 (step S109). The composite image displayed here is, for example, one of the composite images 101 to 131 shown in FIGS.

  Subsequently, when a touch input is made at the periphery of the display screen of the display unit 41 (step S110: Yes), the imaging device 1 performs processing according to the type of touch (steps S111 to S116). Hereinafter, description will be made assuming that three processes of layout change, image process change, and cutout range change can be performed according to the type of touch, but it goes without saying that these processes are merely examples. .

  First, a case where a layout change operation is input (step S111: Yes) will be described. In this case, the imaging device 1 changes the layout and displays it on the display unit 41 (step S112). Specifically, after the image processing control unit 253 transmits a layout change instruction to the image composition unit 163, the image composition unit 163 changes the layout and generates a composite image. Thereafter, the display control unit 254 causes the display unit 41 to display the changed composite image.

  FIG. 9 is a diagram showing an outline of the layout change process. When the user performs a flicking operation on the peripheral edge of the sub-image 103 while the display unit 41 is displaying the composite image 101 (FIG. 9A), the touch detection unit 252 detects this operation. Is recognized as layout change processing. Thereafter, the image composition unit 163 generates a composite image 111 having a different layout (FIG. 9B). In the composite image 111, the sub-image 103 displayed at the position where the user's finger was flipped in the composite image 101 is displayed as a main image 113. In the first embodiment, shooting may be performed after the layout setting process is performed first.

  In the first embodiment, the layout before the change and the layout after the change correspond to 1: 1. Therefore, when the user performs an operation to flip the peripheral edge of the main image 113 while the composite image 111 is displayed, the main image 113 has a layout similar to that of the composite image 131 shown in FIG. You may make it change to the synthesized image which displays the image to which the same art effect process was performed as a main image.

  When the layout change operation is not input (step S111: No), the imaging apparatus 1 proceeds to step S113 described later.

  Next, a case where an image processing change operation is input (step S113: Yes) will be described. In this case, after changing the processing content in the art effect image processing unit 162, the imaging apparatus 1 generates a new composite image by the image composition unit 163, and displays the generated composite image on the display unit 41 (step S114). . As the image processing change operation, the display of the rubbed image can be changed by, for example, performing a swipe operation on the peripheral edge of the display screen of the display unit 41.

  FIG. 10 is a diagram showing an outline of the image processing change process. When the display unit 41 displays the composite image 101 and the user performs an operation of rubbing the peripheral portion of the sub-image 104 vertically (FIG. 10A), the touch detection unit 252 detects this operation. Is recognized as image processing change processing. Thereafter, the art effect image processing unit 162 changes the art effect image processing in the rubbed sub-image 104 to perform processing. The content of the art effect image processing performed by the art effect image processing unit 162 after rubbing may be set in advance or may be selected by the user each time. Subsequently, the image composition unit 163 resynthesizes the composite image. FIG. 10B is a diagram illustrating a display example of the recombined composite image. The composite image 141 is subjected to art effect image processing different from the sub-image 104 before the change in the sub-image 144.

  When the image processing change operation is not input (step S113: No), the imaging apparatus 1 proceeds to step S115 described later.

  Next, a case where a cutout range changing operation is input (step S115: Yes) will be described. In this case, the imaging apparatus 1 generates a composite image of the cutout range newly designated by the image composition unit 163 and displays it on the display unit 41 (step S116). Specifically, after the image processing control unit 253 transmits an instruction to change the extraction range to the image composition unit 163, the image composition unit 163 changes the extraction range and generates a composite image. Thereafter, the display control unit 254 causes the display unit 41 to display the changed composite image.

  FIG. 11 is a diagram showing an outline of the extraction range changing process. When the display unit 41 is displaying the composite image 101 and the user pinches in the lower end portion of the sub-image 105 (FIG. 11A), the touch detection unit 252 detects this operation and performs cutout range change processing. recognize. After that, the image composition unit 163 generates a composite image 121 having a different cutout range (FIG. 11A).

  When the extraction range changing process is not input (step S115: No), the imaging apparatus 1 returns to step S101.

  Next, a case where touch input is not performed at the periphery of the display screen of the display unit 41 in step S110 (step S110: No) will be described. In this case, when a touch input is made inside the display screen (step S117: Yes), the imaging apparatus 1 focuses on the touched portion and performs shooting (step S118). Here, the periphery and the inside of the display screen are areas set as appropriate. For example, the peripheral portion can be set as a region having a width of about 1 cm from the outer edge of the display screen, and the region on the inner side can be set as the inside of the display screen.

  Subsequently, when the imaging apparatus 1 is set to the multi-image shooting mode (step S119: Yes), the image composition unit 163 performs image recomposition, and the display unit 41 performs rec view display of the recombined image. (Step S120). Thereafter, the imaging apparatus 1 returns to step S101.

  If no touch input is made inside the display screen in step S117 (step S117: No), when the user performs a shooting operation via the input unit 17 (step S121: Yes), the imaging apparatus 1 performs shooting. This is performed (step S122). When the user does not perform a shooting operation via the input unit 17 in step S121 (step S121: No), the imaging apparatus 1 returns to step S101.

  FIG. 12 is a diagram specifically showing the processing of steps S117 to S120 described above. As shown in FIG. 12A, when the user touches the center of the sub-image 102 of the composite image 101, the touch detection unit 252 detects a touch operation, and the control unit 25 controls a shooting operation such as focusing. . Thereafter, the image composition unit 163 re-synthesizes the touched sub-image 102 as the main image to generate a new composite image. FIG. 12B is a display example of a composite image generated by the image composition unit 163. A main image 132 in the composite image 131 shown in FIG. 12B is an art effect image that has been subjected to the same art effect processing as the sub image 102 touched by the user in the composite image 101. The sub images 133 to 135 correspond to the sub images 103 to 105, respectively.

  In step S119, when the imaging device 1 is not set to the multi-image shooting mode (step S119: No), the imaging device 1 returns to step S101.

  Next, a case where the imaging apparatus 1 is not set to the multi-image shooting mode in step S105 (step S105: No) will be described. In this case, the imaging device 1 proceeds to step S117.

  Next, the case where the imaging device 1 is set to the playback mode (step S101: playback mode) will be described. In this case, the display control unit 254 reproduces and displays a predetermined image recorded by the recording unit 22 on the display unit 41 (step S123).

  Subsequently, when a reproduction image change instruction is input from the input unit 17 (step S124: Yes), the display control unit 254 reproduces and displays a different image on the display unit 41 according to the change instruction (step S125). Thereafter, the imaging apparatus 1 returns to step S101.

  If no change instruction is input in step S124 (step S124: No), the imaging apparatus 1 returns to step S101.

  According to the first embodiment of the present invention described above, one image selected from a plurality of images each subjected to a plurality of different image processing by the image processing unit is used as the main image, and the main image Since other images are collectively displayed on the display unit as sub-images that can be distinguished from the main image, a plurality of images desired by the user can be obtained by a single photographing operation.

  Further, according to the first embodiment, the main image is displayed larger than the sub-image on the display unit, so that the user can obtain a decorative image centered on the selected image.

(Embodiment 2)
Embodiment 2 of the present invention is characterized in that images taken at different times are used as multi-images. The configuration of the imaging apparatus according to the second embodiment is the same as the configuration of the imaging apparatus 1 described in the first embodiment.

  Hereinafter, an overview of processing performed by the imaging apparatus 1 according to Embodiment 2 will be described with reference to the flowchart of FIG. 13. Note that the processing in steps S201 to S216 sequentially corresponds to steps S101 to S116 described with reference to FIG. 8 in the first embodiment.

  In step S217, when a touch input is made inside the display screen of the display unit 41 (step S217: Yes), the imaging apparatus 1 focuses on the touched portion and performs shooting (step S218). Note that the processes in steps S224 and S225 subsequent to the case where no touch input is made inside the display screen in step S217 (step S217: No) sequentially correspond to the processes in steps S121 and S122 described in the first embodiment. Yes.

  Subsequently, when the imaging apparatus 1 is set to the multi-image shooting mode (step S219: Yes), the image shot in step S218 is arranged at the position touched by the user (step S220). In addition, in a region for displaying an image temporally prior to the touched position, a necessary region is selected from images temporarily recorded by the temporary recording unit 21 (temporary recording image), and the corresponding region. (Step S221). Further, images that are taken after the shooting in step S218 and temporarily recorded in the temporary recording unit 21 are sequentially arranged in an area where an image temporally after the touched position is displayed (step S222).

  The display control unit 254 displays the composite image generated by the image composition unit 163 on the display unit 41 (step S223).

  FIG. 14 is a diagram for specifically explaining the processing of steps S217 to S223 described above. Here, it is assumed that the imaging apparatus 1 is set to the multi-image shooting mode. A composite image 201 illustrated in FIG. 14A is a through image in which four regions are displayed side by side. The sub-images 202 to 205 all display the same image. Thereafter, when the sub image 203 is touched in step S217, the image composition unit 163 places the captured image in the second area from the left (step S220).

  Assuming that the composite images after shooting are arranged in chronological order from left to right, the image composition unit 163 captures a predetermined time before the image captured in step S218 in the leftmost region. The read image is read from the temporary recording unit 21 and arranged (step S221).

  Subsequently, the image composition unit 163 reads out images having a predetermined interval from the images sequentially taken after the shooting in step S218 from the temporary recording unit 21, and sequentially arranges them in the third and fourth areas from the left of the screen. (Step S222). In this way, the image composition unit 163 generates a composite image 211 illustrated in FIG. The composite image 211 is an image taken at the earliest time of the sub-image 212, and is an image taken at the latest time of the sub-image 215. A sub-image 203 captured by touching the screen is the main image.

  The processing in steps S224 to S228 sequentially corresponds to the processing in steps S121 to S125 described with reference to FIG. 8 in the first embodiment.

  According to the second embodiment of the present invention described above, one image selected from a plurality of images each subjected to a plurality of different image processing by the image processing unit is set as the main image, and the main image Since other images are collectively displayed on the display unit as sub-images that can be distinguished from the main image, a plurality of images desired by the user can be obtained by a single photographing operation.

  Further, according to the second embodiment, the main image and the sub image are displayed in time series, so that the user can obtain a decorative image including the movement of the subject before and after the selected image.

(Other embodiments)
Up to this point, the mode for carrying out the present invention has been described, but the present invention should not be limited to the two embodiments described above. For example, in the present invention, the layout can be changed as shown in FIG. A composite image 301 shown in the figure includes a main image 302 and five sub-images 303 to 307 which are smaller than the main image 302 and are arranged so as to surround the bottom side and the right side surface of the main image 302.

  In the present invention, when a sub-image is divided and displayed, the magnification may be changed and displayed. FIG. 16 is a diagram showing a display example in this case. In the composite image 311 shown in FIG. 4, four sub-images 312 to 315 having different magnifications are arranged side by side. When any one of the sub-images 312 to 315 is an image having the same magnification as that actually captured, the sub-image corresponds to the main image.

  In the present invention, the divided sub-images may be arranged irregularly. FIG. 17 is a diagram showing a display example in this case. In the composite image 321 shown in the figure, four sub-images 322 to 325 are irregularly arranged.

  In the present invention, a plurality of subjects included in one image may be divided to generate a sub-image. FIG. 18 is a diagram showing a display example in this case. The composite image 331 shown in the figure has three sub-images 332 to 334 and a main image 335 including all subjects displayed by these sub-images 332 to 334. Such an image can be generated by providing a subject detection unit in the control unit.

  In the present invention, a sub-image that displays a plurality of persons included in one image one by one may be generated. FIG. 19 is a diagram showing a display example in this case. In the composite image 341 shown in the figure, three sub-images 342 to 344 each including only one person and a main image 345 including all persons are displayed.

  As described above, the present invention can include various embodiments and the like, and design changes and the like can be made without departing from the technical idea described in the claims.

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Main body part 3 Lens part 4 Monitor part 5 Accessory 6 Tilt mechanism 12 Image sensor 16 Image processing part 17 Input part 41 Display part 42 Touch panel 21 Temporary recording part 22 Recording part 23 Main body communication part 25 Control part 31 Optical system 35 Lens operation unit 36 Lens recording unit 37 Lens communication unit 38 Lens control unit 161 Basic image processing unit 162 Art effect image processing unit 163 Image composition unit 221 Image data recording unit 222 Art effect information recording unit 223 Layout information recording unit 224 Program recording unit 251 Face detection unit 252 Touch detection unit 253 Image processing control unit 254 Display control unit

Claims (10)

An imaging unit that images a subject and generates image data of the subject;
A display unit capable of displaying information including images;
An image processing unit that performs a plurality of different processes on the one image data, and synthesizes the plurality of image data subjected to the plurality of processes in a set layout;
A display control unit that causes the display unit to display a composite image synthesized by the image processing unit;
An imaging apparatus comprising: The layout is
The imaging apparatus according to claim 1, wherein a part of the plurality of images respectively corresponding to the plurality of image data has an overlap. The layout is
The imaging apparatus according to claim 1, wherein a part of the plurality of images respectively corresponding to the plurality of image data is inclined with respect to another image. The layout is
The imaging apparatus according to claim 1, wherein magnifications of a plurality of images respectively corresponding to the plurality of image data are different from each other. The layout is
The imaging apparatus according to claim 1, wherein an aspect ratio of a part of a plurality of images respectively corresponding to the plurality of image data is different from an aspect ratio of another image. The layout is
6. The imaging apparatus according to claim 5, wherein a plurality of subjects included in one image among a plurality of images respectively corresponding to the plurality of image data are divided by another image.   The imaging apparatus according to claim 1, wherein the plurality of image data are images generated at different timings. A touch panel provided on the display unit and receiving a signal input according to a contact position from the outside,
The display control unit
The imaging apparatus according to claim 1, wherein an image corresponding to a position at which the touch panel receives a selection input is enlarged and displayed on the display unit. The image processing unit
The special effect process which produces a visual effect by combining a plurality of image processes with respect to one said image data as said process is performed. Imaging device. An imaging step of imaging a subject and generating image data of the subject;
Processing steps for performing a plurality of different processes on one image data;
A combining step of combining a plurality of image data subjected to the plurality of processes with a set layout;
A display step for displaying the combined image combined in the combining step;
An imaging method characterized by comprising: