JP5980535B2 - Imaging device and image data recording method - Google Patents

Description

  The present invention relates to a photographing apparatus capable of acquiring and recording image data subjected to predetermined image processing by a simple operation, and the image data recording method.

  Conventionally, an optical image formed by a photographing optical system is sequentially converted into an image signal by a photoelectric conversion element or the like, and the obtained image signal can be recorded on a recording medium as image data in a predetermined form. An imaging device configured to include an image display device such as a liquid crystal display device (LCD) that reproduces and displays image data recorded on a medium as an image, such as a digital camera or a video camera (hereinafter collectively referred to as a camera) ) Is generally put into practical use and widely used.

  This type of photographing device (camera) has a feature that various image output results can be easily obtained by performing various signal processing on the acquired image data. For example, image effects using various optical filters, image effects using special forms of shooting lenses (such as fish-eye lenses and shooting lenses with tilt mechanism, etc.), various shooting settings such as exposure adjustment, white balance adjustment, color balance adjustment, etc. Similar image effects substantially corresponding to image effects obtained by contrivances such as various image capturing methods that have been conventionally performed, such as image effects obtained by adjusting values, can be easily realized by image signal processing on image data.

  Therefore, in a conventional photographing device (camera), for example, a plurality of photographing operation modes including a series of image processing program groups in which a procedure for obtaining a specific image effect in advance is associated with various image effects. What has been configured is put to practical use.

  When a photographer takes a picture using such a photographing device (camera), an image including a desired image effect is obtained by selecting and setting a desired photographing operation mode according to the situation of the place. It can be done.

  However, in the conventional photographing device (camera), for example, in order to obtain a specific image effect, only a program with a predetermined setting is prepared, so that there is a problem that it cannot cope with every situation. is there. Also, not all photographers could be satisfied.

  In order for a photographer to obtain a desired image effect according to his / her intention to shoot, various setting values or the like corresponding to various image processing may be directly set individually, but the setting items are enormous, Since various settings are complicated, and in order to directly set various settings, deep knowledge about various image processing is also necessary, so such means is not practical.

  On the other hand, in recent years, an operation member such as a so-called touch panel is provided on a display screen of a display device provided in a photographing apparatus (camera), and an image displayed on the display screen of the display device, an instruction index, and the like are passed through the touch panel. Various devices have been put to practical use that can perform various operations by performing a touch operation or a slide operation. An operation system using an operation member typified by this touch panel has an advantage that an intuitive operation can be performed compared to a conventional operation system using an operation member such as a button or a dial.

  Therefore, it is convenient if an operation member such as a touch panel is positively adopted so that a user's intuitive operation can be linked to various setting value change settings related to image processing.

  The present invention has been made in view of the above-described points, and an object of the present invention is to easily acquire a favorite photograph reflecting the photographer's intention by performing an intuitive and simple operation. It is to provide photographing equipment.

In order to achieve the above object, an imaging device of one embodiment of the present invention includes an imaging unit having an imaging element that images a subject, a display unit that displays an image based on image data acquired by the imaging unit, and A touch panel arranged on the display surface of the display unit, a light source detection unit for detecting a light source in an image being displayed on the display unit, and an operation input determination for detecting and determining coordinate data according to an input operation on the touch panel A luminance distribution of a region corresponding to the coordinate data determined by the operation input determination unit, a control unit that sets a designated region in the image based on the coordinate data detected by the operation input determination unit a luminance distribution determining unit that the luminance distribution enhancement section to emphasize processing the luminance of the designated area within the image set by the control unit, and a recording unit for recording the image data Comprising a, the luminance distribution enhancement unit sets a range for performing the luminance distribution enhancement processing according to the movement distance of the slide operation on the touch panel, setting the luminance distribution enhancement level according to the number of the slide operation on the touch panel To do.

  The image data recording method of one embodiment of the present invention includes a touch determination step for determining a touch operation, a slide determination step for determining a slide movement amount by the slide operation, and a face detection step for detecting a face image in the image. A luminance distribution enhancement step for setting a luminance distribution enhancement level by setting a range for performing luminance distribution enhancement processing based on the slide movement amount determined by the slide determination step and the face image information detected by the face detection step And a recording step for recording image data including the image processing performed by the luminance distribution enhancement step.

  According to the present invention, it is possible to provide a photographing device that can easily acquire a favorite photograph reflecting a photographer's intention by performing an intuitive and simple operation.

The block block diagram which shows the outline of the internal structure of the imaging device (camera) of one Embodiment of this invention The conceptual diagram which shows the effect | action in the imaging device (camera) of this embodiment, and shows a mode that the display part of the imaging device (camera) of FIG. 1 is operated. The figure which is an image displayed on the display part of the imaging device (camera) of FIG. 1, Comprising: The figure which shows the example of a display of the image after changing with the operation result of FIG. The graph which shows the luminance distribution of the image corresponding to the slide locus | trajectory (virtual straight line L) at the time of the slide operation of FIG. The main flowchart which shows the outline of an effect | action of the imaging device (camera) of FIG. FIGS. 6A and 6B are diagrams illustrating image processing performed as a result of an image effect setting operation performed by the photographing apparatus (camera) in FIG. 1. FIG. 6A illustrates an example of a display screen showing the image processing result, and FIG. The principal part enlarged view which expands and shows a part of (A) The flowchart which shows the effect | action (the flow of a process mainly with image effect setting operation) of the imaging device (camera) of FIG. The flowchart which shows the flow of the display process performed in parallel with the flowchart of FIG.

The present invention will be described below with reference to the illustrated embodiments.
In each of the embodiments described below, for example, an optical image formed by an optical lens is photoelectrically converted using a solid-state imaging device, and an image signal obtained thereby is stored on a recording medium as digital image data representing a still image or a moving image. The present invention is applied to a photographing device (hereinafter simply referred to as a camera) configured to be able to record and reproduce and display a still image or a moving image on a display device based on digital image data recorded on a recording medium. This is an example of the case.

  In each drawing used for the following description, each component may be shown with a different scale in order to make each component large enough to be recognized on the drawing. Therefore, according to the present invention, the number of constituent elements, the shape of the constituent elements, the ratio of the constituent element sizes, and the relative positional relationship of the constituent elements described in these drawings are limited to the illustrated embodiments. It is not a thing.

  FIG. 1 is a block configuration diagram showing an outline of an internal configuration of a photographing apparatus (camera) according to an embodiment of the present invention. 2-5 is a figure which shows the effect | action in the imaging device (camera) of this embodiment. Among these, FIG. 2 is a conceptual diagram showing a state in which the display unit of the photographing apparatus (camera) of the present embodiment is operated. FIG. 3 is a diagram showing an image displayed on the display unit of the photographing apparatus (camera) of the present embodiment, and shows an example of the image after changing according to the operation result of FIG. FIG. 4 is a graph showing the luminance distribution of the image corresponding to the slide locus (virtual straight line L) at the time of the slide operation of FIG. FIG. 5 is a main flowchart showing an outline of the operation of the photographing apparatus (camera) of the present embodiment.

  First, an outline of an internal configuration of a camera that is a photographing apparatus according to the present embodiment will be described below with reference to FIG.

  As shown in FIG. 1, a photographing apparatus (hereinafter simply referred to as a camera) 1 according to the present embodiment includes a photographing optical system 41, a diaphragm mechanism 42, a lens driver 43, a diaphragm driver 44, and a shutter mechanism 51. An image sensor 52, an analog processing unit 53, an analog-digital conversion unit (hereinafter abbreviated as AD conversion unit) 54, an AE processing unit 55, an AF processing unit 56, an image processing unit 57, and an image compression unit. Development unit 58, display drive unit (hereinafter abbreviated as display driver) 59, display unit 60, memory interface (hereinafter abbreviated as memory IF) 61, recording medium 62, SDRAM 63, and flash memory 64 An operation unit 65, a control unit 66, a touch slide determination unit 67, a brightness (luminance) distribution determination unit 68, a face detection unit 69, and a brightness (luminance) distribution enhancement unit 70. A shutter driver 71, a power supply circuit 72 is configured by including a communication bus 73 or the like.

  The photographing optical system 41 is a unit that forms a subject image by transmitting a light beam from the subject and forms the subject image on the light receiving surface of the image sensor 52. The photographing optical system 41 includes, for example, a plurality of optical lenses arranged along the optical axis O, and a lens frame that supports each of the plurality of optical lenses. The photographing optical system 41 is driven and controlled by the control unit 66 via the lens driver 43.

  The lens driver 43 is a unit for moving at least a part of the optical lens (a lens frame supporting the lens lens) of the photographing optical system 41 in a direction along the optical axis O. The lens driver 43 includes a driving source such as an actuator, components such as a driving mechanism that transmits a driving force from the driving source, and an electric circuit for driving and controlling the driving source.

  The aperture mechanism 42 is disposed in the photographing optical system 41 and is a unit that adjusts the amount of light from a subject passing through the photographing optical system 41. The aperture mechanism 42 is driven and controlled by the controller 66 via the aperture driver 44.

  The aperture driver 44 includes, for example, a driving source such as a stepping motor, components such as a driving mechanism that transmits a driving force from the driving source, and an electric circuit for driving and controlling the driving source. .

  The shutter mechanism 51 is a unit that controls the exposure time of the subject image formed on the light receiving surface of the image sensor 52. The shutter mechanism 51 is driven and controlled by the control unit 66 via the shutter driver 71.

  The shutter driver 71 is a control unit that drives and controls the shutter mechanism 51 under the control of the control unit 66.

  The image sensor 52 converts the light amount of the subject image into an analog signal representing the amount of charge by photoelectrically converting an optical image (subject image) formed by the photographing optical system 41 and received on its light receiving surface. It is a photoelectric conversion element. As the image sensor 52, for example, a photoelectric conversion element such as a CMOS or a CCD is applied. The electrical signal (analog image signal) generated by the image sensor 52 is output to the analog processing unit 53.

  The imaging optical system 41, the aperture mechanism 42, the shutter mechanism 51, the imaging element 52, and the like constitute an imaging unit of the camera 1.

  The analog processing unit 53 receives an electrical signal (analog image signal) output from the image sensor 52, performs waveform shaping after reducing reset noise and the like, and then performs gain-up processing or the like so as to obtain a desired brightness. It is a signal processing part which performs. A signal processed by the analog processing unit 53 is output to the AD conversion unit 54.

  The AD conversion unit 54 is a signal processing unit that receives the analog image signal output from the analog processing unit 53 and converts the analog image signal into digital image data. The image data output from the AD conversion unit 54 is sent to the SDRAM 63 via the communication bus 73 and temporarily stored therein.

  The AE processing unit 55 is a data processing unit that calculates subject luminance in an image based on image data after AD conversion temporarily stored in the SDRAM 63, and is also a light source detection unit that detects a light source in the image. . In addition to the image data, for example, a dedicated photometric sensor may be provided as the data handled in the AE processing unit 55, that is, the subject luminance calculation data, and output data from the dedicated photometric sensor may be used.

  The AF processing unit 56 is a data processing unit that extracts a high-frequency component signal from the image data and performs AF (Auto Focus) integration processing to acquire a focus evaluation value.

  The image processing unit 57 is a data processing unit that performs various image processing on the image data read from the SDRAM 63. The image data after various processes are performed in the image processing unit 57 is temporarily stored in the SDRAM 63 again.

  The image compression / decompression unit 58 is a data processing unit that performs compression processing of image data by a predetermined compression method, expansion (decompression) processing of compressed image data compressed by a predetermined compression method, and the like. When the image data handled in the image compression / decompression unit 58 is still image data, compression and decompression processing is performed by a method based on the JPEG standard, for example. When the image data handled by the image compression / decompression unit 58 is moving image data, for example, Motion-JPEG standard or H.264 standard. The compression and decompression processing is performed by various methods based on the H.264 standard. When recording image data relating to a still image, the image compression / decompression unit 58 reads the image data from the SDRAM 63, compresses the read image data, for example, by performing compression processing according to the JPEG compression method. A series of processes is executed in which the processed JPEG image data is temporarily stored in the SDRAM 63 again.

  The display unit 60 is configured by various types of display devices such as a liquid crystal display device (LCD), for example, in order to display an image based on the image data acquired by the imaging unit such as the image sensor 52. The display unit 60 is driven and controlled via the display driver 59 under the control of the control unit 66. For example, the display unit 60 receives the image data immediately after the photographing operation and displays the image as a photographing acquisition result for a predetermined short time, and displays the image data (JPEG file or the like) recorded in the recording medium 62. Moving image display such as reproduction display of a base image and through image display (also referred to as live view display) is performed.

  Here, for example, when image reproduction is performed based on image data (JPEG file) recorded on the recording medium 62, the control unit 66 uses the image compression / decompression unit 58 to record image data recorded on the recording medium 62. Desired data is read out from the (JPEG file) and subjected to expansion processing (decompression processing). The image data decompressed by the image compression / decompression unit 58 is temporarily stored in the SDRAM 63. Subsequently, the control unit 66 reads out the decompressed image data from the SDRAM 63 via the display driver 59, converts the image data into a displayable video signal using the display unit 60, and outputs the video signal to the display unit 60. Thereby, an image is displayed on the display unit 60.

  The display driver 59 is a unit that drives and controls the display unit 60 under the control of the control unit 66.

  The memory IF 61 drives the recording medium 62 under the control of the control unit 66, reads an image data file recorded on the recording medium 62, and records image data in a predetermined format on the recording medium 62. Interface.

  The recording medium 62 is a medium for recording image data or the like, and for example, a card-shaped semiconductor memory that is detachably attached to the camera body 50, a so-called memory card or the like is applied. Note that the form of the recording medium 62 is not limited to this form, and may be another form, for example, a medium fixed in the camera body 50, an optical plate medium, a magnetic medium, or the like in addition to the semiconductor memory. Various forms can be applied. The memory IF 61 and the recording medium 62 constitute a recording unit.

  The SDRAM 63 is a storage unit including a volatile memory that temporarily stores various data such as image data generated by the AD conversion unit 54 and image data processed by the image processing unit 57 and the image compression / decompression unit 58. .

  The flash memory 64 specifies various parameters necessary for camera operation such as white balance gain corresponding to the white balance mode, low-pass filter coefficient, image data of a granular pattern resembling the granular feeling due to silver salt particles, and the camera 1. This is a storage unit composed of a non-volatile memory in which various kinds of information such as product name and serial number are stored in advance. Further, the flash memory 64 stores various programs executed by the control unit 66 in advance. Therefore, the control unit 66 reads and executes the program stored in the flash memory 64 at an appropriate timing. At that time, the control unit 66 reads various parameters necessary for various sequence processes from the flash memory 64.

  The operation unit 65 includes a plurality of operation members for performing various operations on the camera 1 and corresponding operation switches. When the user operates a predetermined operation member of the operation unit 65, a predetermined instruction signal is generated from the corresponding operation switch, and the instruction signal is transmitted to the control unit 66. Upon receiving this instruction signal, the control unit 66 executes various sequences in accordance with appropriate operations. Specifically, as the operation unit 65, for example, an operation member interlocked with a mechanical switch such as a power button, a release button, a playback button, a menu button, a moving image button, a mode switching button, or the like for inputting instructions on a touch panel or the like. Input operation members and the like are included.

  The control unit 66 is a control unit that comprehensively controls various sequences of the camera body 50. In addition, the control unit 66 creates a JPEG file by adding necessary JPEG header information and the like to the JPEG image data temporarily stored in the SDRAM 63, and the created JPEG file is recorded on the recording medium via the memory IF 61. The process of recording to 62 is also performed. An operation unit 65, a flash memory 64, a touch slide determination unit 67, a brightness distribution determination unit 68, a face detection unit 69, and a brightness distribution enhancement unit 70 are directly connected to the control unit 66. Yes.

  The touch slide determination unit 67 detects a touch operation or a slide operation on the touch panel included in the operation unit 65, and also detects the position and operation amount (operation range, operation time, etc.) on the display screen of the detected touch operation and slide operation. It is a circuit part which comprises the operation input determination part which detects etc. The determination result by the touch slide determination unit 67 is output to the control unit 66.

  The brightness distribution determination unit 68 receives the determination result of the touch slide determination unit 67 and determines the distribution of the luminance signal with respect to the image signal in the range where the touch operation and the slide operation are performed on the display image on the display screen. It is a circuit part to judge.

  The face detection unit 69 obtains information on a face image having a predetermined feature included in an image displayed on the display screen as a result of the imaging operation, for example, information such as the form and size of a face image such as a person or a pet. A function that continues to track the detected face image when it moves within the screen, and a function to continue tracking when it enters the screen again even if it goes out of the screen. It is a circuit part which implement | achieves etc.

  The brightness distribution enhancement unit 70 is based on the determination result by the brightness distribution determination unit 68 and the determination result by the touch slide determination unit 67, and the brightness distribution (luminance signal distribution) for a predetermined range of image signals. It is a circuit part which performs image processing which emphasizes.

  The power supply circuit 72 includes a power supply such as a battery and a circuit that controls the power supply, and appropriately supplies necessary power to each component unit and circuit unit in the camera 1 under the control of the control unit 66. It is a circuit part to do.

  The communication bus 73 is a transfer path for transferring various data generated inside the camera 1 to each part of the internal configuration unit constituting the camera 1. The communication bus 73 includes an AD conversion unit 54, an AE processing unit 55, an AF processing unit 56, an image processing unit 57, an image compression / decompression unit 58, a display driver 59, a memory IF 61, an SDRAM 63, a control unit 66, a lens driver 43, an aperture. The driver 44 and the shutter driver 71 are connected. The other configurations are omitted as they have the same configuration as a conventional general photographing apparatus (camera). Moreover, about the component shown by FIG. 1, what was not directly related to this invention was kept to simple description.

The operation of the camera 1 of the present embodiment configured as described above will be described below with reference to FIGS.
In the present embodiment, when the user performs a touch operation and a slide operation with a finger or the like on the display screen of the display unit 60, the camera 1 appropriately performs predetermined image processing under the control of the control unit 66. A specific example of obtaining an intended image effect (brightness enhancement effect in the present embodiment) is shown. These series of operations are setting operations for obtaining a desired image effect, and the image effect setting operations will be specifically described below.

  For example, as shown in FIG. 2, it is assumed that a through image (live view image; in shooting mode) or a shot image (in playback mode) is displayed on the display screen of the display unit 60 of the camera 1. In this state, the user touches an arbitrary point on the display screen of the display unit 60 (the touch surface of the touch panel provided on the display unit 60) with the finger 100a of the hand 100, and then performs a slide operation to perform the hand operation. 100 is moved from the position indicated by [A] in FIG. 2 to the position indicated by [B].

  In this case, it is assumed that the finger 100a touches the light source 101 such as the sun in the screen at a predetermined position on the display screen of the display unit 60. The touch position P1 at this time is indicated by coordinates (X1, Y1). Note that an index 110 is displayed in a portion including the light source 101 in the display screen. The index 110 is an index that is displayed to clearly indicate a screen area where the shutter release operation by the touch operation is invalid. The index 110 is displayed as follows. For example, when a through image is displayed or when a reproduction image is displayed, the control unit 66 of the camera 1 controls the AE processing unit 55 and the like to detect the light source position in the display image and surround the light source position. Thus, the index 110 is displayed. When an area in the index 110 is touched, an image effect setting operation according to the present embodiment, which will be described later, is performed instead of a normal shutter release operation.

  Subsequently, the finger 100a is moved from the touch position P1 (X1, Y1) to a predetermined direction, for example, a predetermined position away from the touch position P1 (X1, Y1) by a predetermined distance, for example, in the direction of the face of the person 102 (arrow S direction) It is assumed that a slide operation is performed to a part of the face close to the light source 101 and the finger 100a is separated from the display screen of the display unit 60 at that position. Here, a position P2 where the finger 100a is released is indicated by coordinates (X2, Y2).

  The direction of the sliding operation at this time, that is, a virtual straight line obtained by extending a straight line along the arrow S to the peripheral edge of the screen is indicated by a symbol L. Two points on the straight line L that intersect at the periphery of the screen of the display unit 60 are indicated by coordinates (X0, Y0) and (X3, Y3), respectively.

  As described above, when a slide operation is performed following a touch operation on a predetermined area (light source position), that is, when a continuous touch and slide operation is detected, in that case, an autofocus operation, a shutter release operation And the like are determined to be the image effect setting operation described in this embodiment.

  Therefore, as described above, when a touch operation and a slide operation are detected, a shutter release operation or the like does not start even if a touch operation is performed on an area including the index 110. In this state, a touch operation is performed on an area other than the index 110 in order to perform a shutter release operation or the like.

  Note that, as described above, instead of determining the image effect setting operation by detecting successive touch operations and slide operations, the touch time of the first touch operation on the display screen of the display unit 60 is determined. It may be determined whether the touch operation is an operation for executing an autofocus operation, an operation for executing a shutter release operation, or an image effect setting operation.

  By performing the above operation, in the camera 1 of the present embodiment, the region designated by the touch & slide operation by the user (in the above example, from the touch positions P1 (X1, Y1) on the straight line L to P2 (X2 , Y2)), image processing for enhancing the luminance (brightness) of the image area in a predetermined range, that is, image processing for raising (making brighter) the luminance (brightness) of the designated area is performed. .

  That is, when the user performs a touch and slide operation on the display screen of the display unit 60 in a state where an image (through image or reproduced image) is displayed, a desired area is designated, so that the camera 1 is operated by the AE processing unit. The exposure information such as the exposure value set based on 55 can be corrected for partial exposure reflecting the user's intention. As a result, an image effect reflecting the user's intention can be obtained.

  In a normal case, the AE processing unit 55 of the camera 1 determines an appropriate exposure value in consideration of the brightness (brightness information) of the entire screen. In this case, for example, in a situation where the display image includes a light source 101 such as the sun as shown in FIG. 2, the object within the same screen (in the case of FIG. 102) is in a so-called backlight state, so that most of the image area is often a dark silhouette-like low luminance area (reference numeral 102b in FIG. 2).

  Here, FIG. 4 is a diagram showing a luminance distribution on the virtual straight line L. In FIG. A solid line (a graph line indicated by reference numeral [2]) illustrated in FIG. 4 indicates a luminance distribution on the straight line L of the image illustrated in FIG. As shown in FIG. 4, P1 (X1, Y1) on the light source 101 has a high luminance, and the luminance decreases as the distance from the light source 101 increases. In the face area receiving the light from the light source 101, a part of the face area near the light source 101, that is, in the vicinity of the face contour 102c, becomes slightly brighter and gradually darker and darker (from the sign of FIG. 2). 102b).

  Therefore, in order to partially correct the dark silhouette-like low-brightness part, for example, by performing the touch and slide operation as described above and specifying a partial area in the screen, an image as shown in FIG. That is, the luminance in the vicinity of the designated area 101 a including the light source 101 is further increased, and a part of the object that has become a dark silhouette, that is, a part of the face area of the person 102, which is close to the light source 101. Image processing for increasing the luminance (brightness) of the region 102a in the range is performed. The resulting luminance distribution is a graph line (one-dot chain line) indicated by reference numeral [3] in FIG. In this case, a boundary portion between a part of the face area of the person 102 and a predetermined area 102a near the light source 101 and a dark silhouette-like low-intensity part 102b of the face area is shown in FIG. In FIG. The boundary 102d is not shown by a clear line, but is shown by a solid line in the drawing for simplification of illustration.

  FIG. 5 is a flow chart that briefly summarizes such a series of actions. Of the operations in the camera 1 of the present embodiment, the flow of processing mainly associated with the image effect setting operation will be described below with reference to the flowchart of FIG.

  First, it is assumed that the power source of the camera 1 is turned on and is operatively activated. In this state, in step S1 of FIG. 5, the control unit 66 checks whether or not the currently set operation mode is the shooting mode. If the shooting mode is set, the process proceeds to the next step S2. If an operation mode other than the shooting mode is set, the process proceeds to step S21.

  In step S <b> 2, the control unit 66 controls the drive of the image sensor 52 and controls the display unit 60 via the display driver 59 to execute a through image display process (also referred to as a live view display process). In this through image display process, an image signal acquired by the image sensor 52 and output from the AD conversion unit 54 via the analog processing unit 53 is received and transmitted to the display unit 60 via the display driver 59, and this display is performed. This is a display process for continuously displaying images on the display screen of the unit 60. Thereafter, the process proceeds to step S3.

  In step S <b> 3, the control unit 66 monitors an instruction signal from the operation unit 65 and confirms whether or not a photographing operation, that is, a shutter release operation has been performed. Here, the shutter release operation in the camera 1 is a touch operation on the touch panel included in the operation unit 65 as described above. In addition, by separately providing a shutter release button, the shutter release button pressing operation may be a shutter release operation. In the following description, the shutter release operation of the camera 1 is a touch operation. It will be explained as being.

  When the control unit 66 confirms the touch operation on the touch panel included in the operation unit 65 in the process of step S <b> 3, the touch slide determination unit 67 determines the touch operation instruction signal. If it is confirmed that the touch operation is a shutter release instruction signal, the process proceeds to the next step S4.

  In addition, when an operation other than the touch operation is confirmed in the process of step S3 described above, or when the touch operation is confirmed and it is determined that the touch operation is not a shutter release instruction signal. Advances to step S11.

  Here, for example, as described above, the determination process of whether or not the shutter release instruction signal is the shutter release instruction signal by the touch slide determination unit 67 is to determine the time of the touch operation on the touch panel or the presence or absence of the slide operation following the touch operation. This is determined by confirmation (slide determination processing in step S11 described later).

  When the shutter release instruction signal is confirmed in the process of step S3 and the process proceeds to the process of step S4, in step S4, the control unit 66 executes a normal photographing process. This shooting process is performed via the aperture driver 44 linked to the AF processing unit 56 and via the aperture driver 44 linked to the AE processing unit 55 (AF control operation, etc.). This is a series of control processes such as drive control of the diaphragm mechanism 42, drive control of the shutter mechanism 51 (exposure control operation) performed via the shutter driver 71, and image pickup operation for driving and controlling the image sensor 52. Note that the photographing process itself executed in the process of step S4 is the same as that of a conventional general photographing apparatus (camera), and a detailed description thereof will be omitted. The image signal acquired as a result of the photographing process is output from the AD conversion unit 54 and temporarily stored in the SDRAM 63. Thereafter, the process proceeds to step S5.

  In step S5, the control unit 66 executes normal recording processing. In this recording process, the image compression / development unit 58 applies a signal compression process of a predetermined form to the image signal temporarily stored in the SDRAM 63 to generate image data, and the image data is stored in the recording medium 62 via the memory IF 61. It is a series of control processes recorded in the predetermined area. Note that the recording process itself executed in the process of step S5 is the same process as that of a conventional general photographing apparatus (camera), and thus detailed description thereof is omitted. Thereafter, the processing returns to the above-described step S1 and the subsequent processing is repeated.

  On the other hand, if the shutter release instruction signal is not confirmed in step S3 and the process proceeds to step S11, in step S11, the control unit 66 determines whether the touch slide determination unit 67 has performed a slide operation. Judgment is made. Here, when the slide operation is confirmed, the touch operation must be confirmed in the process of step S3 described above. Accordingly, it is assumed that a slide operation following the touch operation has been performed, and the process proceeds to the next step S12. If the slide operation is not confirmed, the process returns to the above-described step S1 and the subsequent processes are repeated.

  In step S12, the control unit 66 executes a luminance distribution determination process. In other words, the brightness distribution determination unit 68 determines the luminance distribution for the area specified by the touch and slide operation in the above-described steps S3 and S11 (creates a graph as shown in FIG. 4). Then, for this luminance distribution, it is confirmed whether or not a predetermined pattern, that is, a pattern in which the high luminance portion appears again from the high luminance portion through the low luminance portion. If it is determined that the luminance distribution has a predetermined pattern, the process proceeds to the next step S13. On the other hand, if it is determined that the luminance distribution does not have a predetermined pattern, the process returns to step S1 and the subsequent processes are repeated.

  In step S13, the control unit 66 controls the AE processing unit 55 to execute processing for correcting the set exposure value to the plus (+) side. Then, it returns to the process of step S1 and repeats the subsequent processes.

  On the other hand, when it is determined in step S1 that the operation mode other than the shooting mode is set and the process proceeds to step S21, the control unit 66 is currently set in step S21. It is confirmed whether or not the operation mode is the playback mode. If the playback mode is set, the process proceeds to the next step S22. If another operation mode other than the playback mode is set, for example, the communication mode, the data storage mode, etc., the process proceeds to step S31. In this step S31, the operation process for the set operation mode is performed. Is executed.

  Note that operations in other operation modes other than the shooting mode and the playback mode are not directly related to the present embodiment. Therefore, the operation in other operation modes is the same as that of a conventional general camera, and detailed description thereof is omitted. Thereafter, the processing returns to the above-described step S1 and the subsequent processing is repeated.

  If it is determined in step S21 that the playback mode is set and the process proceeds to the next step S22, the control unit 66 executes the selected image playback process in step S22.

  When the camera 1 is in the playback mode, an image based on the image data recorded on the recording medium 62 is displayed on the display screen of the display unit 60. At this time, the user can switch a plurality of image data recorded on the recording medium 62 in order and display them on the display unit 60 by performing a predetermined operation. The selected image reproduction process is a series of processes for reading an image selected by a user operation from the recording medium 62 and reproducing and displaying it on the display unit 60. Since the selected image reproduction process itself is the same operation as that of a conventional general camera, detailed description thereof will be omitted. Thereafter, the process proceeds to step S23 described above.

  In step S <b> 23, the control unit 66 monitors an instruction signal from the touch panel of the operation unit 65, and confirms whether the touch & slide operation has been performed by the touch slide determination unit 67. If it is confirmed that the touch & slide operation has been performed, the process proceeds to the next step S24. If the touch & slide operation is not confirmed, the process proceeds to step S27.

  In step S24, the control unit 66 executes a luminance distribution determination process. In other words, the brightness distribution determination unit 68 determines the luminance distribution for the region specified by the touch and slide operation in the above-described step S23 (creates a graph as shown in FIG. 4). Then, similarly to the processing in step S12 described above, it is confirmed whether or not this luminance distribution has a predetermined pattern (for example, a luminance pattern in which the high luminance portion appears again from the high luminance portion through the low luminance portion). . If it is determined that the luminance distribution has the predetermined pattern, the process proceeds to the next step S25. If it is determined that the luminance distribution is not the predetermined pattern, the process proceeds to step S27.

  In step S25, the control unit 66 controls the brightness distribution enhancement unit 70 to execute brightness enhancement processing. This brightness enhancement processing is performed based on the determination result by the brightness distribution determination unit 68 and the determination result by the touch slide determination unit 67, and the brightness distribution (luminance signal distribution) for a predetermined range of image signals. Is an image processing for emphasizing. Thereafter, the process proceeds to step S26.

  This brightness enhancement processing is, for example, enhancing the range of light emitted from a light source in a photographed image by normal photographing, extending the length of light rays, reaching distance, etc., and photographing objects such as a person facing the light source Image processing for performing highlighting with improved contrast. By performing such image processing, a more dramatic and divine image effect can be obtained.

  The brightness enhancement processing performed here is from the touch start point (touch position P1 (X1, Y1) in FIG. 2) in the touch & slide operation by the processing in step S23 described above to the slide direction (arrow S direction in FIG. 2). This is a process of gradually enhancing the brightness. At this time, in the above-described slide operation, only a straight line in the direction of the arrow S is specified, but a predetermined region including the straight line along the arrow S is set as the target of the brightness enhancement process.

  Further, a bright portion (high luminance portion) near the end point of the slide operation (P2 (X2, Y2) in FIG. 2), specifically, a face region where the person 102 shown in FIG. Of these, the vicinity of the face contour 102c near the light source 101 and the dark portion (low luminance portion) adjacent to the bright portion, specifically, the vicinity of the face contour 102c of the person 102 in FIG. Also included is a process of emphasizing the brightness level in the vicinity of adjacent parts in the direction away from the light source (in the direction along the arrow S up) and the brightness of a predetermined area including the part.

  In step S26, the control unit 66 confirms whether or not to save the image data obtained as a result of the brightness enhancement process. In the confirmation process, for example, a question display as to whether or not to save the image is displayed by superimposing it on the image (processed image) displayed on the display screen of the display unit 60. Viewing this display, the user uses a predetermined operation member (for example, a touch panel) to instruct whether or not to save. By confirming the instruction signal, it is determined whether or not to save. Here, when the instruction signal instructing the storage is confirmed, the process proceeds to the above-described step S5, and in step S5, the control unit 66 executes the recording process. If the instruction signal for instructing the storage is not confirmed, the process proceeds to step S27.

  In step S27, the control unit 66 monitors the instruction signal from the operation unit 65, and confirms the presence / absence of a signal instructing the end of the reproduction mode. Here, when the reproduction mode end instruction signal is confirmed, the processing returns to the above-described step S1, and the subsequent processing is repeated. If the reproduction mode end instruction signal is not confirmed, the process returns to the above-described step S23 and the subsequent processes are repeated.

  Next, details of the image processing executed by performing the above-described image effect setting operation, that is, the touch & slide operation will be described below. FIG. 6 is a diagram for explaining image processing performed as a result of the image effect setting operation by the camera of this embodiment, and FIG. 6A is an example of a display screen showing the image processing result, and FIG. ) Is an enlarged view of a main part showing a part of FIG. FIG. 6 corresponds to FIGS. 2 and 3 described above. FIG. 7 is a flowchart showing the operation of the camera 1 of the present embodiment (mainly the flow of processing associated with the image effect setting operation). FIG. 8 is a flowchart showing a flow of display processing executed in parallel with the flowchart of FIG.

  First, a desired playback image is displayed on the display screen of the display unit 60 of the camera 1 (playback mode), or a through image (live view image) is displayed in the shooting mode. Note that the flowchart illustrated in FIG. 7 illustrates processing when an operation is performed on a through image (live view image) display in the shooting mode.

  That is, in step S100 shown in FIG. 7, the control unit 66 executes through image display processing.

  Subsequently, in step S <b> 101, the control unit 66 acquires information on the light source included in the through image displayed based on the image signal output from the AD conversion unit 54, such as position information. Thereafter, the process proceeds to step S102.

  In step S102, the control unit 66 is a light source frame display process based on the light source information acquired in the process of step S101 described above, that is, a process of displaying a frame-shaped mark surrounding the light source, for example, to indicate the light source position. is there. By performing this light source frame display processing, when a touch operation is performed on an area where the light source frame is displayed, the release operation is prohibited and the image effect setting operation of the present embodiment can be performed with priority. .

  Here, the camera 1 is continuously in the through image display state (including the light source frame display) and is in the shooting standby state. In this state, the user touches the light source on the display screen of the display unit 60.

  In step S103, the control unit 66 monitors an output signal from the operation unit 65, and detects whether or not a touch signal is output from the touch panel. If a touch signal is detected, the process proceeds to the next step S110. If no touch signal is detected, the process returns to step S101 and the subsequent processes are repeated.

  In step S110, the control unit 66 acquires information on the coordinates P1 (X1, Y1) on the display screen of the touch position of the detected touch signal. Thereafter, the process proceeds to step S111.

  In step S <b> 111, the control unit 66 confirms whether or not the detected touch position substantially matches the light source position in the display screen of the display unit 60. Here, when it is confirmed that the touch position and the light source position substantially coincide with each other, the process proceeds to the next step S112. If it is confirmed that the touch position and the light source position do not substantially coincide with each other, the process proceeds to the photographing process in step S113. The photographing process executed in step S113 is a general photographing operation process that is normally performed. Note that details of the normal general photographing process are omitted.

  After the shooting process is executed in step S113 described above, the process returns to the process in step S101 described above, and the subsequent processes are repeated.

  On the other hand, when the touch position and the light source position substantially coincide with each other in the process of step S111, the process proceeds to step S112. In step S112, the control unit 66 uses the internal counter (not shown) to touch. Start counting times. Thereafter, the process proceeds to step S114.

  In step S <b> 114, the control unit 66 acquires light source information at the touch position coordinates P <b> 1, for example, various information such as position, range, color, and luminance.

  Subsequently, in step S115, the control unit 66 monitors the output signal from the operation unit 65 to determine whether or not the touch operation from the touch panel has been released, that is, whether or not the user's finger during the touch operation has left the touch panel. (Touch release detection). If a touch operation release signal is detected, the process returns to the above-described step S101 and the subsequent processes are repeated. If no touch operation release signal is detected, the process proceeds to the next step S120.

  In step S120, the control unit 66 performs a movement detection process. This movement detection process is a confirmation of whether or not the user has slid the finger 100a on the display screen in a state where the touch operation is maintained following the touch operation detected in step S103 described above. . If slide movement is detected, the process proceeds to the next step S121. If no slide movement is detected, the process returns to the above-described step S115 and the subsequent processes are repeated.

  In step S121, the control unit 66 performs face detection processing using the face detection unit 69, and acquires face information detected in the through image currently displayed. At the same time, a frame display surrounding the detected face may be displayed superimposed on the through image (live view image).

  Subsequently, in step S122, the control unit 66 acquires information on the coordinates P2 (X2, Y2) of the touch release position after the movement.

  In step S123, the control unit 66 calculates a highlight calculation range based on operation information such as a distance between the coordinates P1 and P2, that is, a distance of a slide operation performed on the display screen of the display unit 60. Run. This highlight calculation range calculation processing is image processing for emphasizing the brightness of an image area in a predetermined range including a position designated by a touch and slide operation.

  Subsequently, in step S124, the control unit 66 executes a process for holding the highlight calculation range calculation result.

  Further, in step S125, the control unit 66 changes the through image display parameter. Thereafter, the processing returns to the above-described step S115 and the subsequent processing is repeated.

  In the camera 1 of this embodiment, the flowchart shown in FIG. 8 acts in parallel with the flowchart of FIG. 7 described above. Since the display processing flowchart of FIG. 8 is executed in parallel, the change of the parameter accompanying the operation is reflected on the through image display each time. Therefore, the image display to be changed by the operation can be observed in real time.

  First, when the through image display process in step S100 in the flowchart of FIG. 7 described above is started, the flowchart of FIG.

  In step S200 in FIG. 8, the control unit 66 refers to the number of touches by the internal counter (step S112 in FIG. 7), and confirms whether or not the calculation number N matches the number of touches. If they match, the series of processing ends, and the process returns to the original processing step. If not, the process proceeds to the next step S201.

  In step S201, the control unit 66 adds (increments) the number of operations N of the internal counter by one (N = N + 1).

  Subsequently, in step S202, the control unit 66 acquires contour information from the face information (step S121 in FIG. 7). Here, the contour refers to a portion of the face image detected by face detection in which pixels having similar color and luminance information are continuously linear (hereinafter referred to as a contour line).

  Next, in step S203, the control unit 66 checks whether or not the calculation has been completed for all pixels inside (face side) the face outline. If the completion of calculation is confirmed here, the process returns to step S200 and the subsequent processes are repeated. Further, before completion is confirmed, the process proceeds to the next step S210.

  Subsequently, in step S210, the control unit 66 acquires information of one pixel on the inner side (face side) from the face outline.

  Next, in step S211, the control unit 66 checks whether or not one pixel inside (face side) from the face outline is within the highlight calculation range. Here, if it is confirmed that it is within the calculation range, the process proceeds to the next step S212. If it is not within the calculation range, the process returns to step S203, and the subsequent processes are repeated.

  In step S212, the controller 66 performs light source color synthesis processing (10% to 0%) according to the slide distance. Thereafter, the processing returns to step S203, and the subsequent processing is repeated.

  Here, the light source color composition processing will be briefly described. First, the average value of the color information (RGB) of the light source is set to 100% based on the light source information acquired in step S101. Further, based on the contour information acquired in step S202, the color information of one pixel on the face side of the face contour line, that is, the color information of the silhouette-shaped region shown in FIG.

  Then, a straight line connecting one pixel on the inner side (face side) of the contour line acquired in step S210 and the center point of the light source acquired in step S101 is assumed (see FIG. 6). In this case, the RGB value of the light source and the RGB value of the pixel are synthesized. The degree of synthesis at this time is set in consideration of the distance on the straight line between the contour line (step S202) and one pixel (step S210) inside (face side) the contour line.

  For example, the degree of synthesis of one pixel on the contour line (that is, distance = 0) is set to increase by 10% between 0 and 100% according to the number of touches. That is, the color is set so that it gradually approaches the color of the light source as the number of touches increases.

  The maximum value of the distance from the contour line is determined by the distance between the coordinates P1 and P2 by the touch operation. That is, the degree of synthesis of one pixel at the maximum distance for calculation is set to 0%, and the degree of synthesis from one pixel on the contour line to one pixel at the maximum distance is complemented.

  As described above, in the touch and slide operation, the strength of the highlight is adjusted by, for example, the number of times the light source is touched, and the amount of highlight wraparound, that is, from the outline of the face of the subject to the inside of the face is adjusted depending on the slide movement distance Adjust the distance to (the area where brightness enhancement is performed). Since the result is immediately reflected on the display screen of the display unit 60, the user repeats a plurality of touch operations and slide movement operations while viewing the display screen of the display unit 60. Thus, adjustment is performed until a desired image is generated.

  Note that the range of brightness enhancement is set according to the slide movement distance as described above. That is, it is set in consideration of the distance of the slide movement, the area of the face image detected by face detection, the width of the face image, and the like.

  Specifically, for example, when the distance of the slide movement is the distance from the light source to the contour of the face, the predetermined range of the face for which brightness enhancement is performed includes the width of the face image from the contour of the face image. A range with a length of about 1/4 is set.

  Further, even when there are a plurality of light sources in the display screen of the display unit 60, the same composition processing can be performed by repeatedly performing the same operation on each light source.

  As described above, according to the above-described embodiment, when the camera 1 is in the shooting mode and the through image display is performed, the user performs a touch and slide operation on the touch panel on the display unit 60 to display the area. When the designation is made, the luminance distribution in the designated range is determined, and when the determined luminance distribution is the luminance distribution of the predetermined pattern, exposure positive (+) correction is automatically performed. Thus, an image with enhanced brightness can be automatically obtained with respect to the normal exposure value calculated by the AE processing unit 55. This means that even if you do not have knowledge about exposure compensation or exposure, anyone can easily obtain a more effective image with only intuitive operation that specifies the area by touch & slide operation. it can.

  Apart from this, in the present embodiment, the camera 1 is set to the playback mode and an image based on the image data recorded on the recording medium 62 is displayed on the display unit 60, or the camera 1 is set to the shooting mode. When a through image (live view image) display is performed with this setting set, if the same touch and slide operation is performed on a desired area, the brightness that enhances the brightness of any part of the display image The enhancement process can be executed, and the processed image can be easily recorded. In that case, it is possible to record separately the image data subjected to the brightness image processing separately from the image by the normal processing.

  As described above, even a general user who does not have specialized knowledge about the camera 1 or the imaging technique can perform complicated operations such as exposure, color, brightness, etc. by performing an intuitive operation associated with a shooting operation or an image reproduction operation. It is possible to automatically execute appropriate setting changes. As a result, it is possible to easily shoot and acquire a desired photo having a dramatic and dramatic brightness enhancement effect different from normal shooting.

  Each processing sequence described in each of the above-described embodiments can allow a procedure to be changed as long as it does not contradict its nature. Therefore, for each of the above-described processing sequences, for example, the order of the processing steps is changed each time the processing order is changed, the processing steps are executed simultaneously, or a series of processing sequences are executed. It may be.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications can of course be implemented without departing from the spirit of the invention. Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the above-described embodiment, if the problem to be solved by the invention can be solved and the effect of the invention can be obtained, this constituent requirement is deleted. The configured structure can be extracted as an invention.

  The present invention is not limited to a photographing device that is an electronic device specialized in a photographing function such as a digital camera, and other forms of electronic devices having a photographing function, such as a mobile phone, a recording device, an electronic notebook, and a personal computer. The present invention can also be applied to various electronic devices with photographing functions such as computers, game devices, televisions, watches, navigation devices using GPS (Global Positioning System).

1 …… Camera,
41... Imaging optical system 42. Diaphragm mechanism 43. Lens driver 44. Diaphragm driver
50 …… Camera body, 51 …… Shutter mechanism, 52 …… Image sensor, 53 …… Analog processing unit, 54 …… AD conversion unit, 55 …… AE processing unit, 56 …… AF processing unit, 57 …… Image Processing unit 58 ... Image compression / decompression unit 59 ... Display driver 60 ... Display unit 61 ... Memory interface 62 62 Recording medium 63 ... SDRAM 64 64 Flash memory 65 Operation Part,
66 …… Control unit, 67 …… Touch slide determination unit, 68 …… Brightness distribution determination unit, 69 …… Face detection unit, 70 …… Brightness distribution enhancement unit,
71 …… Shutter driver, 72 …… Power supply circuit, 73 …… Communication bus,

Claims (5)

An imaging unit having an imaging element for imaging a subject;
A display unit for displaying an image based on the image data acquired by the imaging unit;
A touch panel disposed on the display surface of the display unit;
A light source detection unit for detecting a light source in an image being displayed on the display unit;
An operation input determination unit that detects and determines coordinate data according to an input operation on the touch panel;
A control unit that sets a designated region in the image based on the coordinate data detected by the operation input determination unit;
A luminance distribution determining unit that determines a luminance distribution of an area corresponding to the coordinate data determined by the operation input determining unit;
A luminance distribution emphasizing unit for emphasizing the luminance of the designated area in the image set by the control unit ;
A recording unit for recording the image data;
Comprising
The luminance distribution emphasizing unit sets a range for performing luminance distribution emphasis processing according to a moving distance of the slide operation with respect to the touch panel, and sets a luminance distribution emphasis level according to the number of times of the sliding operation with respect to the touch panel. Shooting equipment.   The operation input determination unit detects a touch operation position coordinate with respect to the touch panel, a slide operation from the touch operation position coordinate, and a touch release operation position coordinate after the slide operation, and the slide from the detected coordinates. The photographing apparatus according to claim 1, wherein an operation direction and a movement amount are determined. A face detection unit that performs face detection from the image being displayed on the display unit and acquires face information of the detected face image;
The said control part sets the said designation | designated area | region in consideration of the said face information acquired by the said face detection part in addition to the coordinate data detected by the said operation input determination part. Photography equipment.   The brightness distribution emphasizing unit executes an emphasis process in which, when emphasizing the brightness distribution of a subject existing on a straight line extending in the slide operation direction from the light source, a gradient is gradually formed in a direction gradually becoming darker from the light source side. The photographing apparatus according to claim 1, wherein: A touch determination step for determining a touch operation;
A slide determination step for determining the amount of slide movement by the slide operation;
A face detection step for detecting a face image in the image;
A luminance distribution enhancement step for setting a luminance distribution enhancement level by setting a range for performing luminance distribution enhancement processing based on the slide movement amount determined by the slide determination step and the face image information detected by the face detection step; ,
A recording step of recording image data including the image processing performed by the luminance distribution enhancement step;
An image data recording method comprising:

Images