JP5510353B2 - Display device and display method - Google Patents

Description

The present invention relates to a display device and a display method , and more particularly to a display operation of a display device in which a plurality of display panel units are provided on a housing.

JP 2007-158799 A

Imaging devices such as digital still cameras and digital video cameras are widespread, and in many imaging devices, a display panel unit such as a liquid crystal panel is formed.
For example, as shown in Patent Document 1, a display panel having a relatively large area is provided on a camera casing, and monitoring of a subject image is performed at the time of imaging, and reproduction display is performed at the time of reproducing the captured image. It is made to be.

Here, the present applicant considers newly providing two display panel sections on the apparatus housing .
That is, in the same manner as in the prior art, a display panel unit is provided on the imaging device casing so as to display in the direction of the user (imaging person), and the front side (surface on the subject side) on the device casing is provided. In addition, a display panel unit configured to display toward the subject is provided.
When two display panel units are provided in this way, appropriate display on each display panel, that is, display that effectively uses the two display panels, depending on the operation state and situation related to imaging, It is required to realize a display operation that is useful for a person who views the display and that avoids unnecessary power consumption.
Therefore, an object of the present invention is to realize appropriate display in a display device having two display panel units.

The display device according to the present invention performs display in a direction other than the user direction on the device housing, the first display panel unit performing display toward the user direction on the device housing, When a list display of a plurality of image data is performed on the second display panel unit that can be arranged on the back side of the first display panel unit and the first display panel unit, the list is displayed on the second display panel unit. When the image data being selected among the displays is displayed and one image data is being displayed on the first display panel unit, the one image data is displayed on the second display panel unit. And a control unit for displaying .

For example , when one piece of reproduced image data is displayed on the first display panel unit, the control unit causes the second display panel unit to display the one piece of reproduced image data. .

Further, the control unit controls execution / non-execution of display of reproduced image data on the second display panel unit based on a determination result of the condition of visibility.
In this case, the determination process of visual recognition possibility conditions, to the discrimination processing of the presence of a person at the subject side, is also a discrimination processing for discriminating process, or the image analysis processing result of the captured image signal of the internal detection information The

For example the controller may Oite between reproduction period for reproducing and displaying the image data recorded on the recording medium, the playback display, only one run in one of the first display panel unit and the second display panel unit To control.
Alternatively, the control unit causes the first display panel unit to perform the reproduction display during the reproduction period, and based on the determination processing result of the visibility condition for the second display panel, the second display panel The execution / non-execution of the reproduction display in the unit is controlled.
Alternatively, the control unit selectively executes list display and one-image display as the reproduction display on the first display panel unit in the reproduction period, and only one-image display on the second display panel. that controls so as to run.

The display method of the present invention includes a first display panel unit that performs display in the direction of the user on the device casing, and displays in a direction other than the user direction on the device casing. As a display method of a display device including a second display panel unit that can be arranged on the back side of the first display panel unit, when a list display of a plurality of image data is performed on the first display panel unit, When the second display panel unit displays the image data selected from the list display and one image data is displayed on the first display panel unit, the second display panel The one piece of image data is displayed on the part .

That is, in the present invention, the control as described above, the playback period, an appropriate display in the display panel unit, useful display, realizing the avoidance of wasteful display.
To control the display state depending on the presence of a person to see the purpose and display of field Display example.

For example, for the second display panel unit, display control is performed by determining the possibility that a person exists in a direction other than the user direction during the reproduction period .
For example, the display on the second display panel unit is useful only when a person is present in a direction other than the user direction such as the subject side . Thus it is meaningless to display the monitoring image on the second display panel unit to come The person viewing the display of the second display panel unit it is thought to be absent. Therefore, it is appropriate to save power by turning off the second display panel.
In this way, by appropriately controlling the display operations of the first and second display panel units, it is possible to provide useful display by two display panel units, a highly entertaining display, or two display panel units. It can be realized that power consumption is not increased unnecessarily.

According to the present invention, in the display device, it is possible to provide two display panel portions that can be visually recognized on the user side and the other direction side, and perform appropriate display on each display panel during the reproduction period . That is, it is possible to realize a useful display that effectively uses the two display panel units, a highly entertaining display, and avoiding useless display, and a new and useful display device can be provided.
In particular, it is also possible to control the display operation of the second display panel unit by estimating the presence / absence of a person in a direction other than the user direction and the visibility of the display and controlling the display operation of the second display panel unit.

It is explanatory drawing of the example of an external appearance of the imaging device of embodiment of this invention. It is a block diagram of the imaging device of an embodiment. It is explanatory drawing of the operation | movement transition of the imaging device of embodiment. It is explanatory drawing of the example of an image display of the imaging device of embodiment. It is explanatory drawing of the example of an image display of the imaging device of embodiment. It is a flowchart of the example of a control process which performs transition of each operation period of an embodiment. It is a flowchart of the example of a process of the monitoring period of embodiment. It is a flowchart of the example of a process of the recording period of embodiment. It is a flowchart of the example of a process of the recording period of embodiment. It is a flowchart of the example of a process of the preview period of an embodiment. It is a flowchart of the example of a process of the preview period of an embodiment. It is a flowchart of the example of a process of the preview period of an embodiment. It is a flowchart of the example of a process of the preview period of an embodiment. It is a flowchart of the example of a process of the reproduction | regeneration period of embodiment. It is a flowchart of the example of a process of the reproduction | regeneration period of embodiment. It is a flowchart of the example of a control process including the moving image recording period of embodiment. It is a flowchart of the example of a process of the moving image recording period of embodiment. It is explanatory drawing of the example of the transition of the display state of embodiment. It is explanatory drawing of the example of the transition of the display state of embodiment.

Hereinafter, embodiments of the present invention will be described in the following order.
[1. Configuration of imaging device]
[2. Operation transition]
[3. Example of screen display on both display panels]
[4. Display control example]
<4-1: Processing Example for Performing Operation Period Transition>
<4-2: Example of monitoring period processing>
<4-3: Recording period processing example>
<4-4: Preview Period Processing Example>
<4-5: Reproduction period processing example>
<4-6: Example of processing during moving image recording period>
[5. Example of display state transition]
[6. Modified example]

[1. Configuration of imaging device]

As an embodiment of the present invention, for example, a configuration of an imaging apparatus as a digital still camera will be described with reference to FIGS.

FIGS. 1A and 1B show an example of an external appearance of the imaging apparatus 1 of this example as viewed from the back side (user side) and the front side (subject side).
The imaging device 1 is provided with an imaging lens unit 20 and a flash light emitting unit 15 on the front side.
In addition, operators for user operations are formed at various locations such as the upper surface and the rear surface of the housing. For example, a release operation key 5a, a dial operation unit 5b, a wide / teleoperation key 5c, various operation keys 5d, a cross key 5e, and the like are provided.
The dial operation unit 5b is used for selecting an imaging mode, for example. As the operation key 5d, operations such as a menu instruction, a reproduction instruction, and an exposure correction instruction can be performed.
The cross key 5e is used for various operations such as selection / determination of operation menu items displayed on the display panel 6, for example.

As shown in FIG. 1A, the imaging apparatus 1 is provided with a main display panel 6M such as a liquid crystal panel or an organic EL (Electroluminescence) panel as shown in FIG. 1A, and on the front side as shown in FIG. Similarly, a front display panel 6F made of a liquid crystal panel, an organic EL panel, or the like is provided.
The main display panel 6M and the front display panel 6F have, for example, the same screen size, and are provided so as to occupy a relatively large area on the back surface of the housing and the front surface of the housing, respectively.
In the main display panel 6M, basically, during the monitoring period (when the shutter timing is aimed in the imaging mode), the user displays a monitoring image (through image) of the subject and becomes an imaging target. The user can check the scene of the subject. In the playback mode, playback images and thumbnail images are displayed in accordance with user operations.
On the other hand, the front display panel 6F performs display toward the subject side. As will be described later, the front display panel 6F also displays a monitoring image or the like so that the person on the subject side can see the display contents.

A configuration example of such an imaging apparatus 1 will be described with reference to FIG.
As shown in FIG. 2, the imaging device 1 includes an imaging system 2, a control system 3, a camera DSP (Digital Signal Processor) 4, an operation unit 5, a main display panel 6M, a front display panel 6F, a display controller 7, an external interface 8, An SDRAM (Synchronous Dynamic Random Access Memory) 9 and a medium interface 10 are provided.

  The imaging system 2 is a part that performs an imaging operation, and includes a lens mechanism unit 21, an aperture / ND filter mechanism 22, an imaging element unit 23, an analog signal processing unit 24, an A / D conversion unit 25, a lens driving unit 26, and a lens. A position detection unit 27, a timing generation circuit 28, a shake detection unit 13, a light emission drive unit 14, a flash light emission unit 15, a lens drive driver 17, an aperture / ND drive driver 18, and an image sensor driver 19 are provided.

Incident light from the subject is guided to the image sensor 23 via the lens mechanism 21 and the aperture / ND filter mechanism 22.
The lens mechanism unit 21 is an internal configuration of the imaging lens unit 20 in FIG. 1B and includes a plurality of optical lens groups such as a cover lens, a focus lens, and a zoom lens. The lens driving unit 26 is a transfer mechanism that transfers the focus lens and the zoom lens in the optical axis direction. The lens driving unit 26 is applied with driving power by the lens driving driver 17 and moves the focus lens and the zoom lens. A CPU (Central Processing Unit) 31 to be described later controls the lens drive driver 17 to execute focus control and zoom operation.

The aperture / ND filter mechanism 22 includes an aperture mechanism and an ND filter mechanism that attenuates (adjusts) the amount of incident light by being inserted into the lens optical system, and performs light amount adjustment.
The aperture / ND drive driver 18 adjusts the amount of incident light by opening and closing the aperture mechanism. The aperture / ND drive driver 18 adjusts the amount of incident light by moving the ND filter in and out of the optical axis of the incident light. The CPU 31 can perform incident light amount control (exposure adjustment control) by controlling the aperture / ND drive driver 18 to drive the aperture mechanism and the ND filter.

The light flux from the subject passes through the lens mechanism unit 21 and the aperture / ND filter mechanism 22, and a subject image is formed on the image sensor unit 23.
The imaging element unit 23 photoelectrically converts the subject image to be formed and outputs a captured image signal corresponding to the subject image.
The imaging element unit 23 has a rectangular imaging region composed of a plurality of pixels, and sequentially outputs image signals, which are analog signals corresponding to the charges accumulated in each pixel, in units of pixels. 24. For example, a CCD (Charge Coupled Device) sensor array, a CMOS (Complementary Metal Oxide Semiconductor) sensor array, or the like is used as the imaging element unit 23.

The analog signal processing unit 24 includes a CDS (correlated double sampling) circuit, an AGC (auto gain control) circuit, and the like, and performs predetermined analog processing on the image signal input from the image sensor unit 23. .
The A / D conversion unit 25 converts the analog signal processed by the analog signal processing unit 24 into a digital signal and supplies it to the camera DSP 4.

The timing generation circuit 28 is controlled by the CPU 31 and controls the timing of each operation of the imaging element unit 23, the analog signal processing unit 24, and the A / D conversion unit 25.
That is, the timing generation circuit 28 provides an exposure / charge readout timing signal, a timing signal as an electronic shutter function, a transfer clock, a synchronization signal according to the frame rate, etc., in order to control the imaging operation timing of the imaging device unit 23. , And supplied to the image sensor section 23 via the image sensor driver 19. The analog signal processing unit 24 also supplies the timing signals to the analog signal processing unit 24 so that the processing is performed in synchronization with the transfer of the image signal in the image sensor unit 23.
The CPU 31 can control each timing signal generated by the timing generation circuit 28 to change the frame rate of the captured image and perform electronic shutter control (exposure time variable control in the frame). Further, the CPU 31 can perform gain variable control of the captured image signal by giving a gain control signal to the analog signal processing unit 24 via the timing generation circuit 28, for example.

The shake detection unit 13 detects the amount of camera shake and the amount of movement of the imaging device 1 itself. For example, an acceleration sensor, a vibration sensor, or the like is provided, and detection information as a blur amount is supplied to the CPU 31.
The flash light emitting unit 15 is driven to emit light by the light emission driving unit 14. The CPU 31 can instruct the light emission drive unit 14 to perform flash emission at a predetermined timing by a user operation or the like, and can cause the flash light emission unit 15 to emit light.

The camera DSP 4 performs various digital signal processing on the captured image signal input from the A / D conversion unit 25 of the imaging system 2.
In the camera DSP 4, for example, as shown in the figure, processing functions such as an image signal processing unit 41, a compression / decompression processing unit 42, an SDRAM controller 43, and an image analysis unit 44 are realized by internal hardware and software.

  The image signal processing unit 41 performs processing on the input captured image signal. For example, as an arithmetic process for driving control of the imaging system 2 using a captured image signal, an auto focus (AF) process, an auto iris (AE) process, etc. are performed, and an auto white is performed as a process for the input captured image signal itself. A balance (AWB) process is performed.

For example, as the autofocus process, the image signal processing unit 41 performs contrast detection on the input captured image signal and transmits detection information to the CPU 31. Various control methods are known as the autofocus control method. In a method called contrast AF, the contrast of the captured image signal at each time point is detected while forcibly moving the focus lens, and the optimum contrast is detected. The focus lens position in the state is determined. That is, prior to the imaging operation, the CPU 31 confirms the contrast detection value detected by the image signal processing unit 41 while executing the movement control of the focus lens, and controls the position where the optimum contrast state is achieved as the focus optimum position. I do.
Further, as focus control during imaging, a detection method called so-called wobbling AF can be executed. The CPU 31 confirms the contrast detection value detected by the image signal processing unit 41 while constantly moving the focus lens slightly back and forth during the imaging operation. Naturally, the optimum position of the focus lens varies depending on the condition of the subject, but by performing contrast detection while slightly moving the focus lens back and forth, it is possible to determine a change in the format control direction in accordance with the subject variation. As a result, it is possible to execute autofocus tracking the subject situation.
The transfer mechanism in the lens driving unit 26 is assigned an address for each transfer position, and the lens position is determined based on the transfer position address.
The lens position detection unit 27 can determine the address as the current lens position of the focus lens, thereby calculating the distance to the subject in focus and supplying the distance information to the CPU 31. . Thus, the CPU 31 can determine the distance to the main subject in the focused state.

As the auto iris processing executed by the image signal processing unit 41 of the camera DSP 4, for example, calculation of subject luminance is performed. For example, the average luminance of the input captured image signal is calculated and supplied to the CPU 31 as subject luminance information, that is, exposure amount information. As the calculation of the average luminance, various methods such as the average value of the luminance signal values of all the pixels of the captured image data of one frame or the average value of the luminance signal values obtained by weighting the central portion of the image can be considered. .
The CPU 31 can perform automatic exposure control based on the exposure amount information. That is, exposure adjustment can be performed by an aperture mechanism, an ND filter, or an electronic shutter control in the image sensor unit 23, and a gain control to the analog signal processing unit 24.

  The image signal processing unit 41 of the camera DSP 4 performs auto white balance, γ correction, edge enhancement processing, and camera shake correction processing as signal processing of the captured image signal itself, in addition to signal generation processing used for the autofocus operation and auto iris operation. Etc.

  The compression / decompression processing unit 42 in the camera DSP 4 performs a compression process on the captured image signal and a decompression process on the compressed image data. For example, compression processing / decompression processing is performed by a method such as JPEG (Joint Photographic Experts Group) or MPEG (Moving Picture Experts Group).

  The SDRAM controller 43 performs writing / reading to / from the SDRAM 9. For example, the SDRAM 9 temporarily stores a captured image signal input from the imaging system 2, stores it in the processing process in the image processing unit 41 or the compression / decompression processing unit 42, secures a work area, and information obtained by the image analysis unit 44. The SDRAM controller 43 writes / reads these data to / from the SDRAM 9.

The image analysis unit 44 performs image analysis on the captured image data processed by the image signal processing unit 41, for example, and performs various types of image recognition.
In the case of this example, the image analysis unit 44 performs processing for person recognition and face recognition included in the subject image. In some cases, when the face of a person is recognized, recognition processing such as the direction of the face and the direction of the line of sight is performed. Further, the image analysis unit 44 may detect various types of information that can be recognized by image analysis, such as the external light situation and the magnitude of relative movement between the imaging device 1 and the subject.

  The control system 3 includes a CPU 31, a RAM 32, a flash ROM 33, and a clock circuit 34. Each part of the control system 3, each part of the camera DSP 4, and each part of the imaging system 2, the display controller 7, the external interface 8, and the medium interface 10 can communicate image data and control information with each other via a system bus.

The CPU 31 controls the entire imaging apparatus 1. That is, the CPU 31 performs various arithmetic processes and exchanges control signals with each unit based on a program held in an internal ROM or the like and a user operation by the operation unit 5 to cause each unit to execute a required operation. In particular, in addition to display control on the main display panel 6M, control processing for display operation of the front display panel 6F described later is also performed.
A RAM (Random Access Memory) 32 stores information corresponding to the temporary storage of captured image signals (image data of each frame) processed by the camera DSP 4 and various processes of the CPU 31.
The flash ROM 33 is used for storing image data as a captured image (captured as a still image or a moving image by a user) and other information that is required to be stored in a nonvolatile manner. In some cases, a control software program for the imaging apparatus 1, camera setting data, and the like are stored.
The clock circuit 34 counts current date / time information (year / month / day / hour / minute / second).

The operation unit 5 includes various operators (5a to 5e, etc.) shown in FIG. 1 and a signal generation unit based on the operation. User operation information by various operators is transmitted from the operation unit 5 to the CPU 31.
Note that the operation unit 5 may be configured not only to be an operator but also to be able to operate a touch panel. For example, a touch sensor may be provided on the main display panel 6M, and an operation input may be performed by a user's touch operation on the screen display.

The display controller 7 causes the main display panel 6M and the front display panel 6F to execute a required display operation based on the control of the CPU 31.
As the display operation on the main display panel 6M, monitoring display (so-called through image display), reproduction image display read from the recording medium 90 or the flash ROM, operation menu display, various icon display, time display, and the like are performed.
As the display operation on the front display panel 6F, monitoring display and reproduction image display are performed.

The medium interface 10 reads / writes data from / to a recording medium 90 such as a memory card (card-like removable memory) set in the imaging apparatus 1 based on the control of the CPU 31. For example, the medium interface 10 performs an operation of recording still image data or moving image data as the imaging result on the recording medium 90. In the reproduction mode, an operation for reading image data from the recording medium 90 is performed.
Here, a portable memory card is taken as an example of the recording medium 90, but the recording medium for recording image data as a still image or a moving image that remains as an imaging result may be other types. For example, a portable disk medium such as an optical disk may be used, or an HDD (Hard Disk Drive) may be mounted and recorded.

The external interface 8 transmits and receives various data to and from an external device via a predetermined cable in accordance with a signal standard such as USB (Universal Serial Bus). Of course, the external interface is not limited to the USB system but may be an external interface based on other standards such as an IEEE (Institute of Electrical and Electronics Engineers) 1394 system.
Further, the external interface 8 may be configured by infrared transmission, short-range wireless communication, or other wireless transmission methods instead of the wired transmission method.
The imaging apparatus 1 can perform data transmission / reception with the personal computer and other various devices via the external interface 8. For example, captured image data can be transferred to an external device.

FIG. 2 shows the proximity sensor 50. The proximity sensor 50 is a sensor that detects whether or not there is a person in front of the imaging apparatus 1 (subject side). For example, a pyroelectric sensor can be employed.
As described above, when the person detection is performed by the image analysis processing of the image analysis unit 44, the proximity sensor 50 may not be provided, or the person detection by the image analysis and the detection by the proximity sensor 50 are used in combination. May be.

[2. Operation transition]

The transition of the operation period of the imaging apparatus 1 of this example will be described with reference to FIG. The operation period is a period accompanied by an imaging operation and a recording operation.
As an operation period of the imaging apparatus 1, a monitoring period, a recording period, a preview period, and a reproduction period are changed according to a user operation or the like. Note that there are actually other operation states such as a period during which communication with an external device is performed, but this is omitted for the sake of simplicity.

When the imaging apparatus 1 is powered on, for example, it starts a monitoring operation. In some cases, the playback operation state may be entered when the power is turned on, such as when the user performs a playback operation from the power-off state.
The monitoring period is an operation period for performing imaging by the imaging system 2. When the user normally captures a still image using the imaging device 1, this monitoring operation is first performed.
During this monitoring period, the subject image (through image) is displayed on the main display panel 6M.
That is, during the monitoring period, the CPU 31 causes the imaging system 2 and the camera DSP 4 to execute operations necessary for imaging. The captured image data for each frame supplied from the camera DSP 4 is taken into the RAM 32, for example. Then, the captured image data for each frame is transferred to the display controller 7 to cause the main display panel 6M to execute monitoring display. As will be described later, monitoring display may also be executed on the front display panel 6F at this time.
In this monitoring period, the user selects a subject or aims at the shutter timing while viewing the display on the main display panel 6M.

When the user presses the release operation key 5a in the monitoring period, that is, when a shutter operation is performed, an operation as a recording period is performed.
The CPU 31 performs processing for saving one frame of captured image data captured at the timing of the release operation as still image data. That is, the CPU 31 transfers the captured image data captured at this timing to the medium interface 10 and records it on the recording medium 90.
The recording operation corresponding to the release operation may be performed in the flash ROM 33 instead of the recording medium 90. Ordinarily, the recording is performed on the recording medium 90, but when the recording medium 90 is not loaded, an operation method in which recording is performed on the flash ROM 33 may be used.
This recording period is an instantaneous period immediately after the release operation from the viewpoint of the user, but during this time, display control is performed for the main display panel 6M and the front display panel 6F as described later.

Immediately after the recording operation corresponding to the release operation, for example, a preview period is set to a certain time. The preview period is a period during which an image recorded by the previous recording operation is displayed on the main display panel 6M. That is, it is a period in which the user can confirm the captured still image immediately after.
In the case of a fixed time, for example, a period of about 2 seconds to several seconds is set as the preview period. During this period, the CPU 31 performs control to display the recorded still image data on the main display panel 6M and the front display panel 6F.
Note that, as an internal process of the imaging apparatus 1, the process of the recording period and the process of the preview period may overlap in time. For example, it takes time for the recording process and the preview process is started before the recording is completed. In such a case, the transition between the recording period and the preview period is not completely performed internally, but the display operation may be considered to transition from the recording period to the preview period.

When a predetermined time as the preview period elapses, the CPU 31 returns the operation state to the monitoring state and performs operation control as the monitoring period.
That is, the monitoring period, the recording period, and the preview period transition, and a series of operations as still image capturing is performed.
Although the imaging apparatus 1 can also capture moving images, in the case of moving images, the recording period continues from the start to the end of the moving image capturing. There is no preview period. Later, moving image recording will also be mentioned.

When the user performs an operation for instructing the reproduction operation, the state shifts to the reproduction operation state (reproduction period).
During the reproduction period, an operation for reproducing an image recorded on the recording medium 90 or the flash ROM 33 by imaging or the like is performed.
The CPU 31 reads out an image recorded in the recording medium 90 or the flash ROM 33 in accordance with a user operation, and instructs the display controller 7 to display a thumbnail image or one reproduction image on the main display panel 6M. I do. In some cases, a reproduced image is displayed on the front display panel 6F.

[3. Example of screen display on both display panels]

Examples of screen display performed on the main display panel 6M and the front display panel 6F in the imaging apparatus 1 of this example will be described with reference to FIGS.

FIG. 4A shows a state in which image display is performed on the main display panel 6M and display is turned off on the front display panel 6F.
The displayed images include a monitoring image (through image) in the monitoring period, a recorded image in the recording period (image recorded as a still image), a preview image in the preview period (an image recorded as a still image immediately before), and the like. . There may also be a reproduced image in the reproduction period.
The playback image is assumed to be a playback image of an image captured in the past that is recorded in the recording medium 90 or the flash ROM 33, but may be an image stored in the imaging device 1 in advance, for example. For example, image data to be displayed when a monitoring image is not displayed on the front display panel 6F is prepared, stored in advance in the flash ROM 33 or the like as a preset image, and the preset image data is read and displayed.
Furthermore, it is not limited to image data as a so-called captured image, and text data, animation data, computer graphic data, etc. may be recorded in the recording medium 90 or the flash ROM 33, and these may be reproduced and displayed. That is, the reproduced image includes any image that can be displayed.

FIG. 4B shows a state in which a monitoring image, a reproduced image, and the like are displayed on the main display panel 6M, and the same image is displayed on the front display panel 6F.
FIG. 4C shows a state in which different images are displayed on the main display panel 6M and the front display panel 6F.
FIG. 5A shows an example in which the display is turned off on the main display panel 6M and the monitoring image or the like is displayed on the front display panel 6F.
In FIG. 5B, as a display example of the playback period, a list display of thumbnail images of playback images is performed on the main display panel 6M. This shows a state where a reproduced image is displayed.
FIG. 5C also shows a state in which one playback image is displayed on the main display panel 6M, and one playback image is also displayed on the front display panel 6F as a display example of the playback period. Yes.

The above is an example of the display state. In this example, appropriate display control is performed on the main display panel 6M and the front display panel 6F for each operation period, thereby realizing various display states. .
The CPU 31 performs display control on the main display panel 6M and the front display panel 6F in accordance with the purpose of display in each operation period and the estimated situation. The state becomes various.
Hereinafter, various transitions of the operation period and examples of operation control in each period will be described.

[4. Display control example]
<4-1: Processing Example for Performing Operation Period Transition>

First, referring to FIG. 6, an example of the overall operation control of the CPU 31 with the transition of the operation period will be described. Here, an example (an example corresponding to FIG. 3) in which an operation as a monitoring period is first performed when the imaging apparatus 1 is powered on and activated.

When the imaging apparatus 1 is powered on, the CPU 31 performs a monitoring period start process in step F101 of FIG.
That is, the CPU 31 performs a required activation process and instructs the imaging system 2 and the camera DSP 4 to start an imaging operation. As a result, each frame data as a monitoring image obtained by the processing of the imaging system 2 and the camera DSP 4 is captured.
In step F102, the CPU 31 performs display control processing as a monitoring period. In the monitoring period, the CPU 31 basically performs control to display a monitoring image on the main display panel 6M. In some cases, the monitoring image display is executed on the front display panel 6F. A specific processing example of step F102 will be described with reference to FIG.

The monitoring period is a period in which the user determines the subject and composition or aims at the release timing while viewing the monitoring image. The user can also switch the operation state of the imaging apparatus 1 from the monitoring state to the reproduction operation.
Therefore, the CPU 31 monitors the user's reproduction instruction operation in step F103, and monitors the user's release operation in step F104.

When it is detected that the user has operated the release operation key 5a, the CPU 31 shifts to a recording period and performs necessary processing as step F105. That is, still image recording processing and display control are performed.
As a still image recording process, the CPU 31 performs a process of saving one frame of captured image data captured at the timing of the release operation as still image data. That is, the CPU 31 transfers the captured image data captured at this timing to the medium interface 10 and records it on the recording medium 90. Alternatively, it is recorded in the flash ROM 33.
Further, this recording period is a momentary period immediately after the release operation from the viewpoint of the user. However, in this recording period, the CPU 31 determines the monitoring period up to that time for the main display panel 6M and the front display panel 6F. Performs different display controls. Specific examples will be described later.

As described with reference to FIG. 3, immediately after the recording operation corresponding to the release operation, for example, a predetermined period is a preview period.
The CPU 31 performs a process of displaying the image recorded in the immediately previous recording operation as the process of the preview period in step F106. In this case as well, the main display panel 6M and the front panel are displayed as display controls different from the recording period and the monitoring period. Display control is performed on the display panel 6F.
After performing the preview process, the CPU 31 returns to step F101, performs the monitoring period start process again, and performs display operation control as the monitoring period in step F102.

When the user performs a reproduction instruction operation during the monitoring period, the CPU 31 proceeds to step F107 to perform reproduction display processing.
That is, the control of the image data reading process from the recording medium 90 by the medium interface 10 or the image data reading process from the flash ROM 33 is performed. As will be described later, during this playback period, the CPU 31 executes display control processing for the playback period described later, and performs display control for the main display panel 6M and the front display panel 6F.
When the reproduction operation is terminated by a user operation or the like, the CPU 31 returns from step F108 to F101, and again proceeds to the monitoring period process.

Although not shown in FIG. 6, the CPU 31 performs a power-off process when a predetermined time elapses in a user operation or no operation state.

<4-2: Example of monitoring period processing>

With the processing in FIG. 6, the imaging apparatus 1 performs a transition of a monitoring period, a recording period, a preview period, and a reproduction period as its operation state in accordance with a user operation or the like.
In this example, the CPU 31 switches the display state and display contents of the main display panel 6M and the front display panel 6F in accordance with the transition of these operation periods.
Hereinafter, a specific processing example for each operation period will be described.

First, an example of processing in the monitoring period will be described with reference to FIGS. That is, this is a processing example of the CPU 31 as step F102 in FIG.
In the example of FIG. 7A, first, in step F201, the CPU 31 performs control to execute monitoring image display on the main display panel 6M.
As a result, a monitoring image as a subject image (through image) obtained by the operation of the imaging system 2 and the camera DSP 4 is displayed on the main display panel 6M, and the user can select a subject and a composition by looking at the monitoring image. Can do.

At this time, the CPU 31 performs steps F202 to F205 as display control of the front display panel 6F.
First, in step F202, a condition determination regarding display on the front display panel 6F is performed. This is a process for determining the visibility condition for the front display panel 6F. The visual recognition possibility means the possibility that the display on the front display panel 6F is effectively performed.
For example, there is a person who looks at the front display panel 6F, a situation in which the person is normally visible when trying to view the front display panel 6F, or the person is willing to look at the front display panel 6F. It is estimated that there is a visual recognition possibility.
The determination of the visibility is performed as, for example, a determination process for the presence of a person in the subject direction, a determination process for an imaging mode, a determination process for internal detection information, or a determination process for an image analysis process result of a captured image signal. it can.

If it is determined that there is a possibility of visual recognition, the CPU 31 advances the process from step F203 to F204, and performs display control of the monitoring image on the front display panel 6F. In this case, as shown in FIG. 4B, the monitoring image is displayed on the front display panel 6F in the same manner as the main display panel 6M.
On the other hand, if it is determined that there is no possibility of visual recognition, the CPU 31 advances the process from step F203 to F205 and performs control to turn off the display on the front display panel 6F. For example, the front display panel 6F is set to a non-display state, or power off control is performed for the front display panel 6F.
In this case, as shown in FIG. 4A, the monitoring image is displayed only on the main display panel 6M.

In step F102 of FIG. 6, if the CPU 31 performs the process of FIG. 7A and the condition estimated to be visible is satisfied, the monitoring image display is performed on the front display panel 6F in the process of step F204. Will be done.
During the monitoring period, it is preferable to display the monitoring image on the front display panel 6F. For example, when the subject is a person, the person can see his / her facial expression or pose he / she is about to take by looking at the display on the front display panel 6F.

However, this is useful only when there is a person on the subject side. For example, when the photographer is trying to capture a scene where no person is present, there are many cases where no person sees the display on the front display panel 6F.
Even if there is a person as a subject, there are cases where the display cannot actually be seen due to ambient brightness conditions.
Furthermore, even if there is a person as a subject, there may be a situation where the person does not see or cannot see the display on the front display panel 6F.
In these cases, it is meaningless to display the monitoring image on the front display panel 6F. Therefore, it is appropriate to save power by turning off the front display panel 6F. In step F205, the front display panel 6F is turned off.

  That is, when the display on the front display panel 6F is valid by the condition determination, the monitoring image is displayed on the front display panel 6F so that the subject person or the like can confirm the subject (for example, his / her facial expression or appearance). To do. On the other hand, when it is determined that the display on the front display panel 6F is not valid, the display on the front display panel 6F is turned off. That is, power consumption is reduced by not performing useless display that no one has seen or useless display with poor visibility.

Hereinafter, examples of condition determination for visual recognition possibility will be given.
One of the condition determination methods is determination by an imaging mode.
Imaging mode is appropriate for various situations such as night view mode, night view & portrait mode, portrait mode, landscape mode, soft snap mode, snow mode, beach mode, high-speed shutter mode, high sensitivity mode, smile shutter mode, etc. This mode is selected by the user so that an image can be taken.
As these imaging modes, appropriate shutter speeds, exposure settings, signal gain settings for captured image signals, signal processing settings such as edge enhancement and color processing, etc. are determined in advance, for example, the dial operation shown in FIG. The user can select it by operating the unit 5b.

The night scene mode is an imaging mode in which imaging is performed with settings suitable for night scene imaging.
The night view & portrait mode is an image capture mode in which image capture is performed with settings so that the night view of the back and the facial expression of the person can be captured clearly.
The portrait mode is an imaging mode in which imaging is performed with settings suitable for human imaging.
The landscape mode is an imaging mode in which imaging is performed with settings suitable for landscape imaging.
The soft snap mode is an imaging mode in which imaging is performed with a setting that makes the texture of a person's skin bright and soft.
The high-speed shutter mode is an imaging mode in which imaging is performed with settings suitable for a moving subject.
The high sensitivity mode is an imaging mode in which a dark scene is imaged in a natural atmosphere without using a flash.
The smile shutter mode is an imaging mode in which shutter processing (release) is automatically performed when a subject person smiles.

  An imaging mode for performing an imaging process suitable for these imaging situations is selected by the user, but the CPU 31 controls the imaging process in accordance with the imaging mode setting during the still image imaging process from the monitoring period to the recording period. I do. That is, various parameter instructions are given to the imaging system 2 and the camera DSP 4 in accordance with the imaging mode selected by operating the dial operation unit 5b. For example, instructions such as the shutter speed, exposure setting, and signal processing setting described above.

For example, when these imaging modes are used for condition determination in step F202 in FIG. 7, it is determined whether or not the current imaging mode is a predetermined imaging mode determined in advance.
That is, the current surrounding situation and the target subject are estimated by the imaging mode.

For example, among the above-described imaging modes, the predetermined imaging mode capable of estimating a situation suitable for display on the front display panel 6F is a night view & portrait mode, a portrait mode, a soft snap mode, a smile shutter mode, or the like. . That is, the CPU 31 predetermines these imaging modes as corresponding to a predetermined imaging mode when the condition is determined.
These imaging modes are selected for the purpose of imaging a person, and therefore there is a high possibility that a person is included as a subject. That is, there is a high possibility that a person who can see the display on the front display panel 6F exists as a subject.
Therefore, the CPU 31 assumes that the display condition of the front display panel 6F is satisfied when the imaging mode is any of the night view & portrait mode, portrait mode, soft snap mode, and smile shutter mode.

In other imaging modes, that is, night view mode, landscape mode, high-speed shutter mode, and high-sensitivity mode, the mode is selected when imaging of a person is not intended, or the front display panel 6F has poor visibility. Presumed.
For example, the night view mode and the landscape mode are intended for landscape imaging, and it can be estimated that there is no person in the subject, or even if there is a person, it is not a central presence in the image. In the night view mode or the high sensitivity mode, even if there is a person in the front, the monitoring image when capturing a dark landscape is displayed from the person in front even if it is displayed on the front display panel 6F. Has poor visibility.
The subject in the high-speed shutter mode is a moving subject. For example, even if a person is a subject, the person is in a situation such as a sporting competition or a dance, and is not in a situation of calmly looking at the front display panel 6F.
That is, in these imaging modes, it is presumed that there is no person in front, or that the front display panel 6F is not displayed with good visibility because there is a person, or that the front display panel 6F is not viewed. .
Therefore, when the imaging mode is any one of the night view mode, landscape mode, high-speed shutter mode, and high-sensitivity mode, it is assumed that the display condition of the front display panel 6F is not satisfied in the condition determination.

Note that the above is an example, and besides these, an evening scene mode in which imaging is performed with settings suitable for evening scene imaging, a macro mode suitable for close-up photography of plants and insects, a fireworks mode suitable for fireworks imaging, and underwater In some cases, an underwater mode suitable for imaging is prepared. Also available are a snow mode in which shooting is performed with settings that can represent the slope and the white silver of the snow scene as it is, and a beach mode in which shooting is performed with settings that make the sea and sky blue stand out. There is also.
Also in these cases, how to determine the condition according to the presence of the person, the visibility of the display content of the front display panel 6F, and the situation of the person on the subject side (display on the front display panel 6F) Whether or not it is included in a predetermined imaging mode to be performed) may be set in advance.

Further, as one of the condition determination methods, determination by user settings other than the above-described imaging mode can be given. The user setting here refers to a setting state according to a user operation other than the imaging mode setting such as a flash emission setting and a zoom position operation.
As the condition determination, it is determined whether or not the user setting state other than the current imaging mode is a setting state suitable for display on the front display panel 6F.

The flash emission setting among the user settings is considered as follows. The flash emission setting is a setting for the user to select whether to perform flash emission (flash: on) or not (flash: off), or to perform flash on / off by automatic control (flash: auto). .
In this case, when the user sets the flash to on, the surroundings are usually dark.
In a dark situation, the monitoring image during the monitoring period is also in a low luminance state, and it is considered that the visibility of the display on the front display panel 6F is not good.
Therefore, when the flash emission setting is “flash: on”, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied.

Among the user settings, the zoom position operation setting is considered as follows. The zoom position operation setting is, for example, a setting of a zoom position when the user performs a zoom operation by operating the wide / teleoperation key 5c in FIG.
For example, even if a person is a subject, if the zoom position is on the tele side (telephoto) more than a predetermined value, it can be estimated that the subject person is located far away from the imaging device 1. Naturally, if the person is too far away, the person cannot properly see the display on the front display panel 6F.
Therefore, the CPU 31 determines that the condition for the visibility of the front display panel 6F is not satisfied when the zoom position by the user's operation is a telephoto position that is greater than or equal to a predetermined value.

  In the above, the flash emission setting and the zoom position operation have been described as the user settings. However, in addition to the user settings described above, sensitivity settings, exposure settings, camera shake correction on / off settings, special imaging settings, and the like are assumed. The Each of these can also be reflected in the condition determination as to whether or not an appropriate situation (visibility) is estimated for the act of the subject person appropriately viewing the display on the front display panel 6F.

Further, as one of condition determination methods, determination using internal detection information can be given.
The internal detection information is various kinds of camera detection information detected internally by the imaging device 1. The camera detection information here is information detected by an internal sensor of the imaging apparatus 1, information that can be recognized by the CPU 31 along with operation control of the imaging apparatus 1, and the like. For example, external light amount detection information, zoom position information, focus information, camera shake detection information, subject distance information, and the like used for flash control and exposure control.
As the condition determination, the CPU 31 determines whether or not the situation estimated from the currently obtained camera detection information is a setting state suitable for display on the front display panel 6F.

The amount of external light can be detected from the average brightness value of captured image data or the weighted average brightness value obtained by weighting a part of the screen. This is used for flash light emission control. For example, since the luminance value is calculated by the image signal processing unit 41 of the camera DSP 4, the CPU 31 can obtain the information.
Although not shown in FIG. 2, an external light quantity sensor or the like may be provided to directly detect the external light quantity.
When the amount of external light detected by these methods is low, it is estimated that even if a monitoring image or the like is displayed on the front display panel 6F, the brightness of the image itself is low and good visibility cannot be obtained. it can. In addition, it can be estimated that the display on the front display panel 6F cannot be viewed well even when the external light amount level is too high, such as a so-called backlight state.
Therefore, when the amount of external light is lower than a predetermined level or when it is determined that the backlight is in the backlit state, the CPU 31 is not in an appropriate situation for image display on the front display panel 6F, that is, as the visibility of the front display panel 6F. It is determined that the condition is not satisfied.

As for the zoom position information, the CPU 31 can detect the zoom position by driving and controlling the zoom lens according to a user operation or the like. Even if a person is a subject, when the zoom position is on the tele side (telephoto) more than a predetermined value, it can be estimated that the subject person is located far away from the imaging device 1. That is, it can be estimated that the subject person cannot properly see the display on the front display panel 6F.
Therefore, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied when the zoom position is a telephoto position that is greater than or equal to a predetermined value.

The subject distance information is information on the distance from the imaging device 1 to the subject. For example, the CPU 31 can obtain the subject distance information using the information from the lens position detection unit 27 as described above.
For example, even if a person is a subject, if it can be determined from the subject distance information that the subject person is at a position far away from the imaging device 1, the subject person can appropriately see the display on the front display panel 6F. It can be estimated that this is not possible.
Therefore, when it is detected from the subject distance information that the subject is at a position farther than a predetermined distance, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied.

The focus information is information for determining an in-focus state used for autofocus processing in the image signal processing unit 41.
If the captured image signal is not an in-focus state, the CPU 31 cannot execute appropriate monitoring image display. That is, a blurred monitoring image is displayed.
Therefore, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied when it is not in the focused state. This is an effective condition determination in the case of monitoring image display.

The shake detection information is detection information on camera shake and movement of the imaging apparatus 1. For example, the CPU 31 can obtain blur detection information as information from the shake detection unit 13.
When the camera shake is large or when the user moves the imaging apparatus 1 by following a moving subject, a person in the vicinity cannot visually recognize the image on the front display panel 6F. Therefore, when it is determined from the shake detection information that the shake or the movement of the imaging device 1 is large, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied.

Further, as one of condition determination methods, determination using image analysis information can be given.
The image analysis information is information obtained by image analysis processing executed by the image analysis unit 44.
The image analysis unit 44 performs image analysis processing on captured image data captured by the imaging system 2 and captured by the camera DSP 4 during a monitoring period or the like. For example, image analysis processing is performed on the image data of each frame processed by the image signal processing unit 41 or intermittently extracting frames.

As the image analysis information, information on whether or not a person is included in the subject can be used for condition determination.
In this case, the image analysis unit 44 determines whether or not the captured image data to be analyzed includes an image that can be recognized as a person. That is, it is determined whether or not a contour portion that can be recognized as a person is included in the image. Then, the image analysis result is supplied to the CPU 31.
For this reason, the CPU 31 can confirm whether or not the presence of a person has been recognized as the image analysis result.
If the presence of the person can be recognized, the CPU 31 determines that the condition as the visibility of the front display panel 6F is satisfied. If the presence of a person cannot be recognized, it is determined that the condition as the visibility of the front display panel 6F is not satisfied.

  If such a condition determination is performed, for example, during the monitoring period, when the user points the imaging device 1 so that a person becomes a subject, a monitoring image is displayed on the front display panel 6F. Further, when aiming at a subject scene that does not include a person such as a landscape, the front display panel 6F is turned off.

Note that the presence of a person who can see the display on the front display panel 6F is confirmed by image analysis, but the condition determination is not performed by image analysis, but by confirming the detection result of the proximity sensor 50 shown in FIG. It is good also as performing.
Alternatively, both the image analysis result and the detection result of the proximity sensor 50 may be confirmed.

By the way, as a person detection by image analysis, “face” may be detected.
For example, the image analysis unit 44 determines the presence of a contour that can be recognized as a face and facial elements such as eyes, nose, and mouth in the captured image data, and the captured image data includes a “face” of a person as a subject. It is determined whether or not.
If the presence of a person's face can be recognized as an image analysis result, the CPU 31 determines that the condition as the visibility of the front display panel 6F is satisfied. If the presence of the person's face cannot be recognized, it is determined that the condition as the visibility of the front display panel 6F is not satisfied.
In this way, the presence of a person in front may be confirmed not by determining the whole person's body but by determining the face.

Depending on the image analysis processing in the image analysis unit 44, various image recognition results can be obtained in addition to person recognition and face recognition. For example, determination information on the amount of external light can be obtained. In addition, the amount of relative motion between the imaging apparatus 1 and the subject can be determined by motion detection in frame comparison, analysis of blur amount for each pixel, or the like.
Furthermore, as an image recognition process when a face image is detected, an analysis result such as the size of the face on the screen (the ratio of the face portion in one frame image), the orientation of the face, the direction of the line of sight, etc. is obtained. You can also.
These various image analysis results can also be used for condition determination.

In the case of determining the amount of external light as image analysis, the above-described camera detection information has also been described. It can be estimated that this is not possible.
Therefore, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied when the amount of external light is lower than a predetermined level or when it is determined that the backlight is in the backlight state.

Further, as an image analysis result, the relative movement amount between the imaging device 1 and the subject can be determined. That is, it can be determined whether the imaging device 1 itself is moving or moving (the user is moving the imaging device 1), the subject is moving, or both are moving.
In these cases, when the amount of movement is large, it is considered that the front display panel 6F cannot be properly visually recognized even if there is a person who is the subject.
Therefore, when it is determined that the relative movement between the imaging device 1 and the subject is large, the CPU 31 determines that the condition as the visibility of the front display panel 6F is not satisfied.

As image analysis, not only face detection but also face size (ratio of face part in the screen) can be determined.
Although depending on the zoom position state, considering a certain zoom state, the size of the face is one of the indices for determining the distance from the imaging device 1 to the person who is the subject.
For example, if the face is photographed small even when the zoom state is the wide state, it can be estimated that the person is far away.
Therefore, the CPU 31 determines the perspective of the subject person based on the size of the face in consideration of the zoom position. When it is determined that the person is far away and the display content of the front display panel 6F cannot be viewed, it is determined that the condition as the visibility of the front display panel 6F is not satisfied.

Further, as the image analysis, it is possible to recognize the orientation of the face and the orientation of the line of sight.
When the face is not in the front direction on the captured image, or when the line of sight is not in the front direction, the subject person does not look at the imaging device 1. That is, it can be determined that the front display panel 6F is not viewed.
Therefore, the CPU 31 confirms the face direction or the line-of-sight direction. And when it determines with the person not seeing the display content of the front display panel 6F, it determines with the conditions as the visual recognition possibility of the front display panel 6F not being satisfy | filled.

As described above, examples of condition determination have been listed. However, in actual condition determination processing for visibility, at least one of these may be used, or two or more may be used in combination.
Of course, other than the above, examples of the condition determination process are conceivable. As the condition determination, any condition can be used as long as it can estimate the visibility of the display on the front display panel 6F.
In the process of FIG. 7A, display on the front display panel 6F is appropriately performed according to such a condition determination.

Next, FIG. 7B shows another example as the process of step F102 of FIG.
In this case, the CPU 31 causes the main display panel 6M to display a monitoring image in step F201 during the monitoring period. In step F206, the display on the front display panel 6F is turned off.
That is, in this example, display on the front display panel 6F is not performed during the monitoring period.

<4-3: Recording period processing example>

Next, processing examples in the recording period will be described with reference to FIGS. That is, this is a processing example of the CPU 31 as step F105 in FIG.

The example of FIG. 8A is an example in which no image to be recorded is displayed during the recording period.
That is, the CPU 31 transfers the captured image data captured and taken at the release timing to the medium interface 10 and recorded on the recording medium 90 as processing based on the user's release operation or the like. Alternatively, it is recorded in the flash ROM 33.
In this recording period, the CPU 31 performs control to turn off the display on the main display panel 6M and the front display panel 6F.

The example of FIG. 8B is an example in which an image to be recorded is displayed only on the main display panel 6M during the recording period.
That is, as a process based on a user's release operation or the like, the CPU 31 causes the recording medium 90 or the flash ROM 33 to record captured image data captured at the release timing. In this recording period, the CPU 31 causes the main display panel 6M to display image data related to the recording process. The front display panel 6F is controlled to turn off the display.
Thereby, the user of the imaging device 1 can view the captured image at the shutter timing.

The example of FIG. 8C is an example in which the image to be recorded is displayed only on the front display panel 6F during the recording period.
That is, as a process based on a user's release operation or the like, the CPU 31 causes the recording medium 90 or the flash ROM 33 to record captured image data captured at the release timing. In this recording period, the CPU 31 causes the front display panel 6F to display image data related to the recording process. The main display panel 6M is controlled to turn off the display.
Thereby, the person who is the subject can see the captured image at the shutter timing.

The example of FIG. 8D is an example in which an image to be recorded is displayed on both the main display panel 6M and the front display panel 6F during the recording period.
That is, as a process based on a user's release operation or the like, the CPU 31 causes the recording medium 90 or the flash ROM 33 to record captured image data captured at the release timing. In this recording period, the CPU 31 causes the main display panel 6M and the front display panel 6F to display image data related to the recording process.
Thereby, the user of the imaging device 1 and the person who is the subject can see the captured image at the shutter timing.

FIG. 9 is a processing example in consideration of a so-called “half-press” case as a user operation related to the release operation key 5a.
In general, an imaging apparatus such as a digital still camera is known that performs focus control to focus on a subject in a half-pressed state. FIG. 9 shows an example in which the half-pressed period is included in the recording period when the imaging apparatus 1 of this example also has such a function.
For example, FIG. 9 shows the processing in the case of the processing in FIG. 6 described above in the case where step F104 is half-press detection.
When the CPU 31 detects that the user half-presses the release operation key 5a during the monitoring period of FIG. 6, the process proceeds from step F104 to step F501 of FIG.
Then, the CPU 31 performs focus control on the subject image at that time.

In step F502, the CPU 31 monitors the depression of the release operation key 5a. That is, when the user presses the release operation key 5a from the half-pressed state, it is recognized that the release operation has been performed. Although not shown in FIG. 9, when the user stops half-pressing without pressing the release operation key 5a, the process may return to the monitoring period process of FIG.
During the period in which the half-pressing is continued, the CPU 31 repeats the processes of steps F503 to F507 and step F501.

First, in step F503, the CPU 31 performs control to execute monitoring image display on the main display panel 6M. This is because the user is aiming for a photo opportunity in the half-pressed state, and therefore it is necessary to display a monitoring image on the main display panel 6M.
On the other hand, with regard to the front display panel 6F, first, in step F504, a condition determination is made regarding the visibility of the display on the front display panel 6F. Examples of the condition determination are the same as those described above. For example, the determination process of the presence of a person in the subject direction, the determination process of the imaging mode, the determination process for the internal detection information, or the image analysis process result of the captured image signal A part or all of the discrimination processing and the like is performed. As a result, there is a person who views the front display panel 6F, a situation where the person is normally visible when trying to view the front display panel 6F, or the person's intention to view the front display panel 6F. Judge that there is.

If it is determined that there is a possibility of visual recognition, the CPU 31 advances the process from step F505 to F506, and performs display control of the monitoring image on the front display panel 6F.
On the other hand, if it is determined that there is no possibility of visual recognition, the CPU 31 advances the process from step F505 to F507 and performs control to turn off the display on the front display panel 6F. For example, the front display panel 6F is set to a non-display state, or power off control is performed for the front display panel 6F.
That is, the monitoring image is displayed on the front display panel 6F only when there is a possibility that the subject person sees the front display panel 6F.

If it is detected that the user has pressed the release operation key 5a, the CPU 31 proceeds to step F508 to perform a release process.
That is, as a process based on the user's release operation, the CPU 31 transfers the captured image data captured and taken at the release timing to the medium interface 10 and recorded on the recording medium 90. Alternatively, it is recorded in the flash ROM 33.
Further, the CPU 31 performs control to turn off the display on the main display panel 6M and the front display panel 6F.

The step F508 is the same as that shown in FIG. 8A, but the process shown in FIG. 8B, FIG. 8C, or FIG. 8D may be performed.
As the recording period control process, the examples shown in FIGS. 8 and 9 can be considered.

<4-4: Preview Period Processing Example>

Next, an example of processing in the preview period will be described with reference to FIGS. That is, this is a processing example of the CPU 31 as step F106 in FIG.
FIG. 10 shows an example in which preview display is performed on the main display panel 6M for a fixed time in the preview period, and preview display is performed on the front display panel 6F according to conditions.

When the processing for the recording period is completed, the CPU 31 subsequently performs the processing in FIG. 10 as Step F106 in FIG. First, in step F601, the CPU 31 determines a condition regarding the visibility of the display on the front display panel 6F. As described above, for example, part or all of the determination processing for the presence of a person in the subject direction, the determination processing for the imaging mode, the determination processing for the internal detection information, or the determination processing for the image analysis processing result of the captured image signal I do.
As a result, there is a person who views the front display panel 6F, a situation where the person is normally visible when trying to view the front display panel 6F, or the person's intention to view the front display panel 6F. Judgment of the possibility of visual recognition such as the presence of

If it is determined that the front display panel 6F is visually recognizable, the CPU 31 advances the process from step F602 to F604, and performs preview display control on both the main display panel 6M and the front display panel 6F. That is, the image data recorded in the process of the immediately preceding recording period is displayed on both display panels 6M and 6F.
On the other hand, if it is determined that there is no possibility of visual recognition of the front display panel 6F, the CPU 31 advances the process from step F602 to F603, and performs preview display control on the main display panel 6M. The front display panel 6F is turned off. Thereby, the image data recorded in the process of the immediately preceding recording period is displayed only on the main display panel 6M.

The preview display started in step F604 or F603 is continued until a certain display time elapses in step F605. For example, it is about several seconds. The CPU 31 performs time counting from the time when preview display is started in step F604 or F603, and monitors the passage of a fixed time in step F605.
When a predetermined time has elapsed, the preview display is terminated in step F606.
Thus, the process of step F106 in FIG. 6 is completed, and the CPU 31 returns to step F101 in FIG. 6 to resume the monitoring period process.

  According to the processing of FIG. 10, the preview display is always performed for a certain time on the main display panel 6M, and is performed for a certain time on the front display panel 6F in a situation where it is estimated that there is a viewer. .

Next, the processing example of FIG. 11 will be described. FIG. 11 shows a processing example in which preview display is performed for a predetermined time only by the front display panel 6F.
In FIG. 11, only the step F610 corresponds to the preview process in step F106 in FIG. 6, step F101 is the process in step F101 in FIG. 6, and steps F201, F210, and F211 are the processes in step F102 in FIG. It is described.

  When the processing of the recording period described above is completed, the CPU 31 performs the processing of step F610 in FIG. 11 as step F106 in FIG. That is, the CPU 31 performs control to display a preview on the front display panel 6F for the image data recorded in the process of the immediately preceding recording period.

Then, the CPU 31 proceeds to step F101 and restarts the monitoring period. In step F201, monitoring image display is executed on the main display panel 6M.
Therefore, the monitoring image display is performed on the main display panel 6M, and the preview display is performed on the front display panel 6F.
Further, the CPU 31 performs time counting from the time when the preview display is started in step F610, and monitors the elapse of a fixed time in step F210.
When a certain time has elapsed, the preview display on the front display panel 6F is terminated in step F211.

  As described in FIG. 6, the CPU 31 repeats the process of step F102 while performing the monitoring processes of steps F103 and F104. Accordingly, also in this case of FIG. 11, if the reproduction instruction (F103) or the release operation (F104) is not detected, the CPU 31 repeats the processes of steps F201, F210, and F211 while returning from step F104 to F201.

Eventually, according to the process of FIG. 11, after the preview display is started on the front display panel 6F in the preview period, the process of the monitoring period is performed immediately, and the monitoring image display is started on the main display panel 6M. When the preview display on the front display panel 6F is performed for a predetermined time, the preview display on the front display panel 6F is terminated, and the front display panel 6F is turned off.
Therefore, the user of the imaging apparatus 1 can immediately view the monitoring image without looking at the preview display, can move to preparation for the next still image recording, and the subject person has been photographed for a certain period of time. A still image can be confirmed.

  As a modification of this process, after the preview display is finished on the front display panel 6F, the processes of steps F202 to F205 in FIG. 7 are performed to display the monitoring image on the front display panel 6F according to the conditions. Anyway.

Next, the processing example of FIG. 12 will be described. FIG. 12 shows an example in which preview display is performed on both display panels 6M and 6F, but preview display on the front display panel 6F is performed for a long time.
In FIG. 12, steps F620 and F621 correspond to the preview processing in step F106 in FIG. 6, step F101 is processing in step F101 in FIG. 6, and steps F201 to F205 and F220 are processing in step F102 in FIG. It is described as.

  When the processing of the recording period described above is completed, the CPU 31 performs the processing of step F620 in FIG. 12 as step F106 in FIG. That is, the CPU 31 performs control to display the preview on both the main display panel 6M and the front display panel 6F for the image data recorded in the process of the immediately preceding recording period.

The CPU 31 performs time counting from the time when preview display is started in step F620. In step F621, the passage of a fixed time is monitored. However, in this case, the elapse of the predetermined time T1 as a preview display on the main display panel 6M is monitored.
Until the predetermined time T1 elapses, the preview display is continued on both display panels 6M and 6F as a preview period.
When the predetermined time T1 has elapsed, the CPU 31 proceeds from step F621 to F101 and restarts the monitoring period. The time count continues as it is.
In step F201, the CPU 31 displays a monitoring image on the main display panel 6M.
Accordingly, the main display panel 6M is switched from the preview display to the monitoring image display, while the front display panel 6F is in a state where the preview display is continued.

After shifting to the monitoring period, the CPU 31 monitors the lapse of a fixed time in step F220 with respect to the time count from the time when the preview display in step F620 is started. In this case, the elapse of a predetermined time T2 (T1 <T2) as a preview display on the front display panel 6F is monitored.
As described in FIG. 6, the CPU 31 repeats the process of step F102 while performing the monitoring processes of steps F103 and F104. Accordingly, also in the case of FIG. 12, if the reproduction instruction (F103) or the release operation (F104) is not detected, the CPU 31 returns from step F104 to F201 and repeats steps F220 and F202 to F205.
Therefore, even if the monitoring period is entered, the preview display is continued on the front display panel 6F until it is determined in step F220 that the predetermined time T2 has elapsed.
Thereafter, after the predetermined time T2 has elapsed, the CPU 31 performs the processes of steps F202 to F205 in FIG. 12 as the process of step F102.

That is, in step F202, the CPU 31 performs a condition determination on the visibility of the display on the front display panel 6F. For example, part or all of the determination processing of the presence of a person in the subject direction, the determination processing of the imaging mode, the determination processing of the internal detection information, or the determination processing of the image analysis processing result of the captured image signal is performed.
If it is determined that the front display panel 6F is visually recognizable, the CPU 31 advances the process from step F203 to F204 and performs monitoring image display control on the front display panel 6F.
On the other hand, if it is determined that the front display panel 6F is not visually recognizable, the CPU 31 advances the process from step F203 to F205 and turns off the front display panel 6F.

After all, according to the processing of FIG. 12, preview display is performed on both display panels 6M and 6F as the preview period.
Then, the preview display on the main display panel 6M is ended first, the process proceeds to the monitoring period, and the main display panel 6M is switched to the monitoring image display.
On the front display panel 6F, the preview display is continued until a certain time T2 elapses even after the monitoring period. Then, after the preview display is ended, the monitoring image display on the front display panel 6F is performed or the display is turned off according to the visual recognition possibility.
Therefore, the user of the imaging apparatus 1 can check the preview display for a short time and immediately see the monitoring image, and can move to preparation for the next still image recording. The subject person can check the still image taken for a relatively long time.

  As a modification of this process, after the preview display is ended on the front display panel 6F, the front display panel 6F may be forcibly turned off during the monitoring period.

Next, the processing example of FIG. 13 will be described. In FIG. 13, the preview display is performed on both display panels 6M and 6F, but the preview period is terminated by the user's operation, and the preview display on the front display panel 6F is performed for a longer time. This is an example.
In FIG. 13, steps F630 and F631 correspond to the preview process in step F106 in FIG. 6, step F101 is the process in step F101 in FIG. 6, and steps F201 to F205 and F220 are the processes in step F102 in FIG. It is described as.

  When the processing of the recording period described above is completed, the CPU 31 performs the processing of step F630 in FIG. 13 as step F106 in FIG. That is, the CPU 31 performs control to display the preview on both the main display panel 6M and the front display panel 6F for the image data recorded in the process of the immediately preceding recording period.

In step F631, the CPU 31 monitors whether or not an instruction to end preview display has been performed as a user operation.
Until the preview display end operation is performed, the preview display is continued on both display panels 6M and 6F as the preview period.
When detecting the end operation of the preview display, the CPU 31 proceeds from step F631 to F101 and restarts the monitoring period. In step F201, the CPU 31 displays a monitoring image on the main display panel 6M.
Accordingly, the main display panel 6M is switched from the preview display to the monitoring image display, while the front display panel 6F is in a state where the preview display is continued.

After shifting to the monitoring period, the CPU 31 monitors the lapse of a fixed time in step F220 with respect to the time count from the time when the preview display in step F630 is started. Alternatively, the time count may be started when the monitoring period is started.
As described in FIG. 6, the CPU 31 repeats the process of step F102 while performing the monitoring processes of steps F103 and F104. Therefore, also in this case of FIG. 13, if the reproduction instruction (F103) or the release operation (F104) is not detected, the CPU 31 returns from step F104 to F201 and repeats steps F220 and F202 to F205.
Therefore, even if the monitoring period is entered, the preview display is continued on the front display panel 6F until it is determined in step F220 that a predetermined time has elapsed.
Thereafter, after a predetermined time has elapsed, the CPU 31 performs the processes of steps F202 to F205 in FIG. 13 as the process of step F102.

That is, in step F202, the CPU 31 performs a condition determination on the visibility of the display on the front display panel 6F. For example, part or all of the determination processing of the presence of a person in the subject direction, the determination processing of the imaging mode, the determination processing of the internal detection information, or the determination processing of the image analysis processing result of the captured image signal is performed.
If it is determined that the front display panel 6F is visually recognizable, the CPU 31 advances the process from step F203 to F204 and performs monitoring image display control on the front display panel 6F.
On the other hand, if it is determined that the front display panel 6F is not visually recognizable, the CPU 31 advances the process from step F203 to F205 and turns off the front display panel 6F.

Eventually, according to the processing of FIG. 13, the preview display is performed on both display panels 6M and 6F as the preview period until the user finishes the preview display.
When the user completes the preview display operation, the preview display on the main display panel 6M is ended, the process proceeds to the monitoring period, and the main display panel 6M is switched to the monitoring image display.
On the front display panel 6F, the preview display is continued until a certain time elapses even when the monitoring period is reached. Then, after the preview display is ended, the monitoring image display on the front display panel 6F is performed or the display is turned off according to the visual recognition possibility.
Therefore, the user of the imaging apparatus 1 can confirm the preview display for an arbitrary time. Then, by terminating the preview display at his / her will, the monitoring image can be viewed from that point, and preparation for the next still image recording can be made. The subject person can confirm a still image taken by him / her for a certain period of time even after the transition to the monitoring period.

As a modification of this process, after the preview display is ended on the front display panel 6F, the front display panel 6F may be forcibly turned off during the monitoring period.
In addition, since the user may not perform the preview display end operation indefinitely, there may be a processing example in which the operation automatically shifts to the monitoring period if the operation is not detected in step F631 for a long time. .

<4-5: Reproduction period processing example>

Next, an example of processing in the reproduction period will be described with reference to FIGS. That is, this is a processing example of the CPU 31 as step F107 in FIG.

FIG. 14A shows an example in which reproduction display is performed only on the main display panel 6M during the reproduction period.
When the CPU 31 proceeds to step F107 in FIG. 6, the CPU 31 performs control to turn off the front display panel 6F in step F701 in FIG.
In step F702, data read control from the recording medium 90 or the flash ROM 33 is performed in accordance with a user operation, and the read image data is reproduced and displayed on the main display panel 6M.
That is, in the reproduction display, the front display panel 6F is not used.

FIG. 14B shows an example in which playback display is also performed on the front display panel 6F in some cases.
When the CPU 31 proceeds to step F107 in FIG. 6, the CPU 31 performs a condition determination on the visibility of the display on the front display panel 6F in step F710 in FIG. For example, part or all of the determination processing of the presence of a person in the subject direction, the determination processing of the imaging mode, the determination processing of the internal detection information, or the determination processing of the image analysis processing result of the captured image signal is performed.

If it is determined that the front display panel 6F is visually recognizable, the CPU 31 advances the process from step F711 to F713, and performs data read control from the recording medium 90 or the flash ROM 33 in accordance with a user operation. Then, control is performed to execute reproduction display on both the main display panel 6M and the front display panel 6F.
On the other hand, if it is determined that the front display panel 6F is not visually recognizable, the CPU 31 advances the process from step F711 to F712, and performs data read control from the recording medium 90 or the flash ROM 33 in accordance with the user operation. The main display panel 6M is then controlled to execute playback display. The front display panel 6F is turned off. As a result, the reproduced image is displayed only on the main display panel 6M.

  As described above, when it is estimated that the display on the front display panel 6F is effective, the reproduction image display is also performed on the front display panel 6F. As a result, the person on the front side can also enjoy the reproduced image.

The process of FIG. 15 is an example in which a playback image is displayed on both display panels 6M and 6F and the display is different between the main display panel 6M and the front display panel 6F during the playback period.
When the CPU 31 proceeds to step F107 in FIG. 6, the CPU 31 performs reproduction display control on the main display panel 6M in step F720 in FIG. That is, the CPU 31 performs data read control from the recording medium 90 or the flash ROM 33 in accordance with a user operation, and reproduces and displays the read image data on the main display panel 6M.
For the front display panel 6F, the process branches depending on the reproduction display state on the main display panel 6M.

As a reproduction image display on the main display panel 6M, a display mode is switched according to a user operation. For example, there may be a case where images are switched one by one in accordance with a user operation, or a list display as thumbnail images is performed.
In step F721, the process branches depending on whether or not a thumbnail list of reproduced images is currently displayed on the main display panel 6M or one image is being displayed.

If one reproduced image is currently displayed on the main display panel 6M, the CPU 31 advances the process to step F722, and the display controller 7 displays the same reproduced image data on the front display panel 6F. To instruct. In this case, the display states of the main display panel 6M and the front display panel 6F are as shown in FIG.
On the other hand, if thumbnail list display is currently being executed on the main display panel 6M, the CPU 31 advances the process to step F723. In this case, the display controller 7 is instructed to display the reproduced image data selected by the cursor K on the thumbnail list display on the front display panel 6F. In this case, the display states of the main display panel 6M and the front display panel 6F are as shown in FIG.
The

By performing such processing, when there is a person on the front side, the playback image can be simultaneously viewed on the front display panel 6F side. Therefore, the user of the imaging device 1 and the person on the front side can enjoy the reproduced image.
When the thumbnail list is displayed on the main display panel 6M as shown in FIG. 5 (b), the user of the imaging apparatus 1 moves the cursor K, so that the selected playback is performed on the front display panel 6F side. The image can be shown to the person on the front side.

As a modified example of the processing in FIG. 15, for example, processing similar to that in steps F202 to F205 in FIG. 7 is performed before step F721 in FIG. 15, and reproduction display in step F722 or F723 is performed on the front display panel 6F depending on conditions. You may make it do.

<4-6: Example of processing during moving image recording period>

In the above, the process in each operation period in the case of taking a still image with the imaging device 1 has been described. Since it is also assumed that moving image recording is performed by the imaging apparatus 1, a processing example in the case of moving image recording will be described here.
FIG. 16 is a processing example relating to transition of each operation period when moving image recording is performed. Steps F101 to F103, F107, and F108 are the same as those in FIG. In FIG. 6, the processing (F104 to F106) that is the operation processing related to the still image recording is shown as steps F150 to F153 as the processing related to the moving image recording in FIG.

  Although the monitoring period is a standby period until moving image recording is started, monitoring image display is performed as step F102. In this case, for example, the processing as shown in FIG. 7A or 7B is performed.

In response to the user performing a recording start operation during the monitoring period, the CPU 31 proceeds from step F150 to F151 to perform the moving image recording process and display control during recording. The processing in step F151 is continued until it is determined that recording is stopped, for example, whether the user performs an operation to stop recording or whether recording cannot be performed when the recording medium 90 or the like is full.
When the recording is stopped by a user operation or the like, the CPU 31 proceeds from step F152 to F153, and performs a moving image recording end process. Returning to Step F101, the operation in the monitoring period is resumed.

Here, FIGS. 17A, 17B, and 17C show an example of processing in step F151.
FIG. 17A shows an example in which image display during moving image recording is also performed on the front display panel 6F depending on the situation.
When the CPU 31 proceeds to step F151 in FIG. 16, the CPU 31 performs a moving image recording process in step F800 in FIG. That is, the image data of each frame obtained by the imaging system 2 and the camera DSP 4 is subjected to a predetermined compression encoding process and the like, and the recording medium 90 and the flash ROM 33 are recorded as moving images.

  During the moving image recording process, in step F801, the CPU 31 performs moving image display control on the main display panel 6M. That is, the moving image display as the monitor image being recorded is executed on the main display panel 6M.

Steps F802 to F805 are performed on the front display panel 6F.
In step F802, a condition determination is made regarding the visibility of the display on the front display panel 6F. For example, part or all of the determination processing of the presence of a person in the subject direction, the determination processing of the imaging mode, the determination processing of the internal detection information, or the determination processing of the image analysis processing result of the captured image signal is performed.
If it is determined that the front display panel 6F is visually recognizable, the CPU 31 advances the process from step F803 to F804 and causes the front display panel 6F to display a moving image as a monitor image being recorded.
That is, in this case, the moving image monitor display is executed on both the main display panel 6M and the front display panel 6F.
On the other hand, if it is determined that the front display panel 6F is not visually recognizable, the CPU 31 advances the process from step F803 to F805, and turns off the front display panel 6F. Thereby, the moving image monitor display is displayed only on the main display panel 6M.

  As described above, when it is estimated that the display on the front display panel 6F is valid, the moving image display during recording is also performed on the front display panel 6F. As a result, the person on the front side can also view the monitor image of the recorded moving image.

FIG. 17B shows an example in which monitor images are displayed during moving image recording on both display panels 6M and 6F.
When the CPU 31 proceeds to step F151 in FIG. 16, the CPU 31 performs a moving image recording process in step F810 in FIG. That is, the image data of each frame obtained by the imaging system 2 and the camera DSP 4 is subjected to a predetermined compression encoding process and the like, and the recording medium 90 and the flash ROM 33 are recorded as moving images.
In this moving image recording process, in step F811, the CPU 31 performs moving image display control on the main display panel 6M and the front display panel 6F. That is, moving image display as a monitor image being recorded is executed on both display panels 6M and 6F.

FIG. 17C is an example in which monitor image display during moving image recording is performed only on the main display panel 6M.
When the CPU 31 proceeds to step F151 in FIG. 16, the CPU 31 performs a moving image recording process in step F820 in FIG. That is, the image data of each frame obtained by the imaging system 2 and the camera DSP 4 is subjected to a predetermined compression encoding process and the like, and the recording medium 90 and the flash ROM 33 are recorded as moving images.
In step F821, the CPU 31 performs control to turn off the front display panel 6F. In step F822, the CPU 31 performs moving image display control on the main display panel 6M. That is, the front display panel 6F is not used for displaying a moving image as a monitor image during recording.

For example, when performing moving image recording, display control examples as shown in FIGS. 17A, 17B, and 17C can be considered.

[5. Example of display state transition]

The control examples related to the display on the main display panel 6M and the front display panel 6F for the monitoring period, the still image recording period, the preview period, the reproduction period, and the moving image recording period have been described above.
In the imaging apparatus 1 of this example, a series of still image imaging operation, reproduction operation, and moving image recording operation are performed while each of these operation periods transitions. And in each operation period, effective display is implement | achieved by both the display panels 6M and 6F by employ | adopting one of the processing examples mentioned above.

18 and 19 exemplify display states on both display panels 6M and 6F as the examples # 1 to # 8 change with the transition of the operation period.
Examples # 1 to # 5 show examples of display states when a transition is made from monitoring period → still image recording period → preview period → monitoring period → reproduction period. That is, this is a case in which one still image recording is performed as monitoring period → still image recording period → preview period, and then the playback period is shifted by a user operation or the like during the monitoring period.

First, in the example # 1 shown in FIG. 18, the process of FIG. 7A as the process of the monitoring period, the process of FIG. 8A as the process of the still image recording period, the process of FIG. 10 as the process of the preview period, and the playback period This is a case where the process of FIG.
For the main display panel 6M, monitoring image display is always performed during the monitoring period. Then, the display is turned off for a moment as the still image recording period, and preview display is performed for a predetermined time in the preview period. In the reproduction period, reproduction display is performed.
For the front display panel 6F, in the monitoring period, when it is estimated that there is a possibility of visual recognition, the monitoring image display is performed, but when it is estimated that there is no visual recognition possibility, the display is turned off, I do not do it. The display is turned off for a moment as the still image recording period. If there is a visual recognition possibility during the preview period, a preview display is performed for a predetermined time. If there is no visual recognition possibility, the preview display is not performed. Also, playback display is not performed during the playback period.
That is, this example # 1 is an example in which the front display panel 6F is configured to perform monitoring image display or preview display according to the condition of visibility.

In example # 2, the process of FIG. 7B is performed as the process of the monitoring period, the process of FIG. 8B is performed as the process of the still image recording period, the process of FIG. 10 is performed as the process of the preview period, and the process of FIG. This is a case where the process (b) is adopted.
For the main display panel 6M, monitoring image display is always performed during the monitoring period. The recorded still image is displayed from the still image recording period to the preview period. In the reproduction period, reproduction display is performed.
The front display panel 6F is turned off during the monitoring period. The display remains off even during the still image recording period. If there is a visual recognition possibility during the preview period, a preview display is performed for a predetermined time. If there is no visual recognition possibility, the preview display is not performed. In the reproduction period, reproduction display is performed or display is turned off according to the presence or absence of the visual recognition possibility.
That is, Example # 2 is an example in which the front display panel 6F displays the recorded still image and reproduced image according to the condition of visibility.

In example # 3, the process of F102 in FIG. 11 is performed as the process of the monitoring period, the process of FIG. 8C is performed as the process of the still image recording period, the process of F106 in FIG. This is a case where 15 processes are employed.
For the main display panel 6M, monitoring image display is always performed during the monitoring period. Although the display is not performed in the still image recording period and the preview period, the still image recording period and the preview period are instantaneous as viewed from the user, and the monitoring image display is performed immediately after shifting to the monitoring period. Also, during the playback period, playback display is performed in a format such as single image display or thumbnail list display.
The front display panel 6F is turned off during the monitoring period. In the still image recording period, a still image to be recorded is displayed, and the image is continued during the preview period. In this case, the preview display is continued even when the monitoring period starts. When the preview display for a certain time is finished, the display is turned off. In the reproduction period, a single image similar to the main display panel 6M or a single image being selected when the main display panel 6M is a thumbnail list image is displayed.
That is, in this example # 3, the recorded image is not previewed on the main display panel 6M, and the recorded still image (preview image) or reproduced image is not displayed on the front display panel 6F without displaying the monitoring image. In this example, display is performed.

In example # 4, the process of F102 of FIG. 12 is performed as the process of the monitoring period, the process of FIG. 8D is performed of the process of the still image recording period, the process of F106 of FIG. This is a case where the processing of 14 (b) is adopted.
For the main display panel 6M, monitoring image display is always performed during the monitoring period. A still image recorded as a preview period from the still image recording period is displayed. When the preview period ends, the monitoring image is displayed by moving to the monitoring period. In addition, playback display is performed during the playback period.
For the front display panel 6F, during the monitoring period, the monitoring image display is performed or the display is turned off according to the presence or absence of the visual recognition possibility. The recorded still image is displayed from the still image recording period to the preview period. In this case, the preview display is performed for a longer time than the main display panel 6M. That is, even when the monitoring period is started, a certain amount of time preview display is continued. After the preview display is finished, the monitoring image display is performed or the display is turned off according to the presence / absence of the visual recognition possibility. Even during the reproduction period, reproduction display is performed or display is turned off depending on whether or not there is a visual recognition possibility.
This example # 4 is an example in which the preview display is executed as long as possible on the front display panel 6F, and the monitoring image display and the reproduction display are in accordance with the condition of visibility.

In the example # 5 shown in FIG. 19, the process of F102 of FIG. 13 is performed as the process of the monitoring period, the process of FIG. 9 is processed of the still image recording period, the process of F106 of FIG. This is a case where the processing of FIG. 15 is adopted.
For the main display panel 6M, monitoring image display is always performed during the monitoring period. The monitoring image display is continued during half-pressing in the still image recording period. The display is turned off during the release process. During the preview period, the preview display is performed until the user finishes the preview display operation. Also, during the playback period, playback display is performed in a format such as single image display or thumbnail list display.
For the front display panel 6F, during the monitoring period, the monitoring image display is performed or the display is turned off according to the presence or absence of the visual recognition possibility. The display operation according to the conditions is continued even during half-pressing in the still image recording period. The display is turned off during the release process. The preview display is performed during the preview period, but the preview display is continued even when the monitoring period starts. When the preview display for a certain time is finished, the monitoring image display state is returned according to the presence or absence of the visual recognition possibility. In the reproduction period, a single image similar to the main display panel 6M or a single image being selected when the main display panel 6M is a thumbnail list image is displayed.
That is, in this example # 5, on the main display panel 6M, the preview of the recorded image is terminated by the user's operation. However, even if the preview period is ended and the monitoring period is started, the front display is performed for a certain amount of time. In the panel 6F, the preview display is continued.

  Examples # 6 to # 8 show examples of display states when a transition is made from monitoring period → moving picture recording period → monitoring period → reproduction period. That is, it is a case where moving image recording is performed from the monitoring period to the moving image recording period, and then the reproduction period is shifted by a user operation or the like during the monitoring period.

Example # 6 is a case where the process of FIG. 7A is adopted as the process of the monitoring period, the process of FIG. 17A is adopted as the process of the moving image recording period, and the process of FIG. 14B is adopted as the process of the reproduction period. .
For the main display panel 6M, monitoring image display is always performed during the monitoring period. The monitor image display during recording is also performed during the moving image recording period. In the reproduction period, reproduction display is performed.
For the front display panel 6F, during the monitoring period, the monitoring image display is performed or the display is turned off according to the presence / absence of visual recognition. During the moving image recording period, the monitor display during recording is performed or the display is turned off depending on the presence or absence of the visual recognition possibility. Even during the reproduction period, reproduction display is performed or display is turned off depending on whether or not there is a visual recognition possibility.
That is, this example # 6 is an example in which the front display panel 6F always performs the monitoring image display, the recording monitor display, and the reproduction display in accordance with the condition of visibility.

Example # 7 is a case where the process of FIG. 7A is adopted as the process of the monitoring period, the process of FIG. 17B is adopted as the process of the moving image recording period, and the process of FIG. 14B is adopted as the process of the reproduction period. . Except for the moving image recording period, it is the same as Example # 6.
On the main display panel 6M, monitor image display during recording is performed during the moving image recording period.
Also on the front display panel 6F, the monitor display during recording is always performed during the moving image recording period.
That is, Example # 7 is an example in which recording monitor display is always performed on the front display panel 6F during moving image recording.

Example # 8 is a case where the process of FIG. 7A is adopted as the process of the monitoring period, the process of FIG. 17C is adopted as the process of the moving image recording period, and the process of FIG. 14B is adopted as the process of the reproduction period. . Except for the moving image recording period, it is the same as Example # 6.
On the main display panel 6M, monitor image display during recording is performed during the moving image recording period.
On the front display panel 6F, the display is turned off during the moving image recording period.
That is, Example # 8 is an example in which recording monitor display is not performed on the front display panel 6F during moving image recording.

As described above, as examples # 1 to # 8, examples of the transition of the display state accompanying the operation period transition have been described. Of course, various display processing examples other than these examples can be considered.
In the processing described as FIGS. 6 to 17, the monitoring period processing is any one of FIGS. 7A and 7B, F <b> 102 in FIG. 11, F <b> 102 in FIG. 12, and F <b> 102 in FIG. ) Can be adopted.
As the processing for the still image recording period, any of FIGS. 8A, 8B, 8C, and 9D (or a modified example thereof) can be employed.
As the processing in the preview period, any one of F106 in FIG. 10, FIG. 11, F106 in FIG. 12, and F106 in FIG. 13 (or a modified example thereof) can be adopted.
As the processing in the reproduction period, any of FIGS. 14A, 14B, and 15 (or a modified example thereof) can be adopted.
As the processing of the moving image recording period, any one of (a), (b), and (c) in FIG. 17 (or a modified example thereof) can be employed.
In other words, by combining these processing examples, examples of display state transitions due to operation transitions are assumed to be very diverse.

In the imaging apparatus 1 of the present embodiment, the display states of the main display panel 6M and the front display panel 6F are controlled for each of various operation periods that change in the process of operation, as in the above examples # 1 to # 8. .
For example, when a transition is made between a monitoring period, a still image recording period, a preview period, a reproduction period, a moving image recording period, and the like, the display state is controlled according to the purpose of display and the presence of a person viewing the display.
In particular, display control is performed such that the main display panel 6M and the front display panel 6F can have different display contents during at least one operation period. Different display content means that a different image is displayed or one of the images is turned off. The different display content can be different depending on, for example, the result of the condition determination. That means.
For example, in example # 1, the main display panel 6M and the front display panel 6F can have different display contents during the monitoring period and the preview period. In addition, different display contents are displayed during the reproduction period. In other examples # 2 to # 8, the main display panel 6M and the front display panel 6F can have different display contents in at least one operation period.
By controlling in this way, appropriate display, useful display, avoidance of useless display, and the like are realized in each display panel unit for each operation period.

[6. Modified example]

While various processing examples and modifications as the embodiment have been described above, various modifications can be considered as the embodiment of the present invention.

  In the above example, for the front display panel 6F, for example, the display is turned off when the condition for visibility is not satisfied. However, in such a case, an example in which the front display panel 6F is in a low-luminance display state or a reproduced image or a preset image is displayed without turning off the display is also conceivable.

  For example, when the process proceeds to step F205 in the process of FIG. 7A, the monitoring image is displayed with the display brightness reduced on the front display panel 6F. For example, when a display device using a self-luminous element such as an organic EL panel is used as the front display panel 6F, reducing the display luminance is useful for reducing power consumption. Therefore, when the condition for visibility is not satisfied, such as when there is no person in the front or when the display cannot be seen due to poor visibility, power consumption is reduced by reducing the display brightness.

For example, when the process proceeds to step F205 in the process of FIG. 7A, an image unrelated to the monitoring image is displayed on the front display panel 6F, such as a preset image or a reproduction image.
For example, even when it is estimated that there is no person who is the subject in front or that the visibility is poor and the display can be seen, there are many situations where there is a person nearby. Depending on the position of the person, the display on the front display panel 6F may be easy to see.
For those around them, the display on the front display panel 6F is recognized as a part of the external appearance design of the imaging device 1 and is interesting.
Further, in such a case, by allowing the user to select an image to be displayed on the front display panel 6F, the user can freely set the appearance of his / her own imaging device 1, and the enjoyment of using the camera is expanded. Can do.

  These processes are a modification of the process when the front display panel 6F is turned off in FIGS. 8A and 8B, and a modification of the process when the front display panel 6F is turned off in steps F507 and F508 of FIG. It can also be considered. Similarly, step F603 in FIG. 10, step F211 in FIG. 11, step F205 in FIG. 12, step F205 in FIG. 13, step F701 in FIG. 14 (a), step F713 in FIG. 14 (b), and step F713 in FIG. Step F805 and step F821 in FIG.

  For example, when normal monitoring image display, preview display, or the like is not performed on the front display panel 6F, the display on the front display panel 6F is turned off, low-luminance display, a playback image or a preset image is displayed. It may be possible for the user to select.

  In this example, an apparatus generally called a digital still camera is taken as an example of the imaging apparatus 1, but the present invention can be applied to various apparatuses such as a video camera, a mobile phone having an imaging function, and a PDA (Personal Digital Assistant). .

  1 imaging device, 2 imaging system, 3 control system, 4 camera DSP, 5 operation unit, 6M main display panel, 6F front display panel, 7 display controller, 8 external interface, 9 SDRAM, 10 medium interface, 13 shake detection unit, DESCRIPTION OF SYMBOLS 14 Light emission drive part, 15 Flash light emission part, 17 Lens drive driver, 18 Aperture / ND drive driver, 19 Image sensor driver 21 Lens mechanism part, 22 Aperture / ND filter mechanism, 23 Image sensor part, 24 Analog signal processing part, 25 A / D conversion unit, 28 timing generation circuit, 26 lens driving unit, 27 lens position detection unit, 31 CPU, 32 RAM, 33 flash ROM, 34 clock circuit, 41 image signal processing unit, 42 compression / decompression processing unit, 43 SDRAM controller, 44 image analysis unit, 5 Proximity sensor

Claims (4)

A first display panel unit for displaying toward the user on the device housing;
A second display panel unit that performs display in a direction other than the user direction on the device casing and can be disposed on the back side of the first display panel unit;
When a list display of a plurality of image data is performed on the first display panel unit, the second display panel unit displays the image data being selected from the list display and the first display. In the case where one piece of image data is displayed on the panel unit, a control unit that displays the one piece of image data on the second display panel unit ,
A display device comprising:   The display device according to claim 1, wherein the control unit controls execution / non-execution of display of image data on the second display panel unit based on a determination result of a visibility possibility condition. The display device further includes an imaging unit,
The display device according to claim 1, wherein the plurality of image data includes image data generated based on the imaging unit. A first display panel that displays in the direction of the user on the apparatus housing, and displays in a direction other than the user direction on the apparatus casing, and the rear surface of the first display panel As a display method of a display device comprising a second display panel unit that can be arranged on the side,
When a list display of a plurality of image data is performed on the first display panel unit, the second display panel unit displays the image data being selected from the list display and the first display. A display method of displaying one piece of image data on the second display panel unit when one piece of image data is displayed on the panel unit .

Images