JP2001103431A - Method and device for image reproduction and image- pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize reproduction of an image according to time information added to the image, while keeping flexible operation. SOLUTION: In a digital camera, that reproduces and displays an image of image data stored in a storage medium, each of image data is in cross- reference with time information and stored in a flash memory. In the image- reproduction processing, the image data stored in the flash memory are read, reproduced and displayed (step S515). Then the arrival of a display switching time of the image data to be reproduced and displayed is judged on the basis of the time information stored in the flush memory (steps S513, S514). When the arrival of the display switching time is judged and other application is being executed, the arrival of the display switching time is informed (step S523).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image reproducing method and apparatus for storing a captured image, reading out the stored image, reproducing and displaying the image, and an image pickup apparatus provided with the image reproducing apparatus. is there.

[0002]

2. Description of the Related Art Conventionally, for example, in a digital camera, when image data of a plurality of frames is stored in a built-in disk, memory, or the like, when image data of the plurality of frames are continuously reproduced and displayed, In accordance with the key operation of the operator, the stored image data of each frame is sequentially read out and displayed, or the image data of each frame is automatically read out and reproduced at a preset time interval. Was configured to be.

[0003]

However, in the continuous reproduction display by the conventional digital camera, the image of each frame is reproduced at a predetermined time interval. For this reason, for example, in a case where a plurality of image data shot with the lapse of time during one event or work is reproduced, continuous reproduction and display are performed regardless of the actual lapse of time. There has been a problem that the passage of time between the displayed frame images cannot be known.

For example, immediately after photographing, the operator can insert the elapsed time information into the image data or associate the elapsed time information with the elapsed time so that the elapsed time between frames can be read at the time of reproduction. In addition, a method of performing such processing and displaying the assigned time information together with the image when the frame image is reproduced is also conceivable.

Alternatively, if the input of time information by the operator causes trouble in the operation, the elapsed time of the image data is measured by a built-in timer or the like when the image data is captured, and the measurement time is automatically determined. A method of inserting or associating them into the inside is also conceivable. However, just displaying these time information when playing each frame,
There is a problem that it is difficult to intuitively grasp the elapsed time.

[0006] As means for solving this problem, when each frame of a photographed image is reproduced, reproduction of image data is switched in accordance with the interval of time information inserted or associated at the time of photographing the image. A method is also conceivable. However, in such a playback method, during a series of playback cycles, it is not possible to execute other applications such as taking another image, organizing the image, and inputting information, and the next playback image and the next playback image are not performed. If the elapsed time until the image to be processed is long, there is a problem that the use of the device is hindered.

To solve this problem, a method of interrupting the reproduction of the currently displayed image even during the reproduction cycle to permit the execution of another application is conceivable. When the playback time of an image comes, the currently running application may be suddenly interrupted. In addition, when the currently executed application is prioritized, there is a problem that the next reproduced image is skipped.

The present invention has been made in view of the above conventional example, and it is an object of the present invention to enable reproduction of an image in accordance with time information added to an image while maintaining flexibility of operation.

It is another object of the present invention to effectively achieve both reproduction in accordance with time information added to an image and execution of another application.

[0010]

An image reproducing apparatus according to the present invention for achieving the above object has, for example, the following arrangement. That is, an image reproducing apparatus that reproduces and displays an image based on image data, a storage unit that stores time information in association with each image data, a reproducing unit that reads out the stored image data, reproduces and displays the image data, Judging means for judging the arrival of the display switching time of the image data reproduced and displayed by the reproducing means based on the stored time information, and determining that the display switching time has come by the judging means. And a notifying means for notifying this.

The image reproducing method of the present invention for achieving the above object includes, for example, the following steps. That is, an image reproducing method for reproducing and displaying an image based on image data, storing a time information in association with each image data, reading out the stored image data, and reproducing and displaying the stored image data. Determining a display switching time of image data to be reproduced and displayed in the reproducing step based on the time information obtained in the reproducing step; Notification step.

Further, according to the present invention, there is provided an imaging apparatus provided with the above-mentioned image reproducing apparatus. Further, according to the present invention, there is provided a storage medium for storing a control program for causing a computer to implement the image reproducing method.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

In this embodiment, a description will be given of the case of a digital camera which captures and stores a video and reproduces it. For example, such a video is captured and stored, or video data is stored. It is needless to say that the present invention can be applied to an image pickup device, a reproducing device, and the like in which a storage medium is set and reproduced.

FIG. 1 shows a first embodiment of the present invention.
1 is a block diagram illustrating a schematic configuration of a digital camera according to an embodiment.

In FIG. 1, reference numeral 101 denotes a CPU (Central Processing Unit).
It is controlled by U101. The CPU 101 includes a ROM (Read Only Memory) 102 storing a control program, a RAM (Random Access Memory) 10
3. Data storage unit 104, image processing unit 108, tablet control unit 109, LCD control unit 11
1, a shutter SW 114, a timer 115, and a DC / DC converter 117 for supplying power are respectively connected.

The image processing unit 108 is connected to a CCD control unit 107, and the CCD control unit 107 is connected to a CCD 106. The handwriting tablet 110 is connected to the tablet control unit 109. The LCD control unit 111 has a display drive unit 112.
Is further connected to the display drive section 112, and the display section (TF
(T color liquid crystal) 113 is connected. DC /
Power is supplied to the DC converter 117 from the battery 116.

The CPU 101 performs various controls based on a control program stored in the ROM 102. The processing realized by this control program is as follows: “Read the captured image signal output from the image processing unit 108,
A process for performing A-transfer "," process for DMA-transferring data from the RAM 103 to the LCD control unit "," process for storing JPEG-compressed image data in the data storage unit 104 ", and" handwriting tablet 110 " Executing various applications according to information input from the user), "instruction of photographing operation accompanying operation of shutter SW 114", "timing process of photographing operation interval by timer 115", "time setting of timer 115" And a process of outputting a control signal for controlling power supply to each element to the DC / DC converter 117, and the like.

The RAM 103 has an image development area 103a,
A work area 103b, a VRAM 103c, and a temporary save area 103d are provided. Image development area 103a
Is a photographed image (YU) sent from the image processing unit 108.
V digital signal) and a temporary buffer for temporarily storing JPEG compressed image data read from the data storage unit 104, and as a work area dedicated to images for image compression processing and decompression processing. The work area 103b is a work area for various programs. The VRAM 103c is used as a VRAM for storing display data to be displayed on the display unit 113.
The temporary save area 103d is an area for temporarily saving various data.

A data storage unit 104 is a memory for storing photographed image data JPEG-compressed by the CPU 101 or various attached data referred to by an application in a file format. In the first embodiment, a flash memory is used. It is composed of memory.

A lens group 105 optically converts a subject image into CC.
It is composed of a plurality of lenses for projecting to D105. A CCD (photoelectric conversion element) 106 is a lens group 105
Is an element for converting a captured image projected by the camera into an analog electric signal. CCD control unit 107
Is a timing generator for supplying a transfer clock signal and a shutter signal to the CCD 106, a circuit for removing noise from the CCD output signal and a gain process, and an A / D for converting an analog signal into a 10-bit digital signal. It includes a conversion circuit and the like. The image processing unit 108 performs image processing such as gamma conversion, color space conversion, white balance, AE, and flash correction on the 10-bit digital signal output from the CCD control unit 107, and performs YUV (4: 2: 2) It outputs a format 8-bit digital signal. The lens group 105, the CCD 106, the CCD control unit 107, and the image processing unit 108 are hereinafter collectively referred to as a camera module.

A tablet control unit 109 converts various information input by driving control of the handwriting tablet 110 and touching with a pen into digital signals,
Control to transfer to.

The LCD control unit 111 applies JPEG to the YUV digital image data transferred from the image processing unit 108 or the image file in the data storage unit.
Receiving the decompressed YUV digital image data, R
A process of converting the data into a GB digital signal and outputting it to the display drive unit 112 is performed. The display drive unit 112 performs control for driving the display unit 113. The display unit 113 is a display for displaying an image. In this example, the display unit 113 is a VGA standard (640).
× 480 dots) TFT liquid crystal display device.

The shutter SW 114 is a switch for instructing the start of a photographing operation. This shutter SW
Reference numeral 114 denotes a switch position in two stages depending on the pressing pressure of the switch. When the position of the first stage (low pressing pressure—hereinafter referred to as “half pressing position”) is detected, locking operation of camera settings such as white balance and AE is performed. Then, upon detection of the second stage position (strong pressing pressure—hereinafter referred to as “shutter ON position”), a capture signal capturing operation is performed.

The timer 115 starts counting time in accordance with an instruction from the CPU 101, and transmits the value counted up to that point to the CPU 101 in response to a request from the CPU 101. When the count value is reached, the CPU 101 performs an operation of notifying the CPU 101 of the time-up.

The battery 116 is a rechargeable secondary battery or a dry battery. The DC / DC converter 117 receives a power supply from the battery 116, generates a plurality of power supplies by performing boosting and regulation, and supplies a power supply of a necessary voltage to the CPU 101 and other elements. This DC / DC converter 117
Can control the start and stop of the supply of each voltage by the control signal 118 from the CPU 101.

Hereinafter, the processing procedure of the camera operation in the first embodiment of the present invention will be described with reference to the flowcharts shown in FIGS. 2, 3 and 4.

FIG. 2 is a flowchart showing the flow of the viewfinder function in the photographing operation mode in the digital camera of the first embodiment.

First, in step S201, when the power of the digital camera is turned on or the switch to the photographing operation mode is turned off, the process proceeds to step S202.
CC including CCD 106 and CCD control unit 107
Put the D module in an operable state (enable). Subsequently, the process proceeds to step S203, in which an operation of causing the display unit 113 to function as an electronic viewfinder for confirming a subject at the time of shooting is started.

Next, with reference to the steps after step S204, a continuous process until the image captured from the camera module is displayed on the display unit 113 will be described.

In step S204, the camera lens group 1
A process of converting the optical information of the object captured from the camera 05 into an electric signal by the CCD 106 is performed. This output signal is a non-interlace analog signal, and outputs data of a reduced size of 320 × 240 dots by a thinning process instead of the total pixels of 640 × 480 dots in order to increase the processing speed. The signal captured in step S204 is
Next, in step S205, after noise removal processing and gain processing by the CCD control unit 107, 10
After being A / D converted into a bit digital signal, it is sent to the image processing unit 108. Then, in step S206, the image processing unit 108 sets the auto white balance, A
E, processing such as correction at the time of flash photography, or Y
Processing such as signal conversion to the UV (4: 2: 2) format is performed.

The signal YUV-converted by the image processing unit 108 is written by the CPU 101 into the VRAM 103c for storing display image data, and is constantly output to the LCD control unit 111 using DMA. L
In step S207, the CD control unit 111 converts the received YUV signal into an RGB digital signal, and then in step S208, the display driving unit 1
12 to output an RGB signal. In response to the output signal from the display drive unit 112, the display unit 113 displays a subject image in step S209.

As described above, steps S204 to S2
The image taken by the CCD 106 is constantly monitored on the display unit 113 by continuously looping the processing up to 09 in a cycle of 1/30 (1/30) second.

If a key operation by the photographer is detected during the processing loop displaying this video, an interrupt signal accompanying the key operation is output to the CPU 101 to generate an interrupt event. The processing shifts to an interrupt processing A shown in FIG.

FIG. 3 shows steps S204 to S20 described above.
9 is a flowchart illustrating a control procedure of an interrupt process generated by a key operation during display of a captured image performed in step S9.

At the stage when this key operation occurs, there is internally one of two modes. One is a normal mode in which a display operation on the viewfinder (display unit 113) described with reference to FIG. 2 is performed. The other is a “half-press mode” that is shifted by setting the shutter SW 114 to a half-press position, in which the shutter SW 114 is once pressed halfway and various camera settings are locked, and the display unit 11 is locked.
This is a mode in which the display on No. 3 is performed. In FIG. 3, the start step of the process is divided into two cases, a process from the normal mode and a process from the “half-press mode”.

First, step S301 is a key status reading process for checking which key operation has been performed in the interrupt process from the normal mode. If it is determined in step S302 that the shutter SW 114 is at the shutter ON position based on the key status, the process proceeds to step S303. In step S303, various camera settings controlled in the image processing unit 108, such as auto white balance, AE, and strobe correction in the case of strobe shooting, are locked with the current set values. Then, the process proceeds to step S316,
The display drive unit 1 for reducing the processing load of the CPU
12. The operation of the display unit 113 is stopped.

Now, as shown in the description of the flowchart of FIG. 2, in the viewfinder display processing, in order to increase the processing speed, only the signal of the number of pixels of the thinned image obtained by thinning out the original number of pixels of the CCD 106 is taken. VGA standard (640 × 480)
dot) from all the pixels of the CCD 106. Therefore, in step S317, a capture signal of the number of VGA pixels is captured, and after predetermined processing in the image processing unit 108, the data of the YUV signal is written to the image development area 103a in the RAM 103.

Then, the flow advances to step S318 to perform image compression processing based on the JPEG standard on the digital image data. Then, the flow advances to step S319 to store the compressed data in the data storage unit 104 (flash memory in this example). Write as a file. Then, step S320
Then, the operation of the display drive of the display unit 113 which has been stopped is restarted. Then, in step S321,
After displaying the image data on the display unit 113 for a certain period of time so that the photographed image can be confirmed, step S32 is performed.
In step 2, the interrupt processing is terminated, and the flow returns to the loop of steps S204 to S209 in FIG. 2 again to restart the above-described viewfinder processing.

On the other hand, from the key status read in step S301, the shutter half-press position is detected instead of the shutter ON position (step S3).
04) If yes, the process proceeds to step S305. In step S305, the state setting inside the digital camera is set to “half-press mode”. Next, the process proceeds to step S306,
Auto white balance, as in step S303,
Locks various camera settings in the image processor, such as AE and flash correction for flash shooting, with the current settings. Thereafter, the process proceeds to step S307, ends the interrupt processing, and returns to the loop of steps S204 to S209 in FIG.

If it is determined in step S304 that the shutter is not in the half-press position, the flow advances to step S308 to check whether a key for changing the photographing condition has been pressed.
If so, the process proceeds to step S309. Step S30
In step 9, various camera settings controlled in the image processing unit 108, such as auto white balance, AE, and strobe correction in the case of strobe shooting, are changed according to the type of the pressed key. to correct. afterwards,
The process proceeds to the return process of step S307.

If the key status read in step S301 indicates that the OFF key (power OFF) has been pressed, the flow advances to step S311 via step S310. In step S311, the operation of the display drive is completed. Next, in step S312, the operation of the CCD module is completed. In step S313, the processing for ending the other photographing operations is performed, and then the system power-off processing is performed. . Step S310
If no OFF key is detected, no valid key or switch is detected, and the process returns to step S307 without performing any processing.

Next, the flow of interrupt processing in the "half-press mode" will be described with reference to step S314 and subsequent steps.

Step S314 is a key status reading process for checking which key operation has been pressed in the interrupt process in the "half-press mode". If it is determined in step S315 that the shutter switch 114 has been pressed, the flow advances to step S316 to set various cameras in the image processing unit 108 locked by the detection of the previous half-press key (step S304). While the step S306) remains valid, the process proceeds to the photographing process (described above) after the step S316.

On the other hand, if the key status read in step S314 is not the ON state of the shutter key, the flow advances to step S323 to check whether the half-press is released. If so, the flow advances to step S324 to release the state setting of the digital camera from the "half-press mode", and then to the return processing in step S322. If no half-press release key is detected in step S323, it means that a valid key or switch has not been detected, and the process proceeds to the return process in step S322 without performing any processing.

Next, FIG. 4 for explaining the reproduction process of the image data according to the present embodiment will be described with reference to FIG. 4 for reading out the image data stored in the data storage unit 104, reproducing the image data and displaying it on the display unit 113. 6 is a flowchart illustrating a flow of a process in a reproduction operation mode.

First, in step S401, when the power of the camera is turned on or the switch is switched to the reproduction operation mode, the process proceeds to step S402, where the operation of the display unit 113, which is an electronic viewfinder for confirming a subject at the time of shooting, is performed. To start. Next, step S403
Then, for example, the compressed image data written in step S319 (photographing operation) of FIG. 3 is read from the data storage unit 104 (flash memory) and written to the image development area 103a in the RAM 103.

Next, the flow advances to step S404 to execute an image decompression process, that is, a process for converting compressed data conforming to the JPEG standard into original data (YUV data). Next, the process proceeds to step S405, where the decompressed frame image data is stored in the VRAM 103c for storing display image data.
Write to

Thereafter, similarly to the processing from step S207 to step S209 in FIG.
In step 6, the received YUV signal is converted into an RGB digital signal, and the process advances to step S407 to output an RGB signal to the display driver 112. Then, in step S408, the read frame image is reproduced and displayed on the display unit 113 which has received the output signal from the display drive unit 112.

Next, the overall operation of the digital camera according to the first embodiment of the present invention will be described with reference to the flowchart shown in FIG.

In FIG. 5, first, in step S501,
When the power of the digital camera is turned on, step S50 is performed.
Proceed to 2 to check the operation mode. Step S5
If the “timer shooting mode”, which is a feature of the present embodiment, is selected in 02, the process proceeds to the timer shooting operation processing in step S503 and subsequent steps. On the other hand, if the “timer shooting mode” has not been selected, step S510
To see if "timer playback mode" is selected. If the “timer reproduction mode” is selected, the process proceeds to the timer reproduction operation processing after step S511. If neither mode is set, the flow advances to step S520 to execute a camera operation that is normal shooting and playback.

Hereinafter, the processing of the timer photographing operation will be described with reference to steps S503 to S509.

If the "timer shooting mode" is selected, the flow advances to step S503 to wait for the operator to input a timer shooting start instruction. Here, for example, when this instruction is performed from the handwriting tablet 110 or the like, the process proceeds to step S504. In step S504, after the count value of the timer 115 is initialized,
Proceeding to step S505, the timer 115 starts counting. Next, the process proceeds to step S506, where the photographing operation processing described with reference to FIGS. 2 and 3 is performed. When the photographing of one frame image ends, that is, when the generation of the photographed frame image data ends, step S5
07, the count value counted by the timer 115 up to that point is read from the timer 115,
It is added to the generated frame image data.

Next, in step S508, when the operator instructs to end the timer shooting operation,
When the end processing in step S509 is executed and no end instruction is given, that is, when the shooting is continued, the process returns to the initialization processing of the count value of the timer 115 in step S504 again, and the shooting operation is repeated.

By the above-described processing, the count value of the timer 115 is automatically used as the time information from the immediately preceding photographing operation (the immediately preceding frame) to the current photographing operation (the current frame) during the photographing operation. Is added to each frame image data photographed at the time.

Next, the processing of the timer reproduction operation will be described.

If the "timer playback mode" is selected in step S510, the flow advances to step S511 to read the pointer to the first frame image of the selected image group, that is, the frame image first shot at the time of timer shooting. set. Next, step S
The process proceeds to 512, where a timer count value added to or associated with the frame image data at the pointer position where the read pointer is set is read, and this count value is set in the timer 115. In this case, the timer 115 is used as a subtraction timer. The set value is sequentially subtracted from the set value with the lapse of time. In response, a time-up signal is output. In step S513, the subtraction of the timer value is started. While the timer is counting, it is in a state of waiting for time-up while the target frame image is displayed. Here, as shown in step 521, execution of another application is performed by a switching operation by a key operation or the like. Is also possible.

If it is determined in step S514 that the timer 115 has timed out and a time-up interrupt signal has been output to the CPU 101, the process proceeds to step S5.
At 22, it is determined whether another application is currently being executed. If another application has not been executed, that is, if the current frame image is being displayed on the display unit 113, step S51 is executed.
The process proceeds to step S5, where the frame reproduction operation process described with reference to the flowchart of FIG. 4 is performed, and the designated frame image is displayed on the display unit 113.

Thereafter, the flow advances to step S516 to wait while the reproduced image is displayed until a confirmation instruction is given. If a confirmation instruction from the operator is detected, the process advances to step S517 to check whether there is a next frame image to be reproduced. If there is no next frame image to be reproduced, the end processing of the timer reproduction function in step S519 is performed.

On the other hand, if there is still a next frame image to be reproduced in step S517, the process proceeds to step S5.
Then, the process advances to step 18 to advance the read pointer to the position of the frame image data to be reproduced next. Thereafter, the flow returns to step S512 again, and the setting of the timer value in the timer 115 and the image reproduction processing are repeatedly executed.
In step S517, it is determined whether or not there is a next frame. When there are a plurality of frames having the same information regarding the application (602 and 702 in FIGS. 6 and 7 described later), all the frames are reproduced. It is determined whether or not it has been performed.

If it is determined in step S522 that another application is being executed, the flow advances to step S523. In step S523,
The application being executed is interrupted for a moment, a process for popping up a warning display for indicating that the reproduction time of the next frame image has come, and the process proceeds to step S524.

In step S524, when an operation to instruct to reproduce the next frame image is performed by the operator, the above-described image reproduction processing in step S515 is executed. If the reproduction instruction has not been issued in step S524, the process proceeds to step S525. If it is determined that an operation to instruct to skip the reproduction of the next image has been performed, the image is not reproduced, and the process of checking whether there is a next frame image to be reproduced in step S517. Proceed to. In other words, the currently running application is continuously executed until the reproduction time of the next image comes.

If the skip instruction has not been issued in step S525, the flow advances to step S526. If it is determined that the timer reproduction operation has been canceled, the flow advances to the end process in step S519. Continue running the currently running application.

FIG. 6 is a diagram showing the data structure of one frame of image data shot by the digital camera according to the first embodiment and stored in the data storage unit 104. This image data is stored in a data structure conforming to the JPEG standard, and the count value counted by the timer 115 is embedded in the image data as a “timer value”.

In FIG. 6, reference numeral 601 denotes a header portion storing information of the frame image data.
An area 2 stores various information specified by the application. Reference numeral 603 denotes an area in which the count value (timer value) of the timer 115 is stored. When each frame image is reproduced, the “timer value” in this area is read, and a subtraction value is set in the timer 115. An area 604 stores JPEG-compressed frame image data.

FIG. 7 shows another embodiment of the timer 115.
FIG. 8 is a diagram showing a case where a count value “timer value” is stored in a data storage unit 104.

Here, different from FIG. 6, the timer values corresponding to each frame image data by the timer 115 are collectively stored in an area 705 different from the image data.
Accordingly, as indicated by reference numeral 703, related information (pointer or the like) indicating the address or the state where the timer value of the corresponding timer 115 is stored is stored in each frame image data.

In FIG. 7, reference numeral 701 denotes a header section similar to that of FIGS. 6 and 601; 702, an application information storage section similar to 602; 703, a readout value of a count value "timer value" for the frame "image 1"; This indicates an area where information is stored. Further, the other frames “image 2” and frame “image n” are stored in the same data structure.

Reference numeral 705 denotes an area in which the "timer value" is actually stored, and 705a denotes the "image 1"
705b indicates an area where “timer value 2” for “image 2” is stored, and 705c indicates an area where “timer value n” for “image n” is stored.

A method is also conceivable in which the frame image data and the timer value are filed and associated with each other by file names. For example, if the image file is “image 1.JPG”, “image 2.JPG”
.. and the timer value data file is "Image 1.T
The same file name having a different extension may be assigned as “MR”, “image 2.TMR”, etc., and these may be treated as the same group.

Next, FIG. 8 shows an example of an application according to the first embodiment.

The application described with reference to FIG. 8 is an application example in which, in the course of cooking, images of the progress of each are taken together with the information of the time lapse, and the same food is cooked again at a later time while reproducing it. FIG. 8 shows a display example of the reproduced image. This application information is stored in the information 602 and 702 regarding the application shown in FIGS. The display example shown here is an example in which another application is not executed during the reproduction of the frame image.

In FIG. 8, reference numeral 801 denotes an image displayed on the display unit 113 immediately after selecting the timer reproduction, and a comment such as the content of the dish and the ingredients is displayed on this screen. It is assumed that these comments have been input by the photographer in advance by character input using the handwriting tablet 110 during shooting. Here, if the user touches the “OK” area 801a on the screen, timer playback for explaining the cooking procedure is started. Reference numeral 802 denotes a display screen immediately after the start, and the first captured image is displayed.

When the user touches the "confirmation" area 802a, the counting operation according to the timer value added to the image data of the next frame (steps S513 and S5 in FIG. 5).
14) is started, and then the time set in the timer 115 and the time counted up to the present time by the timer 115 in the state where the same image as the first screen display (802) is displayed as shown in 803 Is displayed at the upper right of the screen. Thus timer 1
When the time set to 15 elapses, the display switches to the next screen, that is, the reproduction display of the second captured frame image, as shown at 804. Further, by touching “confirmation” 804 a, similarly to the case of 803, the elapsed time is displayed, and when the time measurement by the timer 115 ends, the display of the next frame is continuously performed, such as the display of the next frame image. . Then, as shown on the screen 805, the last frame image is displayed, and the timer reproduction operation ends when the “end” area 805a is touched.

In the application display example described with reference to FIG. 8, another application is not executed between the reproduction of a frame image and the reproduction of the next frame image, that is, while the timer is counting down. An example in which only display is performed has been described. However,
During the reproduction of the cooking procedure as shown in FIG. 8, for example, when it is desired to add a new noticed note or the like as a memo,
There may be a case where it is desired to newly capture an intermediate image or a case where the stored contents are to be slightly corrected or corrected.

As shown in the flowchart of FIG. 5, in the present embodiment, the application can be switched even during the timer reproduction operation, and the reproduction time of the next frame image can be changed while another application is being executed. When a warning message comes, a warning display is first displayed to notify the operator of the time-up, and the interruption or continuation of the application can be selected by the instruction of the operator. The operation when another application is executed during the timer reproduction operation will be described with reference to the display example of FIG.

In FIG. 11, 8 from the start screen of 801
The screen display examples up to the end screen 05 are shown at 801 to 8 in FIG.
Same as 05. Here, for example, when switching to another application, such as adding a memo or taking a new image, while waiting for the time-up until the next frame is reproduced on the reproduction screen 803, as shown in 1101, The screen switches to the application execution screen.

If the time set in the timer has elapsed, the application is temporarily interrupted and a warning display 1102a indicating that the reproduction time of the next frame image has come, as indicated by 1102, appears. . At the same time, pen touch icons 1102b, 1102c, and 1102d for instructing the operator to perform the next action are displayed.

Reference numeral 1102b denotes a playback icon. When a pen is touched in this area, the currently executing application is immediately stopped and the next frame image is played back and displayed. Reference numeral 1102c denotes a skip icon. When the pen is touched in this area, the display of the frame image which is the target of the warning is skipped, and the counting operation is started again until the display time of the next frame image. Application is continuously executed. Reference numeral 1102 d denotes a cancel icon. When the user touches this area with a pen, the timer playback operation is canceled, and the continuation of the currently executing application can be executed.

As described above, by performing the timer photographing and the timer reproduction of the first embodiment, each frame image can be reproduced and displayed with the same lapse of time as the actual cooking process. With this, it is possible to check the finished condition of the dish at each point in time while viewing the reproduced image. If such a digital camera is used, for example, in a cooking class or the like, when reviewing the cooking process at a later date, the same cooking method can be surely learned without causing any mistake in the procedure.

[Second Embodiment] In the first embodiment,
Although an example of application to an application such as timer photographing and timer playback of a cooking process has been described, the present invention is not limited to this, and various applications are possible.

In the second embodiment, the directions to a certain destination are recorded as images and comments of important points such as junctions, intersections, and landmarks, and the time required to reach the destination is recorded as image data by timer shooting. A description will be given of an application example to a navigation function that can automatically guide a road by playing the timer. Since the device configuration, control flow, and the like of the second embodiment are the same as those of the first embodiment, description thereof will be omitted.

FIG. 9 is a diagram showing a display example of a reproduced image in the second embodiment. However, in the case of the second embodiment, information 602 and 702 regarding the application include
It is stored as navigation information. Also, the display example shown in FIG. 9 is an example in which another application is not executed during the reproduction of the frame image and during the reproduction of the frame image.

In FIG. 9, reference numeral 901 denotes a display immediately after the timer reproduction is selected, in which a comment such as a destination and a means of transportation until reaching the destination is displayed. It is assumed that these comments have been input by the photographer in advance by character input using the handwriting tablet 110 during shooting. Here, the “OK” area 90 on the screen 901
When 1a is touched with a pen or the like, timer playback as a navigation function is started.

Reference numeral 902 denotes a display screen immediately after the start, and displays the first captured image, in this embodiment, the image of the nearest station. In the comment displayed below the image, guidance such as the direction to go first from the station is shown.
If the user touches the "confirmation" area 903, the counting operation (steps S513 and S514 in FIG. 5) starts according to the value of the counting data added to the image data.
As shown in FIG. 3, while the same image as 902 is displayed,
Information 903a of the time set in the timer 115 and the time counted up to the present is displayed in the upper right portion of the screen. When the time set in the timer 115 elapses in this way, as shown at 904, the next screen, that is, the second captured image is displayed. here,
The image switches to the first intersection. The comment on this screen 904 indicates the description of the mark, the direction to proceed, and the like. Subsequently, when the “confirmation” area 904 a is touched, the elapsed time is displayed as in the case of 903, and the display switches to the next screen when the time measurement by the timer 115 ends. Then, as shown on the screen 905, the display of the last video, that is, the video of the destination is displayed.
When 5a is touched, the timer reproduction operation ends.

As described above, according to the second embodiment, an incomprehensible intersection or a route appears as video information in the same time lapse as actually walking, so that the route to the destination is easily confirmed. You can surely reach your destination without getting lost.

Needless to say, this embodiment can be used for car navigation. In the case of a car, a slight time error occurs due to the timing of a signal, the degree of road congestion, and the like. However, such a time lag can be sufficiently corrected by an operation performed by the operator to specify a “confirmation” area. Things.

[Third Embodiment] In the first and second embodiments, the timer reproduction operation is also performed after the image confirmation operation by the operator is completed, that is, while the timer 115 is performing the counting process. Although the display of the displayed image has been continued, the present invention is not limited to this.

In the case of a battery-powered portable camera as shown in the first and second embodiments, power consumption is large while an image is displayed on a display device, and a timer is used to display a time value. When the display is continuously performed as described above, the consumption of the battery becomes particularly severe.

Therefore, in the third embodiment, after the operator performs the operation of checking the timer playback image, the power of the device is automatically turned off until the next playback image after the time-up is displayed. An example in which power saving is performed will be described.

FIG. 10 is a flowchart for explaining the timer playback operation in the digital camera according to the third embodiment. Note that the configuration of the digital camera of the third embodiment is the same as that of FIG. 1 described above, and a description thereof will be omitted.

In FIG. 10, when the power of the camera is turned on (step S1001), step S50 in FIG.
Steps S1002 and S100 as in steps S100 and S510
At 4, the operation mode is checked. here,
Step S10 when the timer playback mode is selected
02, the flow advances to step S1003 to execute timer shooting processing, that is, the above-described steps S503 to S508 in FIG.
Are performed in the same manner as described with reference to FIG.

If it is determined in step S1004 that the timer reproduction operation has not been selected, the process proceeds to step S1004.
Proceeding to 1017, a process of a normal camera operation similar to that in step S520 of FIG. 5 is executed.

If it is determined in step S1004 that the timer playback operation has been selected, the process proceeds to step S1.
The routine proceeds to 005, and waits until the operator issues a timer reproduction start instruction. Here, when an instruction to start timer playback is input by the operator using the handwriting tablet 110 or the like, the process proceeds to step S1006, and the process proceeds to step S100 in FIG.
As in 511, a pointer is set at the position of the first frame image to be reproduced.

In steps S1007 and S1008, similarly to steps S512 and S513 in FIG. 5, the timer value read from the frame image data pointed by the pointer is set in the timer 115.
The counting by the timer 115 is started. Then, the process proceeds to step S1009, in which the power of the digital camera is turned off to reduce power consumption. The term “power-off” used herein means that the timer 115 maintains an operating state for the counting process, and the CPU waits for an interrupt so that the CPU 115 can immediately start up upon detecting a time-up signal from the timer 115. It has become. In addition, the camera module, the display unit 113
Since these devices consume large power, they are in a state in which operation and power supply are completely stopped.

As described with reference to FIG. 1, the control of the power supply is performed by giving a control signal 118 to the DC / DC converter 117 so that the CPU controls each output power.

During this OFF state, step S
In 1010, when the end of counting of the timer value (time-up) by the timer 115 is detected,
An interrupt signal is output to the step 101, and a step S1018
Proceed to. In step S1018, the power is turned off at this point.
Whether the FF has been set, that is, while the timer 115 is counting the timer value while the power is off,
It checks whether the operator has turned on the power and is not executing another application. Here power supply O
If it is determined that the power supply is in the FF state, the process proceeds to step S1011.
Perform necessary initialization processing. Next, step S10
In step 12, the reproduction operation process described with reference to FIG. 4 is performed, and the frame image currently designated by the read pointer is displayed.

Thereafter, steps S1013 and S101
4, the processing of S1015 and S1016 is performed in the same manner as steps S516, S517, S518 and S519 in FIG. That is, the apparatus waits while displaying the reproduced image until a confirmation instruction is issued, and when the confirmation instruction is detected, checks whether there is a next frame image to be reproduced. When there is no frame image to be reproduced, end processing is performed, and when there is a next frame image to be reproduced, processing for advancing the read pointer to the position of the next frame image is performed. Then, the process returns to step S1007 again, and the timer 1154
, And the process of reproducing the frame image is repeatedly executed.

If it is determined in step S1018 that the power is not off, that is, that execution of another application is being performed, step S1019 is executed.
Proceed to. In step S1019, the application being executed is temporarily interrupted, and a process is performed to raise the warning display to indicate that the reproduction time of the next frame image has come, and the process proceeds to step S1020.

If the operator instructs to reproduce the next frame image, step S
The process advances from step 1020 to step S1012 to execute the above-described image reproduction processing. If an operation to instruct to skip the reproduction of the next image is performed, the process proceeds from steps S1020 and S1021 to S1014, and the next frame image to be reproduced in step S1014 is not performed without reproducing the image. Proceed to the check process to see if there is any. In other words, the currently running application is continuously executed until the reproduction time of the next image comes. If cancellation of the timer playback operation is instructed, the process proceeds to step S1016 through step S1020, S1021, and S1022, and the currently executed application is continuously executed.

As described above, one frame image is reproduced and displayed, and after the operation of confirming the image is completed, the timer 1 is turned off (the display is turned off) while the power is turned off.
By executing the count operation by 15 and detecting the time-up by the timer 115, the power is turned on again and the next frame image is reproduced, so that the total power consumption can be reduced and the battery consumption can be reduced. it can.

It is also effective not to turn off the power of the whole system during the counting operation of the timer 115 but to perform control to turn off only the operation of the camera module and the display unit 113 which consume a particularly large amount of power. Needless to say,

[Fourth Embodiment] In the first, second, and third embodiments, the "timer value" added to an image to determine the image playback interval is automatically set at the time of shooting as a timer shooting operation. Has been described as an example that is added to
The present invention is not limited to this.

In the fourth embodiment, an example will be described in which the "timer value" to be added to an image is manually added by an operator at the time of capturing an image.

FIG. 12 is a flowchart showing the entire operation of the digital camera according to the fourth embodiment of the present invention. In FIG. 12, steps S501, S502, S
506, S508, S509, S510, S520
This is the same as each processing in FIG.

First, in step S501, when the power of the digital camera is turned on, the flow advances to step S502 to check the operation mode. In this step S502,
If the “timer shooting mode” is selected, the process proceeds to step S506, and the shooting operation processing described with reference to FIGS. 2 and 3 is performed. When the shooting of one frame image ends, that is, when the generation of the shot frame image data ends, the process advances to step S1201 to input the “timer value” by the operator. Next, step S1202
Then, the timer value input in step S1201 is added to the frame image data generated in step S506.

Then, the flow advances to step S1203 to check whether text data is added to the image data. Whether to add the text data can be arbitrarily selected by the operator. here,
If text data is to be added, step S120
Proceed to 4 to perform text input processing. In the text input process, input can be performed on the handwriting tablet 110 by a handwritten character recognition process using a pen or the like. Then, the process advances to step S1206 to perform a process of adding the input text data to the image data, and then advances to step S508. The structure of the image data to which the text data is added is as described with reference to FIG. If it is determined in step S1203 that text input has not been selected, the process proceeds to step S508.

In step S508, it is checked whether or not the end of the timer shooting operation has been instructed by the operator. If so, the end process of step S509 is executed, and if the end instruction has not been issued, that is, If the photographing is to be continued, the flow returns to the image photographing process in step S506 again, and the photographing operation is repeated.

By the above processing, the time information to be waited when reproducing from the immediately preceding photographed image data (the immediately preceding frame) to the current photographed image data (the current frame) must be manually set by the operator. Can be.

If the timer shooting mode has not been selected, steps S502 to S510 are performed.
Then, it is checked whether the timer reproduction mode is selected. If the timer playback mode is selected in step S510, the processing of the timer playback operation in step S1207 is executed. This timer reproduction process is performed in steps S511 to S51 described with reference to FIG.
9, processing similar to the processing from S521 to S526.

If the timer playback mode is not selected in step S510, the process proceeds to step S5
Proceeding to 20, the normal camera operation is performed.

FIG. 13 is a diagram showing a data structure in which text data is added as additional information to one frame of image data stored in the data storage unit 104 after photographing. The text data is, for example, an arbitrary character string or text representing an image description, a title, or the like, and is obtained by performing character recognition or the like on the handwritten input from the handwritten tablet 110 as described above. 13, 601 to 604 in FIG.
This is the same data as. Reference numeral 1301 denotes an area where the added text data is stored.

Next, in the timer photographing operation according to the fourth embodiment, FIGS.
01, an example of a display screen for inputting a timer value and text by the operator as described in S1204 is shown.

FIG. 14 shows an example in which the timer input area and the text input area are simultaneously displayed on one screen. The operator can input a timer value or text data by directly writing a data value into these areas with a pen or the like.

Referring to FIG. 14, reference numeral 1401 denotes a display area of the entire screen; 1402, an area displaying a captured image; 1403, an area for inputting text;
04 is an area for inputting the “time” of the timer value, 1405
Is an area for inputting the timer value “minute”, and 1406 is an area for inputting the timer value “second”.

FIG. 15 is an example of a screen display when a timer value and text data are sequentially input in an interactive manner.

In FIG. 15, reference numeral 1501 denotes a screen on which image data is reproduced and displayed immediately after a frame image is shot. If an action for proceeding to the next operation is performed by touching a pen or operating a key, a screen 1501 is displayed. As shown in 1502, a timer value input screen is displayed. After the input of the timer value is completed, when an action for proceeding to the next is operated, the screen is switched to a screen display for text input as indicated by 1503.

In the first, second, third and fourth embodiments, in the timer reproduction operation, when the counting of the timer value ends, that is, when the reproduction time of the next image comes, a warning message is issued. Described an embodiment in which a notification pops up on a display to notify the operator, but the present invention is not limited to this, and a notification method (for example, a screen It is needless to say that the same effect can be obtained by changing the color, the contrast, or the blinking display. It is needless to say that the same effect can be obtained by using a sound such as a buzzer or another synthesized sound as a notification means for warning.

As described above, according to the first and second embodiments, the timer means for measuring the elapsed time from the photographing operation (photographed image data generation) to the next photographing operation is provided. A means for inserting or associating elapsed time data measured from the immediately preceding photographing operation into image data and providing a means for automatically switching reproduced images at intervals according to time information generated during photographing during reproduction. Depending on the event or series of work,
Especially for the purpose of time information occupying an important element such as cooking and directions, the reproduction of multiple captured image data is performed in real time, which has a great effect on realism and intelligibility and simplifies operation. There is also an advantage that it can be converted.

According to the third embodiment, the power of the device is automatically turned off while the timer is counting, and automatically turned on when the time is up, and then the next image is reproduced. By doing so, there is an effect that power consumption can be reduced.

Further, by controlling such that another application can be executed even while the timer is counting, the device can be used without any trouble during the waiting time of the timer counting. When the playback time of the next frame image comes, a warning message is displayed, and at the same time, the application can be smoothly interrupted and continued by allowing the operator to select the subsequent processing. On the other hand, there is an effect that troubles such as the frame image not being reproduced or the application being abruptly interrupted can be avoided.

Further, since the image reproducing apparatus of the above embodiment can be applied to the recording of the cooking procedure, etc., by accumulating the reproduced food and its date, the image reproducing apparatus can be used for a certain period (for example, one week, one month). It goes without saying that it is possible to make the user recognize how many times the same cooking procedure has been seen. Such an application also serves to prevent the rut of cooking.

Further, even if the present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, and the like), a single device (for example, a copying machine, a facsimile, etc.) Device).

Further, an object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or the apparatus.
And MPU) reads and executes the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM,
DR, magnetic tape, nonvolatile memory card, ROM
Etc. can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0129]

As described above, according to the present invention,
The image can be reproduced according to the time information added to the image while maintaining the flexibility of the operation. Further, according to the present invention, it is possible to effectively balance the reproduction according to the time information added to the image and the execution of another application.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a digital camera according to a first embodiment.

FIG. 2 is a flowchart illustrating a control procedure of a camera photographing operation performed by a CPU.

FIG. 3 is a flowchart illustrating an interrupt process occurring in the flowchart of FIG. 2;

FIG. 4 is a flowchart illustrating a control procedure of a camera reproducing operation performed by a CPU.

FIG. 5 is a flowchart illustrating a control procedure of timer shooting and playback operations according to the first embodiment.

FIG. 6 is a diagram illustrating an example of a data structure of a captured image according to the first embodiment.

FIG. 7 is a diagram illustrating another example of the data structure of a captured image according to the first embodiment.

FIG. 8 is a diagram illustrating an application example to an application according to the first embodiment.

FIG. 9 is a diagram illustrating an application example to an application according to the second embodiment.

FIG. 10 is a flowchart illustrating a control procedure of timer shooting and playback operations according to the third embodiment.

FIG. 11 is a diagram illustrating an application example to an application according to the third embodiment.

FIG. 12 is a flowchart illustrating a control procedure of timer shooting and playback operations according to a fourth embodiment.

FIG. 13 is a diagram illustrating an example of a data structure of a captured image according to a fourth embodiment.

FIG. 14 is a diagram illustrating an example of an operation screen according to the fourth embodiment.

FIG. 15 is a diagram illustrating another example of the operation screen according to the fourth embodiment.

[Explanation of symbols]

 101 CPU 102 ROM 103 RAM 104 Data storage unit 105 Lens group 106 CCD 107 CCD control unit 108 Image processing unit 109 Tablet control unit 110 Handwritten tablet 111 LCD control unit 112 Display drive unit 113 Display unit 114 Shutter SW 115 Timer 116 Battery 117 DC / DC converter

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 J F term (Reference) 5C022 AB00 AB15 AB40 AC03 AC13 AC32 AC42 AC69 AC73 5C053 FA06 FA08 GB06 GB36 HA40 JA22 KA04 KA05 KA08 KA20 KA24 LA01 LA06 5E501 AA02 AA30 AC15 BA05 BA14 CA04 CB01 CB03 CB06 CB11 EA12 EB05 FA14 FB34

Claims (19)

[Claims] 1. An image reproducing apparatus for reproducing and displaying an image based on image data, comprising: storage means for storing time information in association with each image data; and reproducing and reproducing and displaying the stored image data. Means, based on the stored time information, determining means for determining the arrival of a display switching time of image data reproduced and displayed by the reproducing means, and determining that the display switching time has arrived by the determining means. And a notifying means for notifying the user when the image is reproduced. 2. An image processing apparatus according to claim 1, further comprising: an execution unit configured to execute a desired application while the reproduction unit displays the image, wherein the notification unit displays an image to be reproduced and displayed while the application is being executed by the execution unit. 2. The image reproducing apparatus according to claim 1, wherein when the switching time has arrived, the arrival of the display switching time is notified. 3. The image processing apparatus according to claim 1, further comprising a display switching unit configured to switch an image to be reproduced and displayed when a display switching time of an image to be reproduced and displayed arrives while an application is not being executed by the execution unit. The image reproducing apparatus according to claim 2, wherein 4. The display switching means executes switching of an image to be reproduced and displayed when an instruction to switch the display is issued while the arrival of the display switching time is notified by the notifying means. The image reproducing device according to claim 3. 5. After the image reproduced and displayed by the display switching unit is switched by the display switching unit, the determination unit waits for a predetermined operation by a user and starts time measurement until a next switching time. The image reproducing device according to claim 3 or 4, wherein 6. The power for controlling the power consumption of the image reproducing apparatus to be reduced from the time when the determination unit starts measuring the time until the next image switching time until the time when the next image switching time comes. The image reproducing apparatus according to claim 5, further comprising a control unit. 7. The image reproducing apparatus according to claim 6, wherein the power control unit reduces power consumption by prohibiting the reproduction display unit from displaying and displaying an image. 8. An image pickup apparatus comprising the image reproduction apparatus according to claim 1. Description: 9. An image capturing means for storing a captured image on a storage medium in accordance with an image capturing operation, and a time information storing means for storing image data stored by the image capturing means in association with time information when the image data was captured. The imaging device according to claim 8, further comprising: 10. The time information storage means, at the time of imaging,
The imaging device according to claim 9, wherein a time indicated by a clock incorporated in the imaging device is stored as time information. 11. The time information storage means includes:
The imaging device according to claim 9, wherein time information input by a user is stored. 12. An image reproducing method for reproducing and displaying an image based on image data, comprising: a reproducing step of storing time information in association with each image data, reading out the stored image data, and reproducing and displaying the image data; Based on the stored time information, a determining step of determining the arrival of the display switching time of the image data reproduced and displayed by the reproducing step, and when it is determined that the display switching time has arrived by the determining step, And a notifying step of notifying the user of the image. 13. An image processing apparatus, further comprising an execution step of executing a desired application while displaying an image in the reproduction step, wherein the notifying step includes displaying an image to be reproduced and displayed while the application is being executed by the execution step. 13. The image reproducing method according to claim 12, wherein when the switching time has arrived, the arrival of the display switching time is notified. 14. A display switching step for switching an image to be reproduced and displayed when a display switching time of an image to be reproduced and displayed arrives while an application is not being executed in the execution step. The image reproducing method according to claim 13, wherein: 15. The display switching step executes switching of an image to be reproduced and displayed when an instruction to switch the display is given while the arrival of the display switching time is notified by the notification step. 15. The image reproducing method according to claim 14, wherein: 16. The determination step is characterized in that after an image reproduced and displayed in the display switching step is switched, a predetermined operation by a user is waited and time measurement until a next switching time is started. The image reproducing method according to claim 14 or 15, wherein 17. The power for controlling to reduce the power consumption in the image reproducing method from the time when the determining step starts measuring the time until the next image switching time until the time when the next image switching time comes. 17. The image reproducing method according to claim 16, further comprising a control step. 18. The image reproducing method according to claim 17, wherein in the power control step, power consumption is reduced by prohibiting reproduction and display of an image in the reproduction and display step. 19. A storage medium for storing a control program for causing a computer to reproduce and display an image based on image data, wherein the control program stores time information in association with each image data. A code for a reproducing step of reading and reproducing and displaying the image data obtained, and a code for a determining step of determining, based on the stored time information, the arrival of a display switching time of the image data reproduced and displayed in the reproducing step. And a notifying step code for notifying when the display switching time has arrived in the determining step.