JP4250274B2 - Image reproduction method and apparatus, and imaging apparatus - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image reproducing method and apparatus for storing captured images, and for reading out and displaying the stored images, and an imaging apparatus including the image reproducing apparatus.
[0002]
[Prior art]
Conventionally, for example, in a digital camera, when image data of a plurality of frames is stored in a built-in disk, memory, or the like, an operator's key is used to continuously reproduce and display the image data of the plurality of frames. Depending on the operation, etc., the stored image data of each frame is sequentially read and displayed for reproduction, or the image data of each frame is automatically read and reproduced at a preset time interval. It was.
[0003]
[Problems to be solved by the invention]
However, in the continuous reproduction display by the conventional digital camera, the image of each frame is reproduced at a preset time interval. For this reason, for example, when playing back a plurality of image data taken with the passage of time in one event or work, it is continuously reproduced and displayed regardless of the actual passage of time. There has been a problem that the passage of time between displayed frame images is unknown.
[0004]
In order to be able to read the time lapse between each frame at the time of reproduction, for example, immediately after shooting, processing of inserting the elapsed time information into the image data by the operator's hand or associating it with the elapsed time. A method is also conceivable in which the given time information is displayed together with the image when the frame image is reproduced.
[0005]
Alternatively, if the time information input by the operator is cumbersome to operate, the elapsed time taken by the built-in timer or the like is measured when the image data is taken, and the measurement time is automatically inserted into the image data. Alternatively, a method of performing association is also conceivable. However, there is a problem in that it is difficult to sensuously grasp the passage of time only by displaying these time information during the reproduction of each frame.
[0006]
As a means for solving this problem, a playback method may be considered in which display of image data is switched according to the interval of time information inserted or associated during image capture when each frame of the captured image is reproduced. It is done. However, in such a playback method, during the series of playback cycles, it is not possible to execute other applications such as shooting other images, organizing images, and inputting information. When the elapsed time until the image is long, there is a problem that the use of the device is hindered.
[0007]
In order to solve this problem, it is possible to interrupt the playback of the currently displayed image even during the playback cycle and allow other applications to be executed. When time runs out, the currently running application may be interrupted suddenly. In addition, when priority is given to an application that is currently being executed, there is a problem in that the next reproduced image is skipped.
[0008]
The present invention has been made in view of the above conventional example, and it is possible to reproduce an image according to time information added to the image while maintaining flexibility of operation.
[0009]
Another object of the present invention is to effectively achieve both reproduction according to time information added to an image and execution of another application.
[0010]
[Means for Solving the Problems]
  In order to achieve the above object, an image reproduction apparatus according to the present invention comprises the following arrangement, for example. That is,
  An image reproduction apparatus for reproducing and displaying an image based on image data,
  Storage means for storing each image data in association with time information;
  Playback means for reading out and playing back the stored image data;
  Execution means for executing an application during display of an image by the reproduction means;
  Determining means for determining the arrival of the display switching time of the image data reproduced and displayed by the reproducing means based on the stored time information;
  While the application is being executed by the execution means,When it is determined by the determination means that the display switching time has arrived,The display switching time has arrivedTo informMessage on display meansAn informing means.
[0011]
  The image reproduction method of the present invention that achieves the above object includes the following steps, for example.Have. That is,
  An image reproduction method for reproducing and displaying an image based on image data,
  Reproduction process of storing time information in association with each image data, reading out and reproducing the stored image data, and
  An execution step of executing an application during display of an image by the reproduction step;
  A determination step of determining arrival of a display switching time of the image data reproduced and displayed by the reproduction step based on the stored time information;
  While the application is being executed by the execution step,When it is determined by the determination step that the display switching time has arrived,The display switching time has arrivedTo informMessage on display meansNotification processHave.
[0012]
In addition, according to the present invention, there is provided an imaging apparatus provided with the above image reproducing apparatus.
Furthermore, according to the present invention, there is provided a storage medium for storing a control program for causing a computer to realize the image reproduction method.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
[0014]
In this embodiment, a digital camera that captures and stores video and reproduces it will be described. However, for example, such video is captured and stored, or video data is stored. Needless to say, the present invention can also be applied to an image pickup apparatus, a reproduction apparatus, and the like that set a medium and reproduce the medium.
[0015]
[First Embodiment]
FIG. 1 is a block diagram showing a schematic configuration of a digital camera according to the first embodiment of the present invention.
[0016]
In FIG. 1, reference numeral 101 denotes a CPU (Central Processing Unit), and the operation of the digital camera is controlled by the CPU 101. The CPU 101 includes a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a data storage unit 104, an image processing unit 108, a tablet control unit 109, an LCD control unit 111, a shutter SW 114, A timer 115 and a DC / DC converter 117 for supplying power are connected to each other.
[0017]
A CCD control unit 107 is connected to the image processing unit 108, and a CCD 106 is connected to the CCD control unit 107. A handwritten tablet 110 is connected to the tablet control unit 109. A display driving unit 112 is connected to the LCD control unit 111, and a display unit (TFT color liquid crystal) 113 is connected to the display driving unit 112. Further, power is supplied from the battery 116 to the DC / DC converter 117.
[0018]
The CPU 101 performs various controls based on a control program in the ROM 102. The process realized by this control program includes “a process for reading a captured image signal output from the image processing unit 108 and performing DMA transfer to the RAM 103”, “a process for performing DMA transfer of data from the RAM 103 to the LCD control unit”, and , “Process for JPEG compression of image data and storing in file format in file format 104”, “Execution of various applications according to information input from handwritten tablet 110”, and “Operation of shutter SW 114” Accompanying shooting operation instruction ”,“ timer processing of shooting operation interval by timer 115 ”,“ processing such as image switching processing during playback according to time setting of timer 115 ”, and“ supplying power to each element ” A control signal for controlling the DC / DC converter 117 It includes processing "for outputting.
[0019]
The RAM 103 includes an image development area 103a, a work area 103b, a VRAM 103c, and a temporary save area 103d. The image development area 103a is a temporary buffer for temporarily storing the captured image (YUV digital signal) sent from the image processing unit 108 and the JPEG compressed image data read from the data storage unit 104. Used as an image-dedicated work area for image compression processing and decompression processing. The work area 103b is a work area for various programs. The VRAM 103 c is used as a VRAM that stores display data to be displayed on the display unit 113. The temporary save area 103d is an area for temporarily saving various data.
[0020]
The data storage unit 104 is a memory for storing captured image data JPEG-compressed by the CPU 101 or various attached data referred to by an application in a file format. In the first embodiment, the data storage unit 104 is configured by a flash memory. Is done.
[0021]
The lens group 105 includes a plurality of lenses for optically projecting a subject image onto the CCD 105. A CCD (photoelectric conversion element) 106 is an element for converting a captured image projected by the lens group 105 into an analog electric signal. The CCD control unit 107 is a timing generator for supplying a transfer clock signal and a shutter signal to the CCD 106, a circuit for performing noise removal and gain processing of the CCD output signal, and for converting an analog signal into a 10-bit digital signal. A / D conversion circuit and the like. Further, the image processing unit 108 performs image processing such as gamma conversion, color space conversion, white balance, AE, and flash correction on the 10-bit digital signal output from the CCD control unit 107, and YUV (4: 2: 2) An 8-bit digital signal is output in the format. These lens group 105, CCD 106, CCD control unit 107, and image processing unit 108 are collectively referred to as a camera module hereinafter.
[0022]
The tablet control unit 109 performs control for driving the handwritten tablet 110 and converting various information input by pen touching into a digital signal and transferring it to the CPU 101.
[0023]
The LCD control unit 111 receives the YUV digital image data transferred from the image processing unit 108 or the YUV digital image data obtained by performing JPEG decompression on the image file in the data storage unit, converts it into an RGB digital signal, and displays it. Processing to output to the drive unit 112 is performed. The display driving unit 112 performs control for driving the display unit 113. The display unit 113 is a display for displaying an image. In this example, the display unit 113 is a TFT liquid crystal display device of VGA standard (640 × 480 dots).
[0024]
The shutter SW 114 is a switch for instructing the start of the photographing operation. The shutter SW 114 has two switch positions depending on the pressing pressure of the switch. Locking of camera settings such as white balance and AE is detected by detecting the first position (weak pressing pressure—hereinafter referred to as “half pressing position”). The operation is performed, and the capture signal capturing operation is performed by detecting the second stage position (strong pressing pressure—hereinafter referred to as “shutter ON position”).
[0025]
The timer 115 starts time counting in response to an instruction from the CPU 101 and transmits the value counted up to that point in response to a request from the CPU 101. Also, the timer 115 starts time counting in response to an instruction from the CPU 101. At that time, the CPU 101 is notified of the time-up.
[0026]
The battery 116 is a rechargeable secondary battery or a dry battery. The DC / DC converter 117 receives a power supply from the battery 116, generates a plurality of power supplies by performing boosting and regulation, and supplies a power supply of a necessary voltage to each element including the CPU 101. The DC / DC converter 117 can control the start and stop of each voltage supply by a control signal 118 from the CPU 101.
[0027]
Hereinafter, the procedure of the camera operation according to the first embodiment of the present invention will be described with reference to the flowcharts shown in FIGS.
[0028]
FIG. 2 is a flowchart showing the flow of the viewfinder function in the shooting operation mode in the digital camera of the first embodiment.
[0029]
First, in step S201, when the power of the digital camera is turned on or the photographing operation mode is turned off, the process proceeds to step S202, and the CCD module including the CCD 106 and the CCD control unit 107 can be operated (enable). To. Subsequently, the process proceeds to step S203, and an operation for causing the display unit 113 to function as an electronic viewfinder for confirming the subject at the time of shooting is started.
[0030]
Next, with reference to steps after step S204, a continuous process until the video captured from the camera module is displayed on the display unit 113 will be described.
[0031]
In step S <b> 204, a process of converting light information of the subject captured from the camera lens group 105 into an electrical signal by the CCD 106 is performed. This output signal is a non-interlaced analog signal, and in order to increase the processing speed, data of a reduced size of 320 × 240 dots is output by a thinning process instead of a total pixel of 640 × 480 dots. In step S205, the signal captured in step S204 is subjected to noise removal processing and gain processing by the CCD control unit 107, A / D converted into a 10-bit digital signal, and then sent to the image processing unit. In step S206, the image processing unit 108 performs processing such as auto white balance, AE, and correction during strobe shooting, or processing such as signal conversion into the YUV (4: 2: 2) format.
[0032]
The signal YUV-converted by the image processing unit 108 is written by the CPU 101 to the VRAM 103c that stores the display image data, and is output to the LCD control unit 111 constantly using DMA. In step S207, the LCD control unit 111 converts the received YUV signal into an RGB digital signal, and then outputs the RGB signal to the display driving unit 112 in step S208. In response to the output signal from the display drive unit 112, the subject image is displayed on the display unit 113 in step S209.
[0033]
As described above, the image captured by the CCD 106 is constantly monitored on the display unit 113 by continuously looping the process from step S204 to step S209 in a cycle of 1/30 (1/30) second.
[0034]
If a key operation by the photographer is detected during the processing loop displaying this video, an interrupt signal associated with the key operation is output to the CPU 101 and an interrupt event occurs, as shown in FIG. Processing shifts to interrupt processing A.
[0035]
FIG. 3 is a flowchart showing a control procedure for interrupt processing generated by a key operation during display of a captured image performed in steps S204 to S209 described above.
[0036]
At the stage where this key operation occurs, the state is in one of two modes internally. One is a normal mode in which a display operation on the viewfinder (display unit 113) described in FIG. 2 is performed. The other is a “half-press mode” which is shifted by setting the shutter SW 114 to the half-press position. The display on the display unit 113 is performed when the shutter SW 114 is half-pressed and various camera settings are locked. Mode. In FIG. 3, the process start step is divided into two cases: a process from the normal mode and a process from the “half-press mode”.
[0037]
First, step S301 is a key status reading process for checking which key operation is performed in the interrupt process from the normal mode. If it is detected in step S302 that the shutter SW 114 is at the shutter ON position based on the key status, the process proceeds to step S303. In step S303, various camera settings controlled in the image processing unit 108, such as auto white balance, AE, and flash correction in the case of flash photography, are locked with the current setting values. Subsequently, the process proceeds to step S316, and the operations of the display drive unit 112 and the display unit 113 are stopped in order to reduce the processing load on the CPU.
[0038]
Now, as shown in the description of the flowchart of FIG. 2, in order to increase the processing speed in the viewfinder display processing, only the signal of the number of pixels of the thinned image obtained by thinning out the original number of pixels of the CCD 106 is captured. As an image to be taken, image signals from all pixels of the CCD 106 of the VGA standard (640 × 480 dots) are necessary. Accordingly, in step S317, capture signals of the number of VGA pixels are captured, and after predetermined processing in the image processing unit 108, YUV signal data is written into the image development area 103a in the RAM 103.
[0039]
In step S318, the digital image data is subjected to image compression processing conforming to the JPEG standard, and then in step S319, the compressed data is written as an image file in the data storage unit 104 (flash memory in this example). . Thereafter, the process proceeds to step S320, and the display drive operation of the display unit 113 that has been stopped is restarted. In step S321, the image data is displayed on the display unit 113 for a predetermined time so that the photographed image can be confirmed. Then, in step S322, the interruption process is terminated, and the loop of steps S204 to S209 in FIG. 2 is performed again. Return to the above and resume the viewfinder process described above.
[0040]
On the other hand, if not the shutter ON position but the shutter half-pressed position is detected from the key status read in step S301 (step S304), the process proceeds to step S305. In step S305, the state setting inside the digital camera is set to “half-press mode”. Next, proceeding to step S306, as in step S303, various camera settings in the image processor, such as auto white balance, AE, and flash correction in the case of flash photography, are locked with the current setting values. Thereafter, the process proceeds to step S307, the interrupt process is terminated, and the process returns to the loop of steps S204 to S209 in FIG.
[0041]
If it is determined in step S304 that the shutter release position is not half-pressed, the process proceeds to step S308 to check whether or not a key for changing the shooting condition is pressed. If so, the process proceeds to step S309. In step S309, according to the key operation, various camera settings controlled in the image processing unit 108 such as auto white balance, AE, and strobe correction in the case of strobe shooting are set according to the key operation. To correct. Thereafter, the process proceeds to the return process of step S307.
[0042]
If the key status read in step S301 indicates that the OFF key (power OFF) has been pressed, the process proceeds to step S311 via step S310. In step S311, the display driving operation is terminated. Next, in step S312, the operation of the CCD module is terminated. In step S313, the other photographing operation is terminated, and then the system power-off process is performed. . If no OFF key is detected in step S310, no valid key or switch has been detected, and no processing is performed, and the return process in step S307 is executed.
[0043]
Next, the flow of interrupt processing in the “half-press mode” will be described with reference to step S314 and subsequent steps.
[0044]
Step S314 is a key status reading process for checking which key operation is pressed in the interrupt process in the “half-press mode”. If it is detected in step S315 that the shutter switch 114 has been pressed, the process proceeds to step S316, and various camera settings (in the image processing unit 108 locked by the previous half-press key detection (step S304)) ( While the step S306) remains valid, the process proceeds to the photographing process (described above) after the step S316.
[0045]
On the other hand, if the key status read in step S314 is not ON of the shutter key, the process proceeds to step S323 to check whether the half-press is released. If so, the process proceeds to step S324, the digital camera state setting is canceled from the “half-press mode”, and the process proceeds to the return process in step S322. If the half-press release key is not detected in step S323, it means that no valid key or switch has been detected, and no process is performed, and the process proceeds to the return process in step S322.
[0046]
Next, image data reproduction processing according to the present embodiment will be described.
FIG. 4 is a flowchart showing a flow of processing in the reproduction operation mode for reading out the image data stored in the data storage unit 104, reproducing it, and displaying it on the display unit 113.
[0047]
First, in step S401, when the camera is turned on or the switch is switched to the reproduction operation mode, the process proceeds to step S402, and the operation of the display unit 113, which is an electronic viewfinder for confirming the subject at the time of shooting, is started. . In step S403, the compressed image data written in step S319 (shooting operation) in FIG. 3 is read from the data storage unit 104 (flash memory) and written in the image development area 103a in the RAM 103, for example.
[0048]
In step S404, image decompression processing, that is, processing for converting compressed data compliant with the JPEG standard into original data (YUV data) is executed. In step S405, the decompressed frame image data is written into the VRAM 103c that stores the display image data.
[0049]
Thereafter, similarly to the processing from step S207 to step S209 in FIG. 2, first, in step S406, the received YUV signal is converted into an RGB digital signal. Then, the process proceeds to step S407, and the display driving unit 112 receives the RGB signal. Output a signal. In step S408, the read frame image is reproduced and displayed on the display unit 113 that has received the output signal from the display driving unit 112.
[0050]
Next, the overall operation of the digital camera according to the first embodiment of the present invention will be described based on the flowchart shown in FIG.
[0051]
In FIG. 5, when the digital camera is turned on in step S501, the process proceeds to step S502 to check the operation mode. If the “timer shooting mode” that is a feature of the present embodiment is selected in step S502, the process proceeds to the timer shooting operation processing in step S503 and subsequent steps. On the other hand, if the “timer shooting mode” is not selected, the process advances to step S510 to check whether the “timer reproduction mode” is selected. Here, when the “timer reproduction mode” is selected, the process proceeds to the timer reproduction operation processing from step S511. If neither mode is selected, the process advances to step S520 to execute a camera operation that is normal shooting and reproduction.
[0052]
Hereinafter, the process of the timer photographing operation will be described with reference to steps S503 to S509.
[0053]
If the “timer shooting mode” is selected, the process proceeds to step S503, where the operator waits for an input of a timer shooting start instruction. Here, for example, when this instruction is given from the handwritten tablet 110 or the like, the process proceeds to step S504. In step S504, after the count value initialization process of the timer 115 is performed, the process proceeds to step S505, and the time count process by the timer 115 is started. In step S506, the shooting operation process described with reference to FIGS. 2 and 3 is performed. When shooting of one frame image is completed, that is, generation of shot frame image data is completed, the process proceeds to step S507, and the count value counted by the timer 115 up to that point is read from the timer 115, and the generated frame image data Append to
[0054]
Next, in step S508, if the operator instructs the end of the timer shooting operation, the end process of step S509 is executed. If the end instruction is not issued, that is, if shooting is continued, step S504 is performed again. The processing returns to the initialization processing of the count value of the timer 115 and the photographing operation is repeated.
[0055]
Through the processing described above, the count value of the timer 115 is automatically captured during the shooting operation as time information required from the previous shooting operation (previous frame) to the current shooting operation (current frame). Control added to each frame image data is performed.
[0056]
Next, the timer playback operation process will be described.
[0057]
If “timer playback mode” is selected in step S510, the process proceeds to step S511, and a read pointer is set to the first frame image of the selected image group, that is, the first frame image shot during timer shooting. In step S 512, a timer count value added to or associated with the frame image data at the pointer position where the read pointer is set is read, and the count value is set in the timer 115. The timer 115 in this case is used as a subtraction timer, and the set value is subtracted sequentially from the set value as time elapses. When the time is up, that is, when the time becomes zero (or carry output), the CPU 101 In contrast, a time-up signal is output. In step S513, subtraction of this timer value is started. While the timer is counting, it is in a state of waiting for time-up while the target frame image is displayed. Here, as shown in step 521, another application is executed by a switching operation by a key operation or the like. Is also possible.
[0058]
Here, in step S514, if the timer 115 has timed up and a time-up interrupt signal has been output to the CPU 101, in step S522, it is determined whether another application is currently being executed. If another application has not been executed, that is, if the current frame image is being displayed on the display unit 113, the process proceeds to step S515, and the frame reproduction operation process described with reference to the flowchart of FIG. The designated frame image is displayed on the display unit 113.
[0059]
Thereafter, the process proceeds to step S516 and waits while displaying the reproduced image until a confirmation instruction is issued. If a confirmation instruction by the operator is detected, the process proceeds to step S517, where it is checked whether there is a next frame image to be reproduced. If there is no next frame image to be reproduced, the timer reproduction function end processing in step S519 is performed.
[0060]
On the other hand, if there is still a next frame image to be reproduced in step S517, the process proceeds to step S518, and a process of advancing the read pointer to the position of the frame image data to be reproduced next is performed. Thereafter, the process returns to step S512 again, and the setting of the timer value in the timer 115 and the image reproduction process are repeatedly executed. Whether there is a next frame in step S517 is determined when there are a plurality of frames having the same information relating to the application (602 and 702 in FIGS. 6 and 7 to be described later). It is judged by whether it was done.
[0061]
If it is determined in step S522 that another application is being executed, the process proceeds to step S523. In step S523, the application being executed is interrupted for a moment, and a process for popping up a warning display to indicate that the playback time of the next frame image has come is performed, and the process proceeds to step S524.
[0062]
In step S524, when the operator performs an operation to instruct to reproduce the next frame image, the above-described image reproduction processing in step S515 is executed. On the other hand, if no reproduction instruction is given in step S524, the process proceeds to step S525. If it is determined that an operation for instructing to skip the reproduction of the next image has been performed, the image is not reproduced and a check process of whether there is a frame image to be reproduced in step S517. Proceed to That is, the application currently being executed is continuously executed until the next image reproduction time comes.
[0063]
If the skip instruction is not issued in step S525, the process proceeds to step S526. If it is determined that the cancellation of the timer reproduction operation is instructed here, the process proceeds to the end process in step S519 and is currently executed. The running application continues to run.
[0064]
FIG. 6 is a diagram illustrating a data structure of one frame of image data captured by the digital camera according to the first embodiment and stored in the data storage unit 104. This image data is stored in a data structure conforming to the JPEG standard, and the count value counted by the timer 115 is embedded in the image data as a “timer value”.
[0065]
In FIG. 6, reference numeral 601 denotes a header portion that stores information on the frame image data, and reference numeral 602 denotes an area that stores various information defined by the application. Reference numeral 603 denotes an area in which a count value (timer value) by the timer 115 is stored. When each frame image is reproduced, a “timer value” in this area is read and a subtraction value is set in the timer 115. An area 604 stores JPEG-compressed frame image data.
[0066]
FIG. 7 is a diagram showing a case where the count value “timer value” by the timer 115 is stored in the data storage unit 104 in still another form.
[0067]
Here, unlike FIG. 6, timer values corresponding to each frame image data by the timer 115 are collectively stored in an area 705 different from the image data. Accordingly, in each frame image data, as indicated by reference numeral 703, related information (pointer or the like) indicating the address or state where the timer value by the corresponding timer 115 is stored is stored.
[0068]
In FIG. 7, reference numeral 701 denotes a header part similar to that in FIGS. 6 and 601, 702 denotes an application information storage part similar to 602, and 703 stores information for reading a count value “timer value” for the frame “image 1”. The area that is being shown. The other frame “image 2” and frame “image n” are also stored in the same data structure.
[0069]
Reference numeral 705 denotes an area in which “timer value” is actually stored. 705a is “timer value 1” for “image 1”, 705b is “timer value 2” for “image 2”, and 705c is “ The area where “timer value n” for image “n” is stored is shown.
[0070]
In addition, a method is conceivable in which the frame image data and the timer value are respectively filed and associated by file names. For example, the image file is “image 1.JPG”, “image 2.JPG”..., The timer value data file is “image 1.TMR”, “image 2.TMR”. It is also possible to attach the same file names with different names and treat them as the same group.
[0071]
Next, FIG. 8 shows an application example in the first embodiment.
[0072]
The application described in FIG. 8 shows an application example in which, in the process of making a dish, an intermediate video is shot together with the information of the time progress, and the same dish is made again while reproducing it later. 8 shows a display example of the reproduced image. This application information is stored in information 602 and 702 relating to the application shown in FIGS. The display example shown here is an example in which another application is not executed during the reproduction of the frame image.
[0073]
In FIG. 8, reference numeral 801 denotes an image displayed on the display unit 113 immediately after the timer reproduction is selected, and comments such as the contents of the dish and ingredients are displayed on this screen. It is assumed that these comments are input in advance by the photographer by inputting characters with the handwritten tablet 110 at the time of shooting. Here, when the “OK” area 801a of the screen is touched, timer reproduction for explaining the cooking procedure is started. Reference numeral 802 denotes a display screen immediately after the start, on which the first captured video is displayed.
[0074]
If the “confirm” area 802a is touched here, a counting operation (steps S513 and S514 in FIG. 5) corresponding to the timer value added to the image data of the next frame is started. While the same image as the first screen display (802) is displayed, the time set in the timer 115 and the information 803a of the time counted up to the present time by the timer 115 are displayed in the upper right part of the screen. ing. When the time set in the timer 115 elapses in this way, as shown at 804, the screen is switched to the next screen, that is, the reproduction / display of the frame image taken second. Further, by touching “Confirm” 804a, each frame is reproduced and displayed continuously as in the case of 803, such as displaying the elapsed time and displaying the next frame image when the timer 115 finishes counting. . Then, as shown in the screen 805, the last frame image is displayed, and when the “end” area 805a is touched, the timer reproduction operation is ended.
[0075]
In the application display example described in FIG. 8, another application is not executed during the period from the playback of the frame image to the playback of the next frame image, that is, while the timer is counting down, and only the playback image is displayed. An example is shown. However, during the reproduction of the cooking procedure as shown in FIG. 8, for example, when a newly noticed cautionary note or the like is to be added as a memo, when an intermediate image is newly taken, or stored contents It may also occur when you want to correct or correct a little.
[0076]
As shown in the flowchart of FIG. 5, in this embodiment, the application can be switched even during the timer playback operation, and the playback time of the next frame image comes while another application is being executed. In addition, in order to notify the operator of the time-up, a warning is displayed first, and the interruption or continuation of the application can be selected according to the operator's instruction. An operation when another application is executed during the timer reproduction operation will be described with reference to the display example of FIG.
[0077]
In FIG. 11, screen display examples from the start screen 801 to the end screen 805 are the same as those 801 to 805 in FIG. Here, when switching to another application such as adding a memo or shooting a new image while waiting for time-up until the next frame playback on the playback screen 803, as shown in 1101, Switch to the application execution screen.
[0078]
Here, when the time set in the timer has elapsed, as indicated by reference numeral 1102, the application is temporarily interrupted, and a warning display 1102a indicating that the playback time of the next frame image has arrived appears. At the same time, pen touch icons 1102b, 1102c, and 1102d for displaying the next action from the operator are displayed.
[0079]
Reference numeral 1102b denotes a reproduction icon. When this area is touched with a pen, the currently executing application is immediately stopped, and reproduction and display of the next frame image is executed. Reference numeral 1102c denotes a skip icon. When this area is touched with a pen, the display of the frame image that is a warning target is skipped, and the count operation starts again until the display time of the next frame image. The running application is continuously executed. Reference numeral 1102d denotes a cancel icon. When this area is touched with a pen, the timer reproduction operation is canceled, and the continuation of the currently executing application can be executed.
[0080]
As described above, by performing the timer shooting and the timer reproduction of the first embodiment, each frame image can be reproduced and displayed in the same time course as the process of actually cooking. Thereby, the completion of cooking can be confirmed at each time point while viewing the reproduced image. When such a digital camera is used in a cooking class, for example, when reviewing the cooking process at a later date, it is possible to reliably learn the same cooking method without causing a mistake in the procedure.
[0081]
[Second Embodiment]
In the first embodiment, the application example to the application of timer shooting and timer reproduction of the process of making a dish has been described. However, the present invention is not limited to this, and various applications are possible.
[0082]
In the second embodiment, the route to a certain destination is recorded as video and comments of important points such as branch points, intersections, landmarks, etc., and the required time to that point is recorded as image data by timer shooting. An application example to a navigation function that can automatically guide the route by reproducing the timer will be described. Since the apparatus configuration, control flow, and the like of the second embodiment are the same as those of the first embodiment, description thereof is omitted.
[0083]
FIG. 9 is a diagram illustrating a display example of a reproduced image in the second embodiment. However, in the case of the second embodiment, the information 602 and 702 relating to the application stores navigation information. The display example shown in FIG. 9 is also an example in which another application is not executed during the frame image reproduction and the intermediate time of the frame image reproduction.
[0084]
In FIG. 9, reference numeral 901 denotes a display immediately after the timer playback is selected, and comments such as the destination and the means of transportation until reaching the destination are displayed. It is assumed that these comments are input in advance by the photographer by inputting characters with the handwritten tablet 110 at the time of shooting. Here, when the “OK” area 901a of the screen 901 is touched with a pen or the like, timer playback serving as a navigation function is started.
[0085]
Reference numeral 902 denotes a display screen immediately after the start, in which the first photographed image, in this embodiment, the image of the nearest station is displayed. The comment displayed at the bottom of this image shows guidance such as the direction to proceed first from the station. When the “confirm” area 903 is touched here, a counting operation (steps S513 and S514 in FIG. 5) according to the value of the counting data added to the image data starts, and the same image as 902 is displayed as indicated by 903. While being displayed, information 903a of the time set in the timer 115 and the time counted up to the present is displayed in the upper right part of the screen. When the time set in the timer 115 elapses in this manner, as shown at 904, the next screen, that is, the second photographed image is displayed. Here, it switches to the image of the first branching intersection. The comment on this screen 904 shows the explanation of the mark, the direction of advance, and the like. When the “confirmation” area 904a is touched continuously, the elapsed time display is performed as in the case of 903, and the display is switched to the next screen display when the timer 115 finishes counting. Then, as shown on the screen 905, the display of the last video, that is, the video of the destination is displayed, and when the “end” area 905a is touched, the timer playback operation ends.
[0086]
As described above, according to the second embodiment, in the same time as when actually walking, difficult-to-understand intersections and directions appear as video information, so the route to the destination can be confirmed easily, and the road You can reach your destination without any hesitation.
[0087]
Needless to say, this embodiment can also be used for car navigation. In the case of a car, there will be some time error depending on the timing of the signal, how busy the road is, etc., but this time shift can be sufficiently corrected by the operation of instructing the “confirmation” area of the operator. Is.
[0088]
[Third Embodiment]
In the first and second embodiments, in the timer reproduction operation, after the image confirmation operation by the operator is finished, that is, while the timer 115 is counting, the display of the target image is continued. However, the present invention is not limited to this.
[0089]
In the case of a battery-powered portable camera as shown in the first and second embodiments, the power consumption is large while an image is displayed on the display device, such as displaying a time value by a timer. If the display is continuously performed, the battery is particularly consumed.
[0090]
Therefore, in the third embodiment, after the operator confirms the timer playback image, the device is automatically turned off to save power until the next playback image is displayed after the time is up. An example to be performed will be described.
[0091]
FIG. 10 is a flowchart for explaining the timer playback operation in the digital camera according to the third embodiment. The configuration of the digital camera according to the third embodiment is the same as that shown in FIG.
[0092]
In FIG. 10, when the power of the camera is turned on (step S1001), the operation mode is checked in steps S1002 and S1004 as in steps S502 and S510 of FIG. Here, when the timer reproduction mode is selected, the process proceeds from step S1002 to step S1003, and timer photographing processing, that is, processing similar to that described with reference to steps S503 to S508 in FIG. 5 described above is performed.
[0093]
If the timer reproduction operation is not selected in step S1004, the process proceeds to step S1017, and the normal camera operation process similar to step S520 in FIG. 5 is executed.
[0094]
If the timer reproduction operation is selected in step S1004, the process proceeds to step S1005 and waits until an instruction to start timer reproduction is given by the operator. Here, when an instruction to start timer playback is input by the operator using the handwritten tablet 110 or the like, the process proceeds to step S1006, and a pointer is set at the position of the first frame image to be played back as in step S511 of FIG.
[0095]
In steps S1007 and S1008, the timer value read from the frame image data pointed to by the pointer is set in the timer 115 and counting by the timer 115 is started, as in steps S512 and S513 in FIG. . Thereafter, the process proceeds to step S1009 to perform power-off processing of the digital camera to reduce power consumption. The power off here means that the timer 115 maintains an operating state for the count processing, and the CPU waits for an interrupt so that the CPU 115 can immediately start up upon detecting a time-up signal from the timer 115. It has become. Further, since the camera module, the display unit 113, and the like consume a large amount of power, the operation and the supply of power are completely stopped for these.
[0096]
As described with reference to FIG. 1, these power supply controls are performed when the CPU gives a control signal 118 for the CPU to control each output power supply to the DC / DC converter 117.
[0097]
If the timer value count end (time up) by the timer 115 is detected in step S1010 during the OFF state, an interrupt signal is output to the CPU 101, and the process proceeds to step S1018. In step S1018, whether or not the power is turned off at this point, that is, while the timer 115 counts the timer value while the power is off, the operator does not turn on the power and execute another application. Check whether or not. If it is determined that the power is off, the process proceeds to step S1011. First, power on processing, that is, restoration of each power supply, necessary initialization processing, and the like are executed. In step S1012, the reproduction operation process described with reference to FIG. 4 is performed, and the frame image currently designated by the read pointer is displayed.
[0098]
Thereafter, the processes in steps S1013, S1014, S1015, and S1016 are performed in the same manner as steps S516, S517, S518, and S519 in FIG. That is, it waits while displaying a reproduced image until a confirmation instruction is received. When a confirmation instruction is detected, it is checked whether there is a frame image to be reproduced next. If there is no frame image to be reproduced, end processing is performed. If there is a next frame image to be reproduced, processing for advancing the read pointer to the position of the next frame image is performed. Then, the process returns to step S1007 again to repeatedly set the timer value in the timer 1154 and the frame image reproduction process.
[0099]
If it is determined in step S1018 that the power is not OFF, that is, another application is being executed, the process proceeds to step S1019. In step S1019, the application being executed is temporarily interrupted, and a process of popping up a warning display to indicate that the playback time of the next frame image has come is performed, and the process proceeds to step S1020.
[0100]
When the operator performs an operation for instructing to reproduce the next frame image, the process proceeds from step S1020 to step S1012 to execute the above-described image reproduction process. If an operation to instruct to skip the reproduction of the next image is performed, the process proceeds from steps S1020 and S1021 to S1014, and the next frame image to be reproduced in step S1014 is not reproduced without reproducing the image. The process proceeds to check whether there is any. That is, the application currently being executed is continuously executed until the next image reproduction time comes. If an instruction to cancel the timer reproduction operation is given, the process proceeds to step S1016 through steps S1020, S1021, and S1022, and the currently executed application is continuously executed.
[0101]
As described above, one frame image is reproduced and displayed, and after the confirmation operation of the image is completed, the count operation by the timer 115 is executed while the power is turned off (the display is turned off). By controlling to turn on the power again and detect the next frame image when the time-up is detected, the total power consumption can be reduced and the battery consumption can be reduced.
[0102]
In addition, it is effective not to turn off the power supply of the entire system during the counting operation of the timer 115, but also to perform control to turn off only the operation of the camera module and the display unit 113 that consumes particularly large power. Needless to say.
[0103]
[Fourth Embodiment]
In the first, second, and third embodiments, the “timer value” added to the image to determine the image playback interval is automatically added as a timer shooting operation during shooting. However, the present invention is not limited to this.
[0104]
In the fourth embodiment, an example will be described in which the “timer value” added to the image is manually added by the operator when the image is captured.
[0105]
FIG. 12 is a flowchart showing the overall operation of the digital camera according to the fourth embodiment of the present invention. In FIG. 12, steps S501, S502, S506, S508, S509, S510, and S520 are the same as the respective processes in FIG.
[0106]
First, in step S501, when the digital camera is turned on, the process proceeds to step S502 to check the operation mode. If the “timer shooting mode” is selected in step S502, the process proceeds to step S506, and the shooting operation process described with reference to FIGS. 2 and 3 is performed. When shooting of one frame image is completed, that is, generation of shot frame image data is completed, the process proceeds to step S1201, and the operator inputs a “timer value”. In step S1202, the timer value input in step S1201 is added to the frame image data generated in step S506.
[0107]
Then, the process proceeds to step S1203, where it is further checked whether text data is added to the image data. Whether or not to add this text data can be arbitrarily selected by the operator. Here, when adding text data, it progresses to step S1204 and performs a text input process. The text input processing can be input by handwriting character recognition processing using a pen or the like on the handwriting tablet 110. Then, the process proceeds to step S1206. After the process of adding the input text data to the image data is performed, the process proceeds to step S508. The structure of the image data to which the text data is added is as described with reference to FIG. If no text input is selected in step S1203, the process proceeds directly to step S508.
[0108]
In step S508, it is checked whether or not the operator has instructed the end of the timer shooting operation. If instructed, the end process of step S509 is executed, and if the end instruction has not been given, that is, the shooting is continued. If so, the process returns to step S506, and the photographing operation is repeated.
[0109]
Through the processing as described above, the time information that the user wants to wait for when reproducing from the immediately preceding captured image data (previous frame) to the current captured image data (current frame) can be manually set by the operator.
[0110]
If the timer shooting mode is not selected, the process advances from step S502 to step S510 to check whether the timer playback mode is selected. If the timer playback mode is selected in step S510, the timer playback operation processing in step S1207 is executed. This timer reproduction process is the same as the process from steps S511 to S519 and S521 to S526 described in FIG.
[0111]
If the timer playback mode is not selected in step S510, the process proceeds to step S520, and a normal camera operation is performed.
[0112]
FIG. 13 is a diagram illustrating a data structure in which text data is added as additional information to one frame of image data stored in the data storage unit 104 after shooting. The text data is, for example, an arbitrary character string or sentence representing an image description, a title, and the like, and is obtained by performing character recognition on handwritten input from the handwritten tablet 110 as described above. In FIG. 13, 601 to 604 are the same data as 601 to 604 in FIG. Reference numeral 1301 denotes an area in which the added text data is stored.
[0113]
Next, in the timer photographing operation according to the fourth embodiment shown in FIGS. 14 and 15, examples of display screens for inputting the timer value and text by the operator as described in steps S1201 and S1204 of FIG. Show.
[0114]
FIG. 14 is an example in which a timer input area and a text input area are displayed simultaneously in one screen. The operator can input timer values and text data by writing data values directly into these areas with a pen or the like.
[0115]
In FIG. 14, reference numeral 1401 denotes a display area of the entire screen, 1402 denotes an area for displaying a photographed image, 1403 denotes an area for inputting text, 1404 denotes an area for inputting a timer value “time”, and 1405 An area for inputting “minute” of the timer value 1406 is an area for inputting “second” of the timer value.
[0116]
FIG. 15 is an example of a screen display when the timer value and text data are sequentially input in an interactive manner.
[0117]
In FIG. 15, reference numeral 1501 denotes a screen on which image data is reproduced and displayed immediately after a frame image is captured. When an action for proceeding to the next is operated by a pen touch or key operation, 1501 is shown. Thus, the timer value input screen is displayed. After the input of the timer value is completed, when an action for proceeding to the next is operated, the screen display for text input is switched as indicated by 1503.
[0118]
In the first, second, third, and fourth embodiments, a warning message is displayed when the timer value count ends in the timer reproduction operation, that is, when the next image reproduction time comes. Although an embodiment has been described in which the operator pops up and notifies the operator, the present invention is not limited to this, and a notification method (for example, a change in screen color) that changes the display pattern on the display Needless to say, the same effect can be obtained even when contrast change or blinking is performed. Further, it goes without saying that the same effect can be obtained by using a sound such as a buzzer or other synthesized sound as a notification means for warning.
[0119]
As described above, according to the first and second embodiments, the timer unit that measures the elapsed time from the shooting operation (captured image data generation) to the next shooting operation is provided, and the previous shooting is performed during the shooting operation. By inserting or associating the elapsed time data measured from the operation into the image data and providing a means for automatically switching the playback image at intervals according to the time information generated at the time of shooting during playback. And for a series of tasks, especially for purposes where time information occupies an important element, such as cooking and route guidance, since multiple captured image data are played back in real time, it produces a great effect in terms of presence and ease of understanding In addition, there is an advantage that the operation can be simplified.
[0120]
Further, according to the third embodiment, the device is automatically turned off while the timer is counting, and is automatically turned on when time is up, and then the next image is reproduced. In addition, the power consumption can be reduced.
[0121]
Furthermore, by performing control so that another application can be executed while the timer is counting, the device can be used without any trouble during the timer count waiting time. When an image playback time comes, a warning is displayed at the same time, and by allowing the operator to select a subsequent process, the application can be interrupted and continued smoothly. There is also an effect that it is possible to avoid troubles such as an image not being reproduced or an application being interrupted unexpectedly.
[0122]
In addition, since the image reproduction apparatus of the above embodiment can be applied to recording of cooking procedures, etc., by accumulating the reproduced dishes and their dates, the same cooking procedures are performed for a certain period (for example, one week, one month). It goes without saying that you can make people recognize how many times you have seen. Such an application also serves to prevent cooking from becoming rut.
[0123]
In addition, even if the present invention is applied to a system composed of a plurality of devices (for example, a host computer, interface device, reader, printer, etc.), a device (for example, a copier, a facsimile device, etc.) comprising a single device. You may apply to.
[0124]
Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and store the computer (or CPU or MPU) of the system or apparatus. Needless to say, this can also be achieved by reading and executing the program code stored in the medium.
[0125]
In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
[0126]
As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0127]
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. It goes without saying that some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing.
[0128]
Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
[0129]
【The invention's effect】
As described above, according to the present invention, it is possible to realize the reproduction of an image according to the time information added to the image while maintaining the flexibility of the operation.
Further, according to the present invention, it is possible to effectively achieve both reproduction according to time information added to an image and execution of another application.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a schematic configuration of a digital camera according to a first embodiment.
FIG. 2 is a flowchart showing a control procedure of a camera photographing operation performed by a CPU.
FIG. 3 is a flowchart for explaining interrupt processing that occurs in the flowchart of FIG. 2;
FIG. 4 is a flowchart illustrating a control procedure of a camera playback operation performed by a CPU.
FIG. 5 is a flowchart showing a control procedure of timer shooting and reproduction operations in the first embodiment.
FIG. 6 is a diagram illustrating an example of a data structure of a captured image in the first embodiment.
FIG. 7 is a diagram showing another example of the data structure of a photographed image in the first embodiment.
FIG. 8 is a diagram illustrating an application example to the application in the first embodiment;
FIG. 9 is a diagram illustrating an application example to an application in the second embodiment.
FIG. 10 is a flowchart showing a control procedure of timer shooting and reproduction operations in the third embodiment.
FIG. 11 is a diagram illustrating an application example to an application in the third embodiment.
FIG. 12 is a flowchart showing a control procedure of timer shooting and reproduction operations in the fourth embodiment.
FIG. 13 is a diagram illustrating an example of a data structure of a photographed image in the fourth embodiment.
FIG. 14 is a diagram showing an example of an operation screen in the fourth embodiment.
FIG. 15 is a diagram illustrating another example of the operation screen in the fourth embodiment.
[Explanation of symbols]
101 CPU
102 ROM
103 RAM
104 Data storage
105 lens group
106 CCD
107 CCD control unit
108 Image processing unit
109 Tablet control unit
110 handwritten tablet
111 LCD controller
112 Display driver
113 Display
114 Shutter SW
115 timer
116 batteries
117 DC / DC converter

Claims (12)

An image reproduction apparatus for reproducing and displaying an image based on image data,
Storage means for storing each image data in association with time information;
Playback means for reading out and playing back the stored image data;
Execution means for executing an application during display of an image by the reproduction means;
Determining means for determining the arrival of the display switching time of the image data reproduced and displayed by the reproducing means based on the stored time information;
Notification means for displaying on the display means a message for notifying the arrival of the display switching time when the determination means determines that the display switching time has arrived while the application is being executed by the execution means. An image reproducing apparatus comprising: Claim 1 between the display switching time of the image to be reproduced and displayed while is not running the application by the executing means when arriving, and further comprising a display switching means to perform switching of images to be reproduced and displayed The image reproducing device described in 1. The display switching means executes switching of an image to be reproduced and displayed when there is an instruction to switch display of an image while a message for notifying the arrival of the display switching time is displayed by the notification means. The image reproducing apparatus according to claim 2 , wherein: The determination unit waits for a predetermined operation from the user after the image to be reproduced and displayed by the display switching unit is switched, and starts measuring time until the next switching time. Item 4. The image reproducing device according to Item 3 . Power control means for controlling to reduce power consumption in the image reproducing apparatus from when the determination means starts measuring time until the next image switching time until the next image switching time arrives is further provided. The image reproducing apparatus according to claim 4 , wherein The power control unit, an image reproducing apparatus according to claim 5, characterized in that to reduce power consumption by prohibiting playback display of an image by said reproducing means. Imaging device characterized by comprising an image reproducing apparatus according to any one of claims 1 to 6. Imaging means for storing a captured image in a storage medium in accordance with an imaging operation;
The imaging apparatus according to claim 7 , further comprising time information storage means for storing the image data stored by the imaging means in association with time information when the image data is captured. The imaging apparatus according to claim 8 , wherein the time information storage unit stores time indicated by a clock built in the imaging apparatus as time information during imaging. The imaging apparatus according to claim 8 , wherein the time information storage unit stores time information input by a user at the time of imaging. An image reproduction method for reproducing and displaying an image based on image data,
Reproduction process of storing time information in association with each image data, reading out and reproducing the stored image data, and
An execution step of executing an application during display of an image by the reproduction step;
A determination step of determining arrival of a display switching time of the image data reproduced and displayed by the reproduction step based on the stored time information;
An informing step of displaying on the display means a message for informing the arrival of the display switching time when it is determined by the determining step that the display switching time has arrived while the application is being executed by the executing step. image playback method characterized by comprising and. A storage medium storing a control program for causing a computer to reproduce and display an image based on image data, the control program being
Reproduction process of storing time information in association with each image data, reading out and reproducing the stored image data, and
An execution step of executing an application during display of an image by the reproduction step;
Based on the stored time information, a determination step of determining arrival between the display switching of the image data to be reproduced and displayed by the regeneration step,
Informing step of displaying on the display means a message for notifying the arrival of the display switching time when it is judged by the judging step that the display switching time has come while the application is being executed by the executing step. computer-readable storage medium characterized by executing and.

Images