JP2002101331A - Image recorder - Google Patents

Image recorder

Info

Publication number
JP2002101331A
JP2002101331A JP2000291560A JP2000291560A JP2002101331A JP 2002101331 A JP2002101331 A JP 2002101331A JP 2000291560 A JP2000291560 A JP 2000291560A JP 2000291560 A JP2000291560 A JP 2000291560A JP 2002101331 A JP2002101331 A JP 2002101331A
Authority
JP
Japan
Prior art keywords
image
means
recording
operation
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2000291560A
Other languages
Japanese (ja)
Other versions
JP3900812B2 (en
Inventor
Tatsuya Iijima
達也 飯島
Original Assignee
Casio Comput Co Ltd
カシオ計算機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Casio Comput Co Ltd, カシオ計算機株式会社 filed Critical Casio Comput Co Ltd
Priority to JP2000291560A priority Critical patent/JP3900812B2/en
Publication of JP2002101331A publication Critical patent/JP2002101331A/en
Application granted granted Critical
Publication of JP3900812B2 publication Critical patent/JP3900812B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

(57) [Summary] [PROBLEMS] To mainly enable photographing in a photographing mode desired by a photographer without making the photographer perform complicated operations. SOLUTION: When a shutter key is turned on, taking in of an image from a CCD is started, and thereafter, it is performed every 0.2 seconds, and image data of a subject is sequentially stored in an independent area of an image memory. At the same time, a timer for determining the mode is started. Before the timer value reaches the moving image discrimination time (1.1 seconds), the shutter key is turned off.
F, the shooting mode is determined as the still image mode,
The first captured image is recorded in a still image format (see FIG. 4).
(A)). Conversely, when the shutter key is kept pressed and the timer value exceeds the moving image determination time (1.1 seconds), the shooting mode is determined as the moving image mode, and a plurality of image data stored in the image memory is recorded in the moving image format. (Figure 4
(B)).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image recording apparatus such as a digital camera, and more particularly to control of a photographing mode.

[0002]

2. Description of the Related Art In recent years, digital cameras have become widespread in which a subject image picked up using a solid-state image pickup device such as a CCD is compressed by a compression processing technique such as JPEG and image data is recorded on a recording medium such as a flash memory. In addition, in this type of digital camera, in addition to a still image mode for recording a still image, a moving image mode for recording a moving image for a fixed period of time, and a shooting with sound for simultaneously recording a still image or a moving image with a sound. Some have a mode.

[0003]

However, as described above, in a digital camera having a still image mode and a moving image mode and capable of recording an image in a plurality of formats, the photographer must select the type of the image to be recorded (still image or moving image). ), It is necessary to set the shooting mode in advance. Therefore, when a photo opportunity of a shooting mode different from the shooting mode set in advance comes, it is necessary to change the shooting mode immediately before starting shooting. Therefore, there is a problem that a situation where a photo opportunity is missed easily occurs.

[0004] Further, in a camera having a photographing mode with sound, it is desirable that both sound and image can be recorded in the best condition. In many cases, recording cannot be performed. In such a case, recording of unnecessary image data and audio data wastefully consumes a recording memory.

[0005] The present invention has been made in view of the above-mentioned conventional problems, and enables photographing in a photographing mode desired by a photographer without requiring the photographer to perform complicated operations. It is an object of the present invention to provide an image recording device that enables effective use.

[0006]

According to a first aspect of the present invention, there is provided a still image mode in which image data of a subject imaged by an imaging means is recorded in a data format for a still image. In an image recording apparatus having a moving image mode for recording in a data format for a moving image, an operation unit for performing a shooting instruction operation for instructing imaging of a subject, a timing unit for measuring a duration of the shooting instruction operation by the operation unit,
Switching means for switching the recording format of the image data of the subject imaged by the imaging means from the still image to the moving image when the operation continuation time measured by the timing means exceeds the predetermined time. It was assumed.

In such a configuration, the image data of the subject is recorded in a data format for a still image when the operation continuation time of the photographing instructing means does not exceed a predetermined time, and when the operation continuation time exceeds a predetermined time, the image data for a moving image is recorded. It is recorded in the data format.

According to a second aspect of the present invention, the image data of the subject imaged by the image pickup means is sequentially compressed as the operation continuation time measured by the time measuring means exceeds a predetermined time. The image processing apparatus further includes a data generation unit that generates the image data for the moving image.

In this configuration, the compression of the moving image format image data is started while the operation means is performing the shooting instruction operation. The storage capacity of the image data to be secured is smaller than in the case where the data is stored individually.

According to a third aspect of the present invention, there is provided a voice input means for inputting a voice to be reproduced at the time of displaying image data recorded in accordance with a shooting instruction operation of the operation means.
A recording unit for recording the voice input to the voice input unit in accordance with a shooting instruction operation of the operation unit; a detection unit for detecting a voice input level in the voice input unit; and a detection result of the detection unit continuously. A timer for measuring the time in a state exceeding a predetermined level, and only when the time measured by the timer is equal to or longer than a predetermined time while the photographing instruction operation by the operating unit is continued, And control means for causing the recording means to record the sound input to the sound input means in correspondence with the image of the subject imaged in accordance with the photographing instruction operation by the operation means.

In such a configuration, at the time of photographing, the sound is recorded only when the input level of the sound input to the sound input means has exceeded a predetermined level for a predetermined time or more. Ineffective sound recording can be prevented when the recording is performed.

According to a fourth aspect of the present invention, there is provided an image recording apparatus for recording, as image data, an image of a subject imaged by an imaging means, an operation means for performing a photographing instruction operation for instructing an image of the object, Voice input means for inputting a voice reproduced when displaying image data recorded in accordance with a shooting instruction operation of the operation means; recording means for recording the voice input to the voice input means; Detecting means for detecting an input level, time measuring means for measuring a time during which the detection result of the detecting means continuously exceeds a predetermined level, and while the photographing instruction operation by the operating means is continued. Only when the time measured by the timing means is a predetermined time or more,
And control means for causing the recording means to record the sound input to the sound input means in correspondence with the image of the subject imaged in accordance with the shooting instruction operation by the operation means.

[0013] Also in this configuration, at the time of shooting, the sound is recorded only when the input level of the sound input to the sound input means exceeds a predetermined level for a predetermined time or more. In this case, recording of a sound that is not effective when reproduced can be prevented.

According to a fifth aspect of the present invention, the control means sets the time measured by the time measuring means to a predetermined length while the photographing instruction operation by the operating means is continued. When the sound does not reach, the prepared sound is recorded in the recording means in association with the image of the subject imaged in accordance with the photographing instruction operation by the operation means. In such a configuration, an effective sound can be always recorded together with the captured image.

According to a sixth aspect of the present invention, the control means superimposes a sound input to the sound input means on an image of a subject imaged in response to a shooting instruction operation by the operation means. Means to be recorded.

According to a seventh aspect of the present invention, there is provided an exposure detecting means for detecting an exposure amount at the time of imaging of a subject by the imaging means, and the control means comprises an exposure amount detected by the exposure detecting means. When the image data does not reach the predetermined amount, the recording of the image data accompanying the photographing instruction operation of the operation means is stopped. In such a configuration,
At the time of photographing, useless image data is not recorded.

In the invention according to claim 8, the control means prepares in advance a voice input to the voice input means when the exposure amount detected by the exposure detection means is equal to or less than a predetermined value. The image is superimposed on the image and recorded by the recording means. In such a configuration, an effective image can always be recorded together with the sound at the time of shooting.

[0018]

DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) An embodiment of the present invention will be described below with reference to the drawings. FIG.
FIG. 1 is a block diagram illustrating an electrical configuration of a digital camera 1 which is an image recording device according to the present invention.

The digital camera 1 mainly includes a CCD 2,
It comprises a CCD control unit 3, a YUV processor 4, a memory controller 5, an image memory 6, a video encoder 7, a video output unit 8, a control unit 9, a recording medium 10, and a key processing unit 11.

The CCD 2 is driven based on a timing signal generated by the CCD control unit 3 and captures a subject image formed by a lens provided in a camera body (not shown), and converts the image as a color image signal (analog) into the CCD control unit. 3
Output to The CCD control unit 3 sequentially performs A / D conversion on the input color image signal based on the timing signal, and
Send to processor 4. The YUV processor 4 creates luminance component data (Y) and two color component data (Cb, Cr) from each pixel of the color image. The memory controller 5 sequentially stores the three types of image data created by the YUV processor 4 in the image memory 6, and stores the first field from the image memory 6 when in the shooting standby state.
Y data every other line, C
The b data and the Cr data are read and sent to the video encoder 7 sequentially.

The video encoder 7 converts the data sent from the memory controller 5 into RGB signals and sends them to the video output unit 8. The video output unit 8 has a liquid crystal module, and the liquid crystal module includes a video encoder 7.
An image based on the RGB signal sent from the camera, that is, a through image is displayed during a shooting standby, and a recorded image stored in the recording medium 10 is displayed at the time of reproducing a recorded image.

The control section 9 comprises a CPU, a ROM, a RAM and the like. The ROM stores various control programs executed by the CPU, data used at the time of control, and the like, and the RAM has a work area used in various processes executed by the CPU.
The CPU controls the operation of the memory controller 5 based on the control program and a key input signal sent from the key processing unit 11 including a plurality of operation keys such as a shutter key, a power key, and a mode switching key provided on the camera body. Control. When the shutter key is operated, the control unit 9 converts the image data read by the memory controller 5 into data for a still image (for example, JPEG format) or data for a moving image (for example, MPEG format). Then, the converted data is stored in the recording medium 10. The recording medium 10 is, for example, a flash memory or the like.

Next, the operation of the digital camera 1 according to the present invention will be described. FIG. 2 is a flowchart showing key processing executed by the CPU of the control unit 9 at regular intervals in a shooting standby state, and FIG. 4 is a timing chart for explaining the operation of the digital camera 1 corresponding to such processing. is there.

The operation will be described below with reference to FIG. When starting the key processing operation, the CPU first determines whether or not the shutter key is pressed based on a key input signal sent from the key processing unit 11 (step SA1). If the shutter key has not been pressed, it is further determined whether or not the previous ON flag has been set (step SA8). If the result of this determination is also NO, the process is terminated as it is. On the other hand, if the shutter key is pressed by the photographer and the result of determination in step SA1 is YES, it is further determined whether or not the previous ON flag has been set, that is, whether or not the shutter key has just been pressed. (Step SA2). Here, if immediately after the shutter key is pressed, “NEW” in steps SA3 to SA6 is performed.
ON processing ". That is, first, the previous ON flag is set (step SA3), and the timer value for moving image determination is cleared (step SA4). Next, a timer interrupt process is permitted (step SA5), and the first image data is fetched into the image memory 6 at a size to be used as still image data (step SA6).

As shown in FIGS. 3 and 4, the timer interruption process is a process of taking in one image data of a photographed image taken by the CCD 2 into the image memory 6 every 0.2 seconds (step SB1). The captured image data is stored in a separate area of the image memory 6 without overwriting the previous image as moving image data smaller than the size used as still image data.

Thereafter, even when it is determined that the shutter key is pressed (YES in step SA2) and when it is determined that the shutter key is not pressed,
The previous ON flag was set (YE in step SA8).
S) If the time counted by the above-described moving image determination timer has not exceeded the predetermined chattering time (NO in step SA9), "ON processing"
In step SA7, the value of the moving image determination timer is incremented. In other words, while the shutter key is kept depressed, the “ON processing” is continued, and in the meantime, the timer interrupt processing shown in FIG. 3 is performed every 0.2 seconds, so that The captured image data for a moving image is sequentially stored in the image memory 6.

Thereafter, when the photographer stops pressing the shutter key (NO in step SA1, step SA1).
8 and SA9 are both YES), the following "NEW OFF processing" is performed. That is, after clearing the previous ON flag (step SA10) and disabling the timer interrupt processing shown in FIG. 3 (step SA11), the timer value counted in the ON-state processing is changed to the predetermined moving image determination time (this execution). In the embodiment, it is determined whether or not the time exceeds 1.1 second) (step SA12). Here, as shown in FIG.
The time during which the photographer has pressed the shutter key is, for example, 0.9.
If the second is not longer than the moving image determination time, the process proceeds to the still image mode process (NO in step SA12), and FIG.
As shown in (b), the time during which the photographer has pressed the shutter key (operation continuation time) is, for example, 4.7 seconds,
If the moving image determination timer value exceeds the moving image determination time, the process proceeds to the moving image mode process (YE in step SA12).
S).

In the moving image mode processing, the size of the image data first taken into the image memory 6 in step SA6 is converted from the still image size to the moving image size (step SA1).
3) The size-converted first image data and the remaining (second and later) image data stored in the timer interrupt processing in the moving image size from the beginning are recorded in the moving image format on the recording medium 10.
(Step SA14). In the still image mode process, the image data of the still image size first taken into the image memory 6 is recorded as it is on the recording medium 10 in the still image format (step SA15), and the process ends.

Therefore, even if the photographer does not previously set the type of the recorded image (still image and moving image), it is possible to record the desired type of image only by adjusting the time of pressing the shutter key. Can be. For this reason, when a photo opportunity comes, shooting can be started immediately, and the subject can be recorded as a still image or a moving image at each time. Further, in the present embodiment, immediately after the shutter key is pressed, in step SA6, the first image data of the first image fetched into the image memory 6 in the size for a still image is shifted to the moving image mode processing. Since the data is used as the first piece of data for a moving image, the memory area of the image data for the moving image can be saved by an area corresponding to one frame.

(Second Embodiment) Next, a second embodiment of the present invention will be described.
An embodiment will be described. In this embodiment, FIG.
This relates to the case where, for example, the CPU of the control unit 9 has relatively high processing performance in the digital camera 1 shown in FIG. FIG. 5 is a flowchart showing another key process executed by the CPU of the control unit 9 at regular intervals.
Hereinafter, the operation of the digital camera 1 according to the present embodiment will be described with reference to FIG.

In this embodiment, when the CPU starts the key processing operation, it first determines whether or not the shutter key has been pressed based on the key input signal sent from the key processing section 11 (step SC1). If the shutter key has not been pressed and the previous ON flag has not been raised (NO in steps SC1 and SC11),
The process ends as it is. On the other hand, immediately after the photographer presses the shutter key (YES in step SC1)
Step SC2 is NO), Step SC3 to Step S
The "NEW ON process" of C6 is performed. That is, first, the previous ON flag is set (step SC3), and the timer value for moving image determination is cleared (step SC4). Next, a timer interrupt process of 0.2 seconds, which will be described later, is permitted (step SC5), and the first image data is fetched into the image memory 6 in a size to be used as still image data (step SC6). ).

Thereafter, even if it is determined that the shutter key is being pressed (YES in step SC2) and if it is determined that the shutter key is not being pressed, the previous ON flag is set. If yes (YES in step SC11) and the time counted by the moving image determination timer has not passed the predetermined chattering time (NO in step SC12), the following “ON processing” is performed. In the “ON processing”, first, the timer value is incremented (step SC7), and then the timer value is set to a predetermined moving image determination time (1.1 in this embodiment).
Is determined (step SC).
8). While the result of this determination is NO, the timer interruption process permitted in step SC5 described above is performed. Also in the present embodiment, the interval of the interrupt processing is every 0.2 seconds, and as shown in FIG. 6, when the timer value does not exceed the moving image determination time at the time of the interrupt (step SD
1), the image data of one image picked up by the CCD 2 is used as moving image data smaller than the size used as still image data, without overwriting the previous image, and without overwriting the previous image. (Step SD2). Therefore, while the shutter key is kept depressed, the captured image data for a moving image is sequentially stored in the image memory 6 every 0.2 seconds until the duration exceeds the moving image determination time. The operation up to this point is substantially the same as in the case of the first embodiment.

In executing the “ON processing”, the time during which the shutter key is pressed exceeds the moving image determination time,
If the decision result in the step SC8 is YES, first, in step SC6, the size of the image data first taken into the image memory 6 is converted from the still image size to the moving image size (step SC9), and then the timer interrupt processing is performed. Then, the remaining (second and subsequent) image data stored in the moving image size is recorded in the image memory 6 in the compressed moving image format, for example, the MPEG format (step SC10). In addition,
Although not explicitly shown in the illustrated flowchart, the processing in step SC9 and step SC10 is performed only once after the above-described “NEW ON processing” is newly performed. If the shutter key is continuously pressed after this, the determination result of step SD1 in the timer interrupt processing of FIG.
S, the compressed data pre-recorded in the compressed moving image format in the image memory 6 contains one of the images captured by the CCD 2.
Real-time moving image recording is performed in which new image data for one sheet is sequentially added, that is, compressed data is updated (step SC10).

Thereafter, when the photographer stops pressing the shutter key (NO in step SC1; step SC1).
1 and SA12 are both YES), the following "NEW OFF"
Process ”. That is, after clearing the previous ON flag (step SC13) and disabling the timer interrupt processing of FIG. 6 (step SC14), the timer value counted in the “ON processing” becomes the moving image determination time (1.1 seconds). ) Is determined (step SC15). If the timer value, that is, the time during which the photographer has pressed the shutter key (operation continuation time) exceeds the moving image determination time, the process proceeds to the moving image mode process (YE in step SC15).
S) If the time during which the photographer has pressed the shutter key has not exceeded the moving image determination time, the flow shifts to still image mode processing (NO in step SC15).

In the moving image mode processing, predetermined moving image header data is generated, the compressed data that has been sequentially compressed and recorded in the timer interrupt processing of FIG. 6 is read, and the generated moving image header data is added to the recording medium 10. (Step SC16). In the still image mode process, similarly to the first embodiment, the image data of the still image size first taken into the image memory 6 is directly recorded in the still image format on the recording medium 10 (step SC17). finish.

Therefore, in this embodiment, as in the first embodiment, even if the photographer does not previously perform the work of setting the type of recorded image (still image and moving image),
By simply adjusting the time during which the shutter key is pressed, a desired type of image can be recorded. Moreover, in the present embodiment, after the time during which the shutter key is pressed exceeds the moving image determination time, all the image data constituting the moving image acquired until the shutter key is released is sequentially compressed. In this case, the moving image data is stored in the same memory area of the image memory 6 as compared with the case where all the image data constituting the moving image are left individually on the image memory 6 as in the first embodiment. The memory area to be secured in the image memory 6 is reduced. Therefore, compared with the first embodiment, it is possible to record a moving image for a longer time without increasing the capacity of the image memory 6.

In this embodiment, the case where the CPU of the control unit 9 generates the compressed moving image data in real time has been described. However, the present invention is not limited to this, and a dedicated circuit for generating the compressed moving image data, A configuration in which a processor is provided may be employed. Further, in the first and second embodiments, the interval of the timer interrupt processing for capturing the moving image data is set to 0.2 seconds and the moving image determination time is set to 1.1 seconds. Can be set to any time.

(Third Embodiment) Next, a third embodiment of the present invention will be described.
An embodiment will be described. The present embodiment relates to a digital camera provided with a photographing mode with sound that records sound simultaneously with photographing of a still image or a moving image.

FIG. 7 is a block diagram showing an electrical configuration of the digital camera 21 according to the present embodiment. The digital camera 21 is capable of recording audio in addition to still images and moving images, and includes an audio input unit 22, an A / D converter 23, an audio level detector 24, a D / A converter 25, An output unit 26 is provided. The audio input unit 22 has a microphone or the like arranged in a camera body (not shown), collects sound around the camera body, and outputs the sound as an audio signal. The A / D converter 23 converts the output signal of the audio input unit 22 into a digital signal, and outputs the digital signal to the audio level detector 24 as audio data. Note that the sampling frequency of audio data in the present embodiment is 20 kHz. The audio level detection unit 24 is configured by a circuit that detects the level of audio converted into a digital signal and sends the detection result to the control unit 9 as audio level information.

The audio data input to the audio level detection unit 24 is temporarily stored in the image memory 6 by the memory controller 5 and then multiplexed by the control unit 9 with the image data fetched from the CCD 2 and stored in the storage medium 10. Be recorded. The control unit 9 reads out the image data from the storage medium 10 as necessary, and separates the audio data multiplexed into the image data. The D / A converter 25 converts the audio data separated by the controller 9 into an audio signal (analog signal) and outputs the audio signal to the audio output unit 26. The audio output unit 26 includes an amplifier that amplifies an input audio signal, a speaker that converts the amplified audio signal into audio, and emits sound. The rest of the configuration is the same as that of the digital camera 1 in FIG. 1, and therefore, the same portions are denoted by the same reference numerals and description thereof will be omitted.

Next, the operation of the digital camera 21 according to the present invention will be described. FIG. 8 is a flowchart showing key processing executed by the CPU of the control unit 9 at regular intervals in the shooting standby state. FIGS. 10 and 11 illustrate the operation of the digital camera 21 corresponding to the key processing. It is a timing chart for performing. In the key processing according to the present embodiment, similarly to the first embodiment, the CPU of the control unit 9 determines that the time during which the shutter key was pressed is a predetermined moving image determination time (3. When it is determined that the time exceeds 1 second), the moving image mode processing is performed. When it is determined that the time does not exceed the moving image determination time, the still image mode processing is performed.

Referring to FIG. 8, the CPU determines at the start of the key processing operation whether or not the shutter key has been pressed (step SE1). When the ON flag has not been raised last time (NO in both step SE1 and step SE12), the process is terminated as it is. On the other hand, when the shutter key is pressed by the photographer and the previous ON flag is not set (YES in step SE1, NO in step SE2), that is, immediately after the shutter key is pressed, steps SE3 to SE10 are performed. "NEW
ON processing ". In this processing, as in the first embodiment, first, the previous ON flag is set, the timer value for moving image determination is cleared, and then the timer interrupt processing described in FIG. At the same time as permitting, the first one image data is taken into the image memory 6 in a size to be used as still image data (step SE3 to step SE6).

Subsequently, the CPU permits voice interrupt processing (details will be described later) every 50 μs, starts voice capture by the voice input unit 22 (recording operation) (step SE7), and starts the first voice. After fetching the data into a predetermined voice storage area of the image memory 6 which is assigned in advance (step SE8), the voice multiplex flag is cleared (step SE9), and the level continuation flag is further cleared (step SE10). The audio multiplex flag and the level continuation flag reflect a change in the level state of the audio input to the microphone of the audio input unit 22 as shown in FIGS. And the audio multiplexing flag, which is set when the level of the audio signal exceeds a predetermined level indicated by a broken line in FIGS. 10 and 11, indicates that the audio level exceeds the predetermined level and the state of the audio signal is constant. This flag is set when the multiplexing determination time (0.4 seconds in the present embodiment) has been continued.

After the "NEW ON process", the time period during which the shutter key is determined to be pressed (YES in step SE2) and the time period when it is determined that the shutter key is not pressed are determined. Also, if the ON flag was set last time (YES in step SE12) and the time counted by the moving image determination timer has not passed the predetermined chattering time (NO in step SF13), the "ON processing". To perform the process of incrementing the value of the moving image determination timer (step SE1).
1). That is, while the shutter key is kept depressed, the “ON processing” is continued, and during that time, the image data is output every 0.2 seconds by the timer interrupt processing permitted in step SE5 described above. The voice data is captured, and voice data is captured every 50 μsec by the voice interrupt process permitted in step SE7.

FIG. 9 is a flowchart showing the operation in the audio interruption processing. In the audio interruption processing, first, the audio interruption processing is input to the audio input section 22 and the A / D conversion section 2
After temporarily storing the audio data converted in step 3 in a predetermined audio storage area on the image memory 6 (step SF1), it is determined whether or not the above-mentioned audio multiplex flag is set (step SF2). Immediately after the above-mentioned "NEW ON process", the result of the determination is NO, and the sound level (the level of the sound taken in step SF1) detected by the sound level detecting section 24 is equal to or higher than the predetermined level. Is determined (step SF
3). Here, if it is not higher than the predetermined level (step SF
(NO in 3), the level continuation flag is cleared, or the process is terminated in the cleared state (step SF10).

Further, at the time of interruption, the audio level is equal to or higher than the predetermined level (YES in step SF3), and if the level continuation flag is not set (N in step SF4).
O), after setting the level continuation flag (step SF)
5), the value of the audio level determination timer is cleared (step SF6). Thereafter, while the level continuation flag is on (YES in step SF4), the value of the audio level determination timer is incremented at the time of interruption (step SF7), and it is determined whether the timer value has exceeded 0.4 seconds. Judgment is made (step SF8), and if it exceeds, the audio multiplex flag is set (step SF9). Then, at the time of interruption after the audio multiplex flag has been set once, the determination result of step SF2 becomes YES, and processing for temporarily storing the fetched audio data in the audio storage area of the image memory 6 sequentially (step S2).
Repeat only F1).

Returning to FIG. 8 again, if the photographer stops pressing the shutter key while the "ON processing" is continued (NO in step SE1, steps SE12, SE)
13 are both YES), the following “NEW OFF process” is performed. That is, the previous ON flag is cleared (step SE14), the timer interrupt processing of FIG. 3 is prohibited (step SE15), and the voice interrupt processing of FIG. 9 is prohibited (step SE16), and then the “ON processing” is counted. It is determined whether or not the timer value being processed has exceeded the moving image determination time (3.1 seconds) (step SE17). Here, if the timer value, that is, the time during which the photographer is pressing the shutter key (operation continuation time) does not exceed the moving image determination time,
The process shifts to the still image mode processing as shown in FIG. 10 (NO in step SE17), and if the time during which the photographer has pressed the shutter key exceeds the moving image determination time, as shown in FIG. (Step SE17)
YES).

In the moving image mode processing, the size of the image data first taken into the image memory 6 in step SE6 is converted from the still image size to the moving image size (step SE1).
8) The first image data whose size has been converted and the remaining (second and subsequent) image data stored in the timer interrupt processing in the moving image size from the beginning are stored in the image memory 6 in the moving image format.
Is once recorded in a predetermined area (step SE19).
In the still image mode process, the image data of the still image size first taken into the image memory 6 is once recorded in a still image format in a predetermined area of the image memory 6 (step SE20).

Further, after recording the image data in one of the formats, it is determined whether or not the audio multiplex flag is set (step SE21). Here, when the sound multiplexing flag is set, that is, when a sound higher than a predetermined value level is continuously input for more than 0.4 seconds while the shutter key is pressed (YES in step SE21) ), Read out the audio data stored in the audio storage area of the image memory 6, multiplex it with the image data once recorded in the still image format or the moving image format, and record it in the final image format with sound. (Step SE22). Conversely, if the above condition is not satisfied, the data once recorded in the predetermined area of the image memory 6 is recorded as it is in the recording means 10 and the process is terminated.

Therefore, also in the present embodiment, the photographer can perform photographing in the still image mode and photographing in the moving image mode only by adjusting the time for pressing the shutter key. Furthermore, even if the photographer does not select two types of image recording formats with and without sound before shooting, the photographer can shoot a still image or a moving image with sound in a situation suitable for shooting with sound. Conversely, in a situation suitable for shooting without sound, a still image or a moving image without sound can be shot. This can also reduce the frequency of missing a photo opportunity. In addition, when the audio input level does not satisfy the above-mentioned conditions, for example, when the sound at the time of shooting is too low and the recorded content cannot be heard at the time of reproduction, it is automatically recorded in an image format without sound. Audio data can be omitted, and the recording size of image data can be reduced. As a result, the recording means 10
Can effectively use the recording capacity of the data.

In the present embodiment, a voice storage area is provided in a part of the image memory 6 and voice data is stored therein while the shutter key is pressed. Separately, an audio memory may be provided and audio data may be temporarily stored therein. Further, the audio data may not be multiplexed with the image data, and may be recorded in a part of the image memory 6 or a separately provided audio memory so as to correspond to the image data. Further, in the present embodiment, the moving image capturing interval is set to 0.2 seconds, the audio capturing interval is set to 50 μs, the moving image determination time is set to 3.1 seconds, and the audio multiplex determination time is set to 0.4 seconds. Can be set to any time.

The following can also be performed. For example, a voice ROM for storing voice data is separately provided, and default voice data (one or more) such as tone data prepared in advance is stored in the voice ROM, or the default voice data is stored in the recording unit 10 or the like. If the result of the determination in step SE21 of the above key processing is NO and the audio multiplex flag is not set, the default audio data stored in the audio ROM or the like is converted to image data. It is possible to adopt a configuration in which the data is multiplexed and finally recorded in the recording means 10 in an image format with sound. In that case, a still image or a moving image with valid sound can always be recorded. Furthermore, if the photographer can set in advance whether or not to use the default audio data, the usability is improved. Further, in a case where an area for storing default audio data is provided in a part of the recording unit 10, for example, the user records audio by a predetermined recording operation using the microphone of the audio input unit 22, or externally. If the input voice data is recorded (updated) as default voice data by a predetermined setting operation, usability is further improved.

(Fourth Embodiment) Next, a fourth embodiment of the present invention will be described.
An embodiment will be described. As in the third embodiment, the present embodiment also relates to a digital camera having a shooting mode with sound that records sound simultaneously with shooting of a still image or a moving image.

FIG. 12 is a block diagram showing an electrical configuration of the digital camera 31 according to the present embodiment. Less than,
Explaining the difference from the digital camera 21 (FIG. 7) of the third embodiment, the digital camera 31 eliminates the above-described audio level detection unit 24,
An exposure amount judging unit 32 is provided. The exposure amount determining unit 32 determines whether or not the image was captured with an appropriate exposure amount at the time of image capturing based on the image data sent from the memory controller 5 and sends the determination result to the control unit 9 as exposure information. It is constituted by. In addition,
Except for these points, the digital camera 21 is the same as the digital camera 21 shown in FIG. When the CPU of the control unit 9 has a relatively high processing performance, the exposure amount determination unit 3
2, the control unit 9 may independently acquire the exposure information.

Next, the operation of the digital camera 31 according to the present invention will be described. FIG. 13 is a flowchart showing key processing executed by the CPU of the control unit 9 at regular intervals in the shooting standby state. In the key processing according to the present embodiment, similarly to the third embodiment, the control unit 9 performs the key processing.
When the CPU determines that the time during which the shutter key has been pressed has exceeded the predetermined moving image determination time (3.1 seconds), the CPU performs a moving image mode process, and determines that the time has not exceeded the moving image determination time. If so, still image mode processing is performed.

That is, the CPU of the control section 9 immediately after the shutter key is pressed by the photographer (YES in step SG1, step SG2) similarly to the above-described embodiment.
NO), and performs a “NEW ON process”. In this process, first, the previous ON flag is set (step SG).
3) After clearing the timer value for moving image determination (step SG4), it is determined whether the exposure amount is appropriate based on the exposure information from the exposure amount determination unit 32 (step SG5).
Here, if the exposure amount is appropriate, the timer interruption process described above with reference to FIG. 3 at intervals of 0.2 seconds is permitted (step SG6), and the first image data of one frame is used for a still image. After the data is fetched into the image memory 6 at the size to be used as data (step SG7), the process proceeds to step SG8. Conversely, for example, when it is determined that the exposure is significantly insufficient and the exposure amount is not appropriate (N in step SG5)
O), immediately proceed to step SG8.

After that, the voice interrupt process is enabled every 50 μsec, and the voice input unit 22 starts capturing voice (recording operation) (step SG8). Note that, unlike the third embodiment, the audio interruption process in the present embodiment stores the audio data input to the audio input unit 22 and converted by the A / D conversion unit 23 in a predetermined audio storage on the image memory 6. Processing for sequentially and temporarily storing in the area (step SF in FIG. 9)
1). Subsequently, after the first audio data is fetched into a predetermined audio storage area of the image memory 6 which is allocated in advance (step SG9), "NEW" is read.
ON process "is ended.

After the "NEW ON processing", "ON processing" for incrementing the value of the moving image discrimination timer is performed in the same procedure as in the third embodiment (step SG10). While the is kept pressed, the “ON processing” is continued. In the meantime, if the result of the determination in step SG5 is YES, image data is captured every 0.2 seconds and audio data is captured every 50 μsec. Conversely, if the result of the determination in step SG5 is NO, only the audio data is taken in every 50 μsec.

Thereafter, if the photographer stops pressing the shutter key while the "ON processing" is continued (NO in steps SG1 and YES in steps SG11 and SE12), the process proceeds to step SG13 to SG22. NEW
OFF processing ". First, after clearing the previous ON flag (step SG13), if image capture from the CCD 2 has been performed, that is, if timer interrupt processing every 0.2 seconds is permitted (YE in step SG14).
S) First, the timer interrupt processing is prohibited (image capture is ended) (step SG15), and it is determined whether or not the timer value counted in the “ON processing” exceeds the moving image determination time (3.1 seconds). Is determined (step SG16). Then, in accordance with the result of the determination, the mode shifts to the still image mode and the moving image mode, respectively, as in the third embodiment, and the image data is stored in a predetermined area Once (step SG17).
SG19), and proceeds to step SG21.

On the other hand, if the decision result in the step SG14 is NO.
If the timer interrupt processing at intervals of 0.2 seconds is not permitted, the process directly proceeds to step SG21 without performing the processing of steps SG15 to SG19 and proceeds to step SG21.
Disables audio interrupt processing every second (ends audio data capture). Thereafter, while reading out the audio data stored in the audio storage area of the image memory 6,
This is recorded in the recording means 10 (step SG22), and the process is terminated. At this time, the audio data is recorded in a state where it is multiplexed with the image data if any of the image data of the still image and the moving image is recorded in the image memory 6. If not, record it alone.

Therefore, also in the present embodiment, the photographer can perform photographing in the still image mode and photographing in the moving image mode only by adjusting the time during which the shutter key is pressed. Furthermore, in the state where the shooting mode with sound is selected, when an image is not captured with an appropriate exposure amount, for example, when the exposure amount is large enough and the image cannot be read at the time of reproduction, it is automatically set. Since only audio is recorded, useless recording of image data can be omitted, and the data recording size can be reduced. As a result, the data recording capacity of the recording means 10 can be used effectively.

In this embodiment, as in the third embodiment, an audio storage area is provided in a part of the image memory 6, and audio data is stored therein while the shutter key is pressed. However, an audio memory may be provided separately from the image memory 6 to temporarily store audio data. Further, the audio data may not be multiplexed with the image data, and may be recorded in a part of the image memory 6 or a separately provided audio memory so as to correspond to the image data. The same applies to each set time such as a moving image capturing interval.

The following can also be performed. For example, an image ROM for storing image data is separately provided, and default image data (still image data, moving image data, etc., such as a natural image or any other arbitrary pattern image) prepared in advance may be provided. Or the default image data may be stored in the recording means 10 or the like.
If the result of the determination in step SG14 of the above key processing is NO
If the timer interrupt processing at intervals of 0.2 seconds is not permitted, the default image data stored in the image ROM or the like is read out, and the image memory is replaced with the image data captured. 6 and multiplex the audio data with the default image data or record the audio data in the recording means 10 in association with the multiplexed audio data. In that case, the sound can always be recorded together with the valid image. Furthermore, if the photographer can set in advance whether or not to use the default image data, usability is improved. Further, in a case where an area for storing default image data is provided in a part of the recording means 10, for example, the data of an arbitrary image selected by the user from a photographed image or an image photographed and recorded in advance. Can be recorded (updated) as default image data by a predetermined setting operation, the usability is further improved.

[0064]

As described above, in the present invention,
The image data of the subject is recorded in a data format for a still image when the operation continuation time in the photographing instruction means does not exceed a predetermined time, and is recorded in a data format for a moving image when the operation continuation time exceeds the predetermined time. I made it. Therefore, the photographer can perform the shooting in the still image mode and the shooting in the moving image mode only by adjusting the time of pressing the shutter key, and can perform the shooting in the shooting mode desired by the photographer without making the photographer perform complicated operations. Can be taken.

Also, while the photographing instruction operation of the operation means is being performed, the compression of the image data for the moving image format is started,
The storage capacity of image data to be secured is reduced. Therefore, it is possible to record a moving image for a longer time.

Further, at the time of photographing a subject, it is possible to prevent the recording of an invalid sound when the recorded image is displayed and to reproduce the recorded image. Therefore, the recording memory for recording the unnecessary audio data is not wasted and the recording memory is not wasted. Memory can be used effectively. In addition, according to the situation at the time of shooting, an effective voice can be always recorded together with the captured image, or an effective image can be always recorded together with the audio at the time of shooting.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an electrical configuration of a digital camera according to a first embodiment of the present invention.

FIG. 2 is a flowchart illustrating a key process executed by a CPU of a control unit at regular intervals in a shooting standby state.

FIG. 3 is a flowchart showing a timer interrupt process executed by a CPU of a control unit at a constant interval in the photographing standby state.

FIG. 4 is a timing chart showing a digital camera operation in a case where a transition is made to a still image mode (a) and a case where a transition is made to a moving image mode (b) in accordance with the key processing in FIG. 2;

FIG. 5 is a flowchart illustrating a key process executed by a CPU of a control unit at regular intervals in a shooting standby state according to a second embodiment of the present invention.

FIG. 6 is a flowchart showing a timer interrupt process executed by a CPU of a control unit at a constant interval in the embodiment.

FIG. 7 is a block diagram illustrating an electrical configuration of a digital camera according to a third embodiment of the present invention.

FIG. 8 is a flowchart showing key processing executed by the CPU of the control unit at regular intervals in a shooting standby state in the embodiment.

FIG. 9 is a flowchart showing a voice interrupt process executed by a CPU of a control unit at a constant interval.

FIG. 10 is a timing chart showing the operation of the digital camera when the mode shifts to the still image mode following the key processing of FIG. 8;

FIG. 11 is a timing chart showing a digital camera operation when the mode shifts to the moving image mode in accordance with the key processing of FIG. 8;

FIG. 12 is a block diagram illustrating an electrical configuration of a digital camera according to a fourth embodiment of the present invention.

FIG. 13 is a flowchart showing key processing executed by the CPU of the control unit at regular intervals in a shooting standby state in the embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Digital camera 2 CCD 6 Image memory 9 Control part 10 Recording medium 11 Key processing part 21 Digital camera 22 Audio input part 24 Audio level detection part 31 Digital camera 32 Exposure amount judgment part

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. 7 Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 H04N 5/91 J CF term (Reference) 2H054 AA01 2H104 AA12 AA16 5C022 AA00 AA13 AB01 AB67 AC32 AC52 AC69 AC71 AC72 CA01 5C052 AA17 AB04 CC11 GA01 GB05 GB06 GB07 GD03 GD10 GE04 GF01 5C053 FA07 FA27 GA11 GB11 GB37 HA27 JA22 JA23 KA04 KA21 KA24 KA25 LA01

Claims (8)

    [Claims]
  1. A still image mode for recording image data of a subject imaged by an imaging means in a data format for a still image;
    And an image recording apparatus having a moving image mode for recording in a data format for a moving image, comprising: an operation unit for performing a shooting instruction operation for instructing imaging of a subject; a timing unit for measuring a duration of the shooting instruction operation by the operation unit; Switching means for switching the recording format of the image data of the subject imaged by the imaging means from the still image to the moving image in accordance with the operation continuation time measured by the timing means exceeding the determined time. An image recording apparatus, comprising:
  2. 2. When the operation duration time measured by the time measuring means exceeds a predetermined time, image data of a subject imaged by the imaging means is sequentially compressed to generate the moving image data. 2. The image recording apparatus according to claim 1, further comprising a data generation unit that performs the data generation.
  3. 3. An audio input unit for inputting a sound to be reproduced when displaying image data recorded in response to a shooting instruction operation of the operation unit, and a shooting instruction operation of the operation unit by inputting a sound input to the audio input unit. Recording means for recording in accordance with, a detecting means for detecting the input level of the voice in the voice input means, and a timing means for measuring the time during which the detection result of the detecting means continuously exceeds a predetermined level, While the photographing instruction operation by the operation means is continued, only when the time measured by the timer is equal to or longer than a predetermined time, the sound input to the sound input means is used as the photographing instruction operation by the operation means. 3. The image recording apparatus according to claim 1, further comprising: a control unit that causes the recording unit to record the image corresponding to the image of the captured subject.
  4. 4. An image recording apparatus for recording, as image data, an image of a subject imaged by an imaging means, an operation means for performing a shooting instruction operation for instructing the imaging of the subject, Voice input means for inputting a voice reproduced at the time of displaying the image data, recording means for recording the voice input to the voice input means, detection means for detecting an input level of the voice in the voice input means, A timer for measuring the time during which the detection result of the detector is continuously in excess of a predetermined level; and a time measured by the timer while the shooting instruction operation by the operation unit is continued. Only when the time is equal to or longer than a predetermined time, the sound input to the sound input means is matched with the image of the subject imaged in accordance with the shooting instruction operation by the operation means. Control means for causing the recording means to record in response thereto.
  5. 5. The control unit, when the time measured by the clock unit does not reach a predetermined length within a period in which the imaging instruction operation by the operation unit is continued,
    5. The image recording apparatus according to claim 3, wherein a voice prepared in advance is recorded in the recording unit in correspondence with an image of a subject imaged in accordance with a shooting instruction operation by the operation unit.
  6. 6. The control device according to claim 3, wherein the control unit controls the recording unit to superimpose a voice input to the voice input unit on an image of a subject imaged in response to a shooting instruction operation by the operation unit. , 4 or 5.
  7. 7. An exposure detecting means for detecting an exposure amount at the time of imaging of a subject by the imaging means, wherein the control means, when the exposure amount detected by the exposure detecting means does not reach a predetermined amount, 7. The image recording apparatus according to claim 1, wherein recording of the image data in response to a shooting instruction operation of an operation unit is stopped.
  8. 8. The recording means, wherein when the exposure amount detected by the exposure detection means has not reached a predetermined amount, the control means superimposes a sound input to the sound input means on a previously prepared image. The image recording apparatus according to any one of claims 3 to 7, wherein the image recording apparatus is configured to perform recording.
JP2000291560A 2000-09-26 2000-09-26 Image recording device Expired - Fee Related JP3900812B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2000291560A JP3900812B2 (en) 2000-09-26 2000-09-26 Image recording device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2000291560A JP3900812B2 (en) 2000-09-26 2000-09-26 Image recording device

Publications (2)

Publication Number Publication Date
JP2002101331A true JP2002101331A (en) 2002-04-05
JP3900812B2 JP3900812B2 (en) 2007-04-04

Family

ID=18774614

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2000291560A Expired - Fee Related JP3900812B2 (en) 2000-09-26 2000-09-26 Image recording device

Country Status (1)

Country Link
JP (1) JP3900812B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007142715A (en) * 2005-11-17 2007-06-07 Megachips Lsi Solutions Inc Imaging apparatus
US8605162B2 (en) 2004-12-03 2013-12-10 Nikon Corporation Digital camera having video file creating function
US20150281563A1 (en) * 2014-03-31 2015-10-01 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
CN105009564A (en) * 2013-03-08 2015-10-28 汤姆逊许可公司 Method and apparatus for camera control using a virtual button and gestures

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8605162B2 (en) 2004-12-03 2013-12-10 Nikon Corporation Digital camera having video file creating function
JP2007142715A (en) * 2005-11-17 2007-06-07 Megachips Lsi Solutions Inc Imaging apparatus
JP4682382B2 (en) * 2005-11-17 2011-05-11 株式会社メガチップス Imaging device
KR102092431B1 (en) * 2013-03-08 2020-03-23 인터디지털 씨이 페이튼트 홀딩스 Method and apparatus for camera control using a virtual button and gestures
CN105009564A (en) * 2013-03-08 2015-10-28 汤姆逊许可公司 Method and apparatus for camera control using a virtual button and gestures
KR20150128688A (en) * 2013-03-08 2015-11-18 톰슨 라이센싱 Method and apparatus for camera control using a virtual button and gestures
JP2016519447A (en) * 2013-03-08 2016-06-30 トムソン ライセンシングThomson Licensing Method and apparatus for camera control with virtual buttons and gestures
US10642403B2 (en) 2013-03-08 2020-05-05 Interdigital Ce Patent Holdings Method and apparatus for camera control using a virtual button and gestures
US9591218B2 (en) * 2014-03-31 2017-03-07 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
US9800784B2 (en) * 2014-03-31 2017-10-24 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
US9832380B2 (en) * 2014-03-31 2017-11-28 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
US10110815B2 (en) 2014-03-31 2018-10-23 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
US20150281563A1 (en) * 2014-03-31 2015-10-01 Facebook, Inc. Techniques to selectively capture visual media using a single interface element
US9258480B2 (en) * 2014-03-31 2016-02-09 Facebook, Inc. Techniques to selectively capture visual media using a single interface element

Also Published As

Publication number Publication date
JP3900812B2 (en) 2007-04-04

Similar Documents

Publication Publication Date Title
US7417667B2 (en) Imaging device with function to image still picture during moving picture imaging
JP4628681B2 (en) Method and apparatus for capturing sensory data in relation to image data
US7145601B2 (en) Multi-modal reproducing apparatus and digital camera
KR100610582B1 (en) Image processing system, image processing method, electronic camera, and image processing apparatus
US8327283B2 (en) Electronic apparatus with display unit to display icon for mode and associated information-processing method
JP4154400B2 (en) Imaging apparatus, control method thereof, and program
US20030076312A1 (en) Image display control for a plurality of images
US7667763B2 (en) Image pickup equipment and method
US8155431B2 (en) Image file processing apparatus which generates an image file to include stereo image data, collateral data related to the stereo image data, information of a date and time at which the collateral data is updated, and information of a date and time at which the image file is generated or updated, and corresponding image file processing method
US8571378B2 (en) Image capturing apparatus and recording method
JP2006025238A (en) Imaging device
KR100821801B1 (en) Image capture apparatus and auto focus control method
JP4315085B2 (en) Camera device and moving image shooting method
JP4730402B2 (en) Imaging apparatus, imaging control method, and program
US20020021361A1 (en) Digital camera, control method thereof and protable terminal
JP5424732B2 (en) Imaging apparatus, control method thereof, and program
JP4873031B2 (en) Imaging apparatus, imaging method, and program
JP5117280B2 (en) Imaging device, imaging method, reproduction device, and reproduction method
US7760241B2 (en) Image capturing apparatus
JP2004289376A (en) Digital camera
JP4395619B2 (en) Imaging apparatus, imaging condition setting method, and program
JP3800192B2 (en) Imaging apparatus, image composition method, and image composition program
US7428012B2 (en) Image processing method including generating face region information and a digital camera including face region identification unit
JP2009017078A (en) Digital still camera and its operation controlling method
JP2004201282A (en) Photographing device and photographing method

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20050329

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20060911

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060919

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20061108

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20061212

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20061225

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110112

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110112

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120112

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130112

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130112

Year of fee payment: 6

LAPS Cancellation because of no payment of annual fees