JPH0997490A - Camera recording device, camera reproducing device and recording device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable recording/reproducing of not only still picture but also voice data and to enable recording/reproducing, while adding character patterns, in a recording/reproducing device of still pictures which uses MDs. SOLUTION: Since an image compression/expansion circuit 27 which compresses/expands video data and a voice compression/expansion circuit 41 which compresses/expands voice data are provided, recording/reproducing of voice data as well as still pictures are possible. Reproduction of narration and BGM is possible by recording the file managing data for managing compressed video data and compressed audio data. Speeding-up of processing and reduction of circuit scale are expected by providing a common DRAM 42 for video data and voice data. Video images displaying display frames and characters can be recorded by alloting the data region of characters, patterns, etc., to an image memory 31.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera recording device and a camera reproducing device suitable for use in an electronic still camera for recording / reproducing still image digital video signals on an optical disc or a magneto-optical disc.

[0002]

2. Description of the Related Art A subject image is picked up by a CCD image pickup device, a video signal based on the picked-up image signal is digitized, compressed by, for example, JPEG (Joint Photographic Experts Group) type image compression, and recorded on a recording medium. An electronic still camera of a digital recording system has been proposed. The JPEG method uses DCT (Discrete Cosine Transf
orm) and the variable-length code to compress the still image data.
It can be compressed to / 8 to 1/100.

As a recording medium used in such a digital recording type electronic still camera, the present applicant has proposed using a magneto-optical disk having a diameter of 64 mm housed in a cartridge. This magneto-optical disk is basically the same as a music MD (mini disk),
When still image data compressed by the JPEG method is recorded on this magneto-optical disc, about 300 still image data can be recorded on one disc.

An electronic still camera of a digital recording system using such a magneto-optical disc is capable of recording a large number of still image data on one disc, and since it is digital recording, the image quality is not deteriorated. It is also easy to edit. Still image data can be copied on the screen of another application on a computer, and is expected to be widely used in the future.

[0005]

When shooting with an electronic still camera, it is sometimes desirable to save not only still image data but also the situation and commentary at the time of shooting as voice data. In addition to the captured still image data, there are cases where it is desired to leave the characters at the time of shooting, the shooting location, the date, etc., the display frame, and the decorative pattern. Furthermore, there is a case where the photographed still image is desired to be enlarged, reduced, or deformed.

Therefore, an object of the present invention is to provide a camera recording / reproducing apparatus capable of recording / reproducing not only still image data but also audio data.

Another object of the present invention is to provide a camera recording / reproducing apparatus capable of narration reproduction for listening to explanations related to images and BGM reproduction for performing music reproduction for a long time. .

Still another object of the present invention is to provide a camera recording / reproducing apparatus capable of recording / reproducing characters indicating a state of photographing, a photographing place, a date, etc., a display frame, a decorative pattern and the like. To provide.

Still another object of the present invention is to provide a camera recording / reproducing apparatus which can easily enlarge, reduce or deform a photographed still image.

[0010]

SUMMARY OF THE INVENTION The present invention is directed to video input means for inputting video data, image compression means for compressing video data input by the video input means, and compressed video data from the image compression means. Image memory means for accumulating audio data, audio input means for inputting audio data, audio compression means for compressing the audio data input by the audio input means, compressed video data and compressed video data in the program area of the data recording medium. Recording means for recording audio data, and recording file management data for managing compressed video data and compressed audio data in a management area of a data recording medium.

The present invention is a camera reproducing apparatus for reproducing video and audio data from a data recording medium having a management area and a program area, wherein compressed video and compressed audio are recorded according to file management data in the management area. Reproducing means for reproducing the data, image memory means for accumulating the compressed video data from the reproducing means,
Image decompressing means for decompressing compressed video data from the image memory means, audio memory means for storing compressed audio data from the reproducing means, and audio decompressing means for decompressing the compressed audio data from the audio memory means. It is a camera reproducing device consisting of.

According to the present invention, video input means for inputting video data, image memory means for storing the video data input by the video input means, image processing means for performing image processing on the video data, and input by the video input means. Image compression means for compressing the compressed video data,
Recording means for recording the compressed video data,
The recording device selectively records the video data image-processed by the image processing unit and the video data not image-processed by the recording unit.

Image compression / compression for compressing / decompressing video data
Since the expansion means and the audio compression / expansion means for compressing / expanding audio data are provided, not only still images but also audio data can be recorded / reproduced.

By recording the file management data for managing the video data and the audio data, it is possible to perform the narration reproduction for listening to the explanation related to the image and the BGM reproduction for performing the music reproduction for a long time.

By providing a common buffer memory for video data and audio data, the processing speed can be increased and the circuit scale can be reduced.

By providing means for performing image processing on the video data, it is possible to record an image in which a display frame and characters are displayed.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows an external configuration of a digital electronic still camera to which the present invention is applied. FIG. 1A shows a configuration of a front surface thereof, and FIG. 1B shows a configuration of a rear surface thereof. This electronic still camera compresses a digital still image video signal by the JPEG method and
(Mini disk) is recorded on the same magneto-optical disk.

In FIGS. 1A and 1B, reference numeral 1 indicates an electronic still camera body. A lens 2 is attached to a front surface 1A of the electronic still camera body 1. The subject image light is taken in through the lens 2. A microphone 11 is provided on the front surface 1A of the electronic still camera body 1. With this microphone 11,
External sound is picked up.

A liquid crystal display 3 is attached to the back surface 1B of the electronic still camera 1. On the liquid crystal display 3, a screen being photographed is displayed. The liquid crystal display 3 can be used as a finder. A reproduction screen is displayed on the liquid crystal display 3.

On the upper surface 1C of the electronic still camera body 1,
The shutter 4 is attached, and various switches 5 are attached. A video output terminal 6 and audio output terminals 10A and 10B are attached to the side surface 1D of the electronic still camera body 1. The side 1E of the electronic still camera body 1 is provided with a disc insertion slot 8. As shown in FIG. 1C, a cartridge 9 containing a magneto-optical disk 51 having a diameter of 64 mm is mounted in the disk insertion slot 8. This cartridge 9 is M for music
The same thing as D (mini disk) can be used.

When taking a picture with the electronic still camera body 1, the lens 2 is directed toward the subject image. The image captured through the lens 2 is photoelectrically converted by the CCD image pickup device 22 (FIG. 3) in the electronic still camera body 1 and captured in the image memory 31, as described later in detail. Then, this image is displayed on the liquid crystal display 3. When the shutter 4 is pressed, a still image based on the image captured via the lens 2 is recorded on the magnetic disk 51 in the cartridge 9.

The still image recorded on the magneto-optical disk 51 can be reproduced on the liquid crystal display 3. If the video output terminal 6 of the electronic still camera body 1 is connected to the video input terminal of the television receiver, a still image recorded on the magneto-optical disk 5 is reproduced on the screen of the television receiver. be able to.

The liquid crystal display 3 displays the screen being photographed, and as shown in FIG. 2, characters 102 indicating the operating state, photographing location, date, etc., display frame, decorative pattern 101, etc. Can be displayed. The characters indicating the operation state, the shooting location, the date, etc., the display frame, the decoration pattern, and the like can be recorded on the magneto-optical disk 51 together with the video screen by operating the key input 29.

Furthermore, a still image recorded on the magneto-optical disk 51 can be reproduced by a personal computer,
The still image stored on the magneto-optical disk 51 can be edited on the personal computer using an image editing application program.

The sound picked up by the microphone 11 can be recorded on the magneto-optical disk 51 in the cartridge 9. The reproduced audio signal from the magneto-optical disk 51 is output from the audio output terminals 10A and 10B.

FIG. 3 is a block diagram showing the structure of an electronic still camera to which the present invention is applied. In FIG.
Reference numeral 21 is a magneto-optical disk drive. A magneto-optical disk (or optical disk) 51 having a diameter of 64 mm mounted on the cartridge is mounted on the magneto-optical disk drive 21. A digital video signal or digital audio signal compressed by the JPEG system is recorded / reproduced on the magneto-optical disk 51.

Reference numeral 22 is a CCD image pickup device. The lens 2 is arranged on the front surface of the CCD image sensor 22. The subject image light that has passed through the lens 2 is imaged on the light receiving surface of the CCD image pickup element 22. The subject image light is photoelectrically converted by the CCD image sensor 22.

Reference numeral 23 is a CPU. CPU 23
An electronic still such as a process for compressing a video signal captured by the CD image pickup device 22 and recording it on the magneto-optical disk 51 and a process for expanding and reproducing a signal reproduced from the magneto-optical disk 51. The recording / reproducing process of the entire camera body 1 is performed. From this CPU 23, the CP
A U bus 24 is derived. The CPU bus 24 has R
The OM 25, the RAM 26, the image compression / expansion circuit 27, the memory controller 28, the input key 29, the audio compression / expansion circuit 41, and the DRAM 42 are connected, and the magneto-optical disk drive 21 is connected via the interface 30. The input keys 29 include keys for the shutter 4.

The magneto-optical disk drive 21 in which the magneto-optical disk 51 is mounted is constructed as follows.

The magneto-optical disk 51 is rotated by a spindle motor 52. An optical pickup 53 and a magnetic head 54 are provided for the magneto-optical disk 51. The optical pickup 53 and the magnetic head 54 are movable in the radial direction of the disk by a sled mechanism 56.

The servo circuit 55 controls the biaxial device of the optical pickup 53 based on the focus and tracking tracking error signal from the RF circuit 69 to perform focus and tracking control, and also controls the sled mechanism 56. There is. Further, the spindle motor 52 is controlled by the servo circuit 55.

The recording data taken in via the interface 30 is encoded by the encoder 57 at the time of recording. The output of the encoder 57 is supplied to the magnetic head 54 via the driver 58. Then, the laser beam from the optical pickup 53 is applied to the magneto-optical disk 5.
1 and a modulated magnetic field from the magnetic head 54 is applied to the magnetic disk 54.

At the time of reproduction, the optical pickup 53 irradiates the magneto-optical disk 51 with a laser beam. This return light is supplied to the RF circuit 59. From the output of the RF circuit 59, a reproduced signal is obtained. This reproduced signal is supplied to the decoder 60. The output of the decoder 60 is supplied to the interface 30.

Addresses are wobble recorded on the magneto-optical disk 51. This address is detected by the address decoder 61.

Next, the operation of a digital electronic still camera to which the present invention is applied during still image recording will be described. At the time of recording a still image, the subject image light passing through the lens 2 is formed on the light receiving surface of the CCD image sensor 22. The subject image light is photoelectrically converted by the CCD image sensor 22. The output of the CCD image pickup device 21 is supplied to the A / D converter 33 via the sample hold and AGC circuit 32. The image pickup signal is digitized by the A / D converter 33.

The output of the A / D converter 33 is supplied to the camera signal processing circuit 34. The camera signal processing circuit 34 converts the luminance signal Y and the color difference signal RY from the image pickup signal,
A component video signal composed of BY is formed. The camera signal processing circuit 34 performs camera signal processing such as gamma correction, aperture correction, and shading processing.

The video signal from the camera signal processing circuit 34 is taken into the image memory 31 under the control of the memory controller 28. Then, the video signal taken into the image memory 31 is supplied to the D / A converter 35 under the control of the memory controller 28. D / A
The converter 35 converts the digital video signal into an analog video signal.

The output of the D / A converter 35 is supplied to the video signal processing circuit 36. The output of the video signal processing circuit 36 is supplied to the liquid crystal display 3 via the liquid crystal driver 37. The liquid crystal display 3 can be used as a finder at the time of shooting. In the video signal processing circuit 36, for example, a composite video signal of the NTSC system is formed, and this composite video signal is output from an analog video signal output terminal 38.

When the shutter 4 (FIG. 1) is pressed during recording, a video signal based on the screen at that time is taken into the image memory 31. The video signal fetched into the image memory 31 is subjected to image compression /
It is supplied to the expansion circuit 27. Image compression / decompression circuit 27
Is for compressing / expanding a digital video signal using the JPEG method. In the JPEG system, a digital video signal is subjected to DCT conversion and variable-length coding,
It compresses digital video signals.

The image compression / expansion circuit 27 compresses the video signal from the image memory 39 by the JPEG method.
The compressed video signal is temporarily stored in the DRAM 42 via the CPU bus 24. And the DRAM 42
Is supplied to the encoder 57 of the magneto-optical disk drive 21 via the interface 30.

The encoder 57 performs error correction coding processing and further modulation processing. The output of the encoder 57 is supplied to the magnetic head 54 via the driver 58. A laser beam is emitted from the optical pickup 53, and a magnetic field modulated by the output of the encoder 57 is applied to the magnetic head 54. This allows
The compressed video signal is recorded on the magneto-optical disk 51.

During recording, the video signal stored in the image memory 31 is supplied to the D / A converter 35. The output of the D / A converter 35 is supplied to a video signal processing circuit 36. The output of the video signal processing circuit 36 is supplied to the liquid crystal display 3 via the liquid crystal driver 37. As a result, the image being captured is displayed on the liquid crystal display 3.

As will be described later, the image memory 31 is provided with an area for pattern data and an area for character data in addition to the areas for luminance signal data and chroma signal data. The pattern data and the character data are assigned to the pattern data area and the character data area. The pattern data and the character data are combined with the luminance signal data and the chroma signal data using a microprogram. As described above, the video data in which the pattern data and the character data are combined is displayed on the liquid crystal display 3, and the video data in which the pattern data and the character data are combined can be recorded on the magneto-optical disk 51. is there.

Next, the operation when reproducing a still image will be described. At the time of still image reproduction, an image to be reproduced is designated by key input 29. The optical pickup 53 is moved to the address where the designated image is recorded, and the compressed video signal of the designated image is reproduced from the magneto-optical disk 51 by the optical pickup 53. This playback signal is
The signal is supplied to the decoder 60 via the RF amplifier 59. In the decoder 60, processes such as data demodulation and error correction are performed.

The output of the decoder 60 is the interface 3
0, temporarily stored in the DRAM 42 via the CPU bus 24. Then, the data from the DRAM 42 is supplied to the image compression / decompression circuit 27. Image compression / decompression circuit 2
At 7, the video signal compressed by the JPEG method is expanded. The expanded video signal is stored in the image memory 31 under the control of the memory controller 28.

The video signal stored in the image memory 31 is supplied to the D / A converter 35. The output of the D / A converter 35 is supplied to a video signal processing circuit 36. The output of the video signal processing circuit 36 is a liquid crystal driver 37
Is supplied to the liquid crystal display 3 via the.

The video signal processing circuit 36 forms a composite video signal of, for example, NTSC system, and the composite video signal is output from the analog video signal output terminal 38.

The electronic still camera to which the present invention is applied can record / reproduce audio data in addition to still image data. When recording audio data, an audio signal is supplied to the input terminal 45. This voice signal is A /
It is supplied to the D converter 43. A / D converter 43
Then, this audio signal is digitized. The output of the A / D converter 43 is supplied to the audio compression / expansion circuit 41. The audio data is compressed by the audio compression / expansion circuit 41.

The compressed audio data is temporarily stored in the DRAM.
42. The audio data is transmitted to the magneto-optical disk drive 21 via the interface 30.
Is supplied to the encoder 57. And the encoder 5
7, an error correction encoding process is performed, and further, a modulation process is performed, and the compressed audio signal is recorded on the magneto-optical disk 51.

When reproducing the audio data, the compressed audio data is reproduced from the magneto-optical disk 51. The reproduced data is supplied to a decoder 60 via an RF amplifier 59.
And the output of the decoder 60 is
0 on the CPU bus 24. The compressed audio data is temporarily stored in the DRAM 42. Then, the compressed audio signal is supplied to the DRAM 42
Is supplied to the audio compression / decompression circuit 41. The audio signal is expanded by the audio compression / expansion circuit 41. This audio signal is supplied to the D / A converter 24. The output of the D / A converter 24 is output from the output terminal 46.

The audio signal compression method is a normal MD.
Is the same as. Therefore, a music MD can be mounted on the electronic still camera as the magneto-optical disk 51, and the electronic still camera can be used as a music MD player.

In the digital electronic still camera to which the present invention is applied, as described above, at the time of recording, the screen being photographed is displayed on the liquid crystal display 3, and the operating state, photographing place, date, etc. It is possible to display a character indicating, a display frame, a decorative pattern, and the like. The characters indicating the operation state, the shooting location, the date, etc., the display frame, the decorative pattern, etc. can be recorded on the magneto-optical disk 51 by operating the key input 29. It should be noted that these patterns and characters are stored in an area on the image memory 31, which is different from the brightness data and chroma data of the captured video. Therefore, it is also possible to record only the original image on the magneto-optical disk 51 excluding these patterns and characters.

Further, in the digital type electronic still camera to which the present invention is applied, the photographed image can be enlarged, reduced, or deformed and recorded. As described above, the DRAM 42 is provided, and when recording / reproducing a video signal or an audio signal,
The DRAM 42 is used as a buffer memory. The DRAM 42 can also be used when recording an image by enlarging, reducing, or deforming the image.

For example, in the case of enlarging and recording an image, the captured video signal is stored in the image memory 31. The video signal of the image memory 31 is compressed by the image compression / decompression circuit 27 and is temporarily stored in the DRAM 42. Here, when the enlargement command is sent, the DRAM 42
Are accessed, and the data in the DRAM 42 is expanded by the image compression / expansion circuit 27 and stored in the image memory 31.

Since the compressed image data is stored in the DRAM 42 once, the magneto-optical disk 51 is not accessed and the DRA is not sent when the enlargement command is sent.
It is sufficient to access M42, and high-speed processing can be realized.

As described above, the screen pattern or character is stored in the image memory 31 in a region different from the luminance data and chroma data of the photographed video. This will be described in detail below.

As the image memory 31, as shown in FIG. 4, a 4-Mbyte video RAM is used. That is, this video RAM has 512 bits in the horizontal direction, 512 bits in the vertical direction, and 16 bits in the depth direction. Therefore, the capacity of the image memory 31 is 512 × 512 × 16 = 4, 194, 304 bits.

The image memory 31 is allocated as shown in FIG. In FIG. 5, Y is an area of luminance signal data, C is an area of chroma signal data, CG is an area of character data, PA1 to PA8 and PB1 to PB4.
Is a pattern data area, CP is a color palette area, and R is a reserve.

The area Y of the luminance data is 32 in the horizontal direction.
The area is 0 bits, 480 bits in the vertical direction, and 16 bits in the depth direction.

That is, the number of pixels in one screen is 640 pixels in the horizontal direction and 480 pixels in the vertical direction. this is,
This corresponds to the number of effective pixels of one screen of the NTSC system. In this case, the number of samples in one screen is 640 × 480 = 307,200 pixels.

If the luminance signal is quantized with 8 bits, the capacity required for the luminance signal data is 640 × 480 × 8 = 2,457,600 bits as shown in FIG. 6A. Since a video RAM having a depth of 16 bits is used as the image memory 16, when this is allocated on a video RAM having a depth of 16 bits, the area required as the area Y of the luminance signal data is as shown in FIG. 6B. Then, an area of 320 in the horizontal direction and 480 in the vertical direction becomes 320 × 480 × 16 = 2,457,600 bits. In FIG. 3, the area consisting of (320 × 480) is assigned as the area Y of the luminance signal data.

Area C of chroma data is 1 in the horizontal direction.
60 bits, 480 bits vertically, 16 depths
Has been a bit.

That is, the chroma signals C _R and C _B have an information amount of 1/4 of the luminance signal data. Therefore, space required for the chroma signal data as the chroma signal _{C R, (640 × 480 ×} 8) / 4 = 614,400 as bit chroma signal _{C R, (640 × 480 ×} 8) / 4 = 614,400 Bits, which is 1,228,800 bits in total.

This is a 16-bit deep video RAM
When allocated above, the area required as the area C of the chroma data is 160 areas in the horizontal direction and 480 areas in the vertical direction, as shown in FIG. 7, 160 × 480 × 16 = 1, 228, 800 bits. In FIG. 4, this (160 × 480) area is allocated as an area C of chroma signal data.

When the area Y of the luminance signal data and the area C of the chroma signal data are combined, (480 × 480)
Area. On the other hand, the capacity of the video RAM is (512 × 512). This leaves 32 L-shaped areas in the horizontal direction and 32 in the vertical direction.
This L-shaped surplus area is used as the pattern data areas PA1 to PA8 and PB1 to PB4 and the character data area CG.

The character data area CG is an area of 32 bits in the horizontal direction, 256 bits in the vertical direction, and 16 bits in the depth direction.

That is, one screen for character display has 512 pixels in the horizontal direction and 480 pixels in the vertical direction, as shown in FIG. 8A. In the character display, four samples in the horizontal and vertical directions are treated as one sample and represented by two bits. In this case, the required capacity is (512 /
2) × (480/2) × 2 = 122,880 bits.

This is a 16-bit deep video RAM
When allocated above, the area required as the character data area CG is 3 in the horizontal direction as shown in FIG. 8C.
2, 256 areas in the vertical direction 32 × 256 × 16 = 131,072 bits. In FIG. 4, this (32 × 256) area is allocated as an area CG of character data.

The pattern data includes (64 × 32) pattern data areas PA1 to PA8 and (8 × 32)
128) PB1 to PB4.

That is, the screen of the pattern data is shown in FIG.
As shown in A, 640 pixels in the horizontal direction and 5 pixels in the vertical direction
There are 12 pixels. This is slightly larger than the screen of character data. In the pattern display, four samples in the horizontal and vertical directions are treated as one sample and represented by 4 bits. In this case, the required capacity is (640/2) × (512/2) × 4 = 327,680, as shown in FIG. 9B.
Bit.

One screen of pattern data is, as shown in FIG. 9C, areas A1, A2, A divided in the horizontal direction.
, And the areas B1 and B2 divided in the vertical direction are processed. Areas A1, A2, A3, ...
As shown in FIG. 10A, the area is (256 × 32), and the areas B1 and B2 are (32 × 256). Therefore, the size of each of the areas A1, A2, A3, ... Is 256 × 32 × 4 = 32,768 bits. Moreover, the size of each of the areas B1 and B2 is 32 × 256 × 4 = 32,768 bits.

When areas A1, A2, A3, ... Are allocated on the 16-bit deep video RAM, area A
As shown in FIG. 10B, the areas required as 1, A2, A3,... Are 64 areas in the horizontal direction and 32 areas in the vertical direction (64 × 32 × 16 = 32,768 bits). Further, when the areas B1 and B2 are allocated on the video RAM having a depth of 16 bits, the areas required as the areas B1 and B2 are 8 in the horizontal direction as shown in FIG. 10B.
128 areas in the vertical direction (8 × 128 × 16 = 16,
Two 348 bits (16,348 = 32,768)
Bit).

In FIG. 4, the pattern data of areas A1, A2, A3, ... Are assigned to areas (PA1, PA2, PA3, ...) Of (32 × 64) pattern data. (8 × 128) area PB2 and PB4,
Data of area B1 is assigned. (8 x 128)
The data of the area B2 is assigned to the areas PB1 and PB3.

As described above, the area of the pattern data is 640 pixels in the horizontal direction and 512 pixels in the vertical direction. This corresponds to a PAL screen. N
On the screen of the TSC system, the number of effective lines in the vertical direction is 48
0 and the pattern data areas PA1, PA2, P
If A3,... Are (32 × 64), the area is 7.5 areas. Therefore, the area PA8 is used only for half.

Since the character data is 2 bits, only 4 colors can be expressed. The pattern data is 4 bits, and can express only 16 colors. Therefore,
A color pallet area CP is provided, and a plurality of colors can be expressed using the color pallet.

In the area Y of the luminance data and the area C of the chroma data of the image memory 31, the luminance data and the chroma data based on the image pickup screen are temporarily stored and read out. When a character or pattern is combined on this screen, the area CG for character data or the areas PA1, PA2, PA3, ... And P for pattern data is used.
The character data or pattern data stored in B1 to PB4 are combined by the microprogram.

Next, a data recording format in the electronic still camera to which the present invention is applied will be described. It should be noted that this format is basically the same as that of the "apparatus for recording still image data, reproducing apparatus for still image data, and printer apparatus (International Publication Number W
096/09716) ".

There are a plurality of types of files, such as management files, comprehensive index files, image data files, music data files, and other files.
These files are given a file name consisting of a maximum of eight characters and an extension of three characters, like the MS-DOS file. As the extension, an extension “PMF” indicating management information, an extension “PMP” indicating image data, an extension “PMX” indicating index image collection data, and music data are indicated. There is an extension "PMA" and an extension "PMO" indicating that it is another data file. The file type can be identified by these extensions.

The management file (file with extension PMF) is a file for managing files,
The management file includes an overall information management file (OV_INF.PMF) for managing overall information, and an image data management file (PIC_IN) for managing a plurality of image data and a plurality of narration data in a subdirectory.
F. PMF), a split screen management file (PED_INF.PMF) for managing a group of split screens, a print data management file (PRT_INF.PMF) for managing a plurality of print data files, a plurality of playback control data files and BGM audio Playback control management file for managing data (PMF_INF.PMF)
There is.

The image data file (file whose extension is PMP) is a file for storing image data compressed by JPEG or the like. As image data, there are various image sizes corresponding to a video screen having a normal aspect ratio (3: 4), a wide screen of a video having an aspect ratio (16: 9), and a photograph having an aspect ratio of (3: 2). Is used. That is, (PSNnnnnnn.PM
The file P) is a screen (SD-N plane) having (640 × 480) pixels and an aspect ratio of (4: 3).
The file of (PSWnnnnnn.PMP) is a screen (SD-W surface) having (848 × 480) pixels and an aspect ratio of (16: 9). (PHPnnnnnn.PM
The file P) has a pixel count of (1536 × 1024)
Is a screen (HD-P plane) having an aspect ratio of (3: 2). The file of (PHWnnnnnn.PMP) has a pixel count of (1920 × 1080) and an aspect ratio of (1).
6: 9) is the screen (HD-W) surface. (PUPnnn
nn. PMP) files have a pixel count of (3072 × 2)
048) and the screen (UD-
P) plane. The screen of (PEDnnnn.PMP) is a division management plane, and (PEXnnnn.PMP)
Files are reserved.

Comprehensive index file (extension is PM
X files), a comprehensive index file (OV_IDX.PMX) summarizing the representative index images of each image directory, and an image index file (PI) summarizing the index images of the image directories.
DXnnn. PMX).

The music data file (file with extension PMA) is a file for storing audio data compressed by ATRAC.
Narration file (NR * nnnn.PMA)
And the BGM music data file (MSCnnn.PM
A). * Is A, B, C, D, E,
Multilingual support. Narration file (NR * nn
nnn. PMA) is an audio signal that has a 1: 1 correspondence with an image. BGM music data file (MSCn
nn. PMA) is BGM music for slide shows,
It is a data file linked to a plurality of images.

As another data file (file with extension PMO), a print data file (PRTnnn.PM) which is a file of information related to printing is used.
O), a telop data file (TEROP.PMO) that is a collection of telop data, a keyword search file (KW_DTBS.PMO) that is a file that manages the association with images by grouping search keywords, a search time stamp, and a file. Timestamp search data file (TS_DTBS.PMO) for grouping names and organizing the correspondence with images, and playback control data file (P for controlling the sequence of images and music)
MSnnn. PMQ).

FIG. 11 shows the structure of a file. As shown in FIG. 11A, the file is composed of a header and a data body. Between the header and the data body,
A blank can be provided. The start address of the data body is specified by the header. The data body starts from an address that is a multiple of 4, and the upper byte is prioritized for data of 2 bytes or more. The data size is a multiple of 4 except for JPEG data. Strings are always terminated with a null.

As shown in FIG. 11B, the header is composed of a format table at the head of the header and a plurality of tables. As shown in FIG. 11C, the table is provided with a table ID that defines the table and a next table pointer that points to the address of the next table pointer, followed by table data. A blank can be provided between the table data and the next table ID. The next table pointer is a pointer indicating the address of the next table ID, and the address of the next table is indicated by (table size−2).

The table ID includes a format table (10h), a name table (11h), a comment table (12h), a copyright information table (13h), a disc ID table (14h), an image parameter table (20h), and recording information. Table (21h), color management parameter table (22h), division management table (23
h), camera information table (24h), scanner information table (25h), appearance information table (26)
h), a narration table (30h), a BGM table (31h), a lab information table (40h), an option table (90h), and the like (the ID of each table is shown in parentheses). For each table, refer to the previously proposed "still image data recording device, still image data reproducing device, and printer device (International Publication No. W096 / 09716).
No.)]. Here, a narration table (30h) for handling voice information and a BGM table (31h) will be described.

FIG. 12 shows a narration table. As shown in FIG. 12, the narration table has a table ID (1 byte), a next table pointer (1 byte), a reserve (1 byte), a mode (1 byte), a copyright / editing right (1 byte), and a reserve ( 1 byte), total time (2 bytes), start time (2 bytes), valid time (2 bytes), reserve (3 bytes), character identification code (1 byte), and name (40 bytes). Except for the names, all are recorded in binary (B) data format. ASCII or other character codes can be used for the name.

The table ID is "30h" in the narration table. The next table pointer indicates the address of the next table ID. In the mode, a compression ratio when compressed by ATRAC, a music mode such as stereo / monaural, etc. are designated. Copyright / editing rights are
Used to set copy prohibition and editing prohibition. The total time is the total time of the entire narration and is described in units of 1/2 second. The start time is the actual start time and is described in units of 1/2 second. The valid time is described in units of 1/2 second.
The character identification code is ASCII, ISO-8859-
1, shift JIS, binary, etc. are used to identify characters. The name is described in correspondence with the character identification code.

FIG. 13 shows a BGM table. The BGM table is basically configured in the same manner as the narration table. In the BGM table,
As shown in FIG. 13, a table ID (1 byte), a next table pointer (1 byte), a reserve (1 byte),
Mode (1 byte), Copyright / Editing right (1 byte), Reserve (1 byte), Total time (2 bytes), Start time (2 bytes), Effective time (2 bytes), Reserve (3 bytes), Character It consists of an identification code (1 byte) and a name (40 bytes). Except for the names, all are recorded in binary (B) data format. ASCII or other character codes can be used for the name.

In the BGM table, the table ID is
"31h" is set. The next table pointer indicates the address of the next table ID. The mode is AT
The compression ratio when compressing with the RAC and the music mode such as stereo / monaural are designated. The copyright / editing right is used to set copy prohibition and editing prohibition. The total time is B
The total time of GM, which is described in units of 1/2 second. The start time is the actual start time and is described in units of 1/2 second. The valid time is described in units of 1/2 second. The character identification code is
Used to identify characters such as ASCII, ISO-8859-1, shift JIS, and binary. The name is described in correspondence with the character identification code.

Files are managed in a hierarchical directory structure. The directory is an image directory (P
ICnnnn), a divided image directory (DPDnn)
nnn), a print directory (PRINT), and a playback control directory (PMSEQ).

A subdirectory (PIC_MD) is provided in the root directory. Files are managed in this directory (PIC_MD). It is essential to provide this directory (PIC_MD).

In this directory (PIC_MD),
Comprehensive information management file (OV) to manage the entire information
_INF. PMF) and a comprehensive index file (OV_IDX.PMF) which is a comprehensive image index collection of index images representative of each image directory.
Is placed. This comprehensive information management file (OV_IN
F. PMF) and comprehensive index file (OV_I)
DX. It is essential to have a PMF). Furthermore,
As an option, a telop data file (TELOP.PMO) which is a file of a telop data collection, a search data file (KW_DTBS.PMO) for collecting search keywords and managing correspondence with images, and a time stamp search data (TS_DTBS.PMO) ) Is placed.

It is indispensable to provide an image directory (PICnnnnn) for managing image data and narration data under the directory (PIC_MD). Further, a print directory (PRINT) for managing print data and a playback control directory (PMSQ) for managing playback control data and BGM data are provided as options.

Image directory (PICnnnnn)
Is created for each type of image, for example. In each image directory (PICnnnnnn), it is essential that a plurality of image data (data with the extension of PMP) be stored, and that an image data management file (PIC_INF.PMF) and an image index file (PIDXnnn.PMX) be stored. Is done. Image data management file (PIC
_INF. A plurality of image data and a plurality of narration data are managed based on PMF). The image index file (PIDXnnn.PMX) is a collection of index images in an image directory. Furthermore,
When performing narration, an optional narration data file (NR * nnnnnn.PMA)
Is placed. In the case of a divided screen, a divided image directory (DPDnnnnnn) is provided under the image directory (PICnnnnnn).

Divided image directory (DPDnnnn
In (n), an image file (PEDnnn.PMP) for a split screen is optionally placed. If there is an image file for split screens (PEDnnnn.PMP), a split screen management file (PE
D_INF. PMF) is mandatory.

A print data file (PR) is optionally provided in the print directory (PRINT).
Tnnn. PMO) is placed. When there is a print data file (PRTnnn.PMO), it is essential to place a print data management file (PMS_INF.PMF) for managing a plurality of print data files.

As an option, the playback control directory (PMSEQ) contains BGM audio data (MS
CCnnn. PMA) and a playback control data file (PMSnnn.PM) for controlling the sequence of images and music.
PMO) is placed. BGM audio data (MSC
Cnnn. PMA) and playback control data file (PM
Snnn. PMO), a playback control management file PMS_INF.PMS for managing a plurality of playback control data files and BGM audio data files. PM
It is mandatory to put F.

FIG. 14 shows an example of a hierarchical directory structure. As shown in FIG. 14, a subdirectory (PIC_MD) is provided in the root directory. In this directory (PIC_MD), a comprehensive information management file (OV_INF.PMF) and a comprehensive index file (OV_IDX.PMF) are placed.
Furthermore, a telop data file (TELOP.PM
O), search data file (KW_DTBS.PM)
O), time stamp search data (TS_DTBS.P)
MO) is placed.

Under the directory (PIC_MD),
Image directory (PIC0000, PIC0000)
1, PIC00002, ...), print directory (PRINT), and playback control directory (PMSQ)
Is provided. Image directory (PIC0000,
PIC00001,...) Are classified, for example, for each image genre.

The image directory (PIC00000) contains an image data management file (PIC_INF.PM).
F) and an image index file (PIDX000.
PMX) is placed.

Then, the image directory (PIC000
00) contains an image file (PSN00000.PM).
P), (PHP00000.PMP), and narration data file (NRA00000.PMA). The image file (PSN00000.PMP) and the image file (PHP00000.PMP) are the same image but have different sizes. Image file (PSN00
000. PMP is a normal screen (SD-N surface) with an aspect ratio (4: 3) and an image file (PHP0000).
0. PMP is a picture size screen (HD-P surface) with an aspect ratio of (3: 2). The narration data file (NRA00000.PMA) is an image file (PSN00000.PMP) and (PHP0000.
0. It is a file of voice data of narration for PMP).

This image directory (PIC00
000) is an image file (PSN00001.PM
P), (PHW00001.PMP), (PHP000
01. PMP), narration data file (NRA
00001. PMA) is placed. Image file (PS
N00001. PMP), (PHW00001.PM
P) and (PHP00001.PMP) are the same image but different in size. Image file (PSN00
001. PMP is a screen (SD-N surface) with an aspect ratio of (4: 3), and an image file (PHW0000
1. PMP has a screen with an aspect ratio of (16: 9) (H
D-W) and is an image file (PHP00001.P).
MP is a screen (HD-P) with an aspect ratio of (3: 2).
Plane). Narration data file (NRA00
001. PMA is an image file (PSN0000
1. PMP), (PHW00001.PMP), and voice data files of narration for (PHP00001.PMP).

This image directory (PIC00
000) has a divided image directory (DPD0000).
2) is provided, and the divided image directory (DPS0
00002) includes an image file (PED) for a split screen.
000. PMP), (PED001.PMP), ... Are placed. Then, a divided screen management file (PED_INF.PMF) for managing the divided screen group is placed.

Furthermore, this image directory (PIC00
000) contains an image file (PSN00003.PM).
P) is placed. This image file (PSN0000
3. PMP) is a screen (S :) with an aspect ratio of (4: 3).
DN plane).

Other image directories (PIC0000
1) includes an image data management file (PIC_INF.
PMF) and an image index file (PIDX00)
0. PMX) and (PIDX001.PMX). The image directory (PIC00001) contains image files (PSN0000.PMP), (P
SN00001. PMP) is placed. Image files (PSN0000.PMP), (PSN00001.PMP)
PMP) is a screen having an aspect ratio of (4: 3).

Still another image directory (PIC000
02), an image data management file (PIC_IN)
F. PFM) and image index file (PIDX)
000. PMX) is placed.

A print data file (PRT000.PMO) is stored in the print directory (PRINT).
And a print data management file (PMS_INF.PMF) for managing the print data file.

In the reproduction control directory (PMSEQ), the reproduction control management file PMS_INF. PMF,
Playback control data file (PMS000.PMO),
(PMS001.PMO) and BGM audio data (MSC000.PMA), (MSC0.PMO).
01. PMA) is placed.

FIG. 15 is a flow chart showing an example of the case of performing narration reproduction. As shown in FIG. 15, first, the U-TOC is reproduced (step ST1),
Based on the U-TOC data, the directory (PIC
_MD) information is extracted (step ST2). Image data files (PSN
nnnnnn. PMP) and the narration data file (NRAnnnnn corresponding to this image data file
n. The PMA file) is taken out (step ST
3). Image data file (PSNnnnn.PM
P) is taken out, the PMP table corresponding to the data file of this image is referred to (step ST4), the image data file (PSNnnnn.PMP) is accessed based on this image parameter table data (step ST5), This image data file (PSN
nnnnnn. PMP) is decoded (step ST).
6).

Then, the narration table of the narration data file (NRAnnnnn.PMA) corresponding to this image data is referred to (step ST7),
Narration data (NRAnnnnn.PMA) is accessed based on the data of this narration table (step ST8). According to this narration data data file (NRAnnnnn.PMA),
Audio data is decoded (step ST
9).

Thus, while the image is reproduced, the narration corresponding to this image is reproduced. The reason why the narration file data is decoded after the data of the image data file is decoded is that the decoding time of the image is longer than the audio decoding time. When the reproduction of this screen and the narration is completed, the file number nnnnn is incremented (step ST10). It is determined whether or not the file number overflows (step ST11). If the file number does not overflow, the process returns to step ST3 to reproduce the next image file and reproduce the narration.

For example, in the case of narration reproduction of an image in the image directory (PIC00000) with the hierarchical file structure shown in FIG. 14, the following is done. First, the U-TOC is reproduced in step ST1, and the directory (PIC_MD) is taken out in step ST2. In step ST3, the image directory (PIC00
Image data file (PSN0000
0. PMP) and a narration data file (NRA00000.PMA) corresponding to this image data file.
File).

Image data file (PSN00000.
PMP) is taken out, the PMP table corresponding to the data file of this image is referred to in step 4, and the image data file (PSN0000.PM) is referenced based on this image parameter table data in step ST5.
P) is accessed and the image data file (PSN00000.PMP) is decoded in step ST6.

Then, in step ST7, the narration data file (NRA00) corresponding to this image data is generated.
000. Referring to the narration table of (PMA), in step ST8, based on the data of this narration table, the narration data (NRA00000.P).
MA). In step ST9, this narration data data file (NRA0000.PM
The audio data is decoded according to A).

As a result, the image data file (PSN
00000. While playing back the PMP image, the narration data file (NRA000) corresponding to this image
00. The narration is reproduced by PMA).

Next, at step ST10, the number (0000
0) is incremented to (00001), and step S
At T11, it is determined whether the number (00000) overflows. Image directory (PIC0000
0) is an image data file (PSN00001.P).
MP) and narration data file (NRA000
01. Since there is PMA), it is determined that the number (00001) does not overflow, and the process returns to step ST3.

Similarly, the image data file (PS
N00001. PMP) and a narration data file (NRA0000) corresponding to this image data file.
1. The PMA file) is taken out, the image data file (PSN00001.PMP) is decoded, and the narration data file (NRA00001.PM).
Decode A). As a result, while reproducing the image data file (PSN00001.PMP) image,
The narration of the narration data data file (NRA00001.PMA) corresponding to this image is reproduced.

[0119]

According to the present invention, by recording the file management data for managing the video data and the audio data, it is possible to perform the narration reproduction for listening to the explanation related to the image and the music reproduction for a long time. BGM reproduction is possible. Further, since the video compression / expansion circuit 27 for compressing / expanding video data and the audio compression / expansion circuit 41 for compressing / expanding audio data are provided, not only still images but also audio data can be recorded / reproduced. Is. Further, since the DRAM 42 is provided as a common buffer memory for video data and audio data, the processing speed can be increased and the circuit scale can be reduced. Furthermore, character data and pattern data can be combined with video data, and video data in which the character data and pattern data have been combined can be recorded. Since the character data and the pattern data are arranged on the image memory 31, the hardware does not increase.

[Brief description of drawings]

FIG. 1 is a perspective view showing an external configuration of an electronic still camera to which the present invention is applied.

FIG. 2 is a schematic diagram used to explain a pattern and character display.

FIG. 3 is a block diagram of an example of an electronic still camera to which the present invention has been applied.

FIG. 4 is a schematic diagram used for describing a memory in the electronic still camera to which the present invention is applied.

FIG. 5 is a schematic diagram used to explain a memory in the electronic still camera to which the present invention is applied.

FIG. 6 is a schematic diagram used to explain a memory in an electronic still camera to which the present invention is applied.

FIG. 7 is a schematic diagram used for describing a memory in the electronic still camera to which the present invention is applied.

FIG. 8 is a schematic diagram used to explain a memory in an electronic still camera to which the present invention is applied.

FIG. 9 is a schematic diagram used to describe a memory in an electronic still camera to which the present invention is applied.

FIG. 10 is a schematic diagram used to explain a memory in an electronic still camera to which the present invention is applied.

FIG. 11 is a schematic diagram used for describing a recording format in an electronic still camera to which the present invention is applied.

FIG. 12 is a schematic diagram used to explain a recording format in an electronic still camera to which the present invention is applied.

FIG. 13 is a schematic diagram used to explain a recording format in an electronic still camera to which the present invention is applied.

FIG. 14 is a schematic diagram used for describing a recording format in an electronic still camera to which the present invention has been applied.

FIG. 15 is a flowchart for explaining the operation of the electronic still camera to which the present invention is applied.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Electronic still camera main body 2 Lens 21 Magneto-optical disk drive 27 Image compression / expansion circuit 31 Image memory 41 Audio compression / expansion circuit

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical display location H04N 5/781 H04N 5/91 C 5/91 J 5/92 5/92 H G11B 27/00 D

Claims (14)

[Claims] 1. A video input unit for inputting video data, an image compression unit for compressing the video data input by the video input unit, and an image memory unit for storing the compressed video data from the image compression unit. Audio input means for inputting audio data, audio compression means for compressing the audio data input by the audio input means, and recording compressed video data and compressed audio data in a program area of a data recording medium. A camera recording device comprising recording means for recording file management data for managing the compressed video data and the compressed audio data in a management area of the data recording medium. 2. The camera recording device according to claim 1, wherein the file management data is managed according to a file name of the compressed video data and audio data. 3. The camera recording device according to claim 1, wherein the video data is compressed by a JPEG method. 4. The camera recording device according to claim 1, wherein the audio data is compressed by an ATRAC system. 5. The camera recording device according to claim 1, wherein an optical disk or a magneto-optical disk is used as the data recording medium. 6. A camera reproducing device for reproducing video data and audio data from a data recording medium having a management area and a program area, wherein compressed video data and compressed video data are compressed in accordance with file management data in the management area. Reproducing means for reproducing the audio data, image memory means for accumulating the compressed video data from the reproducing means, image expanding means for expanding the compressed video data from the image memory means, and the reproducing means. Of the audio memory means for storing the compressed audio data and the audio expanding means for expanding the compressed audio data from the audio memory means. 7. The camera reproducing apparatus according to claim 6, wherein the file management data is managed according to file names of compressed audio data and compressed video data. 8. A reproduction control means for controlling the reproduction means to access the compressed video data area before accessing the compressed audio data according to the file management information. 6. The camera reproducing device according to item 6. 9. The camera reproducing device according to claim 6, wherein the video data is compressed by a JPEG system. 10. The compressed audio data is ATR.
7. The camera reproducing device according to claim 6, wherein compression is performed by an AC method. 11. The camera reproducing device according to claim 6, wherein an optical disk or a magneto-optical disk is used as the data recording medium. 12. Video input means for inputting video data, image memory means for storing the video data input by the video input means, image processing means for performing image processing on the video data, and the video input means. An image compression unit for compressing the input video data and a recording unit for recording the compressed video data are provided, and the video data image-processed by the image processing unit and the video data not image-processed A recording device adapted to selectively record by means of the recording means. 13. The recording apparatus according to claim 12, wherein the video data is compressed by a JPEG method. 14. The recording apparatus according to claim 12, wherein an optical disk or a magneto-optical disk is used as the data recording medium.