JP2006304103A - Moving video recording apparatus and moving video recording/reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving video recording apparatus and a moving video recording/reproducing apparatus capable of generating a moving video file which shortens a processing time, while alleviating a processing load of thumbnail display. <P>SOLUTION: A JPEG coder 12 applies JPEG coding processing to a digital video signal generated by a video signal processor 10 and generates thumbnail image data. An MPEG4 coder 13 applies MPEG4 coding processing to the digital vido signal and generates video image stream data. An audio coder 14 applies audio coding processing to a digital voice signal generated by a voice input unit 11, and generates voice stream data. A file generator 15 sets the video image stream data and the voice stream data according to a predetermined moving video file format, when a controller 5 issues a thumbnail image creation direction while it creates a thumbnail image data area to set the thumbnail image data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving picture recording apparatus having a thumbnail function and a moving picture recording / reproducing apparatus.

  In recent years, a moving image recording apparatus that converts an image or moving image captured by a CCD (Charge Coupled Device), such as a digital still camera or a digital video camera, into digital data and records it as a moving image file in a predetermined file format on a recording medium such as a flash memory. In addition, video recording / playback apparatuses that play back recorded video files together with video recording have become widespread.

In addition, with the widespread use of moving picture recording devices, personal computers and televisions equipped with a function for playing back moving picture files recorded by a moving picture recording / playback device have also spread.
Although a moving image recording apparatus records a video as a moving image file, recording video data as it is is not realistic from the viewpoint of the amount of data. For this reason, the video data is encoded and compressed to be recorded on a recording medium. In addition, the file format to be recorded on the recording medium adopts a format compatible with a personal computer, a portable terminal, a television, a moving image viewer, and the like.

  For example, Non-Patent Documents 1 and 2 are conventional techniques related to data compression that are generally used. Non-Patent Document 1 discloses a technique relating to multiplexing / assembly of audiovisual information and audio information in MPEG (Moving Picture coding Experts Group) -4. Non-Patent Document 2 discloses a technique related to encoding of visual information in MPEG-4.

  Moreover, as a prior art regarding the file format which records a moving image, there exist nonpatent literatures 3-5, for example. Non-Patent Document 3 discloses a basic technique related to a file format for recording moving image and audio data.

  Non-Patent Document 4 discloses a technique related to a file format for recording moving image and audio data called MP4. Further, Non-Patent Document 5 discloses a technique related to a file format for recording moving image and audio data called an ASF (Advanced Systems Format) file.

ISO / IEC 14496-1 MPEG4 System ISO / IEC 14496-2 MGEG4 Visual ISO / IEC 14496-12 ISO Base File Format ISO / IEC 14496-14 MP4 File Format ASF_Specification

  Incidentally, the moving image recording / playback apparatus has a thumbnail display function for displaying an arbitrary screen (frame) of a recorded moving image file. However, due to the characteristics of the data compression algorithms described in Non-Patent Documents 1 and 2 and the file format characteristics of Non-Patent Documents 3 to 4, there is a problem that the processing load of the thumbnail display processing is large and the processing time is long. there were.

  Specifically, in the data compression technique (MPEG-4) described in Non-Patent Documents 1 and 2, data is compressed by interframe prediction coding, motion compensation prediction, discrete cosine transform, and entropy coding. . In inter-frame predictive coding, by taking the difference between the current frame image and the previous frame processed immediately before, there is a statistical bias in the difference value to increase the coding amount reduction effect by entropy coding. Yes. In other words, in MPEG-4, a frame image can be constructed by itself (I picture) that has all the information of the frame image data and can be constructed by itself. (P picture and B picture) cannot be stream data.

  For this reason, when a P picture or B picture frame is designated as a thumbnail display, the stream data of all frames from that picture to the I picture must be expanded, so the processing load until the thumbnail is displayed. Is large and processing time is also required.

  In addition, since an I picture has information on all frames, the data size of stream data constituting one frame increases depending on compression conditions such as a bit rate and a pixel size. However, the MP4 file described in Non-Patent Documents 3 and 4 and the ASF file format described in Non-Patent Document 5 have a large data size because the data area for storing image data is divided into a predetermined size. In many cases, I-picture stream data is divided and stored. Therefore, in order to expand an image of one frame, data must be read from a plurality of data areas. That is, the storage medium has to be accessed as many times as the number of divisions of the stream data, and the processing time for displaying thumbnails becomes longer.

  For example, in the case of MP4 files described in Non-Patent Documents 3 and 4, all stream data is stored in chunk data in a content data area (Movie Data Box). However, information such as the offset from the beginning of the chunk data file and the number of streams, stream size, and time included in the chunk data are all described in the Sample Description Box below the content data area. Also, because the Sample Description Box and the chunk data are placed in different locations, you must always access the storage medium that stores the video file between the time the stream information is acquired and the time the stream data is acquired. .

  The present invention has been made in view of the above, and an object thereof is to obtain a moving image recording apparatus and a moving image recording / reproducing apparatus that generate a moving image file that reduces the processing load of thumbnail display and shortens the processing time. To do.

  The second object is to provide a moving picture recording apparatus and a moving picture recording / reproducing apparatus that can display thumbnail images that clearly show the contents.

  In order to solve the above-described problems and achieve the object, the present invention generates a moving image file of a predetermined moving image file format from a digital video signal and a digital audio signal of a video to be recorded, and stores the moving image file In the apparatus, a first encoding unit that generates a compressed video stream data by performing a predetermined first encoding process on the digital video signal, and a second code predetermined for the digital audio signal A second encoding unit that generates audio stream data compressed by performing an encoding process, and sets the video stream data and the audio stream data in a video stream and an audio stream of the video file, Create a thumbnail image data area in the user creation area that can be created arbitrarily by the user And a file generation unit for setting a digital video signal of a frame used as a thumbnail image as thumbnail image data in the generated thumbnail image data area when an instruction to create a thumbnail image is received from the outside. .

  According to the present invention, when a moving image file having a predetermined moving image file format is generated from a digital video signal and a digital audio signal of a video to be recorded, a user creation area in which a user can arbitrarily create a moving image file. Since the thumbnail image data area is created and the thumbnail image data of the thumbnail image used at the time of thumbnail display is set in the created thumbnail image data area, the thumbnail image data is simply read and displayed at the time of thumbnail display. In many cases, the processing load of the thumbnail display processing can be reduced and the processing time can be shortened as compared with the case where the thumbnail image is generated from the video stream data generated from the digital video signal.

  Embodiments of a moving image recording / playback apparatus according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

Embodiment 1 FIG.
A first embodiment according to the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the configuration of the moving image recording / playback apparatus according to the first embodiment of the present invention. In FIG. 1, a moving picture recording / reproducing apparatus includes a video signal processing unit 10, an audio input unit 11, a JPEG encoding unit 12 (third encoding unit in the claims), and an MPEG4 encoding unit 13 (patent). A recording processing unit 1 having a first encoding unit in the claims), an audio encoding unit 14 (second encoding unit in the claims), and a file generation unit 15; JPEG decoding unit 21 (third decoding unit in the claims), MPEG4 decoding unit 22 (first decoding unit in the claims), audio decoding unit 23 ( A second decoding unit in the scope of claims), a display unit 24, a reproduction processing unit 2 having an audio output unit 25, an operation unit 3, a storage unit 4, and a control unit 5. Yes.

  The video signal processing unit 10 generates a digital video signal of a video to be recorded. Specifically, for example, an analog video signal captured by a not-shown CCD (Charge Coupled Device) or the like is converted into a digital signal to generate a digital video signal.

  The MPEG4 encoding unit 13 performs MPEG4 encoding processing on the digital video signal generated by the video signal processing unit 10 to generate video stream data obtained by compressing the digital video signal. The JPEG encoding unit 12 performs thumbnail display for compressing the digital video signal by performing JPEG encoding processing on the digital video signal generated by the video signal processing unit 10 or the digital video signal generated by the MPEG4 decoding unit 22. Thumbnail image data is generated.

  The audio input unit 11 generates a digital audio signal of audio to be recorded. Specifically, for example, an analog audio signal captured by a microphone (not shown) is converted into a digital signal to generate a digital audio signal.

  The audio encoding unit 14 performs encoding processing according to a predetermined audio encoding method on the digital audio signal generated by the audio input unit 11 to generate audio stream data obtained by compressing the digital audio signal.

  The file generation unit 15 is configured to perform predetermined processing from the thumbnail image data generated by the JPEG encoding unit 12, the video stream data generated by the MPEG4 encoding unit 13, and the audio stream data generated by the audio encoding unit 14. Generate a video file of the file format.

  The storage unit 4 is configured by a storage medium such as a flash memory, for example, and stores the moving image file generated by the file generation unit 15. The operation unit 3 is used as input means for receiving instructions such as recording start / end, reproduction start / end, and thumbnail creation / display.

  The control unit 5 comprehensively controls each component of the moving image recording / playback apparatus based on the instruction received by the operation unit 3. When a thumbnail image is designated via the operation unit 3, the control unit 5 outputs a thumbnail image creation instruction to the file generation unit 15. Further, at the time of reproduction, the control unit 5 causes the video stream data of the moving image file stored in the storage unit 4 to be output to the MPEG4 decoding unit 22 and the audio stream data to be output to the audio decoding unit 23. When displaying thumbnails, the control unit 5 causes the JPEG decoding unit 21 to output the thumbnail image data of the moving image file stored in the storage unit 4.

  The MPEG4 decoding unit 22 performs an MPEG4 decoding process on the video stream data input from the storage unit 4 to generate a digital video signal obtained by decompressing the video stream data. The JPEG decoding unit 21 performs a JPEG decoding process on the thumbnail image data to generate a thumbnail image signal obtained by expanding the thumbnail image data.

  The display unit 24 displays a moving image and an image based on the digital video signal generated by the MPEG4 decoding unit 22 and the thumbnail image signal generated by the JPEG decoding unit 21.

  The audio decoding unit 23 performs a predetermined audio decoding process on the audio stream data input from the storage unit 4 to generate a digital audio signal obtained by expanding the audio stream data. The audio output unit 25 includes, for example, a speaker, and outputs audio based on the digital audio signal generated by the audio decoding unit 23.

  Next, the operation of the moving image recording / playback apparatus according to the first embodiment of the present invention will be described with reference to the flowcharts of FIGS. First, the recording operation of the moving picture recording / reproducing apparatus will be described with reference to the flowchart of FIG.

  When receiving a recording start instruction from the user via the operation unit 3, the control unit 5 notifies the recording start instruction to each component of the recording processing unit 1 to start the recording operation. In addition, the control unit 5 sets the JPEG encoding unit 12 to select the digital video signal generated by the video signal processing unit 10.

  When receiving the recording start instruction, the video signal processing unit 10 generates a digital video signal from the input video signal, and the audio input unit 11 generates a digital audio signal from the input audio signal (steps S100 and S101). . The video signal processing unit 10 outputs the generated digital video signal to the JPEG encoding unit 12 and the MPEG4 encoding unit 13. The audio input unit 11 outputs the generated digital audio signal to the audio encoding unit 14.

  The JPEG encoding unit 12 generates thumbnail image data obtained by subjecting the digital video signal to JPEG encoding processing and compressing the digital video signal (step S102). The JPEG encoding unit 12 outputs the generated thumbnail image data to the file generation unit 15.

  On the other hand, the MPEG4 encoding unit 13 generates video stream data obtained by compressing the digital video signal by performing MPEG4 encoding processing on the digital video signal generated by the video signal processing unit 10, and the audio encoding unit 14 The digital audio signal generated by the input unit 11 is encoded by a predetermined audio encoding method to generate audio stream data obtained by compressing the digital audio signal (step S103). The MPEG4 encoding unit 13 outputs the generated video stream data to the file generation unit 15, and the audio encoding unit 14 outputs the generated audio stream data to the file generation unit 15.

  The file generation unit 15 determines whether there is a thumbnail image creation instruction (step S104). When there is a thumbnail image creation instruction, the file generation unit 15 performs thumbnail image data generated by the JPEG encoding unit 12, video stream data generated by the MPEG4 encoding unit 13, and audio in accordance with a predetermined file format. The audio stream data generated by the encoding unit 14 is added to the moving image file stored in the storage unit 4 (step S105).

  In general, the file format of a video file is a file header area in which information (file name, file format, amount of data, etc.) related to file management required for file management and playback is set, video stream data, and audio stream data And a user creation area that can be arbitrarily created by the user. The file generation unit 15 sets video stream data and audio stream data according to a predetermined file format, and sets thumbnail image data in a thumbnail image area provided in the user creation area.

  When there is no thumbnail image creation instruction, the file generation unit 15 stores the video stream data generated by the MPEG4 encoding unit 13 and the audio stream data generated by the audio encoding unit 14 in accordance with a predetermined file format. It adds to the moving image file memorize | stored in the part 4 (step S106).

  The video signal processing unit 10, the audio input unit 11, the JPEG encoding unit 12, the MPEG4 encoding unit 13, the audio encoding unit 14, and the file generation unit 15 control the recording operation shown in steps S101 to S106 described above. The process is repeated until the unit 5 receives a recording end instruction via the operation unit 3 and outputs a recording end instruction to each component (steps S101 to S107).

  FIG. 3 is a diagram illustrating a configuration of a moving image file generated by the file generation unit 15 according to the ASF file format. In FIG. 3, a moving image file in the ASF file format has a file header area 30 in which information relating to file management necessary for file management and reproduction is set, and n (0 <n) in which video stream data and audio stream data are set. , N is a natural number) and is composed of an index data area 32 called a data area 31 having data packets (Data Packets # 1 to #n in the figure).

  The file header area 30 includes a header object (Header Object in the figure), a file property object (File Properties Object in the figure), and a user data object (User Data Object in the figure). . Since the user data object is a user-created area that can be arbitrarily created by the user, the user data object is used as the thumbnail image data area 33 in the ASF file format.

  The thumbnail image data area 33 has a GUID 34 in which an identifier indicating that it is a thumbnail image data area is set, an object size (ObjectSize in the figure) 35 in which the size of the thumbnail image data area is set, and m (1 ≦ m and m are natural numbers) and a thumbnail data area 36 in which thumbnail image data is set.

  Data packets # 1 to #n are composed of a packet header (Packet Header in the figure), an audio stream (Audio Stream in the figure), and / or a video stream (Video Stream in the figure).

  When the moving image file is generated in the ASF file format shown in FIG. 3, the file generation unit 15 sets the audio stream data in the audio stream and sets the video stream data in the video stream in accordance with a general ASF file creation process. To do. Since the video stream data is generated by MPEG4 encoding, there are stream data that can construct a frame image alone and stream data that cannot construct a frame image alone (stream data that is only the difference from the previous frame image). is there. In FIG. 3, video stream data capable of constructing a single frame image is divided and set in the video stream # 1 of the data packet # 1 and the video stream # 1 of the data packet # 2. In # 3, video stream data for constructing a frame image using the video stream data of video stream # 1 in the same data packet is set.

  Further, when there is a thumbnail image creation instruction, the file generation unit 15 determines whether or not the thumbnail image data area 33 exists in the moving image file. Specifically, the file generation unit 15 searches for a GUID 34 in which an identifier indicating the thumbnail image data area 33 is set. When the GUID 34 exists, the data area 31 and the index data area 32 are shifted by the size of the thumbnail image data to be added, and the thumbnail image data that has already been set and the data packet # 1 in the data area 31 are shifted. The newly created thumbnail image data is inserted between them. The file generation unit 15 sets a value obtained by adding the size of the inserted thumbnail image data to the size set in the object size 35 as the object size 35.

  When the GUID 34 does not exist, the data area 31 and the index data area 32 are shifted by an amount obtained by adding the size of the GUID 34 and the object size 35 and the size of the thumbnail image data, and the GUID 34, the object size 35, and the thumbnail data Region 36 is generated. The file generation unit 15 sets an identifier indicating the thumbnail image data area 33 in the GUID 34, sets the size of the thumbnail image data area 33 to the object size 35, and sets thumbnail image data in the thumbnail data area 36.

  FIG. 4 is a diagram illustrating a configuration of a moving image file generated by the file generation unit 15 according to the MP4 file format. In FIG. 4, a moving picture file in the MP4 file format includes a file header area 40 in which information relating to file management necessary for file management and playback is set, a content data area 41 in which video stream data and audio stream data are set, It consists of a plurality of objects such as the user object area 42. In MP4, there is a user creation area that a user can arbitrarily create in an area having a plurality of objects, such as the user object area 42 after the content data area 41. Therefore, the user creation area after the content data area 41 is a thumbnail image. Used as the data area 43.

  The file header area 40 includes a file identifier area in which a file type is set, and a content information area having a video content information area and an audio content information area. The video content information area and the audio content information area are composed of stream information areas each having a Time To Sample Box, a Sample Size Box, and a Chunk Offset Box.

  The content data area 41 includes n (0 <n, n is a natural number) chunk data (in the figure, a plurality of audio streams (Audio Stream in the figure) and / or video streams (Video Stream in the figure). , Chunk Data) # 1 to #n.

  The thumbnail image data area 43 has an object type (Object Type) 44 in which an identifier indicating that the object is the thumbnail image data area 43 is set, and an object size in which the size of the thumbnail image data area 43 is set. (In the drawing, ObjectSize) 45 and a thumbnail data area 46 in which m (0 <m, m are natural numbers) thumbnail image data are set.

  When the moving image file is generated in the MP4 file format shown in FIG. 4, the file generation unit 15 sets the audio stream data in the audio stream and sets the video stream data in the video stream according to a general MP4 file creation process. To do. Since the moving image stream is generated by MPEG4 encoding, there are stream data that can construct a frame alone and stream data that cannot construct a frame image alone (stream data that is only a difference from the previous frame image). In FIG. 4, video stream data capable of constructing a single frame image is set for the video stream # 1, and video stream data for constructing a frame image using a video of the video stream # 1 is set for the video stream # 2. Is set.

  Further, when there is an instruction to create a thumbnail image, the file generation unit 15 determines whether or not the thumbnail image data area 43 exists in the moving image file. Specifically, the file generation unit 15 searches for an object type 44 in which an identifier indicating the thumbnail image data area 43 is set. When the object type 44 exists, a plurality of objects such as the user object area 42 after the content data area 41 are shifted by the size of the thumbnail image data to be added, and the thumbnail image data that has already been set Insert the newly created thumbnail image data. The file generation unit 15 sets a value obtained by adding the size of the inserted thumbnail image data to the size set in the object size 45 as the object size 45.

  When the object type 44 does not exist, a plurality of objects such as the user object area 42 after the content data area 41 are shifted by the sum of the size of the object type 44 and the object size 45 and the size of the thumbnail image data. Then, the object type 44, the object size 45, and the thumbnail data area 46 are generated. The file generation unit 15 sets an identifier indicating the thumbnail image data area 43 in the object type 44, sets the size of the thumbnail image data area 43 to the object size 45, and sets thumbnail image data in the thumbnail data area 46.

  Next, the playback operation of the moving image recording / playback apparatus will be described with reference to the flowchart of FIG. When receiving a playback start instruction from the user via the operation unit 3 (step S200), the control unit 5 includes each component of the playback processing unit 2, the JPEG encoding unit 12 and the file generation unit 15 of the recording processing unit 1. Is notified of the playback start instruction to start the playback operation. In addition, the control unit 5 sets the JPEG encoding unit 12 to select the digital video signal generated by the MPEG decoding unit 22.

  The control unit 5 causes the storage unit 4 to output the video stream data stored in the video stream of the moving image file to the MPEG4 decoding unit 22 according to a predetermined moving image file format, which is stored in the audio stream. The audio stream data is output to the audio decoding unit 23 (step S201).

  Specifically, when the moving image file to be reproduced is the moving image file in the ASF file format shown in FIG. 3, the control unit 5 generally uses the information set in the file header area 30 and the index data area 32. Through the ASF file playback process, the video stream data set in the video stream is output to the MPEG4 decoding unit 22 in the storage unit 4, and the audio stream data set in the audio stream is output to the audio decoding unit 23. Output.

  When the moving image file to be reproduced is the moving image file in the MP4 file format shown in FIG. 4, the control unit 5 stores it by a general MP4 file reproducing process using information set in the file header area 40. The unit 4 causes the video stream data set in the video stream to be output to the MPEG4 decoding unit 22 and the audio stream data set in the audio stream to be output to the audio decoding unit 23.

  The MPEG4 decoding unit 22 performs a MPEG4 decoding process on the video stream data input from the storage unit 4 to generate a digital video signal obtained by expanding the video stream data, and the audio decoding unit 23 receives the input from the storage unit 4. The audio stream data is decoded by a predetermined audio decoding method to generate a digital audio signal obtained by expanding the audio stream data (step S202). The MPEG4 decoding unit 22 outputs the generated digital video signal to the display unit 24 and the JPEG encoding unit 12, and the audio decoding unit 23 outputs the generated digital audio signal to the audio output unit 25.

  The display unit 24 displays video based on the digital video signal, and the audio output unit 25 outputs audio based on the digital audio signal (steps S203 and S204).

  On the other hand, the JPEG encoding unit 12 generates thumbnail image data obtained by compressing the digital video signal by performing JPEG encoding processing on the digital video signal input from the MPEG4 decoding unit 22 (step S205). The JPEG encoding unit 12 outputs the generated thumbnail image data to the file generation unit 15.

  The file generation unit 15 determines whether there is a thumbnail image creation instruction (step S206). When there is an instruction to create a thumbnail image, the file generation unit 15 adds the thumbnail image data generated by the JPEG encoding unit 12 to the moving image file according to the file format of the moving image file being reproduced (step S207).

  Specifically, when the moving image file being reproduced is in the ASF file format, as described above, the data area 31 and the index data area 32 are shifted, and the thumbnail image data area 33 ( If the thumbnail image data area 33 exists, only thumbnail image data) is inserted.

  When the moving image file being played is in the MP4 file format, as described above, a plurality of objects such as the user object area 42 after the content data area 41 are shifted, and the thumbnail after the content data area 41 is displayed. An image data area 43 (only thumbnail image data when the thumbnail image data area 43 exists) is inserted.

  If there is no thumbnail image creation instruction, the file generation unit 15 performs no processing. That is, the moving image file being reproduced is not changed.

  The control unit 5, MPEG4 decoding unit 22, audio decoding unit 23, display unit 24, audio output unit 25, JPEG encoding unit 12, and file generation unit 15 perform the reproduction operation shown in steps S 201 to S 207 described above. The control unit 5 that has received an instruction to end reproduction via the operation unit 3 outputs a recording end instruction to each component or repeats until there is no more data in the moving image file to be reproduced (steps S201 to S209).

  Next, the thumbnail display operation of the moving image recording / playback apparatus will be described with reference to the flowchart of FIG. When receiving a thumbnail display instruction from the user via the operation unit 3 (step S300), the control unit 5 notifies the thumbnail display instruction to the JPEG decoding unit 21 and the display unit 24 of the reproduction processing unit 2 and performs a thumbnail display operation. To start.

  The control unit 5 causes the storage unit 4 to output the thumbnail image data set in the thumbnail image data area of the moving image file to the JPEG decoding unit 21 in accordance with a predetermined moving image file format (step S301).

  Specifically, when the moving image file is an ASF file format moving image file shown in FIG. 3, the control unit 5 detects the thumbnail image data area 33 using the GUID 34 and sets the object size 45 to the size set. Based on this, the thumbnail image data set in the thumbnail data area 36 is acquired.

  When the moving image file is the moving image file in the MP4 file format shown in FIG. 4, the control unit 5 detects the thumbnail image data area 43 based on the object type 44, and the thumbnail data area based on the size set in the object size 45. The thumbnail image data set to 46 is acquired.

  The JPEG decoding unit 21 generates a thumbnail image signal obtained by performing JPEG decoding processing on the thumbnail image data and expanding the thumbnail image data (step S302). The JPEG decoding unit 21 outputs the generated thumbnail image signal to the display unit 24. The display unit 24 displays a thumbnail image based on the thumbnail image signal (step S303).

  The control unit 5, the JPEG decoding unit 21, and the display unit 24 repeat the operations in steps S301 to S303 described above until all the thumbnail image data of the moving image file stored in the storage unit 4 is displayed (steps S301 to S301). S304).

  FIG. 7 is a diagram showing the relationship between thumbnail images generated by the moving image recording / playback apparatus of the first embodiment and recorded video. In FIG. 7, when a user receives an instruction to create a thumbnail image at the start of recording, 30 minutes after the start of recording, and 60 minutes after the start of recording, that is, three images are received in response to an instruction to create thumbnail images three times. This shows a case where the thumbnail image data is generated.

  As described above, in the first embodiment, when a moving image file having a predetermined moving image file format is generated from a digital video signal and a digital audio signal of a video to be recorded, Since the thumbnail image data area is created in the user created area that can be created arbitrarily, and the thumbnail image data of the thumbnail image used when displaying the thumbnail is set in the created thumbnail image data area, the thumbnail image is displayed when the thumbnail is displayed. You only need to read and display the data. Compared to the case where thumbnail images are generated from video stream data generated from digital video signals, the processing load for thumbnail display processing is reduced and the processing time is shortened. Can do.

  Specifically, in the case of a moving image file in the ASF file format, a thumbnail image can be read by only reading the thumbnail image data area without being affected by the number of divided video stream data and the data packet size when setting the moving image file. Since the thumbnail image data can be acquired, the processing load of the thumbnail display process can be reduced and the processing time can be shortened.

  In the case of a moving image file in the MP4 file format, there is no need to search and analyze a Sample Description Box in which stream data information of video stream data is stored, acquire chunk data, and separate streams, and only the thumbnail image data area. Since the thumbnail image data of the thumbnail image can be acquired simply by reading out, the processing load of the thumbnail display processing can be reduced and the processing time can be shortened.

  Further, in the first embodiment, the thumbnail image data area is created in the user created area that can be arbitrarily created by the user in the moving picture file of the predetermined moving picture file format. Compatibility can be maintained without departing from the file format.

  Furthermore, in the first embodiment, any number of thumbnail images of the same moving image file can be created by designation from the outside, and therefore, when recording for a long time, the scene of the moving image file is easily searched. be able to.

  In the first embodiment, the case where video stream data is generated by MPEG4 encoding and thumbnail image data is generated by JPEG encoding has been described as an example. However, the encoding method is not limited to this. However, as an encoding method for generating thumbnail image data, it is desirable to use an encoding method with a smaller number of pixels than the encoding method for generating video stream data.

Embodiment 2. FIG.
A second embodiment according to the present invention will be described with reference to FIG. In Embodiment 1, a digital video signal is compressed using a JPEG encoding method that can be compressed under a condition that the number of pixels is smaller than that of an MPEG4 encoding method that generates video stream data, and thumbnail image data for thumbnail display is obtained. Although generated, a digital video signal may be used as it is as thumbnail image data.

  As shown in FIG. 8, the moving image recording / reproducing apparatus in this case is a recording processing unit 1a in which the JPEG encoding unit 12 is deleted from the recording processing unit 1 of the moving image recording / reproducing apparatus of the first embodiment shown in FIG. And a reproduction processing unit 2a in which the JPEG decoding unit 21 is deleted from the reproduction processing unit 2. Constituent parts having the same functions as those of the moving picture recording / reproducing apparatus of the first embodiment shown in FIG.

  Next, the operation of the moving picture recording / reproducing apparatus of the second embodiment will be described. The difference between the moving picture recording / reproducing apparatus of the second embodiment and the moving picture recording / reproducing apparatus of the first embodiment is whether or not the thumbnail image data is compressed. Will be omitted and only the differences will be described.

  First, the recording operation will be described. At the time of the recording operation, the control unit 5 sets the file generation unit 15 to select the digital video signal generated by the video signal processing unit 10, and when there is an instruction to create a thumbnail image, the file generation unit 15 A digital video signal generated by the video signal processing unit 10 is used as data. Other operations are thumbnail images in which the JPEG encoding unit 12 performs JPEG encoding processing on the digital video signal and compresses the digital video signal in the recording operation processing described with reference to the flowchart of FIG. This is an operation in which step S102 for generating data is omitted.

  Next, the reproduction operation will be described. The control unit 5 sets the file generation unit 15 to select the digital video signal generated by the MPEG4 decoding unit 22, and when there is a thumbnail image creation instruction, the file generation unit 15 sets the thumbnail image data as thumbnail image data. The digital video signal generated by the MPEG4 decoding unit 22 is used. Other operations are thumbnail images in which the JPEG encoding unit 12 performs JPEG encoding processing on the digital video signal and compresses the digital video signal in the recording operation processing described with reference to the flowchart of FIG. This is an operation in which step S205 for generating data is omitted.

  Next, the thumbnail display operation will be described. During the thumbnail display operation, the thumbnail image data read from the storage unit 4 is displayed on the display unit 24. Therefore, the thumbnail display operation described with reference to the flowchart of FIG. The operation is performed by omitting step S302 of generating thumbnail image signals obtained by performing JPEG decoding processing on the thumbnail image data to be decompressed and generating thumbnail image data.

  As described above, in the second embodiment, since digital video signals that are not encoded are used as thumbnail image data, there is no need to perform decoding processing when displaying thumbnails. It is possible to reduce the time from when the thumbnail display is instructed until the thumbnail is displayed, and to reduce the processing time.

Embodiment 3 FIG.
A third embodiment according to the present invention will be described with reference to FIG. In Embodiments 1 and 2, the thumbnail image data area is provided in the user-created area in accordance with the moving image file format generated by the file generation unit 15, but the thumbnail image data area may be provided in the file header area. .

  For example, in the ASF file format shown in FIG. 3, the thumbnail image data area 33 is provided in the file header area 30, but in the MP4 file format shown in FIG. A thumbnail image data area 43 is provided.

  In the MP4 file format, since the content information area in the file header area 40 also has a user-created area, a thumbnail is placed behind the audio content information area in the content information area of the file header area 40 as shown in FIG. An image data area 43a may be provided. In FIG. 9, detailed configurations of the content data area 41, the video content information area, and the audio content information area are the same as those in FIG.

  The analysis of the information set in the file header area is always the first process executed to specify the file format. That is, in the reproduction processing operation and the thumbnail display operation, when the control unit 5 outputs the video stream data, the audio stream data, and the thumbnail image data from the moving image file stored in the storage unit 4, it is set in the file header area. Analyzing information. At this time, if the control unit 5 acquires the information of the thumbnail image data area, the thumbnail display is performed in comparison with the case where the thumbnail image data area is searched from the moving image file after receiving the instruction of the thumbnail display. It is possible to shorten the time from when the instruction is given until the thumbnail is displayed.

Embodiment 4 FIG.
Embodiment 4 according to the present invention will be described with reference to FIG. In the first to third embodiments, the video stream data, the audio stream data, and the thumbnail image data that are sequentially generated are set in the data area of the video stream, the audio stream, and the thumbnail image data area. Therefore, when the thumbnail image data is inserted into the thumbnail image data area 33 shown in FIG. 3, the thumbnail image data area 43 shown in FIG. 4, or the thumbnail image data area 43a shown in FIG. (In FIG. 3, a data area 31 and an index data area 32 composed of a plurality of data packets, in FIG. 4, a user object area 42 and a plurality of object areas, in FIG. 9, a content data area 41 and a user object area 42, a plurality of (Object area) has to be shifted, and there is a problem that the processing load when generating a moving image file including thumbnail image data is large and processing time is also required.

  In order to improve such a problem, the thumbnail image data is generated in an area (work area) different from the moving image file being created in the storage unit 4 or a work memory (not shown), and at the end of recording, You may make it synthesize | combine at the time of completion | finish of reproduction | regeneration.

  That is, the file generation unit 15 generates a normal moving image file according to a predetermined file format, and when there is an instruction to create a thumbnail image, the thumbnail image is stored in a work area of the storage unit 4 or a work memory (not shown). Store it in. When there is a recording end instruction or a reproduction end instruction, the thumbnail image data area is inserted by shifting the area following the thumbnail image data area, and stored in the work area or work memory in the inserted image data area. Set the thumbnail image data.

  Further, if the thumbnail image data area is added to the end of the moving image file, it is not necessary to shift the area following the thumbnail image data area, and the processing load when generating the moving image file including the thumbnail image data is reduced. This can reduce the processing time.

  For example, in the case of the MP4 file format, since the content data area, the user object area, and other object areas are user-created areas, the file generation unit 15 includes a file header area 40, a chunk, as shown in FIG. A moving image file of a normal MP4 file format including a content data area 41 having data (Chunk Data) # 1 to #n, a user object area 42, and a plurality of objects is created in the storage unit 4, and an object type (In the figure, Object Type) 44, object size (in the figure, Object Size) 45, and thumbnail image data area 43b having thumbnail data area 46 having thumbnail image data # 1 to #m is designated as a work area or work memory. To create. When there is a recording end instruction or a reproduction end instruction, the file generation unit 15 adds the thumbnail image data area 43b created in the work area or work memory to the end of the moving picture file created in the storage unit 4.

  As described above, in the fourth embodiment, a thumbnail image data area for setting thumbnail image data is created in an area different from a normal moving image file, and the thumbnail image data area is recorded at the end of recording / playback. Is inserted into the video file, so it is not necessary to shift the area following the thumbnail image data area every time thumbnail image data is created, and the approximate number of accesses to the storage medium can be reduced. It is possible to reduce the processing load when generating the image and to shorten the processing time.

  Furthermore, when the thumbnail image data area is created at the end of the video file, it is not necessary to shift the data, so the approximate number of access to the storage medium can be reduced, and the thumbnail display image can be generated. The processing load can be reduced and the processing time can be shortened.

Embodiment 5 FIG.
A fifth embodiment according to the present invention will be described with reference to FIG. The moving picture recording / reproducing apparatus according to the fifth embodiment of the present invention includes the moving picture recording / reproducing apparatus of the first embodiment shown in FIG. 1 or the moving picture recording / reproducing apparatus of the second embodiment shown in FIG. Although almost the same, the operations of the control unit 5, the video signal processing unit 10, and the MPEG4 decoding unit 22 are different. In the following, the moving picture recording / reproducing apparatus shown in FIG. 1 will be described as an example.

  In addition to the functions of the first embodiment, the control unit 5 generates region information in the frame based on the thumbnail image region input together with the designation of the thumbnail image input from the user via the operation unit 3. . The control unit 5 outputs the region information in the frame to the video signal processing unit 10 during the recording operation, and outputs the region information in the frame to the MPEG4 decoding unit 22 during the reproduction operation.

  The video signal processing unit 10 generates a digital video signal from the input video signal and outputs the digital video signal to the MPEG4 encoding unit 13, and the digital video signal in the area information in the frame input from the control unit 5 is JPEG encoded. To the conversion unit 12.

  The MPEG4 decoding unit 22 performs a MPEG4 decoding process on the video stream data input from the storage unit 4 to generate a digital video signal obtained by expanding the video stream data, and outputs the digital video signal to the display unit 24. The digital video signal in the region information in the input frame is output to the JPEG encoding unit 12.

  Next, the operation of the moving image recording / playback apparatus according to the fifth embodiment will be described. The difference between the moving picture recording / reproducing apparatus of the fifth embodiment and the moving picture recording / reproducing apparatus of the first embodiment is that the moving picture recording / reproducing apparatus of the first embodiment is different from the frame specified as the thumbnail image. Whereas the thumbnail image data is generated, the moving image recording / playback apparatus according to the fifth embodiment generates thumbnail image data with a part of the frame (image in the area information in the frame) designated as the thumbnail image. Therefore, detailed description will be omitted and only the differences will be described.

  First, the recording operation will be described. The control unit 5 sets the JPEG encoding unit 12 to select the digital video signal input from the video signal processing unit 10. The control unit 5 generates region information in the frame based on the thumbnail image region input together with the designation of the thumbnail image input from the user via the operation unit 3. For example, the area information in the frame is information for determining the area in the frame based on the position information of the pixels in the frame. The control unit 5 outputs the generated region information in the frame to the video signal processing unit 10.

  The video signal processing unit 10 generates a digital video signal from the input video signal and outputs the digital video signal to the MPEG4 encoding unit 13, and the digital video signal in the area information in the frame input from the control unit 5 is JPEG encoded. To the conversion unit 12.

  The JPEG encoding unit 12 performs JPEG encoding processing on the digital video signal in the region information in the frame input from the video signal processing unit 10 to generate thumbnail image data indicating a part in the frame.

  When there is a thumbnail image creation instruction, the file generation unit 15 performs thumbnail image data generated by the JPEG encoding unit 12, video stream data generated by the MPEG4 encoding unit 13, and audio in accordance with a predetermined file format. The audio stream data generated by the encoding unit 14 is added to the moving image file stored in the storage unit 4.

  When there is no thumbnail image creation instruction, the file generation unit 15 stores the video stream data generated by the MPEG4 encoding unit 13 and the audio stream data generated by the audio encoding unit 14 in accordance with a predetermined file format. It is added to the moving image file stored in the section 4.

  Next, the reproduction operation will be described. The control unit 5 sets the JPEG encoding unit 12 to select the digital video signal generated by the MPEG4 decoding unit 22. The control unit 5 generates region information in the frame based on the thumbnail image region input together with the designation of the thumbnail image input from the user via the operation unit 3. The control unit 5 outputs the generated region information in the frame to the MPEG4 decoding unit 22.

  The MPEG4 decoding unit 22 performs a MPEG4 decoding process on the video stream data input from the storage unit 4 to generate a digital video signal obtained by expanding the video stream data, and outputs the digital video signal to the display unit 24. The digital video signal in the region information in the input frame is output to the JPEG encoding unit 12.

  When there is a thumbnail image creation instruction, the file generation unit 15 adds the thumbnail image data generated by the JPEG encoding unit 12 to the moving image file according to the file format of the moving image file being reproduced.

  Note that the thumbnail image display operation is the same as that of the first embodiment, and thus the description thereof is omitted here.

  FIG. 11 is a diagram showing a relationship between thumbnail images generated by the moving image recording / playback apparatus of the fifth embodiment and recorded videos. In FIG. 11, when an instruction for creating a thumbnail image is received from the user at the start of recording, 30 minutes after the start of recording, and 60 minutes after the start of recording, that is, three images are received in response to an instruction to create thumbnail images three times. This shows a case where the thumbnail image data is generated.

  In FIG. 11, at the start of recording, an area 50 is designated as a thumbnail image area and a thumbnail image 55 is generated. After 30 minutes from the start of recording, an area 51 is designated as a thumbnail image area and a thumbnail image 56 is generated, and recording starts. 60 minutes after that, the area 52 is designated as the thumbnail image area, and the thumbnail image 57 is generated.

  As described above, in the fifth embodiment, an image of a region set from the outside in a frame indicated by a digital video signal, that is, a digital video signal for a thumbnail of a part of the frame is generated and used for thumbnails. Since the thumbnail image data compressed by applying JPEG encoding to the digital video signal is set in the thumbnail image data area, the scene and state can be easily discriminated, and the contents can be clearly determined. The thumbnails that can be displayed can be displayed.

Embodiment 6 FIG.
A sixth embodiment according to the present invention will be described with reference to FIGS. In the display unit 24 of the moving image recording / playback apparatus according to the first to fifth embodiments, it is conceivable that the display unit 24 that plays a moving image and the aspect ratio of the moving image content are different. When the aspect ratio of the moving image content is different from that of the display unit 24 that reproduces the moving image, for example, the aspect ratio of the display unit 24 is 16: 9 as shown in FIG. When the ratio is 4: 3, the thumbnail areas 58 and 59 to be displayed are cut off and are not displayed.

  In order to improve such a problem, the moving picture recording / reproducing apparatus of the fifth embodiment generates thumbnail image data in accordance with the aspect ratio of the display unit 24 and displays the thumbnail as shown in FIG. This prevents the image from being cut off.

  The moving picture recording / reproducing apparatus of the sixth embodiment is substantially the same as the moving picture recording / reproducing apparatus of the first embodiment shown in FIG. 1 or the moving picture recording / reproducing apparatus of the second embodiment shown in FIG. However, the operations of the video signal processing unit 10 and the MPEG4 decoding unit 22 are different. In the following, the moving picture recording / reproducing apparatus shown in FIG. 1 will be described as an example.

  During the recording operation of the moving image recording / playback apparatus, the video signal processing unit 10 generates a digital video signal from the input video signal and outputs the digital video signal to the MPEG4 encoding unit 13, and the aspect of the display unit 24 from the input video signal. A digital video signal of a frame corresponding to the ratio is generated and output to the JPEG encoding unit 12.

  Also, during the playback operation of the moving image recording / playback apparatus, the MPEG4 decoding unit 22 generates and displays a digital video signal obtained by decompressing the video stream data by performing MPEG4 decoding processing on the video stream data input from the storage unit 4. In addition to outputting to the unit 24, a digital video signal of a frame corresponding to the aspect ratio of the display unit 24 is further generated from the generated digital video signal and output to the JPEG encoding unit 12.

  As a result, the JPEG encoding unit 12 generates thumbnail image data by performing JPEG encoding processing on the digital video signal of the frame corresponding to the aspect ratio of the display unit 24, and the file generation unit 15 performs the aspect of the display unit 24. A moving image file in which thumbnail image data corresponding to the ratio is set in the data area of the thumbnail image data area is generated. The moving image file format may be any of those shown in FIGS. 3, 4, 9, and 10.

  As described above, in the sixth embodiment, since thumbnail image data corresponding to the aspect ratio of the display unit is generated, the aspect ratio of the video unit and the display unit that reproduces the video are different. However, when the thumbnail is displayed, the thumbnail image is not cut off, and the contents can be clearly displayed.

Embodiment 7 FIG.
A seventh embodiment according to the present invention will be described with reference to FIGS. In the first to sixth embodiments, one or a plurality of thumbnail image data is generated and the thumbnail is displayed. However, when the audio stream data corresponding to the thumbnail image data is generated and the thumbnail is displayed, Audio may be output.

  Specifically, during the recording operation or the reproducing operation of the moving image recording / reproducing apparatus according to the first to sixth embodiments, the audio signal corresponding to the thumbnail to be created by the user via a microphone (not shown), for example, “xx time” An audio signal such as “drama for yy” is input. The audio signal input via the microphone is converted into a digital audio signal by the audio input unit 11, encoded by the audio encoding unit 14, and input to the file generation unit 15 as audio stream data. The file generation unit 15 sets the audio stream data in the data area of the thumbnail image data area together with the thumbnail image data.

  For example, when the moving image file format generated by the file generation unit 15 is the ASF file format shown in FIG. 3, the thumbnail data area 36 of the thumbnail image data area 33 is set to the first time as shown in FIG. Set thumbnail image data # 1 and thumbnail audio data # 1 in the second thumbnail image creation instruction, set thumbnail image data # 2 and thumbnail audio data # 2 in the second thumbnail image creation instruction, and generate the mth thumbnail image In the instruction, thumbnail image data # 1 and thumbnail audio data #m are set.

  Even when the moving image file format generated by the file generation unit 15 is the MP4 file format shown in FIGS. 4, 9, and 10, the ASF file format is included in the data areas of the thumbnail image data areas 43, 43a, and 43b. Similarly, the thumbnail image data # 1 and the thumbnail audio data # 1 are set in the first thumbnail image creation instruction, the thumbnail image data # 2 and the thumbnail audio data # 2 are set in the second thumbnail image creation instruction, In the m-th thumbnail image creation instruction, thumbnail image data # 1 and thumbnail audio data #m are set.

  During the thumbnail display operation of the moving image recording / playback apparatuses of Embodiments 1 to 6, the control unit 5 causes the JPEG decoding unit 21 to output the thumbnail image data in the thumbnail image data area from the storage unit 4 according to the moving image file format. The audio audio decoding unit 23 is caused to output thumbnail audio data corresponding to the thumbnail image data.

  The JPEG decoding unit 21 performs a JPEG decoding process on the thumbnail image data to generate a thumbnail image signal obtained by expanding the thumbnail image data, and the display unit 24 displays the thumbnail image signal generated by the JPEG decoding unit 21. To do.

  On the other hand, the audio decoding unit 23 generates a digital audio signal obtained by decompressing the thumbnail audio data by performing a decoding process on the thumbnail audio data using a predetermined audio decoding method, and the audio output unit 25 outputs the digital audio signal. Based on the output.

  FIG. 15 is a diagram showing the relationship between thumbnail images generated by the moving image recording / playback apparatus of the seventh embodiment and recorded videos. In FIG. 15, when a user receives an instruction to create a thumbnail image at the start of recording, 30 minutes after the start of recording, and 60 minutes after the start of recording, that is, three images in response to an instruction to create thumbnail images three times. This shows a case where the thumbnail image data is generated.

  In FIG. 15, a sound “Dry for yy at xx” is output in the thumbnail display at the start of recording, and a documentary for yy at xx is displayed in the thumbnail display 30 minutes after the start of the video. Is output, and in the display of thumbnails 60 minutes after the start of the video, the sound “sports for xx hours and yy” is output.

  As described above, in the seventh embodiment, the audio stream data generated from the audio input when creating the thumbnail image data is set in the thumbnail image data area in association with the thumbnail image data. Therefore, when displaying thumbnails, it is possible to output sound, and the user can not only visually determine the content scene but also auditorily determine the content scene.

Embodiment 8 FIG.
Embodiment 8 according to the present invention will be described with reference to FIG. In the first to sixth embodiments, thumbnail image data is set in the data area of the thumbnail image data area. In the seventh embodiment, thumbnail image data and thumbnail audio data are set in the data area of the thumbnail image data area. The frame number of the video for which the thumbnail image data is generated may be set.

  In this case, the video signal processing unit 10 is monitored by the control unit 5 of the moving picture recording / reproducing apparatus of the first embodiment shown in FIG. 1 or the moving picture recording / reproducing apparatus of the second embodiment shown in FIG. The frame of the video signal input is counted, and the frame count value is output to the file generation unit 15 together with the thumbnail image generation instruction, and the file generation unit 15 sets the frame number together with the thumbnail image data. What should I do?

  Specifically, in the case of the ASF file format, the file generation unit 15 adds a thumbnail to the thumbnail data area 36 of the thumbnail image data area 33 shown in FIG. 3 according to the first thumbnail image creation instruction as shown in FIG. A frame number corresponding to the image data # 1 (in this case “1”) and thumbnail image data # 1 are set, and a frame number corresponding to the thumbnail image data # 2 (in this case “ 5 ”) and thumbnail image data # 2 are set, and a frame number (in this case,“ 100 ”) and thumbnail image data #m corresponding to the thumbnail image data #m are set by an m-th thumbnail image creation instruction.

  As described above, in the eighth embodiment, the frame of the digital video signal to be recorded is counted, and the count value of the frame of the digital video signal to be used used when generating the thumbnail image data, In other words, since the frame number is associated with the thumbnail image data and set in the thumbnail image data area, the frame number is indexed when the user requests playback from the thumbnail image when the thumbnail is displayed. Can be easily used for cueing.

Embodiment 9 FIG.
A ninth embodiment according to the present invention will be described with reference to FIG. In the first to eighth embodiments, in the case of the ASF file format, the thumbnail image data area 33 is set to the GUID 34, the object size 35, and the thumbnail data area 36 for setting the thumbnail image data, the thumbnail audio data, and the frame number of the thumbnail image data. In the case of the MP4 file format, the thumbnail image data area 43 is composed of an object type 44, an object size 45, and a thumbnail data area 46 for setting thumbnail image data, thumbnail audio data, and frame number of thumbnail image data. However, a thumbnail image data generation information area for setting thumbnail image data generation information when thumbnail image data is generated may be provided.

  Specifically, for example, a moving image file including the thumbnail image data area 33a shown in FIG. 17 is used instead of the thumbnail image data area 33 of the ASF file format shown in FIG. The thumbnail image data area 33a shown in FIG. 17 includes contrast information, white point temperature information, gradation characteristic information, between the object size 35 and the thumbnail data area 36 in which the thumbnail image data # 1 to #m are set. A thumbnail image data generation information area 37 in which thumbnail image creation information such as color characteristic information and compression information is set is added.

  In this case, the video signal processing unit 10 is monitored by the control unit 5 of the moving picture recording / reproducing apparatus of the first embodiment shown in FIG. 1 or the moving picture recording / reproducing apparatus of the second embodiment shown in FIG. And the JPEG encoding process of the JPEG encoding unit 12 to generate contrast information, white point temperature information, gradation characteristic information, and color characteristic information. The compression information of the conversion unit 12 is output to the file generation unit 15 together with the thumbnail image generation instruction, and the file generation unit 15 sets the information from the control unit 5 in the thumbnail image data generation information area 37.

  During the thumbnail display operation, the control unit 5 contrast information, white point temperature information, gradation characteristic information, color characteristic information, and compression information set in the thumbnail image data generation information area 37 of the thumbnail image data area 33. , And the thumbnail image signal generated from the thumbnail image data based on the information is displayed on the display unit 24.

  As described above, according to the ninth embodiment, the contrast information, the white point temperature information, the floor level, and the like are input based on the input video signal at the time of creating the thumbnail image data and / or the JPEG encoding process of the JPEG encoding unit. Since thumbnail image data generation information including tone characteristic information, color characteristic information, and compression information is generated and set in the thumbnail image data generation information area in the thumbnail image data generation area, when displaying a thumbnail image In addition, thumbnail images can be displayed under the same conditions as when thumbnail image data was created.

  Although the ASF file format has been described in the ninth embodiment, contrast information, white point temperature information, gradation characteristic information, color characteristic information, and compression information are included in the thumbnail image data area of the MP4 file format. A thumbnail image data generation information area may be provided.

  The thumbnail image data generation information only needs to include at least one of contrast information, white point temperature information, gradation characteristic information, color characteristic information, and compression information.

Embodiment 10 FIG.
The tenth embodiment will be described with reference to FIG. In the first to ninth embodiments, when the control unit 5 receives an instruction to create a thumbnail image from the user via the operation unit 3, the control unit 5 outputs a thumbnail image creation instruction, and the file generation unit 15 Although the thumbnail image data is set in the moving image file in accordance with the creation instruction, all the video signals in the thumbnail data area 36 of the thumbnail image data area 33 are shown in FIG. Frame image data may be set as thumbnail image data. In this case, considering the data amount, the thumbnail image data that has been subjected to the JPEF encoding process by the JPEG encoding unit 12 can be set in the thumbnail data area 36 using the moving picture recording / reproducing apparatus of the first embodiment. desirable.

  As described above, in the tenth embodiment, the thumbnail image data of all the frames of the digital video signal to be recorded in the thumbnail image data area is set in the thumbnail image data area. Regardless of the file format of the file, by reproducing the thumbnail image data, the video recorded in the moving image file can be displayed, and the user can easily determine the contents of the moving image file.

  As described above, the moving image recording apparatus and moving image recording / playback apparatus according to the present invention are useful for devices that handle moving image files, and are particularly suitable for digital still cameras, digital video cameras, televisions, and moving image viewer products.

It is a block diagram which shows the structure of the moving image recording / reproducing apparatus of Embodiment 1 concerning this invention. 6 is a flowchart for explaining a recording operation of the moving picture recording / reproducing apparatus according to the first embodiment of the present invention; It is a figure which shows the structure of the moving image file produced | generated according to the ASF file format. It is a figure which shows the structure of the moving image file produced | generated according to MP4 file format. It is a flowchart for demonstrating reproducing | regenerating operation | movement of the moving image recording / reproducing apparatus of Embodiment 1 concerning this invention. It is a flowchart for demonstrating the thumbnail display operation | movement of the moving image recording / reproducing apparatus of Embodiment 1 concerning this invention. It is a figure which shows the relationship between the image of the thumbnail produced | generated by the moving image recording / reproducing apparatus of Embodiment 1 concerning this invention, and the recorded image | video. It is a block diagram which shows the structure of the moving image recording / reproducing apparatus of Embodiment 2 concerning this invention. It is a figure which shows the structure of the moving image file which the moving image recording / reproducing apparatus of Embodiment 3 concerning this invention produces | generates. It is a figure which shows the structure of the moving image file which the moving image recording / reproducing apparatus of Embodiment 4 concerning this invention produces | generates. It is a figure which shows the relationship between the image of the thumbnail produced | generated by the moving image recording / reproducing apparatus of Embodiment 5 concerning this invention, and the recorded image | video. It is a figure which shows the display image of a thumbnail in case the aspect-ratio of thumbnail image data differs from the aspect-ratio of a display part. It is the display image figure which displayed on the display part the thumbnail image data which the moving image recording / reproducing apparatus of Embodiment 6 concerning this invention produced | generated. It is a figure which shows the data set to the data area of the thumbnail image data area of the moving image file which the moving image recording / reproducing apparatus of Embodiment 7 concerning this invention produces | generates. It is a figure which shows the relationship between the image of the thumbnail produced | generated by the moving image recording / reproducing apparatus of Embodiment 7 concerning this invention, and the recorded image | video. It is a figure which shows the structure of the thumbnail data area | region of the moving image file which the moving image recording / reproducing apparatus of Embodiment 8 concerning this invention produces | generates. It is a figure which shows the structure of the thumbnail data area | region of the moving image file which the moving image recording / reproducing apparatus of Embodiment 9 concerning this invention produces | generates. It is a figure which shows the structure of the moving image file which the moving image recording / reproducing apparatus of Embodiment 10 concerning this invention produces | generates.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 1a Recording processing part 2, 2a Playback processing part 3 Operation part 4 Storage part 5 Control part 10 Video signal processing part 11 Audio | voice input part 12 JPEG encoding part 13 MPEG4 encoding part 14 Audio encoding part 15 File generation part 21 JPEG decoding unit 22 MPEG4 decoding unit 23 Audio decoding unit 24 Display unit 25 Audio output unit 30, 40 File header area 31, 36, 46 Data area 32 Index data area 33, 43, 43a, 43b Thumbnail image data area 34 GUID
35, 45 Object size 37 Thumbnail image data generation information area 41 Content data area 42 User object area 44 Object type 50, 51, 52 area 55, 56, 57 Thumbnail image

Claims (13)

In a video recording apparatus for generating and storing a video file of a predetermined video file format from a digital video signal and a digital audio signal of a video to be recorded,
A first encoding unit that generates video stream data compressed by applying a predetermined first encoding process to the digital video signal;
A second encoding unit that generates audio stream data compressed by applying a predetermined second encoding process to the digital audio signal;
The video stream data and the audio stream data are set in a video stream and an audio stream of the video file, and a thumbnail image data area is created in a user creation area that can be arbitrarily created by the user in the video file. When receiving an instruction to create a thumbnail image, a file generation unit that sets a digital video signal of a frame used as a thumbnail image as thumbnail image data in the created thumbnail image data area;
A moving picture recording apparatus comprising: A third encoding unit for generating thumbnail image data compressed by applying a predetermined third encoding process to the digital video signal;
Further comprising
The file generator
Setting thumbnail image data generated by the third encoding unit in a thumbnail image data area;
The moving image recording apparatus according to claim 1. The third encoding process of the third encoding unit is an encoding process with a condition that the number of pixels is smaller than that of the first encoding process of the first encoding unit;
The moving image recording apparatus according to claim 2. The file generator
Creating the thumbnail image data area in the file header area of the moving image file, after the data area in which the video stream and the audio stream are set, or at the end of the moving image file;
The moving picture recording apparatus according to claim 1, wherein The file generator
Thumbnail image data is stored in a predetermined area, and at the end of recording, a thumbnail image data area is generated in the moving image file, and the thumbnail image data stored in the predetermined area is generated in the generated thumbnail image data area. Setting,
The moving picture recording apparatus according to any one of claims 1 to 4. A video signal processing unit for generating a thumbnail digital video signal used to create thumbnail image data from the digital video signal;
Further comprising
The video signal processor is
In the frame indicated by the digital video signal, a thumbnail digital video signal is generated from an image of a region set from outside,
The third encoding unit, or the file generation unit,
Generating thumbnail image data using the thumbnail digital video signal;
The moving picture recording apparatus according to any one of claims 1 to 5. The video signal processor is
Changing the aspect ratio of the frame indicated by the digital video signal to generate a digital video signal for thumbnail;
The moving picture recording apparatus according to claim 1, wherein The file generator
Among the audio stream data generated by the second encoding unit, the audio stream data corresponding to the audio input when the thumbnail image data is created, together with the thumbnail image data, the thumbnail image data area of the moving image file Set to
The moving picture recording apparatus according to any one of claims 1 to 7. A control unit for counting frames of the digital video signal to be recorded;
Further comprising
The file generator
Setting the frame count value of the digital video signal to be recorded used when generating the thumbnail image data as a frame number in association with the thumbnail image data in the thumbnail image data area;
The moving picture recording apparatus according to any one of claims 1 to 8. The controller is
Based on the video signal to be recorded and / or the third encoding process of the third encoding unit, at least one of contrast information, white point temperature information, gradation characteristic information, color characteristic information, and compression information Create thumbnail image data generation information including
The file generator
Setting thumbnail image data generation information generated by the control unit in a thumbnail image data area of the moving image file;
The moving picture recording apparatus according to claim 9. The file generator
Setting thumbnail image data of all frames of the digital video signal of the video to be recorded in the thumbnail image data area of the moving image file;
The moving picture recording apparatus according to any one of claims 1 to 10. A moving picture recording / reproducing apparatus comprising the moving picture recording apparatus according to any one of claims 1 to 11,
A first decoding unit that generates a digital video signal obtained by performing a first decoding process on video stream data set in a video stream of a video file generated by the video recording device;
A second decoding unit that generates a digital audio signal obtained by performing a second decoding process on the audio stream data set in the audio stream of the video file generated by the video recording device;
When the thumbnail image data set in the thumbnail image data area of the moving image file generated by the moving image recording apparatus is encoded, the thumbnail image is decompressed by performing a third decoding process on the thumbnail image data. A third decoding unit for generating a signal;
A video is displayed based on the digital video signal generated by the first decoding unit, and a thumbnail is displayed based on the thumbnail image signal generated by the third decoding unit when an instruction to display a thumbnail is received. A display for displaying the image of
An audio output unit that outputs audio based on the digital audio signal generated by the second decoding unit;
A moving picture recording / reproducing apparatus comprising: The file generator of the video recording device
When the display unit displays an image based on the digital video signal generated by the first decoding unit, when receiving an instruction to create the thumbnail image, the display unit generates the image by the first decoding unit. Or the thumbnail image data compressed by performing a third encoding process on the digital video signal generated by the third encoding unit and the digital video signal generated by the first decoding unit. Set the thumbnail image data area,
The moving picture recording / reproducing apparatus according to claim 12.

Images