JP4821462B2 - Recording apparatus and method, reproducing apparatus and method, and program - Google Patents

Description

  The present invention relates to a recording apparatus and method, a reproducing apparatus and method, and a program, and more particularly, to a recording apparatus and method, a reproducing apparatus and method, and a program for recording metadata or reproducing metadata.

  When recording a content such as a still image or a moving image, an apparatus that records metadata related to the content at the same time is used.

  In the case of a still image recorded by the EXIF (Exchangeable Image File Format) method, information relating to shooting date and time and image data is recorded as metadata in an IFD area existing in APP1. In recent years, many applications utilizing this metadata have been developed.

  Japanese Patent Application Laid-Open No. H10-228561 discloses utilizing metadata for quickly editing content. Further, Patent Document 2 discloses an application related to content search using metadata.

JP 2004-319077 A

JP 2006-18551 A

  Conventionally, metadata is recorded together with image data in one file like an EXIF still image. In other words, when using metadata, open the file, extract the metadata, determine whether the metadata can be used for the desired processing, close the file, and open the next file Similarly, the process of determining whether the extracted next metadata can be used for a desired process and closing the file has been repeatedly performed. As described above, when a large number of files are recorded on the recording medium and it is desired to use the metadata for the file, a lot of time is spent in determining whether or not the metadata can be used.

  Furthermore, in recent years, there are many metadata such as shooting date and time that are commonly added to different types of files such as moving image files and still image files. In the case of an application using these metadata, generally, the metadata recording method to the moving image file and the metadata recording method to the still image file are different, so the metadata is read by a different system. In other words, more time is spent in determining whether or not metadata can be used for different types of content such as moving images and still images.

  The present invention has been made in view of such a situation, and makes it possible to use metadata more quickly regardless of the type of content.

The recording apparatus according to the first aspect of the present invention controls to record in a second directory a dynamic metafile storing dynamic metadata related to dynamic content in a predetermined structure for each dynamic content. And recording a static metafile in which static metadata related to the dynamic content or the static content is stored in one file in the same structure as the predetermined structure in the first directory. And a second recording control means for controlling so as to make it happen.

The first directory may be higher in the hierarchy than the second directory .

The dynamic metafile may include time or random access information of the dynamic metadata as information for reproducing the dynamic metadata .

Third recording control means for controlling recording of a management file that stores management information for each of the dynamic contents or the static contents is provided, and the third recording control means includes the dynamic information as the management information. Storing first link information indicating a link to content or the static content, and second link information indicating a link to the static metadata related to the dynamic content or the static content Recording of the management file under the first directory can be controlled.

The first recording control unit records the name of the content file for reproducing the dynamic content related to the stored dynamic metadata and the dynamic metafile having the same name except for an extension. be able to.

  The display regarding the files and directories under the first directory can be prohibited.

The recording method according to the first aspect of the present invention controls to record in a second directory a dynamic metafile storing dynamic metadata related to dynamic content in a predetermined structure for each dynamic content. And controlling to record in the first directory a static metafile in which static metadata related to the dynamic content or static content is stored in one file with the same structure as the predetermined structure. Including.

The program according to the first aspect of the present invention controls to record in a second directory a dynamic metafile storing dynamic metadata related to dynamic content in a predetermined structure for each dynamic content. A step of controlling to record in a first directory a static metafile in which static metadata related to the dynamic content or static content is stored in one file with the same structure as the predetermined structure To run.

The playback apparatus according to the second aspect of the present invention is dynamic metadata related to dynamic content, and is stored in a second directory with a predetermined structure in a dynamic metafile for each dynamic content. First reproduction control means for controlling reproduction of dynamic metadata, and static metadata related to the dynamic content or the static content, wherein the static metadata file has the same structure as the predetermined structure. And second reproduction control means for controlling reproduction of static metadata stored in the first directory in one file .

The first directory may be higher in the hierarchy than the second directory .

The dynamic metafile may include time or random access information of the dynamic metadata as information for reproducing the dynamic metadata .

There is provided third playback control means for controlling the playback of the management information stored in the management file , which is management information for each dynamic content or static content, and the third playback control means includes: First link information indicating a link to the dynamic content or the static content, and the dynamic content or the static content stored in the management file under the first directory as the management information It is possible to control the reproduction with the second link information indicating the link to the static metadata related to the.

The first reproduction control unit relates to the dynamic content stored in the dynamic metafile having the same name except for the name of the content file for reproducing the dynamic content and the extension. The reproduction of the dynamic metadata can be controlled.

  The display regarding the files and directories under the first directory can be prohibited.

The reproduction method according to the second aspect of the present invention is dynamic metadata related to dynamic content, and is stored in a second directory with a predetermined structure in a dynamic metafile for each dynamic content. Static metadata related to dynamic content or static content, which controls reproduction of dynamic metadata, and the first directory in a single file with the same structure as the predetermined structure in the static metadata file comprising the step of controlling reproduction of static metadata stored in.

The program according to the second aspect of the present invention is dynamic metadata related to dynamic content, and the dynamic metadata stored in the second directory in a predetermined structure in the dynamic metafile for each dynamic content. Static metadata related to the dynamic content or the static content, wherein the static metadata is the same structure as the predetermined structure, and one file is stored in the first directory. Causing the computer to execute a step of controlling the reproduction of the stored static metadata.

In the first aspect of the present invention, the recording of the dynamic metadata related to the dynamic content in the second directory in which the dynamic metadata related to the dynamic content is stored in a predetermined structure for each dynamic content is controlled. The recording of the static metadata related to the static content or the static content in the first directory having the same structure as the predetermined structure stored in one file is controlled.

In the second aspect of the present invention, dynamic metadata relating to dynamic content, which is stored in a second directory with a predetermined structure in a dynamic metafile for each dynamic content. The reproduction of metadata is controlled, and is static metadata related to the dynamic content or the static content, and the static metafile is stored in the first directory as one file with the same structure as the predetermined structure. Static metadata playback is controlled.

  As described above, according to the first aspect of the present invention, metadata can be recorded.

  Also, according to the first aspect of the present invention, metadata can be recorded so that the metadata can be used more quickly regardless of the type of content.

  According to the second aspect of the present invention, metadata can be used.

  Further, according to the second aspect of the present invention, metadata can be used more quickly regardless of the type of content.

  FIG. 1 is a block diagram showing a configuration of a digital camera 11 according to an embodiment of the present invention. The digital camera 11 includes a camera unit 31, a camera DSP (Digital Signal Processor) 32, an SDRAM (Synchronous Dynamic Random Access Memory) 33, a medium interface (hereinafter referred to as medium I / F) 34, and a recording medium 35. , Control unit 36, operation unit 37, LCD controller 38, LCD 39, external interface (hereinafter referred to as external I / F) 40, communication interface (hereinafter referred to as communication I / F) 41, GPS (Global Positioning System) signal receiving unit 42.

  The recording medium 35 is a medium for recording data or a program that is configured to be detachable. As the recording medium 35, a so-called memory card using a semiconductor memory, an optical recording medium such as a recordable DVD (Digital Versatile Disc) or a recordable CD (Compact Disc), a magnetic disk, or the like is used. However, in this embodiment, a description will be given assuming that, for example, a memory card incorporating a semiconductor memory or a hard disk drive is used as the recording medium 35.

  The camera unit 31 includes an optical block 61, a CCD (Charge Coupled Device) 62, a preprocessing circuit 63, an optical block driver 64, a CCD driver 65, and a timing generation circuit 66. Here, the optical block 61 includes a lens, a focus mechanism, a shutter mechanism, a diaphragm (iris) mechanism, and the like.

  The control unit 36 includes a CPU (Central Processing Unit) 81, a RAM (Random Access Memory) 82, a flash ROM (Read Only Memory) 83, and a clock circuit 84 connected through a system bus 85. The control unit 36 includes, for example, a general-purpose embedded microcomputer or a dedicated system LSI (Large Scale Integrated circuit). The control unit 36 controls each unit of the digital camera 11.

  Here, the RAM 82 is mainly used as a work area, such as temporarily storing intermediate results of processing. The flash ROM 83 stores various programs executed by the CPU 81 and data necessary for processing. The clock circuit 84 can provide the current date, the current day of the week, and the current time, as well as the shooting date and time.

  At the time of shooting an image, the optical block driver 64 forms a drive signal for operating the optical block 61 according to the control from the control unit 36, and supplies this to the optical block 61. Then, the optical block 61 is operated. In accordance with the drive signal from the optical block driver 64, the focus mechanism, shutter mechanism, and aperture mechanism of the optical block 61 are controlled. The optical block 61 captures an optical image of the subject and forms it on the CCD 62. Let

  The CCD 62 photoelectrically converts the optical image from the optical block 61 and outputs an electrical signal of the image obtained by the conversion. That is, the CCD 62 operates in accordance with the drive signal from the CCD driver 65, captures an optical subject image from the optical block 61, and based on the timing signal from the timing generation circuit 66 controlled by the control unit 36. Then, the captured image of the subject (image information) is supplied to the preprocessing circuit 63 as an electrical signal.

  Note that a photoelectric conversion device such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor may be used instead of the CCD 62.

  In addition, as described above, the timing generation circuit 66 forms a timing signal that provides a predetermined timing in accordance with the control from the control unit 36. The CCD driver 65 forms a drive signal to be supplied to the CCD 62 based on the timing signal from the timing generation circuit 66.

  The pre-processing circuit 63 performs CDS (Correlated Double Sampling) processing on the image information of the electrical signal supplied from the CCD 62 so as to maintain a good S / N ratio and AGC (Automatic Gain Control). Processing is performed to control the gain, and A / D (Analog / Digital) conversion is performed to form digital image data.

  The image data converted into a digital signal in the preprocessing circuit 63 is supplied to the camera DSP 32. The camera DSP 32 performs camera signal processing such as AF (Auto Focus), AE (Auto Exposure), and AWB (Auto White Balance) on the supplied image data. The image data subjected to various adjustments in this way is encoded by a predetermined encoding method such as JPEG (Joint Photographic Experts Group) or JPEG 2000, and the digital camera 11 through the system bus 85 and the medium I / F 34. Is supplied to the recording medium 35 and is recorded as a file on the recording medium 35 as described later. Also, a moving image file can be generated and recorded on the recording medium 35 by encoding the image data group using an encoding method for encoding moving images such as MPEG (Motion Picture Experts Group). .

  A still image or a moving image is an example of content. A file that stores still image data or moving image data is an example of a content file.

  Also, the image data recorded on the recording medium 35 is transferred from the recording medium 35 through the medium I / F 34 according to the operation input from the user received through the operation unit 37 including a touch panel and control keys. This is read out and supplied to the camera DSP 32.

  The camera DSP 32 decodes the encoded image data read from the recording medium 35 and supplied through the medium I / F 34, and supplies the decoded image data to the LCD controller 38 through the system bus 85. The LCD controller 38 forms an image signal to be supplied to the LCD 39 from the image data supplied thereto, and supplies this to the LCD 39. As a result, an image corresponding to the image data recorded on the recording medium 35 is displayed on the display screen of the LCD 39.

  Further, the digital camera 11 of this embodiment is provided with an external I / F 40. The external I / F 40 is connected to, for example, an external personal computer, receives image data supplied from the personal computer, and records it on the recording medium 35 attached to the digital camera 11, or the digital camera 11 It is also possible to supply the image data recorded on the recording medium 35 attached to the external personal computer or the like.

  The communication I / F 41 includes a so-called network interface card (NIC) or the like, and is connected to the network and acquires various image data and other information through the network.

  Further, the GPS signal receiving unit 42 receives a signal transmitted from a GPS artificial satellite and supplies GPS data indicating the current position to the control unit 36.

  Further, as described above, information such as image data acquired through an external personal computer or network and recorded on a recording medium is read out and reproduced by the digital camera 11 of this embodiment and displayed on the LCD 39 to be displayed by the user. Of course it can be used.

  The communication I / F 41 can be provided as a wired interface conforming to a standard such as IEEE (Institute of Electrical and Electronic Engineers) 1394 or USB (Universal Serial Bus), or IEEE802.11a or IEEE802.11b. , IEEE802.11g, or as a wireless interface using light or radio waves conforming to the Bluetooth standard. That is, the communication I / F 41 may be a wired or wireless interface.

  FIG. 2 is a diagram for explaining the directory structure in the recording medium 35 and the files recorded in the recording medium 35.

  A root in FIG. 2 is a node indicating the recording medium 35. Under the root, two directories for arranging moving image content, one directory for arranging still image content, and one directory for arranging information related to the content are generated. .

  One of the two directories for storing the content of the moving image is named MOVIE1. In the directory that is MOVIE1, content that is composed of a stream, a playlist, and image management information and that stores the stream, playlist, and image management information in separate files is arranged as a file.

  The playlist indicates, for example, a start point or an end point of reproduction of a predetermined stream in reproduction of predetermined content. The image management information is information indicating a stream encoding method and information for controlling the reading or decoding of the stream. The stream is moving image data.

  Below the directory MOVIE1, a directory whose name is PLAYINF, a directory whose name is CODECINF, and a directory whose name is STREAM are generated.

  A file storing a playlist is arranged in the directory PLAYINF. The extension of the name of the file storing the playlist is pla. A file storing image management information is arranged in a directory which is CODECINF. The extension of the name of the file storing the image management information is cod. Further, a file storing the stream is arranged in the directory which is STREAM. The extension of the name of the file storing the stream is str.

  The name of the file storing the image management information and the name of the file storing the stream are the same except for the extension, and the file storing the image management information and the file storing the stream are related to each other.

  The other name of the two directories for storing moving image content is MOVIE2. A directory that is MOVIE2 stores content that is a moving image stored in one file. Content that is a moving image stored in one file is encoded by, for example, MPEG (Moving Pictures Experts Group) 4 system. The extension of the name of the file storing the content that is a moving image encoded by the MPEG4 system is mp4.

  The name of the directory for placing the still image content is STILL. The content of the still image is encoded by, for example, JPEG (Joint Photographic Experts Group) method. The extension of the name of the file storing the content that is a still image encoded by the JPEG method is jpg.

  Hereinafter, a file storing a playlist (hereinafter referred to as a playlist file), a file storing image management information (hereinafter referred to as an image management information file), a file storing a stream (hereinafter referred to as a stream file), A file storing content that is a moving image and a file storing content that is a still image (hereinafter referred to as a still image file) are collectively referred to as a content file.

  The name of the directory for placing information related to the content is AV_INFO. In the AV_INFO directory, a property file, a thumbnail file, and a metadata file are arranged. Each of the property file, thumbnail file, and metadata file stores information related to the content.

  A property file is an indispensable file. Among information related to content, information necessary for reading content, information indicating the type of content such as moving image, still image, or audio, thumbnail file or metadata file reading If the corresponding content is a moving image, position information indicating the position (hereinafter referred to as a resume point) on the moving image where the moving image was reproduced and stopped last time, other attribute information about the content, and the like are stored. . In addition, when the content is a moving image or a still image, the thumbnail file stores image data of a thumbnail image among information related to the content.

  Further, the metadata file stores metadata other than the image data of the thumbnail image among the information related to the content. More specifically, the metadata file stores metadata that is content metadata and is not a temporal sequence among information related to the content.

  For example, when the content is a still image, metadata that is not a temporal sequence is a still image shooting condition such as aperture, shutter speed, or ISO sensitivity, still image size, or still image encoding. Indicates the indication value of the compression ratio at. In addition, when the content is a moving image, the metadata that is not a time series includes shooting conditions such as sensitivity of the moving image that is not changed or the name of the optical block 61 that is a so-called interchangeable lens, Indicates the size or the indication value of the compression rate in the moving image encoding.

  Hereinafter, the property file, the thumbnail file, and the metadata file are collectively referred to as a content management file.

  Furthermore, a directory with the name TIMEMETA is created under the directory with AV_INFO. In the directory that is TIMEMETA, a timed metadata file that stores content-related metadata, which is content metadata, of information related to the content is arranged.

  Here, the directory under TIMEMETA was created under the directory under AV_INFO. The file under AV_INFO is a file that stores data for managing content, and it must be directly visible to the user. If the files under AV_INFO are made invisible to the user as a result, the files under AV_INFO can be made invisible at once by making the directory in AV_INFO invisible. This is because.

  Here, setting a file or directory to an invisible state means that display of the file or directory is prohibited, for example, the name or icon of the file or directory is not displayed.

  This is because, particularly when the recording medium 35 is a hard disk drive (HDD), when the digital camera 11 as an HDD camera is connected to a personal computer (PC) as a mass storage by USB (Universal Serial Bus), The main reason is to prevent users from deleting important files such as content management files. Furthermore, the directory that is TIMEMETA was created one level below the AV_INFO directory because the frequency of use of the timed metadata file is lower than the frequency of use of the content management file. If the metadata files are mixed and arranged in the same directory, the access speed to the content management file itself is reduced, so that this is prevented.

  For example, when the recording medium 35 is a hard disk drive (HDD), a specific method for setting the invisible state is to turn on a flag that makes the directory entry subject to the file system invisible.

  Further, as a timing for setting the invisible state, for example, when the digital camera 11 is connected to a personal computer via USB, that is, when the digital camera 11 is connected to the personal computer as mass storage, the digital camera 11 senses the connection. (When a signal indicating that the connection has been successfully made is received from the personal computer as the host), a flag for making the directory entry subject to the file system invisible is turned on.

  For example, when the content is a moving image, the time-series metadata is a frame at a predetermined time interval among the frames of the moving image being shot, or the moving image is shot. A position, a shooting condition such as an aperture or a shutter speed that changes during shooting of the moving image, a level of sound recorded together with the moving image, and the like are shown.

  The name of the timed metadata file is the same as the name of the file that stores the content that is a moving image and related to the stored metadata. More specifically, for example, in the name of the timed metadata file, the part excluding the extension is arranged in the directory that is MOVIE2, and the name of the file that stores the content that is a moving image, It is the same as the part excluding the extension. Also, for example, the part of the name of the timed metadata file excluding the extension is the part of the name of the file storing the stream arranged in the MOVIE1 directory and excluding the extension. It is the same.

  As a result, the timed metadata file is associated with the file storing the content.

  The extension of the name of the timed metadata file is MTI.

  The time series metadata is referred to as dynamic metadata, and the non-time series metadata is referred to as static metadata. Also, content with a length in the time direction, such as moving images or sound, in other words, time-series content is called dynamic content, and content with no length in the time direction, such as still images, in other words, time. Content that is not a typical series is called static content.

  FIG. 3 is a block diagram illustrating functions implemented by the CPU 81 that executes a program. When the CPU 81 executes the program, the recording control unit 101, the reproduction control unit 102, and the display control unit 103 are realized.

  The recording control unit 101 controls recording of content or information related to the content on the recording medium 35. The recording control unit 101 includes a property file recording control unit 111, a thumbnail file recording control unit 112, a metadata file recording control unit 113, a content file recording control unit 114, and a timed metadata file recording control unit 115.

  The property file recording control unit 111 controls the recording of the property file on the recording medium 35. The thumbnail file recording control unit 112 controls recording of thumbnail files on the recording medium 35. The metadata file recording control unit 113 controls recording of the metadata file on the recording medium 35.

  The content file recording control unit 114 controls recording of the content file on the recording medium 35.

  The timed metadata file recording control unit 115 controls recording of the timed metadata file on the recording medium 35. The timed metadata file recording control unit 115 includes a timed metadata file generation unit 121.

  The timed metadata file generation unit 121 generates a timed metadata file. Further, the timed metadata file generation unit 121 includes a sample generation unit 131 and a moviebox generation unit 132. The sample generation unit 131 generates a sample (sample) for storing each of the temporal series of metadata in the timed metadata file. The moviebox generating unit 132 generates a moviebox (moviebox) in which data necessary for reading the sample is placed in the timed metadata file among the timed metadata files. Details of the sample and movie box will be described later.

  The reproduction control unit 102 controls reproduction of content recorded on the recording medium 35 or information related to the content. The playback control unit 102 includes a search unit 141, a property file playback control unit 142, a thumbnail file playback control unit 143, a metadata file playback control unit 144, a content file playback control unit 145, and a timed metadata file playback control unit 146. Composed.

  The search unit 141 searches various data stored in the property file, metadata file, or timed metadata file.

  The property file playback control unit 142 controls playback of the property file recorded on the recording medium 35. The thumbnail file playback control unit 143 controls playback of thumbnail files recorded on the recording medium 35.

  The metadata file reproduction control unit 144 controls reproduction of the metadata file recorded on the recording medium 35. The content file playback control unit 145 controls playback of the content file recorded on the recording medium 35.

  The timed metadata file reproduction control unit 146 controls reproduction of the timed metadata file recorded on the recording medium 35.

  The timed metadata file playback control unit 146 includes a sample playback control unit 151, a moviebox playback control unit 152, a sample specifying unit 153, and a time calculation unit 154.

  The sample reproduction control unit 151 controls reproduction of a sample (sample) storing each temporal series of metadata in the timed metadata file. The moviebox playback control unit 152 controls playback of a movie box (moviebox) in which data necessary for reading a sample in the timed metadata file is arranged.

  When the image corresponding to the timed metadata stored in the timed metadata file is displayed on the LCD 39, the sample specifying unit 153 responds to the image instructed by the user among the displayed images. In addition, a sample in which time-series metadata is stored is specified.

  The time calculation unit 154 calculates the time in the content according to the specified sample.

  The display control unit 103 controls the display on the LCD 39 of a moving image or a still image that is content or an image corresponding to information related to the content.

  Next, the content management file will be described with reference to FIG. 4 and FIG.

  As shown in FIG. 4, a property file, a thumbnail file, and a metadata file as a content management file are recorded on the recording medium 35 one by one for each recording medium 35. Even when a plurality of content files are recorded on the recording medium 35, one property file, thumbnail file, and metadata file are recorded on the recording medium 35, respectively.

  In the property file, one property file header and one or a plurality of file entries are arranged.

  In the property file header, the data amount of each of the property slot, thumbnail slot, and metadata slot, the name of the corresponding thumbnail file, the name of the corresponding metadata file, and the like are described. When there are a plurality of thumbnail files or a plurality of metadata files, the thumbnail file or the metadata file constituting the content management file together with the property file is specified by the name of the thumbnail file or the name of the metadata file.

  In the file entry, data for reading a content file, a thumbnail file, or a metadata file is arranged in units of property slots. That is, one file entry is stored in one or a plurality of property slots. The property slot is a recording area having a fixed recording capacity. That is, when a plurality of property slots are provided in the property file, the recording capacity of the property slots is the same.

  Here, the file entry is identified by the physical recording order in the property file of the primary slot among the property slots constituting the file entry. Details of the relationship between the file entry and the primary slot will be described later.

  The thumbnail file stores image data of thumbnail images in units of thumbnail slots. The thumbnail slot is a recording area having a fixed recording capacity. That is, when a plurality of thumbnail slots are provided in the thumbnail file, the recording capacity of the thumbnail slots is the same.

  The metadata file stores metadata of content that is not a time series in units of metadata slots. The metadata slot is a recording area with a fixed amount of data. That is, when a plurality of metadata slots are provided in the metadata file, the recording capacity of the metadata slots is the same.

  Note that the recording capacity of the property slot, the recording capacity of the thumbnail slot, and the recording capacity of the metadata slot may be the same or different.

  Hereinafter, when there is no need to distinguish property slots, thumbnail slots, or metadata slots, they are simply referred to as slots.

  As described above, the property slot, the thumbnail slot, and the metadata slot are recording areas each having a fixed recording capacity, and are sequentially arranged in the property file, the thumbnail file, or the metadata file. Each property slot in the property file, each thumbnail slot in the thumbnail file, and each metadata slot in the metadata file are identified by their physical recording order (hereinafter, the recording order is referred to as a number). The That is, the identification ID for identifying the slot in each slot is not recorded. This is an identification ID that can be reassigned or not duplicated in the property file, thumbnail file, or metadata file when each slot is added or deleted as content is added or deleted This is to prevent the management of the above.

  This makes it possible to access property slots, thumbnail slots, or metadata slots more quickly.

  A thumbnail slot index, a metadata slot index, a file identifier, a creation time, or the like is arranged in the property slot of the file entry. The file identifier indicates the position where the content file indicated by the file entry is recorded, for example, indicates the path of the content file in the recording medium 35. The thumbnail slot index indicates the number of the thumbnail slot in which the image data of the thumbnail image of the content stored in the content file indicated by the file entry is stored. The metadata slot index indicates the number of a metadata slot in which metadata of content stored in the content file indicated by the file entry is stored.

  The creation time indicates the date and time when the content file indicated by the file entry is generated.

  When a file entry cannot be stored in one property slot, a new property slot is secured in the property file, and the file entry is stored in a plurality of property slots. In this case, the new property slot number is stored in the original property slot.

  The same applies to thumbnail slots and metadata slots.

  In this way, a desired amount of data can be stored regardless of the recording capacity of the property slot, thumbnail slot, or metadata slot.

  FIG. 5 is a diagram illustrating an example of metadata for one file entry stored in a plurality of property slots and one content stored in a plurality of metadata slots.

  As shown in FIG. 5, each of the property slots is managed by a number (the number means a physical recording order in the property file). In the example shown in FIG. 5, one file entry is stored in the upper left property slot in FIG. 5 and the lower left property slot in FIG.

  The next extended slot number in the upper left property slot in FIG. 5 indicates the number of the lower left property slot in FIG. 5 in which the file entry is stored following the property slot.

  Here, of the upper left property slot and the lower left property slot in FIG. 5, the primary slot is the upper left property slot. As described above, the file entry is identified by the physical recording order in the property file of the primary slot among the property slots constituting the file entry. For example, when the number of the upper left property slot in FIG. 5 is 1 and the number of the lower left property slot is 2, the file entries stored in the upper left property slot and the lower left property slot in FIG. Is identified and managed by a number.

  For example, although not shown, one file entry is stored in the property slot with the number 1, the property slot with the number 2, and the property slot with the number 3, which are arranged in the property file. When the next extended slot number in the property slot with the number 3 is 1, and the next extended slot number in the property slot with the number 1 is 2, the primary slot has the number property with the number 3. Since it is a slot, file entries stored in a property slot with a number of 1, a property slot with a number of 2, and a property slot with a number of 3 are identified and managed with a number of 3.

  Further, each metadata slot is managed by a number (number means a physical recording order in the metadata file). . In the example shown in FIG. 5, the metadata for one content is stored in the upper right metadata slot in FIG. 5 and the lower right metadata slot in FIG.

  The upper data unit size (data unit size), metadata ID # 1, upper language (language), and upper encoding type (encoding type) in the metadata slot of FIG. The lower data unit size, metadata ID # 2, lower language, and lower encoding type are data for metadata 2. That is, the upper data unit size, metadata ID # 1, upper language, upper encoding type, and metadata 1 have one structure, the lower data unit size, metadata ID # 2, lower The language, the lower encoding type, and metadata 2 have a single structure.

  The upper data unit size in the upper right metadata slot in FIG. 5 indicates the data unit size, metadata ID # 1, upper language, upper encoding type, and data amount of metadata 1. Metadata ID # 1 specifies the type of metadata 1. The upper language specifies the language in which the metadata 1 is described. The upper encoding type indicates a method of encoding metadata 1. Metadata 1 is predetermined metadata related to content.

  The lower data unit size in the upper right metadata slot in FIG. 5 indicates the data unit size, metadata ID # 2, lower language, lower encoding type, and metadata 2 data amount. Metadata ID # 2 specifies the type of metadata 2. The lower language specifies the language in which the metadata 2 is described. The lower encoding type indicates a method of encoding metadata 2. The metadata 2 is metadata that is divided and stored in the upper right metadata slot in FIG. 5 and the lower right metadata slot in FIG. 5, and is predetermined metadata related to the content. The metadata 2 is metadata different from the metadata 1.

  In the example shown in FIG. 5, the metadata slot index in the upper left property slot indicates the number of the upper right metadata slot in FIG. 5, and the metadata slot index in the lower left property slot is the lower right metadata slot in FIG. Indicates the data slot number.

  As described above, the metadata file has a structure including data unit size, metadata ID, language, encoding type, and metadata as components.

  Next, a timed metadata file will be described with reference to FIGS. The timed metadata file has a file format (hereinafter referred to as an MP4 file format) conforming to the regulations of ISO (International Organization for Standardization) / IEC (International Electrotechnical Commission) 14496.

  FIG. 6 is a diagram illustrating the structure of a timed metadata file that stores time-series metadata indicating a position at a predetermined time.

  The timed metadata file is composed of a movie box and media data.

  The movie box has the same structure as the moov box in the MP4 file format, and has a hierarchical structure. Various control information for controlling reading of metadata stored in the timed metadata file is arranged in the movie box.

  The media data has the same structure as an mdat box (Media data container) in the MP4 file format. Metadata is arranged in the media data.

  In the movie box, a track box composed of a media box and a user box is arranged.

  The track box is created according to the type of metadata to be controlled, and has the same structure as the trak box in the MP4 file format. In the example shown in FIG. 6, there is only one track made up of metadata, so that metadata as a track can be controlled, and metadata can be read and written more quickly.

  The media box has the same structure as the mdia box in the MP4 file format. Further, the user box corresponds to a uuid box of a trak box in the MP4 file format. The uuid box is a box for private expansion of the user.

  In the media box, information for randomly accessing metadata arranged in media data, such as metadata reproduction information and random access information, is arranged.

  For example, in the media box, metadata reproduction information having the same structure as the stts box of the stbl box of the minf box in the MP4 file format is arranged. The metadata reproduction information indicates, for example, the time of each sample of media data to be described later. That is, the metadata reproduction information is each time of time series metadata stored as a sample, and indicates the time in the content related to the metadata.

  More specifically, for example, in the metadata reproduction information, the metadata time of the first sample is 0.5 seconds, and the metadata time of the second sample is 1.0 seconds. This indicates that the metadata time of the second sample is 0.8 seconds, and similarly, the metadata time of the nth sample is a seconds. Thus, for example, when content that is a moving image is being played back, it can be seen that metadata corresponding to a point in time when 1.6 seconds have elapsed from the beginning of the content is stored in the third sample.

  That is, by referring to the metadata reproduction information, it is possible to specify metadata corresponding to a predetermined time in the content among the time-series metadata related to the content that is a moving image. it can.

  Conversely, by referring to the metadata reproduction information, when one metadata among temporal series of metadata related to the content that is a moving image is specified, the specified metadata is changed to the specified metadata. In response, the time in the content can be specified.

  For example, random access information having the same structure as the stsz box of the stbl box of the minf box in the MP4 file format is arranged in the media box. The random access information indicates, for example, the data amount of each sample of media data to be described later.

  By referring to the random access information, for example, among the time-series metadata related to the content that is a moving image, the metadata corresponding to a predetermined time on the content is quickly and randomly accessed. be able to.

  The user box is configured to include a metadata data box. The metadata box contains, in order, data unit size, data type ID, language, language, encoding type, metadata, and data unit size. size), data type ID (data type ID), language (language), encoding type (encoding type), and metadata (metadata) are arranged.

  The upper data unit size, upper data type ID, upper language, and upper encoding type in the metadata box are data for the upper metadata, the lower data unit size, and the lower metadata. The ID, lower language, and lower encoding type are data about the lower metadata. That is, the upper data unit size, upper data type ID, upper language, upper encoding type, and upper metadata have one structure, lower data unit size, lower data type ID. The lower language, the lower encoding type, and the lower metadata have one structure.

  The upper data unit size in the metadata box indicates the data unit size, the upper data type ID, the upper language, the upper encoding type, and the data amount of the upper metadata. The upper data type ID is, for example, 0000000Ah, and the upper metadata in the metadata box is a track for controlling time-series metadata in which this track is arranged as a sample. Indicates that the metadata is shown.

  The upper language specifies the language that describes the upper metadata. The upper encoding type indicates a method of encoding the upper metadata. The upper metadata is metadata indicating that it is a track for controlling time-series metadata arranged as a sample track.

  The lower data unit size in the metadata box indicates the data unit size, the lower data type ID, the lower language, the lower encoding type, and the data amount of the lower metadata. The lower data type ID is, for example, 0000000Bh, and the lower metadata in the metadata box is arranged as a sample track, specifically for controlling temporal series metadata. Indicates metadata.

  The lower language specifies the language that describes the lower metadata. The lower encoding type indicates a method of encoding the lower metadata. The lower metadata is a track for controlling temporal metadata arranged as a sample track.

  For example, the lower metadata of 0000001Ah indicates that the temporal series of metadata arranged as a sample track is data indicating a position at a predetermined time.

  For example, the lower metadata, which is 0000002Ah, is arranged as a sample track, and the temporal series of metadata is camera information such as aperture, shutter speed, or zoom at a predetermined time. Indicates.

  For example, the lower metadata, which is 0000003Ah, is arranged as a sample track, and the temporal series of metadata is data indicating the first audio level of the GOP at a predetermined time. Show.

  The media data is composed of one or a plurality of samples. A sample is the smallest unit controlled by a track.

  Each sample consists of data unit size, data type ID, language, encoding type, and metadata. That is, each sample has a structure including a data unit size, a data type ID, a language, an encoding type, and metadata.

  The data unit size in the sample indicates the data amount of the sample. The data type ID in the sample is, for example, 0000001Ah, and indicates that the metadata in the sample is data indicating a position at a predetermined time.

  The language in the sample specifies the language that describes the metadata in the sample. The encoding type in the sample indicates a method of encoding metadata in the sample. The metadata in the sample is metadata at a predetermined time among the time-series metadata. Note that the metadata in the sample can be said to be metadata for a predetermined period of time-series metadata.

  FIG. 7 is a diagram showing the structure of a timed metadata file that stores temporal series of metadata, which is frame data for each predetermined time among frames constituting content that is a moving image.

  A timed metadata file that stores frame data of a predetermined time among moving image frames is composed of a movie box and media data as in the case of FIG. . In the movie box, data for controlling reading of the metadata stored in the timed metadata file is arranged. Metadata is arranged in the media data.

  In the movie box, a track box composed of a media box and a user box is arranged. In the media box, information for randomly accessing the metadata arranged in the media data is arranged.

  The user box is configured to include a metadata data box. In the metadata box, a data unit size, a data type ID, a language, an encoding type, and metadata are arranged in this order.

  Among the video frames, the data unit size, data type ID, language, and encoding type of the metadata box in the timed metadata file that stores the frame data for each predetermined time are data about the metadata. is there. That is, the data unit size, data type ID, language, encoding type, and metadata of the metadata box in the timed metadata file that stores the data of the frames at predetermined intervals among the frames of the moving image are 1 Has one structure.

  The data unit size, data type ID, language, encoding type, and metadata of the metadata box in the timed metadata file that stores the frame data for each predetermined time frame of the moving image Indicates the amount of data. The data type ID is, for example, 0000000Ch, and indicates that the metadata in the metadata box is metadata for controlling the data of frames at predetermined intervals among the frames of moving images.

  The language specifies a language for describing metadata. The encoding type indicates a metadata encoding method.

  The metadata in the metadata box in the timed metadata file that stores the data of frames at predetermined intervals among the frames of moving images controls the data of the frames at predetermined intervals among the frames of moving images. Metadata. That is, it can be seen from the metadata in the metadata box that JPEG data, which is frame data at predetermined time intervals, is stored as a track.

  The media data is composed of one or a plurality of samples. A sample is the smallest unit controlled by a track.

  Each sample consists of JPEG data. The JPEG data in the sample is data of a frame for every predetermined time among the frames of the moving image encoded by the JPEG method.

  More specifically, for example, when a moving image stream is encoded in the MPEG4 format, the JPEG data in the sample is the GOP for each GOP (Group of Pictures) interval in the moving image frame. The data of one frame extracted from is encoded by the JPEG method.

  As described above, the timed metadata file has a structure including a movie box, media data, track box, media box, user box, data unit size, metadata ID, language, encoding type, and metadata. .

  Focusing on the data unit size, metadata ID, language, encoding type, and metadata, it can be said that the timed metadata file has the same structure as the metadata file.

  Since the timed metadata file and the metadata file have the same structure, the procedure for recording and reading (reproducing) the timed metadata file and the metadata file is the same, and the hardware for recording or reading is reduced. Hardware or programs can be shared or shared.

  Hereinafter, temporal series of metadata is referred to as timed metadata. Among metadata, other metadata of timed metadata, that is, metadata that does not form a time series is referred to as static metadata.

  Next, the recording process will be described.

  FIG. 8 is a flowchart for explaining a moving image and static metadata recording process that is executed when recording of a moving image is started. In step S <b> 11, the content file recording control unit 114 of the recording control unit 101 acquires images, that is, frames constituting a moving image at predetermined intervals from the camera DSP 32.

  In step S12, the content file recording control unit 114 determines whether or not the shooting of the moving image has ended based on a signal corresponding to the user's operation from the operation unit 37, and the shooting of the moving image is ended. If it is determined that it is not, the process returns to step S11 to repeat the image acquisition process.

  If it is determined in step S12 that shooting of a moving image has ended, the process proceeds to step S13, and the thumbnail file recording control unit 112 generates a thumbnail image from a predetermined image among the images acquired in step S11. For example, the thumbnail file recording control unit 112 generates a thumbnail image from the first frame of the moving image, the frame when the scene is changed, or the frame when the audio level exceeds a predetermined threshold.

  Note that the thumbnail file recording control unit 112 may execute a process of generating a thumbnail image in parallel with the image acquisition process in step S11.

  In step S14, the content file recording control unit 114 generates image management information and a playlist, and includes an image management information file, a playlist file, and an image management information, a playlist, and a captured moving image stream stored therein, respectively. The stream file is recorded in a predetermined directory.

  For example, the content file recording control unit 114 records the image management information file in which the image management information is stored in the directory on the recording medium 35 under the directory whose directory name is MOVIE1 and whose directory name is CODECINF. The content file recording control unit 114 records the playlist file in which the playlist is stored in the directory having the directory name PLAYINF under the directory having the directory name MOVIE1 on the recording medium 35.

  Further, the content file recording control unit 114 records the stream file storing the moving image stream in the directory having the directory name STREAM under the directory having the directory name MOVIE1 on the recording medium 35.

  For example, when moving image data is encoded in the MPEG4 format and the moving image is recorded as content stored in one file, the content file recording control unit 114 stores the content that is the moving image. Are recorded in a directory of the recording medium 35 whose directory name is MOVIE2.

  In step S15, the property file recording control unit 111 of the recording control unit 101 generates a file entry corresponding to the playlist file storing the playlist, and the file corresponding to the playlist file is generated in the property file of the content management file. Add an entry.

  For example, the property file recording control unit 111 stores a playlist, which is a file entry in units of property slots, in a property file arranged in a directory having the directory name AV_INFO on the recording medium 35. Add a file entry corresponding to the file.

  The property file recording control unit 111 generates a file entry corresponding to a stream file that stores a moving image stream, and a file corresponding to the stream file that stores the moving image stream in the property file of the content management file. An entry may be added.

  In step S16, the thumbnail file recording control unit 112 of the recording control unit 101 adds a thumbnail image entry of an image at a predetermined position of the captured moving image to the thumbnail file of the content management file. That is, the thumbnail file recording control unit 112 stores the image data of the thumbnail image generated in step S13 in the thumbnail slot of the thumbnail file.

  In step S17, the metadata file recording control unit 113 of the recording control unit 101 adds an entry of static metadata accompanying the captured moving image to the metadata file of the content management file, and the process ends. That is, the metadata file recording control unit 113 stores the static metadata of the captured moving image in the metadata slot of the metadata file.

  In this way, a moving image is recorded, a file entry is added to the property file, image data of the thumbnail image is stored in the thumbnail file, and static metadata of the captured moving image is stored in the metadata file, that is, Stores non-temporal metadata.

  Next, a description will be given of a timed metadata file recording process that is executed in parallel with the moving image and static metadata recording process of FIG. 8 when recording of a moving image is started. FIG. 9 is a flowchart for explaining processing for recording a timed metadata file.

  In step S31, the timed metadata file recording control unit 115 of the recording control unit 101 acquires time-varying metadata, that is, time-series metadata, at a predetermined time.

  For example, the timed metadata file recording control unit 115 acquires GPS data indicating the current position from the GPS signal receiving unit 42 at a predetermined time, thereby acquiring metadata representing the current position by latitude and longitude. To do.

  Further, for example, the timed metadata file recording control unit 115 is a moving image by extracting a frame at a predetermined time from a moving image recorded by the moving image and static metadata recording process. Among the frames constituting the content, metadata that is data of frames at predetermined intervals is acquired. In this case, the timed metadata file recording control unit 115 causes the camera DSP 32 to encode metadata, which is frame data for each predetermined time, by the JPEG method, to obtain JPEG data.

  In step S32, the timed metadata file recording control unit 115 records the acquired metadata as one sample. That is, the sample generation unit 131 of the timed metadata file generation unit 121 of the timed metadata file recording control unit 115 generates one sample storing the acquired metadata.

  For example, the sample generation unit 131 stores GPS data representing the current position by latitude and longitude in a sample including a data unit size, a data type ID, a language, an encoding type, and metadata shown in FIG. In this case, GPS data representing the current position by latitude and longitude is stored in the sample as sample metadata including a data unit size, a data type ID, a language, an encoding type, and metadata.

  Further, for example, the sample generation unit 131 stores JPEG data of frames at predetermined time intervals in a sample as metadata shown in FIG.

  In step S33, the timed metadata file recording control unit 115 determines whether or not moving image shooting has ended. If it is determined that moving image shooting has not ended, the process proceeds to step S31, and the timed metadata file recording control unit 115 proceeds to step S31. The process of acquiring the metadata of a typical series and storing it in the sample is repeated.

  If it is determined in step S33 that the shooting of the moving image has ended, no further time series metadata is acquired, so the process proceeds to step S34, where the timed metadata of the timed metadata file recording control unit 115 is acquired. The moviebox generation unit 132 of the data file generation unit 121 generates metadata reproduction information and random access information.

  For example, the moviebox generation unit 132 generates metadata reproduction information indicating the length of time of each metadata on the time in the moving image according to the time when the metadata is acquired. In addition, for example, the moviebox generation unit 132 generates random access information indicating the data amount of each sample.

  In step S35, the moviebox generation unit 132 generates a movie box including metadata reproduction information and random access information.

  In step S36, the timed metadata file generation unit 121 generates one timed metadata file storing a movie box and a sample. In step S <b> 37, the timed metadata file recording control unit 115 sets the file name of the timed metadata file excluding the extension to be the same as the file name in which the captured moving image stream is stored. The extension of the file name of the timed metadata file is predetermined, for example, MTI.

  The timed metadata file recording control unit 115 sets the file name of the timed metadata file, excluding the extension, to be the same as the file name in which the playlist for the captured moving image stream is stored. You may do it.

  In step S38, the timed metadata file recording control unit 115 records the timed metadata file in a predetermined directory, such as a directory that is TIMEMETA under the directory that is AV_INFO of the recording medium 35, and the process ends. To do.

  In this way, temporal series of metadata corresponding to the captured moving image is stored in the timed metadata file.

  Next, processing for recording a still image will be described.

  FIG. 10 is a flowchart for explaining still image and static metadata recording processing executed when a still image is captured. In step S51, the thumbnail file recording control unit 112 generates a thumbnail image of the captured still image.

  In step S52, the content file recording control unit 114 records a file storing image data of a captured still image in a predetermined directory. For example, the content file recording control unit 114 records a file in which image data of a captured still image is stored in a directory of the recording medium 35 whose directory name is STILL.

  In step S53, the property file recording control unit 111 of the recording control unit 101 generates a file entry corresponding to the file in which the image data of the still image is stored, and stores the image data of the still image in the property file of the content management file. Add a file entry corresponding to the file where is stored.

  For example, the property file recording control unit 111 stores the image data of a still image as a file entry in units of property slots in a property file arranged in a directory whose directory name is AV_INFO on the recording medium 35. Add a file entry corresponding to the specified file.

  In step S54, the thumbnail file recording control unit 112 of the recording control unit 101 adds a thumbnail image entry of the captured still image to the thumbnail file of the content management file. That is, the thumbnail file recording control unit 112 stores the image data of the thumbnail image generated in step S51 in the thumbnail slot of the thumbnail file.

  In step S55, the metadata file recording control unit 113 of the recording control unit 101 adds an entry of static metadata accompanying the captured still image to the metadata file of the content management file, and the process ends. That is, the metadata file recording control unit 113 stores the static metadata of the captured still image in the metadata slot of the metadata file.

  In this way, a still image is recorded, a file entry is added to the property file, image data of the thumbnail image is stored in the thumbnail file, and static metadata of the captured still image, that is, a metadata file, that is, Stores non-temporal metadata.

  Note that the timed metadata file recording control unit 115 does not record a timed metadata file when a still image is captured.

  FIG. 11 is a flowchart illustrating metadata search processing. In step S <b> 71, the search unit 141 of the playback control unit 102 starts searching for metadata by acquiring a keyword corresponding to the metadata to be searched from the operation unit 37. In step S72, the metadata file reproduction control unit 144 opens the metadata file.

  In step S73, the search unit 141 determines whether or not the search for all metadata slots has been completed. If it is determined that the search for all metadata slots has not been completed, the search unit 141 proceeds to step S74. The metadata slot is searched for to determine whether or not the metadata hits in the metadata slot having the number indicated by the current counter value of the counter.

  If it is determined in step S74 that the metadata has been hit, the process proceeds to step S75, and the search unit 141 records the number of the metadata slot in which the metadata was hit.

  If it is determined in step S74 that the metadata does not hit, step S75 is skipped.

  In step S76, the search unit 141 increments the counter by 1 to increment the metadata slot number, returns to step S73, and repeats the metadata slot search process.

  If it is determined in step S73 that all metadata slots have been searched, the process proceeds to step S77, and the property file playback control unit 142 opens the property file. In step S78, the search unit 141 searches for a file entry including the hit slot number, and the process ends.

  From the retrieved file entry, it is possible to open a content file that stores content to which metadata corresponding to the keyword is attached, and reproduce the content.

  Next, an example of a process of reproducing content that is a moving image using a timed metadata file that stores timed metadata indicating a position when the moving image is captured will be described.

  For example, when playing back a content that is a moving image, the thumbnail file playback control unit 143 reads out the thumbnail image stored in the thumbnail file of the content management file and supplies the thumbnail image to the display control unit 103. Then, for example, as shown in FIG. 12, the display control unit 103 displays six thumbnail images corresponding to the moving images on the LCD 39.

  The user operates the operation unit 37 to instruct one thumbnail image among the thumbnail images displayed on the LCD 39.

  FIG. 13 is a flowchart illustrating an example of display processing that is executed when the thumbnail image of FIG. 12 is designated. In step S101, the reproduction control unit 102 acquires a signal from the operation unit 37 according to the operation of the user who designates one thumbnail image, and stores the image data of the designated thumbnail image. Stores the thumbnail slot number of the file.

  For example, when a thumbnail image is displayed on the LCD 39, the playback control unit 102 associates the number for specifying the thumbnail image displayed on the LCD 39 with the number of the thumbnail slot in which the image data of the thumbnail image is stored. Generate the table shown. When a signal indicating a thumbnail image number is supplied from the operation unit 37 operated by the user, the playback control unit 102 extracts a thumbnail slot number corresponding to the thumbnail image number indicated by the signal from the table. Then, the number of the thumbnail slot is stored.

  In step S102, the property file playback control unit 142 opens the property file. In step S103, the search unit 141 searches for a file entry including the thumbnail slot number stored in step S101.

  In step S104, the content file playback control unit 145 opens a stream file that is a file storing a stream indicated by the searched file entry. In step S105, the search unit 141 searches for a timed metadata file having the same name as the name of the opened stream file, excluding the extension.

  In step S106, the timed metadata file reproduction control unit 146 opens the searched timed metadata file. In step S107, the display control unit 103 causes the LCD 39 to display a map in the range indicated by the sample GPS data of the opened timed metadata file.

  That is, the sample playback control unit 151 reads out GPS data that is metadata indicating the position stored in the sample of the opened timed metadata file, plays it back, and supplies it to the display control unit 103. The display control unit 103 causes the LCD 39 to display a map in the range indicated by the GPS data indicating the position based on the map data recorded in the recording medium 35 in advance. For example, when the position around Tokyo station is indicated by the GPS data, the display control unit 103 causes the LCD 39 to display a map around Tokyo station.

  In step S108, the display control unit 103 superimposes an image representing the position indicated by the GPS data on the map image and displays it on the LCD 39, and the process ends. That is, the display control unit 103 superimposes the image representing the position indicated by the GPS data on the map image so that the image representing the position indicated by the GPS data is arranged at the position indicated by the GPS data on the map. Display on the LCD 39.

  When the display process is executed, for example, as shown in FIG. 14, an image in which an image representing a position indicated by GPS data that is metadata and a map is superimposed is displayed on the LCD 39.

  In the example of the image displayed on the LCD 39 shown on the right side of FIG. 14, the bold line rising to the right is an image representing the position indicated by the GPS data. GPS data, which is metadata in time series, is acquired at a predetermined interval and recorded as a timed metadata file while recording a moving image. The route traveled while recording a moving image can be displayed on the map by using the GPS data.

  By instructing the position displayed on the map, the moving image stream can be reproduced from the position recorded at the position.

  FIG. 15 is a flowchart for explaining an example of stream reproduction processing. In step S121, the sample specifying unit 153 of the timed metadata file reproduction control unit 146 acquires a signal from the operation unit 37 according to the operation of the user who indicates the position, and indicates the position of the instructed image. Identify samples of GPS data.

  For example, when an image representing the position indicated by the GPS data is displayed on the LCD 39, the sample specifying unit 153 uses the position of the image representing the position indicated by the GPS data on the screen of the LCD 39 and the GPS data. A table indicating the correspondence with a number for specifying a sample in which certain metadata is stored is generated. When a signal indicating the position on the screen instructed by the user is supplied from the operation unit 37 which is a touch panel provided on the LCD 39, the sample specifying unit 153 is placed at the position on the screen indicated by the signal. A sample of GPS data indicating the position of the instructed image is identified by extracting a number identifying the corresponding sample from the table.

  In step S122, the time calculation unit 154 of the timed metadata file reproduction control unit 146 calculates the time on the stream according to the specified sample.

  That is, the moviebox playback control unit 152 of the timed metadata file playback control unit 146 reads out and plays back the metadata playback information stored in the media box. As shown in FIG. 14, the metadata reproduction information is each time of the time series metadata stored as a sample, and indicates the time in the content related to the metadata. The calculating unit 154 refers to the metadata reproduction information and calculates the time on the stream that is the content according to the specified sample.

  In step S123, the content file playback control unit 145 starts playback of the stream stored in the content file from the calculated time on the stream, and the process ends. The display control unit 103 causes the LCD 39 to display a moving image from a location photographed at a position on the map instructed on the screen.

  In this way, it is possible to easily display a moving image shot at a desired position.

  FIG. 16 is a flowchart for explaining another example of the display process executed when the thumbnail image of FIG. 12 is designated. Since each of step S141 thru | or step S143 is the same as each of step S101 thru | or step S103 of FIG. 13, the description is abbreviate | omitted.

  In step S144, the search unit 141 searches for a playlist file, which is a file storing a playlist, indicated by the searched file entry. In step S145, the content file playback control unit 145 opens the searched playlist file. In step S146, the content file playback control unit 145 opens an image management information file that is associated with the playlist and stores image management information. In step S147, the content file playback control unit 145 opens a stream file having the same name as the name of the image management information file except for the extension.

  Steps S148 to S151 are the same as steps S105 to S108 in FIG.

  As described above, even when the content is composed of a stream, a playlist, and image management information, it is possible to display an image in which an image representing a position indicated by GPS data that is metadata and a map are superimposed. it can.

  Next, among the frames of the moving image being shot, the process of reproducing the content that is a moving image using the timed metadata file that stores the timed metadata that is the JPEG data of the frame every predetermined time An example will be described.

  FIG. 17 is a flowchart for explaining still another example of the display process executed when the thumbnail image of FIG. 12 is designated. Steps S171 to S176 are the same as steps S101 to S106 in FIG.

  In step S177, the display control unit 103 causes the LCD 39 to display an image based on the stream stored in the stream file. That is, the content file playback control unit 145 plays back the stream stored in the stream file, and the display control unit 103 causes the LCD 39 to display an image based on the played back stream.

  In step S178, the display control unit 103 superimposes the image of the opened timed metadata file sample JPEG data on the stream image and causes the image to be displayed on the LCD 39, and the process ends.

  That is, the sample playback control unit 151 reads out and plays back JPEG data, which is frame data for each predetermined time among the frames of the moving image stored in the sample of the opened timed metadata file, This is supplied to the display control unit 103. The display control unit 103 arranges images based on JPEG data in time series, and superimposes the images on the stream to display them on the LCD 39.

  For example, the display control unit 103 causes the LCD 39 to display an image of JPEG data corresponding to a frame every predetermined time, such as a GOP interval, a 1-second interval, or a 5-second interval.

  When the display process shown in the flowchart of FIG. 17 is executed, for example, as shown in FIG. 18, a frame image and a stream image for each predetermined time indicated by JPEG data as metadata are superimposed. The displayed image is displayed on the LCD 39.

  In the example of the image displayed on the LCD 39 shown on the right side of FIG. 18, seven images arranged in the lower part of the image are frames at predetermined time intervals indicated by JPEG data as metadata. It is an image. An image of a frame every predetermined time indicated by JPEG data as metadata is displayed as a so-called film roll.

  For example, JPEG data, which is metadata, is obtained by encoding one frame of data extracted from each GOP at every GOP interval from among the frames of a moving image.

  In addition, the present invention is not limited to this, and JPEG data that is metadata may be generated by encoding data of frames at a desired interval, for example, 1 second by the JPEG method. Furthermore, the frame of the moving image may be encoded by the JPEG method after reducing the size of the image by thinning out pixels or the like to generate JPEG data as metadata.

  Then, by instructing an image of a frame every predetermined time indicated by the JPEG data, a moving image stream can be reproduced from the frame.

  FIG. 19 is a flowchart for explaining another example of stream reproduction processing. In step S191, the sample specifying unit 153 of the timed metadata file playback control unit 146 indicates an image displayed by the JPEG data displayed on the LCD 39 and indicating a frame image at every predetermined time. A signal from the operation unit 37 corresponding to the operation is acquired, and a sample of JPEG data for displaying the instructed image is specified.

  For example, when an image representing the position indicated by the GPS data is displayed on the LCD 39, the sample specifying unit 153 displays the position of the image indicated by the JPEG data on the screen of the LCD 39 and the metadata that is the JPEG data. A table indicating the correspondence with the number specifying the sample in which is stored is generated. When a signal indicating the position on the screen instructed by the user is supplied from the operation unit 37 which is a touch panel provided on the LCD 39, the sample specifying unit 153 is placed at the position on the screen indicated by the signal. By extracting the number for identifying the corresponding sample from the table, the sample of JPEG data for displaying the instructed image is identified.

  Since step S192 and step S193 are the same as step S122 and step S123 of FIG. 15, respectively, description thereof is omitted.

  Thus, a moving image can be displayed from a desired frame.

  Next, processing for reproducing desired content among a plurality of contents using a plurality of timed metadata files will be described.

  FIG. 20 is a flowchart for explaining still another example of the display process. In step S201, the property file playback control unit 142 opens the property file.

  In step S202, the search unit 141 searches for a file entry included in the opened property file. In step S203, the reproduction control unit 102 determines whether or not the searched file entry indicates a stream file based on information stored in the searched file entry.

  If it is determined in step S203 that the file entry indicates a stream file, a timed metadata file corresponding to the stream file is recorded, and thus the process proceeds to step S204, where the search unit 141 displays the stream indicated by the file entry. Search for a file. In step S205, the search unit 141 searches for a timed metadata file having the same name as the name of the searched stream file, excluding the extension.

  In step S206, the timed metadata file reproduction control unit 146 opens the searched timed metadata file, and proceeds to step S207.

  On the other hand, if it is determined in step S203 that the file entry does not indicate a stream file, the file indicated by the file entry is a still image file, and a timed metadata file corresponding to the still image file is recorded. Since there is not, step S204 thru | or step S206 are skipped and a procedure progresses to step S207.

  In step S207, the thumbnail file playback control unit 143 reads the thumbnail image indicated by the file entry. That is, the thumbnail file reproduction control unit 143 reproduces the image data of the thumbnail image stored in the thumbnail slot indicated by the file entry. In step S207, the metadata file reproduction control unit 144 reads out static metadata indicated by the file entry. That is, the metadata file playback control unit 144 plays back the static metadata stored in the metadata slot indicated by the file entry.

  In step S208, the playback control unit 102 determines whether all file entries included in the opened property file have been searched. If it is determined that all file entries have not been searched, the process returns to step S202. The above processing is repeated for the next file entry.

  If it is determined in step S208 that all the file entries have been searched, the process proceeds to step S209, and the display control unit 103 sets the sampled GPS data and GPS data of the opened timed metadata file as static. A map in the range indicated by the metadata is displayed on the LCD 39.

  That is, the sample playback control unit 151 of the timed metadata file playback control unit 146 reads out and plays back the GPS data that is the metadata indicating the position stored in the sample of the opened timed metadata file, This is supplied to the display control unit 103. Further, the metadata file reproduction control unit 144 supplies the display control unit 103 with static metadata that is GPS data among the static metadata read in step S207.

  Then, the display control unit 103 causes the LCD 39 to display a map in the range indicated by the GPS data supplied from the reproduction control unit 102.

  In step S210, the display control unit 103 causes the LCD 39 to display an image representing the position indicated by the GPS data on the map image. That is, the display control unit 103 superimposes the image representing the position indicated by the GPS data on the map image so that the image representing the position indicated by the GPS data is arranged at the position indicated by the GPS data on the map. Display on the LCD 39.

  In step S211, the display control unit 103 causes the thumbnail image to be superimposed and displayed at the position indicated by the sample GPS data of the timed metadata file on the map. That is, the thumbnail file playback control unit 143 reads out the image data of the thumbnail image from the thumbnail file and supplies it to the display control unit 103. The display control unit 103 uses the supplied image data as a map for the thumbnail image. Overlay and display.

  In this case, a thumbnail image is read from the thumbnail file related to the content file having the same name as the name of the timed metadata file that stores the GPS data indicating the position on the map.

  That is, for a predetermined content, the position is shown on the map and the thumbnail image is displayed.

  In step S212, the display control unit 103 causes the thumbnail image to be superimposed and displayed at the position indicated by the static metadata that is GPS data on the map, and the process ends.

  In this case, a thumbnail image is read out from a thumbnail file related to a content file related to a metadata file that stores static metadata that is GPS data indicating a position on a map.

  That is, also in this case, the position of the predetermined content is shown on the map and the thumbnail image is displayed.

  As described above, for example, as shown in FIG. 21, positions of a plurality of contents that are still images or moving images are displayed on the map and thumbnail images thereof are displayed.

  In the example of the image displayed on the LCD 39 shown in FIG. 21, the bold line that rises to the right and the horizontal thick line represent the shooting position indicated by the GPS data of the timed metadata file that is recorded together with the moving image. The black circle is an image representing a shooting position indicated by static metadata which is GPS data recorded together with the shooting of a still image.

  In the example of the image displayed on the LCD 39 shown in FIG. 21, a square attached to a star mark or a black circle represents a thumbnail image that is a representative image of a moving image or a still image, and in particular, a square attached to the star mark. Indicates a thumbnail image of the moving image at the position and time at which the moving image was captured. For example, an asterisk in the middle of a thick line represents a resume point of the corresponding moving image content, that is, a position on the moving image that has been played and stopped last time. The resume point is stored in the corresponding file entry as position information.

  By instructing the position displayed on the map, the moving image stream can be reproduced from the position recorded at the position. In addition, by instructing a thumbnail image, a moving image can be reproduced or a still image can be reproduced.

  FIG. 22 is a flowchart for explaining a stream reproduction process or a still image display process that is executed when a position displayed on a map is designated or a thumbnail image is designated. In step S231, the playback control unit 102 determines whether or not a thumbnail image has been instructed. If it is determined that a thumbnail image has not been instructed, the process proceeds to step S232, and whether or not an image indicating a position has been instructed. Determine.

  If it is determined in step S232 that an image indicating a position has been instructed, the process proceeds to step S233, and the reproduction control unit 102 determines whether an image indicating the position indicated by the GPS data of the sample of the timed metadata file has been instructed. Determine whether. If it is determined in step S233 that an image indicating the position indicated by the GPS data of the sample of the timed metadata file has been specified, the process proceeds to step S234, and the search unit 141 includes the GPS data indicating the position of the specified image. A stream file having the same name as the name of the timed metadata file that stores the sample is searched.

  In step S235, the content file playback control unit 145 opens the searched stream file. In step S236, the sample specifying unit 153 of the timed metadata file reproduction control unit 146 performs an instruction based on a signal from the operation unit 37 in accordance with a user operation indicating a position in the same process as in step S121. A sample of GPS data indicating the location of the captured image is identified.

  In step S237, the time calculation unit 154 of the timed metadata file reproduction control unit 146 calculates the time on the stream according to the specified sample by the same process as in step S122.

  In step S238, the content file playback control unit 145 starts playback of the stream stored in the content file from the calculated time on the stream, and the process ends. The display control unit 103 causes the LCD 39 to display a moving image from a location photographed at a position on the map instructed on the screen.

  In step S233, if it is determined that an image indicating the position indicated by the GPS data of the sample of the timed metadata file is not indicated, an image indicating the position indicated by the static metadata that is GPS data is obtained. In step S239, the search unit 141 searches the property file for a file entry indicating a metadata slot that stores static metadata indicating the position of the specified image.

  In step S240, the search unit 141 searches for a still image file that stores the image data of the still image that is the content file indicated by the searched file entry. In step S241, the content file playback control unit 145 opens the still image file that is the searched content file, and plays back the stored still image image data. The content file reproduction control unit 145 supplies the reproduced image data to the display control unit 103.

  In step S242, the display control unit 103 displays a still image on the LCD 39, and the process ends.

  On the other hand, if it is determined in step S231 that a thumbnail image has been specified, the process proceeds to step S243, and the search unit 141 searches the property file for a file entry indicating a thumbnail slot for storing the image data of the specified thumbnail image. To do.

  In step S244, the search unit 141 searches for a content file indicated by the searched file entry and storing a content file storing still image data or a moving image stream, that is, a stream file or a still image file. . In step S245, the content file playback control unit 145 opens the searched content file and plays back the stored still image data or plays back the stored moving image data. To do. The content file reproduction control unit 145 supplies the reproduced image data to the display control unit 103.

  In step S242, the display control unit 103 displays a still image or a moving image on the LCD 39, and the process ends.

  If it is determined in step S232 that the image indicating the position is not instructed, neither the thumbnail image nor the image indicating the position is instructed, and thus the process ends.

  In this way, when the position displayed on the map is instructed, the moving image stream is reproduced from the position recorded at that position, or when the thumbnail image is instructed, the moving image or the still image is displayed. The image is played back.

  As described above, even in the use of metadata in different content forms such as moving images and still images, desired content can be reproduced more quickly by the control by the unified management in the content management file. In addition, it is possible to reproduce desired content from a desired time point more quickly with a simple operation.

  As described above, when the metadata is stored in a file having a predetermined structure, the metadata can be recorded. In addition, it controls the recording for each dynamic content of the first file storing the dynamic metadata related to the dynamic content in the first structure, and static metadata related to the dynamic content or the static content. When the recording of the second file stored in the second structure is controlled, the metadata is recorded so that the metadata can be used more quickly regardless of the type of content. Can do.

  Furthermore, when the metadata recorded as a file having a predetermined structure is reproduced, the metadata can be used. In addition, the dynamic metadata related to the dynamic content, which controls the reproduction of the dynamic metadata stored in the first structure for each dynamic content in the first structure, If the reproduction of static metadata related to the target content and stored in the second file with the second structure is controlled, regardless of the type of content, Metadata can be used more quickly.

  The recording medium 35 is mounted on a stationary device such as a DVD player or a television receiver, and these devices perform metadata search processing, display processing, stream playback processing, stream playback or stillness. Image display processing may be executed.

  Still image content may be stored in an EXIF file. In this case, the metadata is further recorded in the IFD area of APP1. A device that plays back content can use metadata of either a content management file or an EXIF file.

  The content is not limited to a moving image or a still image, but may be anything useful for the user, such as sound or data.

  The present invention is not limited to a digital camera, and can be applied to a device that records content or reproduces content, such as a personal computer, a mobile phone, a portable recorder, or a portable player.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  As shown in FIG. 1, a program recording medium for storing a program that is installed in a computer and can be executed by the computer is a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (Digital Versatile Disc) (including magneto-optical disk), or a recording medium 35 that is a package medium made of semiconductor memory, or a flash ROM 83 in which a program is temporarily or permanently stored The hard disk is not shown. The program is stored in the program recording medium using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication I / F 41 that is an interface such as a router or a modem as necessary. Done.

  In the present specification, the step of describing the program stored in the program recording medium is not limited to the processing performed in time series in the described order, but is not necessarily performed in time series. Or the process performed separately is also included.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the structure of the digital camera of one embodiment of this invention. It is a figure explaining the structure of the directory in a recording medium, and the file recorded on a recording medium. It is a block diagram which shows the function implement | achieved by CPU which performs a program. It is a figure explaining a content management file. It is a figure which shows the example of the metadata with respect to one content stored in several metadata slot and one file entry stored in several property slots. It is a figure explaining a timed metadata file. It is a figure explaining a timed metadata file. It is a flowchart explaining the recording process of a moving image and static metadata. It is a flowchart explaining the process of recording a timed metadata file. It is a flowchart explaining the recording process of a still image and static metadata. It is a flowchart explaining the search process of metadata. It is a figure which shows the example of the thumbnail image displayed on LCD. It is a flowchart explaining the example of a process of a display. It is a figure explaining the reproduction | regeneration of the image displayed on LCD, and the stream of a moving image. It is a flowchart explaining the example of the process of reproduction | regeneration of a stream. It is a flowchart explaining the other example of the process of a display. It is a flowchart explaining the further another example of the process of a display. It is a figure explaining the reproduction | regeneration of the image displayed on LCD, and the stream of a moving image. It is a flowchart explaining the example of the process of reproduction | regeneration of a stream. It is a flowchart explaining the further another example of the process of a display. It is a figure explaining the image displayed on LCD. It is a flowchart explaining the process of the reproduction | regeneration of a stream, or the display of a still image.

Explanation of symbols

  11 digital camera, 35 recording medium, 36 control unit, 39 LCD, 42 GPS signal receiving unit, 81 CPU, 82 RAM, 83 flash ROM, 101 recording control unit, 102 playback control unit, 103 display control unit, 111 property file recording Control unit, 112 thumbnail file recording control unit, 113 metadata file recording control unit, 114 content file recording control unit, 115 timed metadata file recording control unit, 121 timed metadata file generation unit, 131 sample generation unit, 132 moviebox generation unit, 141 search unit, 142 property file playback control unit, 143 thumbnail file playback control unit, 144 metadata file playback control unit, 145 content file playback control unit, 146 timed meta Data file playback control unit, 151 sample playback control unit, 152 moviebox playback control unit, 153 sample specifying unit, 154 time calculation unit

Claims (16)

First recording control means for controlling dynamic metadata related to dynamic content to be recorded in a second directory, a dynamic metafile storing dynamic metadata related to the dynamic content in a predetermined structure;
Second recording for controlling to record in the first directory a static metafile in which static metadata related to the dynamic content or static content is stored in one file with the same structure as the predetermined structure And a recording device. The recording apparatus according to claim 1, wherein the first directory is in a higher hierarchy than the second directory . The recording apparatus according to claim 2, wherein the dynamic metafile includes time or random access information of the dynamic metadata as information for reproducing the dynamic metadata. A third recording control means for controlling recording of a management file storing management information for each of the dynamic content or the static content;
The third recording control means includes, as the management information, first link information indicating a link to the dynamic content or the static content, and the static related to the dynamic content or the static content. The recording apparatus according to claim 3 , wherein recording of the management file storing second link information indicating a link to metadata is controlled under the first directory. The first recording control means controls the recording of the dynamic metafile having the same name except for the name of the content file for reproducing the dynamic content related to the stored dynamic metadata and the extension. The recording apparatus according to claim 4 . The recording apparatus according to claim 5 , wherein display relating to files and directories under the first directory is prohibited. Controlling dynamic metadata related to dynamic content to be recorded in the second directory, a dynamic metafile storing a dynamic metadata for each dynamic content in a predetermined structure;
Recording including controlling to record in a first directory a static metafile in which static content related to the dynamic content or static content is stored in one file with the same structure as the predetermined structure Method. Controlling dynamic metadata related to dynamic content to be recorded in the second directory, a dynamic metafile storing a dynamic metadata for each dynamic content in a predetermined structure;
A step of controlling the computer to record in the first directory a static metafile in which static content related to the dynamic content or static content is stored in one file in the same structure as the predetermined structure The program to be executed. First, which controls dynamic metadata related to dynamic content, the dynamic metadata stored in the second directory having a predetermined structure in the dynamic metafile for each dynamic content. Playback control means;
Static metadata related to the dynamic content or the static content, the static metadata stored in the first directory in a single file with the same structure as the predetermined structure in the static metafile And a second reproduction control means for controlling reproduction. The playback device according to claim 9 , wherein the first directory is in a higher hierarchy than the second directory . The playback device according to claim 10 , wherein the dynamic metafile includes time or random access information of the dynamic metadata as information for playing back the dynamic metadata. A third reproduction control means for controlling reproduction of the management information stored in the management file, which is management information for each of the dynamic contents or the static contents;
The third reproduction control means includes first link information indicating a link to the dynamic content or the static content stored in the management file under the first directory as the management information; The playback apparatus according to claim 11 , wherein playback with second link information indicating a link to the static metadata related to the dynamic content or the static content is controlled. The first reproduction control means relates to the dynamic content stored in the dynamic metafile having the same name as the name of the content file for reproducing the dynamic content and the extension. The playback device according to claim 12 , wherein playback of dynamic metadata is controlled. The playback device according to claim 13 , wherein display relating to files and directories under the first directory is prohibited. Dynamic metadata related to dynamic content, controlling the reproduction of dynamic metadata stored in the second directory in a predetermined structure in the dynamic metafile for each dynamic content;
Static metadata related to the dynamic content or the static content, the static metadata stored in the first directory in a single file with the same structure as the predetermined structure in the static metafile A playback method including a step of controlling playback. Dynamic metadata related to dynamic content, controlling the reproduction of dynamic metadata stored in the second directory in a predetermined structure in the dynamic metafile for each dynamic content;
Static metadata related to the dynamic content or the static content, the static metadata stored in the first directory in a single file with the same structure as the predetermined structure in the static metafile A program that causes a computer to execute steps that control playback.

Images