JP2011244117A - System semiconductor integrated circuit equipped with moving image decorder and method for operating the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To increase chances of normal reproduction of a moving image file by a user in breakage of the moving image file itself in storage media.SOLUTION: External interface accesses the storage media which store the moving image file including a multiplexed stream file of video and sound, and metadata of attribute data. A metadata analyzer 111 of the moving image decoder analyzes the metadata, transfers the stream file to a demultiplexer 112, and encoding signals of video and sound are separated. A video decoder 113 and an audio decoder 114 execute video decoding processing and sound decoding processing. Files to be transferred at once from the metadata analyzer 111 are set to the predetermined size or less, even when an abnormality of the metadata is detected, the stream file is transferred by a plurality of transfer frequencies, and separation processing, the video decoding processing, and the sound decoding processing allow at least the normal reproduction of the moving image file.

Description

  The present invention relates to a system semiconductor integrated circuit equipped with a moving image decoding apparatus and an operation method thereof, and more particularly to increase the chance of normal playback of a moving image file by a user when the moving image file itself stored in a storage medium is damaged. Technology.

  As a data recording format in a video camera, the AVCHD method is widely used. AVCHD is an abbreviation for Advanced Video Codec High Definition, which is a high-definition video recording format that Matsushita Electric Industrial (currently Panasonic) and Sony established basic specifications in May 2006. In order to enable a high-quality moving image recording with a recording capacity of an 8-cm DVD, in the AVCHD format, MPEG-4 (AVC) / H. H.264 (AVC) video compression codec is used, while Dolby AC-3 (Dolby Digital) or linear PCM audio compression codec is used for audio, and MPEG2-TS (transport stream) is used for video and audio multiplexing. It has been adopted.

  The AVCHD system has features that improve functions such as media display, menu navigation, slide show and subtitle. AVCHD menu navigation is similar to DVD video and allows access to individual videos from a common introductory screen. The slide show is generated from an AVC still frame and can be used with a background audio track. The subtitle is used as a time stamp for recording by the video camera.

  The audio, video, subtitle, and additional stream are multiplexed into a single MPEG transport stream and stored as a binary file on the recording medium. In general, memory cards and HDDs use the FAT32 file system, while optical disks use UDF or ISO9660. FAT is an abbreviation for File Allocation Table, UDF is an abbreviation for Universal Disk Format of standard ISO / IEC13346 or standard ECMA-167, and is used for a file system for computer data storage. Used for optical discs.

  At the file system level, the configuration of the AVCHD file system is derived from the Blu-ray Disc (registered trademark) standard, but is not the same.

  Patent Document 1 listed below describes a content storage format as a file system on a recording medium such as Blu-ray Disc (registered trademark) to which a blue laser is applied. This content is divided into moving image content and still image content, and the moving image content has an upper layer index information file, an intermediate layer playlist, and a lower layer clip. The play list in the middle layer includes a plurality of play lists, and the clip in the lower layer includes a plurality of clip information and a plurality of clip AV stream files including AV streams as content actual data. Index information is called up by the playback application, and either a playlist or a menu thumbnail index or a mark thumbnail index of a still image content is selected from the index information according to a user designation.

  One of a plurality of play lists is selected when reproducing the moving image content. The play list includes play items as reproduction target data information. The AV stream as the actual content data is selectively read out by the clip information as the playback section defined by the play item included in the playlist, and the playback of the AV stream is executed. There are a large number of play lists and play items, each of which includes a play list ID and play item ID as identification information. The content of the clip AV stream file is expanded on the time axis, and the playlist designates the access point in the clip mainly by the time stamp. When the playlist indicates an access point into the clip with a time stamp, the clip information file is applied to find address information to start decoding the stream in the clip AV stream file. The still image content includes a thumbnail. The thumbnail is, for example, a still image corresponding to each moving image content. There are two types of thumbnails. One is a menu thumbnail as a representative image for displaying the contents of each content, and this is mainly used on a menu screen for the user to select the moving image content to be viewed by operating the cursor. The other is an image for displaying the scene displayed by the mark, for example, a mark thumbnail composed of thumbnail images of the scene selected by the user.

  On the other hand, Patent Document 2 below describes a data recording format as an AVCHD file system. A content entity part such as AVCHD format shooting data is stored in a stream file (nnnnn.m2ts). This stream file itself is MPEG4-AVC stream (for example, H.264 / AVC stream) encoded data. In the AVCHD format, an index (index.bdmv) file, a movie object (MovieObject.bdmv) file, a playlist (PlayList) file, and a clip information (ClipInformation) file are recorded as reproduction control information other than the content entity data. .

  Furthermore, the following Patent Document 2 also describes the configuration of the root directory of the AVCHD format.

  Directly under the directory [BDMV] is an index file [Index. bdmv] and movie object file [MovieObject. Only two of bdmv] can be arranged. A playlist directory [PLAYLIST], a clip information directory [CLIPINF], and a stream directory [STREAM] are arranged under the BDMV directory [BDMV].

  Index file [Index. bdmv] describes the contents of the directory BDMV. In addition, the movie object file [MovieObject. bdmv] stores information of one or more movie objects.

  The playlist directory [PLAYLIST] includes a playlist file [nnnn. mpls]. Playlist file [nnnnn. mpls] is a file created for each movie play list. In the file name, [. ] (Period) before [nnnnnn] is a 5-digit number, and [mpls] after the period is an extension fixed to this type of file.

  The clip information directory [CLIPINF] includes clip information files [nnnnn. clpi]. In the file name, [. [Nnnnn] before the period] is a five-digit number, and [clpi] after the period is an extension fixed to this type of file.

  The stream directory [STREAM] is a directory in which an AV stream file as an entity is placed. That is, the stream directory [STREAM] includes a clip AV stream file corresponding to each clip information file. The AV stream file is composed of an MPEG4-AVC (for example, H.264 / AVC) transport stream, and the file name is [nnnnn. m2ts]. In the file name, [. ] (Period) before [nnnnn] is the same as the corresponding clip information file, so that the correspondence between the clip information file and this clip AV stream file can be easily grasped.

  On the other hand, Patent Document 3 below does not mention the AVCHD method, but performs error concealment processing for repairing an error mixed in encoded moving image data adopting the moving image compression standard or stops the repair. There is described a moving picture decoding apparatus that selects these based on a time interval from an I frame in which an error occurs to the next incoming I frame.

  According to this moving image decoding apparatus, when the time interval is larger than a predetermined threshold, error concealment processing is performed, and when the time interval is smaller than the predetermined threshold, The error concealment process is disabled, and the skip process is performed until the next I frame.

JP 2006-319954 A JP 2009-104752 A Japanese Patent Laid-Open No. 2008-427569

  Prior to the present invention, the present inventors have developed a system semiconductor integrated circuit incorporating a media processor (moving image decoding apparatus) capable of executing data processing of a nonvolatile memory card storing contents of an AVCHD data recording format. Engaged in.

  In particular, this media processor is downloaded not only through a video file playback function on a mobile communication terminal such as a mobile phone, but also via a removable external non-volatile memory device attached to the mobile communication terminal or the Internet. In addition, a playback function for a moving image file in the AVCHD format data recording format is required. However, it has been clarified that accidental or intentional file corruption occurs in the downloaded moving image file. Accidental file corruption indicates a case in which a moving image file in the external nonvolatile memory device is damaged due to some factor or is damaged during downloading. Intentional file breakage indicates a case where the user is damaged as a result of conscious processing or the like on a normal moving image file.

  Currently, in a commercially available DVD or Blu-ray Disc recording / playback apparatus, it is impossible to play back a moving image file in an AVCHD format data recording format determined to be abnormal due to damage or the like. This means that even when the moving image file is recorded by a device other than the recording / reproducing device, it is impossible to reproduce the moving image file determined to be abnormal.

  On the other hand, in a recording / playback apparatus in which a removable external nonvolatile memory device is mounted, the failure of only the video file itself of the AVCHD format data recording format stored in the memory device is a cause of abnormality. The problem that the recording / playback apparatus recognizes an abnormality in the entire external nonvolatile memory device has also been clarified. Furthermore, it is also clarified that the mobile communication terminal such as a mobile phone may cause a serious operation failure such as a system down or no response to a user operation by recognizing that the entire external nonvolatile memory device is abnormal. It was.

  On the other hand, the moving picture decoding apparatus described in Patent Document 3 selects whether to perform error concealment processing for error repair or to stop based on the time interval from the I frame in which an error has occurred to the next incoming I frame. Therefore, it is impossible to cope with the abnormality determination of the storage medium storing the moving image file of the AVCHD data recording format.

  On the other hand, according to the study by the present inventors prior to the present invention, a moving image file of the AVCHD format data recording format stored in the storage medium is a stream file that is content entity data in which video and audio are multiplexed. The index file, movie object file, playlist file, and clip information file as playback control information other than the above are metadata for stream files that are content entity data, and are usually other than special playback operations such as fast forward and rewind It was clarified that reproduction is not always necessary.

  In other words, the metadata for the content entity data means meta data, that is, data about the data, and is additional attribute information related to the content entity data. For example, in the field of information retrieval, data summarizing entity data to be retrieved is called metadata.

  On the other hand, in the damage of the AVCHD format data recording format moving image file itself stored in a storage medium such as a nonvolatile memory device, the above-mentioned metadata is damaged, but the content entity in which video and audio are multiplexed The stream file that is data may not be damaged. Conventionally, even in such a case, reproduction of a moving image file is impossible and it is determined that the entire storage medium is abnormal. As a result, conventionally, when the moving image file itself is damaged, the user has lost the opportunity of normal reproduction of the moving image file more than necessary.

  The present invention has been made as a result of the examination by the present inventors prior to the present invention as described above.

  Accordingly, an object of the present invention is to increase the chance of normal playback of a moving image file by a user when the moving image file itself stored in the storage medium is damaged.

  The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

  A typical one of the inventions disclosed in the present application will be briefly described as follows.

  That is, a typical embodiment of the present invention is a semiconductor integrated circuit including a moving picture decoding apparatus and an external interface.

  The moving picture decoding apparatus has functions of a metadata analyzer (111), a demultiplexer (112), a video decoder (113), and an audio decoder (114).

  The external interface is connected to the video decoding device and can store a moving image file including a stream file in which video and audio of content entity data are multiplexed and metadata of attribute data related to the content entity data To access the appropriate storage media.

  The metadata analyzer analyzes the metadata of the storage medium and transfers the stream file of the analyzed moving image file to the demultiplexer.

  The demultiplexer performs a process of separating a video encoded signal and an audio encoded signal from the stream file of the moving image file.

  The video decoder executes video decoding processing of the video encoded signal, and the audio decoder executes audio decoding processing of the audio encoded signal.

  In the metadata analyzer, the stream file transferred to the demultiplexer by a single transfer operation is set to a predetermined data size or less, and the stream file of the moving image file is transferred from the metadata analyzer to the demultiplexer. It is transferred to the multiplexer by a plurality of transfer operations.

  Even when the metadata analyzer detects an abnormality in the metadata, the metadata analyzer can transfer the stream file of the moving image file to the demultiplexer by the plurality of transfer operations. .

  The demultiplexer, the video decoder, and the audio decoder are configured to perform the separation process and the video decoding on the stream file of the moving image file that is transferred by the metadata analyzer in the plurality of times of the transfer operation. Each of the process and the voice decoding process can be executed.

  The separation process, the video decoding process, and the audio decoding process performed by the demultiplexer, the video decoder, and the audio decoder in the case where the abnormality is detected can at least normally reproduce the moving image file. It is characterized by that.

  The effects obtained by the representative ones of the inventions disclosed in the present application will be briefly described as follows.

  That is, according to the present invention, when the moving image file itself stored in the storage medium is damaged, the opportunity for normal reproduction of the moving image file by the user can be increased.

FIG. 1 is a diagram showing a configuration of a system semiconductor integrated circuit incorporating a media processor according to Embodiment 1 of the present invention capable of executing data processing of a nonvolatile memory card storing content in an AVCHD data recording format. . FIG. 2 is a diagram showing the structure of the metadata and AV stream file analyzed by the system semiconductor integrated circuit 100 according to the first embodiment of the present invention shown in FIG. FIG. 3 is a diagram showing a detailed configuration of the AV stream file shown in FIG. FIG. 4 is a diagram showing a processing flow for executing the moving image file analysis processing and abnormality check executed by the system semiconductor integrated circuit 100 according to the first embodiment of the present invention shown in FIG. FIG. 5 is a diagram showing a process flow for executing the moving image file analysis process and the abnormality check according to the second embodiment of the present invention executed by the system semiconductor integrated circuit 100 shown in FIG. FIG. 6 is a diagram showing a processing flow for executing the moving image file analysis process and abnormality check according to the third embodiment of the present invention, which is executed by the system semiconductor integrated circuit 100 shown in FIG. FIG. 7 is a diagram showing a configuration of a mobile phone equipped with an application processor as a system semiconductor integrated circuit according to the fourth embodiment of the present invention.

1. First, an outline of a typical embodiment of the invention disclosed in the present application will be described. Reference numerals in the drawings referred to with parentheses in the outline description of the representative embodiments merely exemplify what are included in the concept of the components to which the reference numerals are attached.

  [1] A typical embodiment of the present invention is a semiconductor integrated circuit including a video decoding device and an external interface.

  The moving picture decoding apparatus has a function of a metadata analyzer (111), a function of a demultiplexer (112), a function of a video decoder (113), and a function of an audio decoder (114).

  The external interface is connected to the moving image decoding apparatus, and includes a video file including a stream file in which video and audio as content entity data are multiplexed and metadata as attribute data related to the content entity data. A storage medium that can be stored is accessible.

  The function of the metadata analyzer is to enable the analysis of the metadata of the moving image file that can be stored in the storage medium accessed by the external interface, and to analyze the stream file of the analyzed moving image file. Transfer to the demultiplexer is possible.

  The function of the demultiplexer can execute a separation process of a video encoded signal and an audio encoded signal from the stream file of the moving image file transferred by the function of the metadata analyzer.

  The function of the video decoder is enabled to perform video decoding processing of the video encoded signal separated by the separation processing of the demultiplexer, and the function of the audio decoder is performed by the separation processing of the demultiplexer. It is possible to perform a speech decoding process on the separated speech encoded signal.

  In the function of the metadata analyzer, the stream file transferred to the demultiplexer by one transfer operation after the analysis is set to a predetermined data size or less, and the stream of the moving image file after the analysis The file can be transferred from the metadata analyzer to the demultiplexer by a plurality of transfer operations.

  Even when an abnormality in the metadata is detected by the function of the metadata analyzer (steps S3 and S6), the metadata analyzer extracts the stream file of the video file after the analysis a plurality of times. Transfer to the demultiplexer is enabled by the transfer operation.

  The function of the demultiplexer, the function of the video decoder, and the function of the audio decoder are transferred in the transfer operations of the plurality of times by the function of the metadata analyzer. The separation process, the video decoding process, and the audio decoding process can be performed on the stream file of the moving image file.

  The separation process, the video decoding process, and the audio decoding by the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder in the case where the abnormality of the metadata is detected The processing is characterized in that at least normal reproduction of the moving image file, which is different from special reproduction of fast-forward reproduction and rewind reproduction of the moving image file, is enabled (see FIGS. 1 and 4).

  According to the embodiment, when the moving image file itself stored in the storage medium is damaged, it is possible to increase the chance of normal reproduction of the moving image file by the user.

  In a preferred embodiment, the function of the metadata analyzer checks at least one data of a file size, a file name, a file extension, a time stamp, and attribute information of various information files of the metadata. (Steps S1 and S4), the abnormality of the metadata is detected (see FIG. 4).

  In another preferred embodiment, the separation by the function of the demultiplexer with respect to the stream file transferred by the function of the metadata analyzer in one transfer operation of the plurality of times of the transfer operation. Even if the processing is unsuccessful, the function of the demultiplexer performs the separation processing on the stream file transferred in one transfer operation next to the plurality of transfer operations. (See FIG. 4).

  In still another preferred embodiment, the function of the video decoder relates to the stream file transferred by the function of the metadata analyzer in one transfer operation of the plurality of transfer operations. Even if the video decoding process is unsuccessful, the function of the video decoder performs the video decoding process on the stream file transferred in one transfer operation subsequent to the plurality of transfer operations. (See FIG. 4).

  In still another preferred embodiment, the function of the audio decoder is related to the stream file transferred in one transfer operation of the plurality of transfer operations by the function of the metadata analyzer. Even if the audio decoding process according to the above is unsuccessful, the audio decoder performs the audio decoding process with respect to the stream file transferred in the transfer operation next to the plurality of transfer operations. (See FIG. 4).

  In a more preferred embodiment, when the function of the metadata analyzer detects the abnormality of the metadata by detecting an abnormality of the at least one data of the various information files of the metadata, the abnormality In response to the detection, the fast-forward playback operation and the rewind playback operation of the special playback are prohibited (see FIG. 5).

  In another more preferable embodiment, when the function of the metadata analyzer detects the abnormality of the metadata by detecting the abnormality of the at least one data of the various information files of the metadata. A fast forward point and a rewind point are created from the video encoded signal and the audio encoded signal separated from the stream file of the moving image file by the function of the demultiplexer, and the fast forward point and the rewind point are created. Using the return point, the fast-forward playback operation and the rewind playback operation of the special playback can be performed (see FIG. 6).

  In a specific embodiment, each function of the function of the metadata analyzer, the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder includes hardware, software, It is realized by any of the above.

  In another specific embodiment, the external interface is capable of accessing the AVCHD format moving image file stored in the storage medium.

  In a most specific embodiment, the external interface is made accessible to the AVCHD video file stored in a nonvolatile memory device as the storage medium.

  [2] A typical embodiment of another aspect of the present invention is a method of operating a semiconductor integrated circuit including a moving picture decoding apparatus and an external interface.

  The moving picture decoding apparatus has a function of a metadata analyzer (111), a function of a demultiplexer (112), a function of a video decoder (113), and a function of an audio decoder (114).

  The external interface is connected to the moving image decoding apparatus, and includes a video file including a stream file in which video and audio as content entity data are multiplexed and metadata as attribute data related to the content entity data. A storage medium that can be stored is accessible.

  The function of the metadata analyzer is to enable the analysis of the metadata of the moving image file that can be stored in the storage medium accessed by the external interface, and to analyze the stream file of the analyzed moving image file. Transfer to the demultiplexer is possible.

  The function of the demultiplexer can execute a separation process of a video encoded signal and an audio encoded signal from the stream file of the moving image file transferred by the function of the metadata analyzer.

  The function of the video decoder is enabled to perform video decoding processing of the video encoded signal separated by the separation processing of the demultiplexer, and the function of the audio decoder is performed by the separation processing of the demultiplexer. It is possible to perform a speech decoding process on the separated speech encoded signal.

  In the function of the metadata analyzer, the stream file transferred to the demultiplexer by one transfer operation after the analysis is set to a predetermined data size or less, and the stream of the moving image file after the analysis The file can be transferred from the metadata analyzer to the demultiplexer by a plurality of transfer operations.

  Even when an abnormality in the metadata is detected by the function of the metadata analyzer (steps S3 and S6), the metadata analyzer extracts the stream file of the video file after the analysis a plurality of times. Transfer to the demultiplexer is enabled by the transfer operation.

  The function of the demultiplexer, the function of the video decoder, and the function of the audio decoder are transferred in the transfer operations of the plurality of times by the function of the metadata analyzer. The separation process, the video decoding process, and the audio decoding process can be performed on the stream file of the moving image file.

  The separation process, the video decoding process, and the audio decoding by the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder in the case where the abnormality of the metadata is detected The processing is characterized in that at least normal reproduction of the moving image file, which is different from special reproduction of fast-forward reproduction and rewind reproduction of the moving image file, is enabled (see FIGS. 1 and 4).

  According to the embodiment, when the moving image file itself stored in the storage medium is damaged, it is possible to increase the chance of normal reproduction of the moving image file by the user.

2. Details of Embodiment Next, the embodiment will be described in more detail. In all the drawings for explaining the best mode for carrying out the invention, components having the same functions as those in the above-mentioned drawings are denoted by the same reference numerals, and repeated description thereof is omitted.

[Embodiment 1]
<< Configuration of system semiconductor integrated circuit >>
FIG. 1 is a diagram showing a configuration of a system semiconductor integrated circuit incorporating a media processor according to Embodiment 1 of the present invention capable of executing data processing of a nonvolatile memory card that stores content in an AVCHD data recording format, for example. It is.

  As shown in FIG. 1, the media processor incorporated in the system semiconductor integrated circuit 100 includes a central processing unit (CPU) 110, a metadata analyzer 111, an MPEG transport stream demultiplexer 112, a video decoder 113, and an audio decoder 114. Including. Each function of the metadata analyzer 111, the MPEG transport stream demultiplexer 112, the video decoder 113, and the audio decoder 114 is a hardware core integrated in a semiconductor chip of the system semiconductor integrated circuit 100, respectively. It has been realized.

  The CPU 110 executes overall control of the media processor. That is, according to a recording media / content reproduction control program such as an AVCHD method stored in a non-volatile memory (not shown), the CPU 110 performs a metadata analyzer 111, an MPEG transport stream demultiplexer 112, a video decoder 113, and an audio. Each operation of the decoder 114 is controlled. The signal path 115 is used to transfer an error message from the demultiplexer 112 to the metadata analyzer 111, and the signal path 116 is used to transfer an error message from the video decoder 113 to the metadata analyzer 111. A path 117 transfers an error message from the audio decoder 114 to the metadata analyzer 111.

  A moving image file in a data recording format such as the AVCHD method stored in a removable external nonvolatile memory device attached to a mobile communication terminal such as a mobile phone is supplied to an input terminal of the metadata analyzer 111. Actually, the moving image file is supplied to the input terminal of the metadata analyzer 111 through an external interface that can be connected to the removable external nonvolatile memory device. As will be described in detail below, the metadata analyzer 111 performs analysis processing and abnormality check of each data of the index file, the movie object file, the playlist file, and the clip information file, which are the above-described metadata of the moving image file. Execute.

  The metadata analyzer 111 performs an abnormality check process of a moving image file step by step from the upper layer to the intermediate layer of the metadata hierarchical structure and further from the intermediate layer to the lower layer. That is, the abnormality check process by the metadata analyzer 111 is executed in the order of the index file, movie object file, playlist file, and clip information file. If there is an abnormality in these various information files of metadata, but it is not a serious abnormality, the metadata analyzer 111 performs demultiplexing (demultiplexing) processing of the AV stream file, video decoding processing, and audio. The decoding process is instructed to the MPEG transport stream demultiplexer 112, the video decoder 113, and the audio decoder 114, respectively. Further, even if a minor partial abnormality exists in the MPEG transport stream, it is expected that normal data exists next to that part. Therefore, the MPEG transport stream demultiplexer 112 and the video decoder 113 continue. And the audio decoder 114 continue the demultiplexing process, the video decoding process, and the audio decoding process, and the reproduction operation is continued.

《Metadata and AV stream file configuration》
FIG. 2 is a diagram showing the structure of the metadata and AV stream file analyzed by the system semiconductor integrated circuit 100 according to the first embodiment of the present invention shown in FIG. Note that the arrow Anlyz on the right side of FIG. 2 indicates that the metadata analyzer 111 performs a video file abnormality check process from the upper layer to the middle layer of the metadata, further from the middle layer to the lower layer, and from the lower layer to the AV stream file. It shows the direction to implement step by step.

  As shown in FIG. 2, an index file [Index. bdmv] and movie object file [MovieObject. Only two of bdmv] can be arranged. A playlist directory [PLAYLIST], a clip information directory [CLIPINF], and a stream directory [STREAM] are arranged under the BDMV directory [BDMV]. That is, the metadata Datadata includes a directory [BDMV] and an index file [Index. bdmv] and movie object file [MovieObject. bdmv] and a playlist file [nnnnn.playlist directory [PLAYLIST]. mpls] and clip information file [nnnnn.clip information directory [CLIPINF]. clpi], the AV stream file MPEG_TS includes the clip AV stream file in the stream directory [STREAM].

  Index file [Index. bdmv] describes the contents of the directory BDMV. In addition, the movie object file [MovieObject. bdmv] stores information of one or more movie objects. That is, the index file is a management file that manages the entire medium, manages the titles that can be specified by the user when playing back the content, and manages the correspondence between movie object files (MovieObject) corresponding to the playback program. Is. A movie object (MovieObject) file is a file corresponding to a reproduction program, and is used in accordance with a title selected by a user, and is used for designating a playlist to be used for reproduction.

  The playlist directory [PLAYLIST] includes a playlist file [nnnn. mpls]. Playlist file [nnnnn. mpls] is a file created for each movie play list. In the file name, [. ] (Period) before [nnnnnn] is a 5-digit number, and [mpls] after the period is an extension fixed to this type of file. The play list (PlayList) file is composed of at least one play item, and each play item has a playback start point (IN point) and a playback end point (OUT point) for the clip, thereby specifying the playback section. . By arranging a plurality of play items on the time axis within the playlist, the playback order of each playback section can be specified. In the playlist file, a mark (Mark) indicating a temporal position where the reproduced content exists is set. Generally, a section between marks is called a chapter.

  The clip information directory [CLIPINF] includes clip information files [nnnnn. clpi]. In the file name, [. [Nnnnn] before the period] is a five-digit number, and [clpi] after the period is an extension fixed to this type of file. In the clip information (ClipInformation) file, information on a stream necessary for reproducing an actual stream is described. A file that defines the attributes of the corresponding AV stream in a one-to-one correspondence with the AV stream, and includes, for example, coding, size, time-to-address conversion, reproduction management information, and time map. Furthermore, a set of one clip information (ClipInformation) file and a stream file specified by the clip information (ClipInformation) file is referred to as a clip [Clip].

  The stream directory [STREAM] is a directory in which an AV stream file as an entity is placed. That is, the stream directory [STREAM] includes a clip AV stream file corresponding to each clip information file. The AV stream file is composed of an MPEG4-AVC (for example, H.264 / AVC) transport stream, and the file name is [nnnnn. m2ts]. In the file name, [. ] (Period) before [nnnnn] is the same as the corresponding clip information file, so that the correspondence between the clip information file and this clip AV stream file can be easily grasped. In this clip AV stream file, for example, an MPEG4-AVC stream (for example, H.264 / AVC stream) generated from moving image data shot by a video camera is stored.

<< Detailed structure of AV stream file >>
FIG. 3 is a diagram showing a detailed configuration of the AV stream file shown in FIG.

  As shown in FIG. 3, the AV stream file includes a plurality of packs 30A, 30B, 30C..., And one pack 30A includes a pack header 30AA, a system header 30AB, and a plurality of PES packets 30AC. . PES is an abbreviation for Packetized Elementary Stream.

  A pack header 30AA is added to each pack of the plurality of packs 30A, 30B, 30C..., Followed by reference time information called SCR (System Clock Reference) and a multiplexing bit rate (mux_rate). Is described. A system header 30AB can be added after the pack header 30AA, in which system parameters of the entire stream (bit rate, buffer size, etc. of the individual stream) are described. As described above, since the AV stream file is configured in units of packs, reproduction from the middle of the stream becomes possible.

  The plurality of PES packets 30AC constituting each pack of the plurality of packs 30A, 30B, 30C,... Are obtained by dividing individual streams such as video and audio. The packet header 30AA describes a code (stream_id) for identifying an individual stream and a packet size.

  In MPEG, a reference time called STC (System Time Clock) is defined for synchronously reproducing video and audio. Each video and audio has a unit of decoding / reproduction called an access unit, and time information (in the PES packet header 30AAA) includes a time stamp indicating where to decode and reproduce at a reference time for each unit. PTS: Presentation Time Stamp, DTS: Decoding Time Stamp). The PTS time information is output from the decoder when the STC reference time coincides with the PTS time information at the time of reproducing the access unit. In addition, since the decoding order and the playback order of the MPEG video encoded stream may be different, DTS time information indicating the decoding time is added to the PTS time information. These time stamps enable synchronized playback of video and audio. Further, individual elementary streams 30AAB such as video / audio / additional data are added to the PES packet header 30AAA.

《Video file analysis processing and error check》
FIG. 4 is a diagram showing a processing flow for executing the moving image file analysis processing and abnormality check executed by the system semiconductor integrated circuit 100 according to the first embodiment of the present invention shown in FIG.

《Metadata level analysis processing and error check》
Also, the processes in steps S2, S3, S4, and S5 shown in the upper part of FIG.

  When the processing flow is started in step S0, in the next step S1, the metadata analyzer 111 requires the index file, the movie object file, the playlist file, and the clip information file as the various metadata information files described above. Execute processing to analyze information. These various information files have a prescribed size for each piece of information, and an analysis process is executed according to the prescribed size.

  At the beginning of the analysis process of each information file, it is checked in step S2 whether or not the actual size matches the specified size. As a result of the check, if the actual size does not match the specified size, the subsequent analysis process cannot be continued, and an error message is generated in step S3. This error message notifies the user that a serious error has occurred in the file size analysis processing of various information in steps S1 and S2. As a result of the check in step S2, if it is confirmed that the actual sizes of the various types of information match all the specified sizes, the process proceeds to the next step S4. On the other hand, as described at the beginning, metadata is not necessarily required for normal playback other than special playback operations such as fast forward and rewind. Therefore, in the first embodiment of the present invention, even if a serious error message is generated in step S3, the process proceeds to the next step S4 in order to enable normal playback of moving images.

  In the next step S4, the metadata analyzer 111 executes processing for analyzing the file name and extension combined with various information files, the time stamp, and the video / audio attribute information.

  That is, a prescribed file name is given to these various information files, and analysis processing is executed according to the file name. At the beginning of the analysis process of each information file, it is checked in step S5 whether or not the actual file name matches the specified file name. As a result, if the actual file name does not match the specified file name, it becomes impossible to access the desired file and continue the analysis processing thereafter, and thus a serious error message is generated in step S6. For example, when the file name of the AV stream file is given to the actual file name of any one of the various information files of the metadata described above, access to the desired file becomes impossible. In such a case, an error message is generated in step S6.

  Further, the above-described various information files are given a predetermined extension, and analysis processing is executed according to the extension. When analyzing each information file, it is checked in step S5 whether or not the actual file extension matches the prescribed file extension. If the actual file extension does not match the specified file extension as a result of the check, it becomes impossible to detect the desired file and continue the analysis process thereafter, so a serious error message is generated in step S6. To do.

  In addition, the play item included in the playlist file described above includes a playback start point and a playback end point for the clip. Therefore, the metadata analyzer 111 analyzes these time stamps included in the playlist file. However, if the playback start time is delayed from the playback end time due to the relationship between the playback start point and the playback end point, a normal playback operation is impossible, and a serious error message is displayed in step S6. Generate.

  Further, as described above, the clip information file includes AV stream attribute information. Therefore, the metadata analyzer 111 analyzes the video and audio attribute information included in the clip information file. Therefore, the metadata analyzer 111 analyzes the video and audio attribute information included in the clip information file. However, when the video playback control information and audio playback control information included in the attribute information have higher performance than the specifications of the AVCHD method, etc., or higher performance than the performance of the system semiconductor integrated circuit incorporating the media processor. If the performance is higher than the performance of an electronic device such as a mobile phone equipped with a system semiconductor integrated circuit, a normal reproduction operation is impossible, and a serious error message is displayed in step S6. Generate. The error message in step S6 notifies the user that a serious error has occurred in the analysis process of the file name and extension, time stamp, and video / audio attribute information of the various information files in steps S4 and S5. is there. As a result of the check in step S5, if it is confirmed that no serious error has occurred in the analysis processing of the file name and extension of various information files, the time stamp, and the video / audio attribute information, the lower part of FIG. The processing moves to the analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing of the moving image file at the AV stream file level AVL.

  On the other hand, as described at the beginning, metadata is not necessarily required for normal playback other than special playback operations such as fast forward and rewind. Therefore, in the first embodiment of the present invention, even if a serious error message is generated in step S6, the AV stream file of the moving image file shown in the lower part of FIG. The process proceeds to level AVL analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing.

《V stream file level analysis processing and error check》
If no serious error is detected in the metadata level MDL analysis processing and abnormality check processing shown in the upper part of FIG. 4, steps S7, S8, S11, S13, S14 shown in the lower part of FIG. Then, the process proceeds to the analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing of the moving image file at the AV stream file level AVL in the processing of S16. In this case, the AV stream file level AVL analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing of the moving image file shown in the lower part of FIG. The function and special reproduction operations such as fast forward and rewind are realized.

  On the other hand, when a serious error message is generated in step S3 or step S6 as a result of the analysis process of the metadata level MDL and the abnormality check process shown in the upper part of FIG. AV stream file level AVL analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing of the moving image file in the processing of steps S7, S8, S11, S13, S14, S16 It is transferred to. However, in this case, the AV stream file level AVL analysis processing, demultiplexing (demultiplexing) processing, video decoding processing, audio decoding processing, and abnormality check processing shown in the lower part of FIG. This realizes the playback function. In particular, the one-time processing data size at the AV stream file level AVL is set to be equal to or smaller than the maximum data size uniquely defined by the first embodiment of the present invention.

  This is because, for example, in the system semiconductor integrated circuit 100 shown in FIG. 1, the AV stream file transfer supply from the metadata analyzer 111 to the MPEG transport stream demultiplexer 112 is divided at regular intervals of, for example, 1 second. It can be realized by.

  On the other hand, in the past, AV stream file demultiplexing (demultiplexing) processing was performed by specifying the demultiplexing point by referring to the above-described various information files of the metadata, When various data information files are damaged, the MPEG2-TS (transport stream) itself of the AV stream file is not abnormal, and cannot be reproduced normally. On the other hand, according to the system semiconductor integrated circuit 100 of the first embodiment of the present invention shown in FIG. 1, the MPEG transport stream demultiplexer 112 is sent from the metadata analyzer 111 at regular intervals in step S7 of FIG. Since the demultiplexing (demultiplexing) process can be executed only with the MPEG2-TS (transport stream) of the AV stream file that is divided and supplied in a divided manner, the above-described problem can be solved.

  If the demultiplexing (demultiplexing) processing by the demultiplexer 112 for one AV stream file transferred and supplied during a certain time is successful in step S7 in FIG. 4, as described with reference to FIG. A plurality of access units, which are video and audio decoding and reproduction units, are generated by the demultiplexer 112 and supplied to the video decoder 113 and the audio decoder 114. That is, when the demultiplexer 112 detects the success of the demultiplexing (demultiplexing) process in the check process in step S8 of FIG. 4, a plurality of access units generated by the demultiplexer 112 are connected to the video decoder 113 and the audio. And supplied to the decoder 114.

  On the other hand, even if demultiplexing (demultiplexing) processing by the demultiplexer 112 for one AV stream file is unsuccessful in step S7 in FIG. 112 is determined not to be a serious abnormality, and a demultiplexing (demultiplexing) process of the next AV stream file transferred and supplied from the metadata analyzer 111 is executed in step S7 of FIG. When the AV stream file in this case is normal, the demultiplexing (demultiplexing) process by the demultiplexer 112 of this AV stream file is successful. However, when the AV stream file in this case is damaged, the demultiplexing (demultiplexing) processing of the AV stream file by the demultiplexer 112 becomes unsuccessful again in step S7 in FIG. For example, when the demultiplexer 112 detects that the number of consecutive unsuccessful times of the demultiplexing (demultiplexing) process of step S7 in the check process of step S8 of FIG. 4 exceeds a predetermined value, the process proceeds to step S9. Generate an error message. This error message notifies the user that the number of consecutive unsuccessful times of the demultiplexing (demultiplexing) process in step S7 has exceeded a predetermined value.

  In the next step S10 in FIG. 4, the video decoding process and the audio decoding process in the video decoder 113 and the audio decoder 114 of the access unit generated by the demultiplexer 112 are executed. In this decoding process, preferably, the video decoding process in the video decoder 113 of the video access unit and the audio decoding process in the audio decoder 114 of the audio access unit are processed in parallel. If the video decoding process and the audio decoding process are successful in step S10 for one AV stream file transferred and supplied from the metadata analyzer 111 to the demultiplexer 112 during a predetermined time, the video decoding signal and the audio decoding process are performed. A signal is generated from the video decoder 113 and the audio decoder 114 and supplied to a video output device (not shown) and an audio decoder (not shown).

  On the other hand, the video decoding process and the audio decoding process by the video decoder 113 and the audio decoder 114 of the video access unit and the audio access unit for one time are shown in FIG. Even if unsuccessful in step S10, the video decoder 113 and the audio decoder 114 determine that there is no serious abnormality, and the next one video access unit and audio access unit transferred from the demultiplexer 112 are supplied. The video decoding process and the audio decoding process are executed in step S10 of FIG. In this case, when the video access unit and the audio access unit are normal, the video decoding process and the audio decoding process of the video access unit and the audio access unit are successful. However, if the access unit in this case is damaged, the video decoding process and the audio decoding process of the video access unit and the audio access unit are again unsuccessful in step S10 of FIG. For example, the video decoder 113 and the audio decoder 114 detect that the number of consecutive unsuccessful times of the video decoding process and the audio decoding process of step S10 exceeds a predetermined value in the check process of step S11 of FIG. In step S12, a serious error message is generated. This error message notifies the user that the number of consecutive unsuccessful times of the video decoding process and the audio decoding process in step S10 has exceeded a predetermined value.

  In the next step S13 of FIG. 4, video output processing and audio output processing of video output signals and audio output signals in a video output device (not shown) and an audio output device (not shown) are executed. If the video output process and the audio output process have succeeded in step S13 for one AV stream file transferred and supplied from the metadata analyzer 111 to the demultiplexer 112 during a certain time, the video output apparatus and the audio output A video output signal and an audio output signal are generated from the apparatus.

  On the other hand, even if video output processing and audio output processing by the video output device and audio output device for one AV stream file are unsuccessful in step S13 in FIG. 4, the video output device and audio output device are not seriously abnormal. Video output processing and audio output processing by the video output device and audio output device of the next video decoding signal and audio decoding signal transferred and supplied from the video decoder 113 and audio decoder 114 are shown in FIG. 4 is executed in step S13. In this case, when the video decoding signal and the audio decoding signal are normal, the video output processing and the audio output processing by the video output device and the audio output device are successful. However, if the video decoding signal and the audio decoding signal in this case are damaged, the video output processing and the audio output processing by the video output device and the audio output device are again unsuccessful in step S13 of FIG. For example, when the video output device and the audio output device detect that the number of consecutive unsuccessful times of the video output processing and the audio output processing in step S13 exceeds a predetermined value in the check processing in step S14 of FIG. In step S15, a serious error message is generated. This error message notifies the user that the number of consecutive unsuccessful video output processes and audio output processes in step S14 has exceeded a predetermined value.

  In the next step S16 in FIG. 4, it is determined whether or not the reproduction of all the video access units and audio access units included in one moving image content to be reproduced has been completed. If NO is determined in step S16, the process returns to the demultiplexing (demultiplexing) process in step S7. On the other hand, if YES is determined in step S16, the process flow ends in step S17.

[Embodiment 2]
<< Analysis Processing and Abnormality Check of Video File of Embodiment 2 >>
FIG. 5 is a diagram showing a process flow for executing the moving image file analysis process and the abnormality check according to the second embodiment of the present invention executed by the system semiconductor integrated circuit 100 shown in FIG.

  The processing flow for executing the moving image file analysis processing and abnormality check according to the second embodiment of the present invention shown in FIG. 5 is different from the processing flow according to the first embodiment of the present invention shown in FIG. The following points.

  That is, in the processing flow according to the second embodiment of the present invention shown in FIG. 5, step S5 for checking the file name or the like of the analysis processing of the metadata level MDL and the demultiplexing (demultiplexing of the AV stream file level AVL analysis processing). The operation mode selection step S18 is added between the processing step S7, and the fast forward step S19 and the rewinding step S20 are further added. Note that the analysis processing, demultiplexing (demultiplexing) processing, and video decoding processing of the moving image file at the AV stream file level AVL in the processing of steps S7, S8, S11, S13, S14, and S16 shown in the lower part of FIG. The voice decoding process and the abnormality check process realize the normal playback function. Therefore, in the processing flow shown in FIG. 5, the user can arbitrarily select the normal playback function, the fast-forward function, and the rewind function using the operation mode selection step S18.

  Further, in the processing flow according to the second embodiment of the present invention shown in FIG. 5, the serious error message generated in step S3 of the AV stream file level AVL analysis processing and the serious error message generated in step S5 are shown. In response, an inhibition signal INHB is generated. That is, in the processing flow shown in FIG. 5, the prohibition signal INHB generated in response to either the critical error message generated in step S3 or the critical error message generated in step S6 is a fast-forward step. The fast-forward function in S19 and the rewind function in step S20 of rewind are set to the operation stop state. Therefore, in the processing flow shown in FIG. 5, only when a serious error message is not generated from either step S3 or step S6, the fast-forward function of fast-forward step S19 and the rewind function of rewind step S20 are performed. Can be set in an operable state.

[Embodiment 3]
<< Analysis Processing and Abnormality Check of Video File of Embodiment 3 >>
FIG. 6 is a diagram showing a processing flow for executing the moving image file analysis process and abnormality check according to the third embodiment of the present invention, which is executed by the system semiconductor integrated circuit 100 shown in FIG.

  The processing flow for executing the moving image file analysis processing and abnormality check according to the third embodiment of the present invention shown in FIG. 6 is different from the processing flow according to the first embodiment of the present invention shown in FIG. The following points.

  That is, in the processing flow according to the third embodiment of the present invention shown in FIG. 6, step S5 for checking the file name or the like of the analysis processing of the metadata level MDL and the demultiplexing (demultiplexing of the analysis processing of the AV stream file level AVL). The operation mode selection step S18 is added between the processing step S7, and the fast forward step S19, the rewind step S20, and the fast forward point and the rewind point generation step S21 are added. It has been done. Note that the analysis processing, demultiplexing (demultiplexing) processing, and video of the moving image file at the AV stream file level AVL in steps S7, S8, S21, S11, S13, S14, and S16 shown in the lower part of FIG. The decoding process, the audio decoding process, and the abnormality check process realize a normal reproduction function. Accordingly, in the processing flow shown in FIG. 6, the user can arbitrarily select the normal reproduction function, the fast forward function, and the rewind function by using the operation mode selection step S18.

  Furthermore, in the processing flow according to the third embodiment of the present invention shown in FIG. 6, the demultiplexing (demultiplexing) processing by the demultiplexer 112 for one AV stream file transferred and supplied during a predetermined time is performed in step S7. If successful, the demultiplexer 112 generates a plurality of access units, which are video and audio decoding and playback units. The media processor built in the system semiconductor integrated circuit 100 shown in FIG. 1 uses the video and audio access unit generated by the success of the demultiplexing process in step S21 shown in FIG. Create and store fast-forward / rewind points independently.

  In other words, in the process of storing points, the various information files of the original metadata are referred to, and if there is a difference from the originally created points, the original metadata is treated as damaged and the original fast-forwarding / winding is performed. A return point is created in step S21. Conventionally, when various information files of original metadata are damaged, the fast forward / rewind function cannot be executed. On the other hand, the processing flow according to the third embodiment of the present invention shown in FIG. 6 is generated by successful demultiplexing (demultiplexing) processing even when various information files of the original metadata are damaged. A fast-forward function and a rewind function are realized by using a video and audio access unit. That is, the fast forward / rewind point created in step S21 is used for the fast forward function in step 19 and the rewind function in step S20.

[Embodiment 4]
《Mobile phone with application processor》
FIG. 7 is a diagram showing a configuration of a mobile phone equipped with an application processor as a system semiconductor integrated circuit according to the fourth embodiment of the present invention.

  7 includes an antenna 4, a duplexer 5, an RF analog signal processing integrated circuit 6, an RF power amplifier 7, a baseband processor 8, and an application processor 3 in order to realize the functions of the mobile phone. .

  In addition, the cellular phone shown in FIG. 7 has a rod antenna 1 and a one-segment digital terrestrial broadcast in order to allow one-segment (hereinafter referred to as one-segment) terrestrial digital broadcast to be viewed and recorded on an external nonvolatile semiconductor storage device. / A tuner module 2 and an application processor 3 are included. The one-seg terrestrial digital broadcast / tuner module 2 is an ISDB-T reception tuner module that receives a terrestrial digital one-seg broadcast. ISDB-T is an abbreviation for Integrated Services Digital Broadcasting-Terrestrial.

  Further, the LCD display device 16 connected to the application processor 3 and the audio integrated circuit 9 connected to the baseband processor 8 are used for enabling the function of a mobile phone and viewing of one-segment digital terrestrial broadcasting. Is done.

  Although not shown, an operation device having operation keys and operation buttons is connected to the application processor 3, and the end user operates the operation device to view and make reservations for telephone calls and one-seg terrestrial digital broadcasting. Recording is possible.

《Mobile phone functions》
When the end user operates the operation device, a mobile phone call is started. The RF reception signal from the base station received by the antenna 4 is supplied to the reception signal processing unit inside the RFIC 6 via the duplexer 5. The RF reception signal is down-converted to an analog reception baseband signal by the reception signal processing unit of the RFIC 6, and the analog reception baseband signal is converted into a digital reception baseband signal by an A / D converter (not shown) inside the RFIC 6. .

  A digital reception baseband signal supplied from an A / D converter (not shown) of the RFIC 6 is subjected to demodulated signal processing by the baseband processor 8, and received voice output by D / A conversion by the D / A converter 82. A signal is generated. The received audio output signal is amplified by the audio IC 9 and then supplied to the speaker 10.

  The transmission audio input signal of the microphone 11 is amplified by the audio IC 9 and then converted into a digital signal by A / D conversion by the A / D converter 83 of the baseband processor 8, and further the modulation signal processing of the baseband processor 8 is performed. Then, it is converted into a digital transmission baseband signal. This digital transmission baseband signal is converted into an analog transmission baseband signal by D / A conversion by a D / A converter (not shown) of the RFIC 6, and the analog transmission baseband signal is RF-transmitted by the reception signal processing unit of the RFIC 6. Upconverted to signal. The RF transmission signal is amplified by the RF power amplifier 7 and then transmitted to the base station via the duplexer 5 and the antenna 4.

  An application processor 3 as a semiconductor integrated circuit according to the fourth embodiment of the present invention is connected to the one-segment digital terrestrial broadcasting / tuner module 2, the baseband processor 8, and the audio IC 9.

<Application processor configuration>
The application processor 3 includes a central processing unit (CPU) 31, an external memory interface unit 32, a media processor 33, and an LCD controller 34.

  The CPU 31 includes a CPU core 311, an instruction cache memory 312, a data cache memory 313, and a built-in SRAM 314.

  The external memory interface unit 32 is connected to a first external memory interface 322 connected to a flash memory as the first external nonvolatile semiconductor storage device 12 and a synchronous dynamic random access memory as the first external volatile storage device 13. A second external memory interface 323 is included.

  The flash memory 12 can store operating system (OS) software for the basic operation of a mobile phone as a mobile terminal, and the SDRAM 13 can be used for the operation of the mobile phone and for watching and watching one-segment terrestrial digital broadcasting. Various data of the receiver that enables recording can be stored.

  The external memory interface unit 32 is further inserted into a third external memory interface 324 connected to a flash memory as the second external nonvolatile semiconductor memory device 14 and a mobile phone as a mobile terminal as the extended external nonvolatile semiconductor memory device 15. An extended external memory interface 325 connected to the connected flash memory card is included.

  The flash memory 14 can store software of various application programs of a mobile phone and a one-seg terrestrial digital broadcast receiver that can be constructed on the OS stored in the flash memory 12. The flash memory card 15 can store various data and contents that the end user designates non-volatile storage and stores in a non-volatile manner in relation to the operation of the mobile phone and the one-segment terrestrial digital broadcast receiver.

  The media processor 33 includes a transport stream input interface 331, an AVCHD decoder 332, and an audio interface 333. In particular, the AVCHD decoder 332 incorporated in the media processor 33 adopts or executes any one of the configurations and operations from the first embodiment to the third embodiment of the present invention described above.

  The transport stream TS from the one-segment digital terrestrial broadcasting / tuner module 2 includes digital information of the digital broadcasting program received by the module 2 and multiplexed, and includes video information, audio information, and accompanying transmission information in MPEG4 compression format. Yes. The accompanying information includes an event information table in which start time, program length, program name, performer, program genre, and the like are described for each program as program identification information or program arrangement information.

《Viewing 1Seg digital terrestrial broadcast programs》
Before viewing, a one-segment digital terrestrial broadcast program can be selected by the end user operating the operation device while viewing the display of the event information table on the LCD display device 16.

  The viewing of the one-seg terrestrial digital broadcast program is made possible by execution of the broadcast program viewing program, which is one of the application programs that can be constructed on the storage OS of the flash memory 12, by the application processor 3. In response to the broadcast program viewing setting, the CPU 31 of the application processor 3 instructs the one-segment digital terrestrial broadcast / tuner module 2 to receive a transport stream of the one-segment digital terrestrial broadcast program selected for viewing.

  The transport stream TS of the one seg terrestrial digital broadcast that has been received by the selection of the program is supplied from the one seg terrestrial digital broadcast / tuner module 2 to the AVCHD decoder 332 via the transport stream input interface 331. The AVCHD decoder 332 performs video decoding processing of the transport stream TS, the decoded video data is supplied to the LCD display device 16 via the LCD controller 34, and the decoded audio data is supplied to the speaker 10 via the audio interface 333 and the audio IC 9. To be supplied. In this way, the end user can view a one-segment terrestrial digital broadcast program.

《One-segment digital terrestrial broadcast recording to external non-volatile semiconductor storage device》
Reserving recording of one-segment digital terrestrial broadcasting to an external non-volatile semiconductor storage device is one-segment digital terrestrial broadcasting in which reservation recording is performed by operating an operation device by an end user while viewing an event information table displayed on the LCD display device It becomes possible by determining the program. This one-seg terrestrial digital broadcast reservation recording is also made possible by the application processor 3 executing a reservation recording program, which is one of the application programs that can be constructed on the OS stored in the flash memory 12.

  When the recording reservation is set, by using a watchdog timer (not shown) of the CPU core 311 of the CPU 31 of the application processor 3 that is executing the program, it is possible to know the arrival of the start time of the program for which the recording reservation is set. it can.

  When the start time of the program for which the recording reservation is set is reached, the CPU 31 starts the reception of the one-segment terrestrial digital broadcast of the program for which the recording reservation is set in the one-segment terrestrial digital broadcasting / tuner module 2 and inputs TS to the transport stream input interface 331. Instructs the start of data reception. At the same time, the CPU 31 instructs the transport stream input interface 331 to start nonvolatile storage in the flash memory card 15 via the extended external memory interface 325 of the transport stream of the program for which recording reservation is set. With the start of non-volatile storage in the flash memory card 15, the reservation recording operation is started.

  After the reserved recording operation is started, the end time of the program for which recording reservation is set is set in a watch dock timer (not shown) of the CPU core 311 of the CPU 31 of the application processor 3 by executing the program. The program end time is calculated by adding the start time of the event information table and the program length by the CPU 31. After reaching the end time of the program for which the recording reservation is set, the CPU 31 completes reception of the one-segment terrestrial digital broadcast of the program for which the recording reservation is set in the one-segment terrestrial digital broadcasting / tuner module 2 and the transport stream input interface 331. To end the reception of TS data. At the same time, the CPU 31 instructs the transport stream input interface 331 to end the nonvolatile storage of the write data to the flash memory card 15 via the extended external memory interface 325.

  Further, after the scheduled recording is completed, the flash memory card 15 is pulled out from the extended external memory interface 325 and inserted into a memory slot of a personal computer or the like outside the mobile phone, thereby using a large display screen of a personal computer or the like. You can watch videos.

  As mentioned above, the invention made by the present inventor has been specifically described based on various embodiments. However, the present invention is not limited thereto, and various modifications can be made without departing from the scope of the invention. Needless to say.

  For example, in the media processor built in the system semiconductor integrated circuit 100 as shown in FIG. 1, the functions of the metadata analyzer 111, the MPEG transport stream demultiplexer 112, the video decoder 113, and the audio decoder 114 are as follows. In addition to being realized as a hardware core integrated on a semiconductor chip, it can also be realized by a software core executed by the CPU 110.

  Furthermore, for example, the data recording format that can be processed by the system semiconductor integrated circuit equipped with the moving picture decoding apparatus of the present invention and the operation method thereof is not limited to the AVCHD system, but by a layer structure called a track. It is possible to use QuickTime files provided by Apple Inc., including text tracks, chapter tracks, etc., as well as moving images and audio, and can also be applied to files such as MP4.

  Further, in the mobile phone shown in FIG. 7, the baseband processor 8 and the application processor 3 can be integrated in a single integrated single-chip ultra large-scale semiconductor integrated circuit.

DESCRIPTION OF SYMBOLS 100 ... System semiconductor integrated circuit 110 ... CPU
111 ... Metadata analyzer 112 ... Demultiplexer 113 ... Video decoder 114 ... Audio decoder

Claims (20)

A semiconductor integrated circuit comprising a video decoding device and an external interface,
The moving picture decoding apparatus has a metadata analyzer function, a demultiplexer function, a video decoder function, and an audio decoder function,
The external interface is connected to the moving image decoding apparatus, and includes a video file including a stream file in which video and audio as content entity data are multiplexed and metadata as attribute data related to the content entity data. Storage media that can be stored is accessible,
The function of the metadata analyzer is to enable the analysis of the metadata of the moving image file that can be stored in the storage medium accessed by the external interface, and to analyze the stream file of the analyzed moving image file. Transferable to the demultiplexer;
The function of the demultiplexer can execute a separation process of a video encoded signal and an audio encoded signal from the stream file of the moving image file transferred by the function of the metadata analyzer.
The function of the video decoder is enabled to perform video decoding processing of the video encoded signal separated by the separation processing of the demultiplexer, and the function of the audio decoder is performed by the separation processing of the demultiplexer. Enabling speech decoding processing of the separated speech encoded signal;
In the function of the metadata analyzer, the stream file transferred to the demultiplexer by one transfer operation after the analysis is set to a predetermined data size or less, and the stream of the moving image file after the analysis The file can be transferred from the metadata analyzer to the demultiplexer by a plurality of transfer operations.
Even when an abnormality in the metadata is detected by the function of the metadata analyzer, the metadata analyzer can perform the transfer operation for the plurality of times of the stream file of the video file after the analysis. Can be transferred to the multiplexer,
The function of the demultiplexer, the function of the video decoder, and the function of the audio decoder are transferred in the transfer operations of the plurality of times by the function of the metadata analyzer. And the separation process, the video decoding process, and the audio decoding process can be performed on the stream file of the video file,
The separation process, the video decoding process, and the audio decoding by the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder in the case where the abnormality of the metadata is detected The processing is a semiconductor integrated circuit characterized in that at least normal reproduction of the moving image file, which is different from special reproduction of fast-forward reproduction and rewind reproduction of the moving image file, is enabled. In claim 1,
The function of the metadata analyzer is to check at least one data of a file size, a file name, a file extension, a time stamp, and attribute information of various information files of the metadata, thereby A semiconductor integrated circuit characterized by detecting an abnormality. In claim 2,
Regarding the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer, even if the separation process by the function of the demultiplexer is unsuccessful, The semiconductor integrated circuit according to claim 1, wherein the function of the demultiplexer executes the separation processing on the stream file transferred in one transfer operation next to the transfer operations of the plurality of times. In claim 3,
The video decoding process by the function of the video decoder is unsuccessful with respect to the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer. Further, the function of the video decoder is to perform the video decoding process on the stream file transferred in one transfer operation subsequent to the plurality of transfer operations. In claim 4,
The audio decoding process by the function of the audio decoder is unsuccessful with respect to the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer. Further, the function of the audio decoder is to perform the audio decoding process on the stream file transferred in one transfer operation next to the transfer operations of the plurality of times. In claim 5,
When the function of the metadata analyzer detects the abnormality of the metadata by detecting an abnormality of the at least one data of the various information files of the metadata, the special reproduction is performed in response to the abnormality detection. The semiconductor integrated circuit, wherein the fast forward reproduction operation and the rewind reproduction operation are prohibited. In claim 5,
When the function of the metadata analyzer detects the abnormality of the metadata by detecting the abnormality of the at least one data of the various information files of the metadata, the function of the demultiplexer A fast-forward point and a rewind point are created from the video encoded signal and the audio encoded signal separated from the stream file of the file, and the special reproduction is performed using the fast-forward point and the rewind point. The semiconductor integrated circuit, wherein the fast forward reproduction operation and the rewind reproduction operation are enabled. In claim 5,
Each function of the function of the metadata analyzer, the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder is realized by either hardware or software. A semiconductor integrated circuit. In claim 8,
The semiconductor integrated circuit according to claim 1, wherein the external interface is capable of accessing the AVCHD video file stored in the storage medium. In claim 8,
2. The semiconductor integrated circuit according to claim 1, wherein the external interface is capable of accessing the AVCHD video file stored in a nonvolatile memory device as the storage medium. A method for operating a semiconductor integrated circuit comprising a video decoding device and an external interface,
The moving picture decoding apparatus has a metadata analyzer function, a demultiplexer function, a video decoder function, and an audio decoder function,
The external interface is connected to the moving image decoding apparatus, and includes a video file including a stream file in which video and audio as content entity data are multiplexed and metadata as attribute data related to the content entity data. Storage media that can be stored is accessible,
The function of the metadata analyzer is to enable the analysis of the metadata of the moving image file that can be stored in the storage medium accessed by the external interface, and to analyze the stream file of the analyzed moving image file. Transferable to the demultiplexer;
The function of the demultiplexer can execute a separation process of a video encoded signal and an audio encoded signal from the stream file of the moving image file transferred by the function of the metadata analyzer.
The function of the video decoder is enabled to perform video decoding processing of the video encoded signal separated by the separation processing of the demultiplexer, and the function of the audio decoder is performed by the separation processing of the demultiplexer. Enabling speech decoding processing of the separated speech encoded signal;
In the function of the metadata analyzer, the stream file transferred to the demultiplexer by one transfer operation after the analysis is set to a predetermined data size or less, and the stream of the moving image file after the analysis The file can be transferred from the metadata analyzer to the demultiplexer by a plurality of transfer operations.
Even when an abnormality in the metadata is detected by the function of the metadata analyzer, the metadata analyzer can perform the transfer operation for the plurality of times of the stream file of the video file after the analysis. Can be transferred to the multiplexer,
The function of the demultiplexer, the function of the video decoder, and the function of the audio decoder are transferred in the transfer operations of the plurality of times by the function of the metadata analyzer. And the separation process, the video decoding process, and the audio decoding process can be performed on the stream file of the video file,
The separation process, the video decoding process, and the audio decoding by the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder in the case where the abnormality of the metadata is detected The processing is an operation method of a semiconductor integrated circuit, characterized in that at least normal reproduction of the moving image file, which is different from special reproduction of fast-forward reproduction and rewind reproduction of the moving image file, is enabled. In claim 11,
The function of the metadata analyzer is to check at least one data of a file size, a file name, a file extension, a time stamp, and attribute information of various information files of the metadata, thereby An operation method of a semiconductor integrated circuit, wherein abnormality is detected. In claim 12,
Regarding the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer, even if the separation process by the function of the demultiplexer is unsuccessful, 2. The semiconductor integrated circuit operating method according to claim 1, wherein the function of the demultiplexer executes the separation processing on the stream file transferred in one transfer operation after the plurality of transfer operations. In claim 13,
The video decoding process by the function of the video decoder is unsuccessful with respect to the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer. In the semiconductor integrated circuit, the function of the video decoder is to execute the video decoding process on the stream file transferred in one transfer operation after the transfer operation of the plurality of times. How it works. In claim 14,
The audio decoding process by the function of the audio decoder is unsuccessful with respect to the stream file transferred by the transfer operation of the plurality of times by the function of the metadata analyzer. The function of the audio decoder is to perform the audio decoding process on the stream file transferred in one transfer operation after the plurality of transfer operations. How it works. In claim 15,
When the function of the metadata analyzer detects the abnormality of the metadata by detecting an abnormality of the at least one data of the various information files of the metadata, the special reproduction is performed in response to the abnormality detection. A method of operating a semiconductor integrated circuit, wherein the fast forward reproduction operation and the rewind reproduction operation are prohibited. In claim 15,
When the function of the metadata analyzer detects the abnormality of the metadata by detecting the abnormality of the at least one data of the various information files of the metadata, the function of the demultiplexer A fast-forward point and a rewind point are created from the video encoded signal and the audio encoded signal separated from the stream file of the file, and the special reproduction is performed using the fast-forward point and the rewind point. An operation method of a semiconductor integrated circuit, wherein the fast forward reproduction operation and the rewind reproduction operation are enabled. In claim 15,
Each function of the function of the metadata analyzer, the function of the demultiplexer, the function of the video decoder, and the function of the audio decoder is realized by either hardware or software. A method for operating a semiconductor integrated circuit. In claim 18,
The method of operating a semiconductor integrated circuit, wherein the external interface is capable of accessing the AVCHD video file stored in the storage medium. In claim 18,
A method of operating a semiconductor integrated circuit, wherein the external interface is made accessible to the AVCHD video file stored in a nonvolatile memory device as the storage medium.

Images